SYSTEMS AND METHODS FOR PROVIDING CONTENT DURING REDUCED STREAMING QUALITY
Systems and methods are described herein for providing content during reduced streaming quality. Data streaming is susceptible to degradation in quality that adversely affects the delivery of content. For example, sufficient reduction in streaming quality can cause video and audio portions of a data stream to become unsynchronized. The system compares currently streamed video frames to previously received video frames to identify suitable replacement video frames for the currently streamed video frames in the event that the currently streamed video frames are affected by the sufficiently reduced streaming quality.
1 . (canceled)
2 . A method for pre-downloading and replacing video frames in a content item, comprising:
identifying sets of video frames for the content item, wherein the sets of video frames include identified scenes mapped to other video frames within the content item;
pre-downloading the sets of video frames to a device before streaming the content item to the device; and
replacing video frames affected by streaming quality reduction with the pre-downloaded video frames at the beginning of a scene.
3 . The method of claim 2 , comprising:
pre-processing the content item to identify replacement sets of video frames for each scene before causing the content item to be displayed or streamed to the device.
4 . The method of claim 3 , wherein the pre-processing includes:
selecting replacement video frames by determining which scenes depict an actor who is either silent or making minimal lip movements to ensure synchronized audio and video playback.
5 . The method of claim 4 , comprising:
using audio processing to identify video frames accompanied by audio of an actor performing spoken dialogue; and
using image processing to determine which of the identified video frames do not depict the actor performing the spoken dialogue.
6 . The method of claim 5 , wherein the image processing includes:
selecting video frames in which another actor is making minimal lip movements for replacement.
7 . The method of claim 3 , wherein the pre-processing includes:
choosing sets of video frames based at least in part on a longest duration of consecutive video frames, wherein a first set of video frames having a longer duration is chosen over a second set with a shorter duration.
8 . The method of claim 3 , comprising:
selecting multiple sets of video frames for each scene or each video frame in a scene, wherein the multiple sets include a first set of video frames with an actor directly facing a camera and a second set of video frames with a side view of another actor that obscures lip movements.
9 . The method of claim 2 , comprising packaging metadata for mapping video frame sets.
10 . The method of claim 2 , comprising:
packaging the replaced video frames into a package;
storing the package as part of metadata of the content item; and
identifying the replaced video frames by time segment tags, scene number, or any suitable identification mark to map a set of video frames to at least one other video frame.
11 . The method of claim 10 , comprising:
generating a data structure or pointer linking data of the replaced video frames associated with a first camera angle to a time segment associated with a video frame at a second camera angle;
causing the package to be received by the device before the content item is streamed, based at least in part on network bandwidth availability or device storage capacity; and
receiving portions of the package when network bandwidth or storage capacity is sufficient.
12 . A system for pre-downloading and replacing video frames in a content item, comprising:
a content application configured to identify sets of video frames for the content item, wherein the sets of video frames include identified scenes mapped to other video frames within the content item;
a device configured to pre-download the sets of video frames before streaming the content item; and
the content application configured to replace video frames affected by streaming quality reduction with the pre-downloaded video frames at the beginning of a scene.
13 . The system of claim 12 , wherein the content application is configured to:
pre-process the content item to identify replacement sets of video frames for each scene before causing the content item to be displayed or streamed to the device.
14 . The system of claim 13 , wherein the content application is configured to:
select replacement video frames by determining which scenes depict an actor who is either silent or making minimal lip movements to ensure synchronized audio and video playback.
15 . The system of claim 14 , wherein the content application is configured to:
use audio processing to identify video frames accompanied by audio of an actor performing spoken dialogue; and
use image processing to determine which of the identified video frames do not depict the actor performing the spoken dialogue.
16 . The system of claim 15 , wherein the image processing includes:
selecting video frames in which another actor is making minimal lip movements for replacement.
17 . The system of claim 13 , wherein the content application is configured to:
choose sets of video frames based at least in part on a longest duration of consecutive video frames, wherein a first set of video frames having a longer duration is chosen over a second set with a shorter duration.
18 . The system of claim 13 , wherein the content application is configured to:
select multiple sets of video frames for each scene or each video frame in a scene, wherein the multiple sets include a first set of video frames with an actor directly facing a camera and a second set of video frames with a side view of another actor that obscures lip movements.
19 . The system of claim 12 , wherein the content application is configured to:
package metadata for mapping video frame sets.
20 . The system of claim 12 , wherein the content application is configured to:
package the replaced video frames into a package;
store the package as part of metadata of the content item; and
identify the replaced video frames by time segment tags, scene number, or any suitable identification mark to map a set of video frames to at least one other video frame.
21 . The system of claim 20 , wherein the content application is configured to:
generate a data structure or pointer linking data of the replaced video frames associated with a first camera angle to a time segment associated with a video frame at a second camera angle;
cause the package to be received by the device before the content item is streamed, based at least in part on network bandwidth availability or device storage capacity; and
receive portions of the package when network bandwidth or storage capacity is sufficient.