VIDEO ENCODING QUALITY THROUGH THE USE OF ONCAMERA SENSOR INFORMATION
Systems and methods for utilizing on-camera sensor information to improve video and/or image encoding quality are discussed herein. Specifically, the systems and methods described herein may utilize on-camera sensor information to adaptively adjust an intra frame insertion rate associated with a sequence of frames. The intra frame insertion rate associated with a sequence of frames may be adjusted based on the motion of the image capturing device while capturing the sequence of frames and a predefined motion threshold associated with the intra frame insertion rate of the sequence of frames. In some implementations, the intra frame insertion rate may be adjusted based on the activity being performed during the capture of the sequence of frames. As such, the encoding of one or more frames within a sequence of frames may be adaptively adjusted to better suit the scene depicted by the sequence of frames.
1 . A system that adaptively encodes a sequence of frames based on sensor information obtained from an image capturing device, the system comprising:
one or more physical computer processors configured by computer readable instructions to:
obtain video information related to video content, the video content comprising a plurality of frames captured in a sequence by an image capturing device, wherein the plurality of frames comprise a sequence of frames comprising at least a first frame captured at a first time and a second frame captured at a second time;
determine an intra frame insertion rate associated with the sequence of frames, wherein the intra frame insertion rate identifies a frequency of intra frames within a predefined number of frames, the first frame encoded as an intra frame and the second frame being within the predefined number of frames of the first frame;
obtain a predefined motion threshold;
obtain motion information characterizing first motion of the image capturing device between the first time and the second time, wherein the motion information is generated by one or more motion sensors associated with the image capturing device; and
encode the plurality of frames in accordance with the intra frame insertion rate unless the motion of the image capture device exceeds the predefined motion threshold such that:
the second frame is encoded as the inter frame based on the first motion of the image capturing device not exceeding the predefined motion threshold;
the second frame is encoded as the intra frame based on the first motion of the image capturing device exceeding the predefined motion threshold; and
frames captured subsequent to the second frame is encoded in accordance with the intra frame insertion rate unless the motion of the image capture device exceeds the predefined motion threshold.
2 . The system of claim 1 , wherein the first frame and the second frame are adjacent frames within the sequence of frames.
3 . The system of claim 1 , wherein the one or more motion sensors include one or more of an inertial measurement unit, a GPS component, an accelerometer, a gyroscope, an altimeter, and/or a distance measurement sensor.
4 . The system of claim 1 , wherein the motion information characterizing motion of the image capturing device includes one or more of zoom, translational motion, rotational motion, vertical motion, horizontal motion, acceleration motion, and/or deceleration motion.
5 . (canceled)
6 . The system of claim 1 , wherein the predefined motion threshold is associated with the intra frame insertion rate.
7 . The system of claim 1 , wherein the one or more physical computer processors are further configured to:
obtain an identification of an activity being performed during capture of the sequence of frames, wherein the second frame is encoded as an intra frame based on the identified activity.
8 . The system of claim 7 , wherein to obtain the identification of the activity being performed during capture of the sequence of frames, the one or more physical processors are further configured to:
obtain one or more predefined activity profiles associated with one or more activities, wherein the one or more predefined activity profiles comprise predefined motion information characterizing the one or more activities;
compare the motion information characterizing the motion of the image capturing device with the predefined motion information; and
determine a match between the motion information and predefined motion information characterizing at least one of the one or more activities.
9 . The system of claim 7 , wherein to encode the second frame as an intra frame based on the identified activity, the one or more physical processors are further configured to:
obtain a predefined activity profile associated with the identified activity, wherein the predefined activity profile comprises a predefined intra frame insertion rate; and
determine the intra frame insertion rate as the predefined intra frame insertion rate.
10 . (canceled)
11 . A method of adaptively encoding a sequence of frames based on sensor information obtained from an image capturing device, the method comprising:
obtaining video information related to video content, the video content comprising a plurality of frames captured in a sequence by an image capturing device, wherein the plurality of frames comprise a sequence of frames comprising at least a first frame captured at a first time and a second frame captured at a second time;
determining an intra frame insertion rate associated with the sequence of frames, wherein the intra frame insertion rate identifies a frequency of intra frames within a predefined number of frames, the first frame encoded as an intra frame and the second frame being within the predefined number of frames of the first frame;
obtaining a predefined motion threshold;
obtaining motion information characterizing first motion of the image capturing device between the first time and the second time, wherein the motion information is generated by one or more motion sensors associated with the image capturing device; and
encoding the plurality of frames in accordance with the intra frame insertion rate unless the motion of the image capture device exceeds the predefined motion threshold such that:
the second frame is encoded as the inter frame based on the first motion of the image capturing device not exceeding the predefined motion threshold;
the second frame is encoded as the intra frame based on the first motion of the image capturing device exceeding the predefined motion threshold; and
frames captured subsequent to the second frame is encoded in accordance with the intra frame insertion rate unless the motion of the image capture device exceeds the predefined motion threshold.
12 . The method of claim 11 , wherein the first frame and the second frame are adjacent frames within the sequence of frames.
13 . The method of claim 11 , wherein the one or more motion sensors include one or more of an inertial measurement unit, a GPS component, an accelerometer, a gyroscope, an altimeter, and/or a distance measurement sensor.
14 . The method of claim 11 , wherein the motion information characterizing motion of the image capturing device includes one or more of zoom, translational motion, rotational motion, vertical motion, horizontal motion, acceleration motion, and/or deceleration motion.
15 . (canceled)
16 . The method of claim 11 , wherein the predefined motion threshold is associated with the intra frame insertion rate.
17 . The method of claim 11 , the method further comprising:
obtaining an identification of an activity being performed during capture of the sequence of frames, wherein the second frame is encoded as an intra frame based on the identified activity.
18 . The method of claim 17 , wherein obtaining the identification of the activity being performed during capture of the sequence of frames comprises:
obtaining one or more predefined activity profiles associated with one or more activities, wherein the one or more predefined activity profiles comprise predefined motion information characterizing the one or more activities;
comparing the motion information characterizing the motion of the image capturing device with the predefined motion information; and
determining a match between the motion information and predefined motion information characterizing at least one of the one or more activities.
19 . The method of claim 17 , wherein encoding the second frame as an intra frame based on the identified activity comprises:
obtaining a predefined activity profile associated with the identified activity, wherein the predefined activity profile comprises a predefined intra frame insertion rate; and
determining the intra frame insertion rate as the predefined intra frame insertion rate.
20 . (canceled)
21 . The system of claim 1 , wherein the first frame and the second frame are non-adjacent frames within the sequence of frames.
22 . The method of claim 11 , wherein the first frame and the second frame are non-adjacent frames within the sequence of frames.