METHODS AND APPARATUS FOR PROVIDING IN-LOOP PADDING TECHNIQUES FOR ROTATED SPHERE PROJECTIONS
Apparatus and methods for providing in-loop padding techniques for projection formats, such as, Rotated Sphere Projections (RSP). In one embodiment, methods and apparatus for the encoding of video data is disclosed, the video data includes a projection format that has redundant data, the apparatus and methods include obtaining a frame of video data, the frame of video data including reduced quality areas within the frame of video data; transmitting the obtained frame of the video data to a reconstruction engine; reconstructing the reduced quality areas to nearly original quality within the frame by using other portions of the frame of video data in order to construct a high fidelity frame of video data; storing the high fidelity frame of video data within a reference picture list; and using the high fidelity frame of video data stored within the reference picture list for encoding of subsequent frames of the video data. Methods and apparatus for the decoding of encoded video data are also disclosed.
1 . A method for encoding video data, the video data comprising a projection format that includes redundant data, the method comprising:
obtaining a frame of video data, the frame of video data comprising reduced quality areas within the frame of video data;
transmitting the obtained frame of the video data to a reconstruction engine;
reconstructing the reduced quality areas to nearly original quality within the frame by using other portions of the frame of video data in order to construct a high fidelity frame of video data;
storing the high fidelity frame of video data within a reference picture list; and
using the high fidelity frame of video data stored within the reference picture list for encoding of subsequent frames of the video data.
2 . The method of claim 1 , wherein the using of the other portions of the frame of video data comprises using original quality areas within the frame of video data.
3 . The method of claim 2 , further comprising generating the reduced quality areas within the frame of video data, the generating further comprising rendering the reduced quality areas with inactive pixels.
4 . The method of claim 2 , further comprising generating the reduced quality areas within the frame of video data, the generating further comprising aggressively quantizing the reduced quality areas within the frame of video data.
5 . The method of claim 2 , wherein the reconstructing of the reduced quality areas to nearly original quality further comprises:
applying a geometric rotation to an area within the original quality areas within the frame of video data; and
translating the geometrically rotated area to a reduced quality area within the reduced quality areas within the frame of video data.
6 . A computing device, the computing device comprising:
a signal generation device, the signal generation device configured to capture a plurality of frames of video data;
a processing unit configured to process the plurality of frames of the video data; and
a non-transitory computer-readable storage apparatus, the computer-readable storage apparatus comprising a storage medium comprising computer-readable instructions, the computer-readable instructions being configured to, when executed by the processing unit:
obtain a frame of video data, the frame of video data comprising reduced quality areas within the frame of video data;
cause transmission of the obtained frame of the video data to a reconstruction engine;
reconstruct the reduced quality areas to nearly original quality within the frame of video data via use of other portions of the frame of video data in order to construct a high fidelity frame of video data;
store the high fidelity frame of video data within a reference picture list; and
use the high fidelity frame of video data stored within the reference picture list for encode of subsequent frames of the video data.
7 . The computing device of claim 6 , wherein the signal generation device is further configured to capture panoramic content, the captured panoramic content comprising a 360° field of view (FOV).
8 . The computing device of claim 7 , further comprising additional computer-readable instructions, the additional computer-readable instructions being configured to, when executed by the processing unit:
generate the frame of video data, the generated frame of video data comprising a rotated sphere projection (RSP) projection format.
9 . The computing device of claim 8 , further comprising additional computer-readable instructions, the additional computer-readable instructions being configured to, when executed by the processing unit:
generate the reduced quality areas within the RSP projection format, the generated reduced quality areas utilized to decrease a transmission bitrate for the captured plurality of frames of video data as compared with a transmission of the captured plurality of frames of video data without the reduced quality areas.
10 . The computing device of claim 9 , wherein the generation of the reduced quality areas within the RSP projection format comprises a generation of inactive pixels for the reduced quality areas within the RSP projection format.
11 . The computing device of claim 9 , wherein the generation of the reduced quality areas within the RSP projection format comprises an application of aggressive quantization for the reduced quality areas within the RSP projection format.
12 . The computing device of claim 6 , wherein the use of the other portions of the frame of video data comprises a use of original quality areas within the frame of video data.
13 . The computing device of claim 12 , wherein the reconstruction of the reduced quality areas to nearly original quality further comprises:
application of a geometric rotation to an area within the original quality areas within the frame of video data; and
translation of the geometrically rotated area to a reduced quality area within the reduced quality areas within the frame of video data.
14 . The computing device of claim 6 , further comprising additional computer-readable instructions, the additional computer-readable instructions being configured to, when executed by the processing unit:
receive an encoded frame of video data, the encoded frame of video data comprising a reduced quality version of a pre-encoded version of the frame of video data;
retrieve one or more other frames of video data from a decoded picture buffer, the one or more other frames of video data comprising nearly original quality versions of previously decoded frames;
reconstruct the encoded received frame of video data to nearly original quality using the retrieved one or more other frames of video data; and
store the reconstructed frame of video data to the decoded picture buffer.
15 . The computing device of claim 14 , wherein the storage of the reconstructed frame of video data to the decoded picture buffer enables decode of subsequent encoded frames.
16 . A method for decoding video data, the video data comprising a projection format that includes redundant data, the method comprising:
receiving an encoded frame of video data, the encoded frame of video data comprising a reduced quality version of a pre-encoded version of the frame of video data;
retrieving one or more other frames of video data from a reference picture list, the one or more other frames of video data comprising nearly original quality versions of previously decoded frames;
reconstructing the encoded received frame of video data to nearly original quality using the retrieved one or more other frames of video data; and
storing the reconstructed frame of video data to the reference picture list.
17 . The method of claim 16 , wherein the receiving of the encoded frame of video data comprises receiving an encoded frame of video data according to a rotated sphere projection (RSP) projection format.
18 . The method of claim 17 , further comprising using the stored reconstructed frame of video data for the decoding of subsequent frames of encoded video data.
19 . The method of claim 16 , wherein the reconstructing of the encoded received frame of video data further comprises:
applying a geometric rotation to an area within the retrieved one or more other frames of video data; and
translating the geometrically rotated area to a reduced quality area within the received encoded frame of video data.
20 . The method of claim 19 , further comprising using the stored reconstructed frame of video data for the decoding of subsequent frames of encoded video data.