3D video encoding and decoding methods and apparatus
Methods and apparatus relating to encoding and decoding stereoscopic (3D) image data, e.g., left and right eye images, are described. Various pre-encoding and post-decoding operations are described in conjunction with difference based encoding and decoding techniques. In some embodiments left and right eye image data is subject to scaling, transform operation(s) and cropping prior to encoding. In addition, in some embodiments decoded left and right eye image data is subject to scaling, transform operations(s) and filling operations prior to being output to a display device. Transform information and/or scaling information may be included in a bitstream communicating encoded left and right eye images. The amount of scaling can be the same for an entire scene and/or program.
1. A method of operating a content playback device, comprising:
receiving geometric recovery data corresponding to a stereoscopic frame pair;
receiving an encoded left eye image of the stereoscopic frame pair;
receiving an encoded right eye image of the stereoscopic frame pair;
decoding the encoded left eye image of the stereoscopic frame pair to produce a decoded left eye image;
scaling said decoded left eye image to generate a scaled decoded left eye image; and
performing an inverse left eye transform on said scaled decoded left eye image to generate a left eye output image, wherein performing an inverse left eye transform includes performing both: i) a shift in a direction and amount which is based on received left eye transform information and ii) a first fill operation;
decoding said encoded right eye image of the stereoscopic frame pair to produce a decoded right eye image;
scaling said decoded right eye image to generate a scaled decoded right eye image;
performing an inverse right eye transform on said scaled decoded right eye image to generate a right eye output image, wherein performing an inverse right eye transform includes performing both: i) a shift in a direction and amount which is based on received right eye transform information and ii) a second fill operation; and
wherein said scaling of said decoded left eye image and said decoded right eye image is by a first amount, said first amount being an amount indicated by said geometric recovery data, said geometric recovery data being received: i) with at least one of said encoded left eye image and said encoded right eye image or ii) prior to said encoded left and right eye images being received.
2. The method of claim 1 ,
wherein scaling said decoded left eye image includes scaling the decoded left eye image in accordance with a scaling factor indicated in said geometric recovery data to reduce the size of the decoded left eye image.
3. The method of claim 1 , further comprising:
transmitting said left and right eye output images to a display device.
4. The method of claim 3 ,
wherein said left eye output image is the same size as said encoded left eye image, and
wherein said right eye output image is the same size as said encoded right eye image.
5. The method of claim 4 , wherein said encoded left eye image is the same size as said encoded right eye image.
6. The method of claim 2 ,
wherein performing an inverse left eye transform further includes:
performing a preliminary inverse left eye transform operation prior to performing said first fill operation; and
wherein performing an inverse right eye transform further includes:
performing a preliminary inverse right eye transform operation prior to performing said second fill operation.
7. The method of claim 5 , wherein said preliminary inverse left eye transform operation includes one of: a null transform, shifting transform, anamorphic scaling transform, keystone transform or warping transform.
8. An apparatus configured to process encoded stereoscopic image data the apparatus comprising:
a processor configured to:
receive geometric recovery data corresponding to a stereoscopic frame pair;
receive an encoded left eye image of the stereoscopic frame pair;
receive an encoded right eye image of the stereoscopic frame pair;
decode said encoded left eye image of the stereoscopic frame pair to produce a decoded left eye image;
scale said decoded left eye images to generate a scaled decoded left eye image;
perform an inverse left eye transform on said scaled decoded left eye image to generate a left eye output image, wherein performing an inverse left eye transform includes performing both: i) a shift in a direction and amount which is based on received left eye transform information and ii) a first fill operation;
decode said encoded right eye image of the stereoscopic frame pair to produce a decoded right eye image;
scale said decoded right eye image to generate a scaled decoded right eye image;
perform an inverse right eye transform on said scaled decoded right eye image to generate a right eye output image, wherein performing an inverse right eye transform includes performing both: i) a shift in a direction and amount which is based on received right eye transform information and ii) a second fill operation; and
wherein said scaling of said decoded left eye image and said decoded right eye image is by a first amount, said first amount being an amount indicated by said geometric recovery data, said geometric recovery data being received: i) with at least one of said encoded left eye image and said encoded right eye image or ii) prior to said encoded left and right eye images being received; and
a memory coupled to said processor.
9. A playback device comprising:
a receiver configured to receive i) geometric recovery data corresponding to a stereoscopic frame pair, ii) an encoded left eye image of the stereoscopic frame pair, and iii) an encoded right eye image of the stereoscopic frame pair; and
a processor configured to control the playback device to:
decode said encoded left eye image to produce a decoded left eye image;
scale said decoded left eye images to generate a scaled decoded left eye image; and
perform an inverse left eye transform on said scaled decoded left eye image to generate a left eye output image, wherein performing an inverse left eye transform includes performing both: i) a shift in a direction and amount which is based on received left eye transform information and ii) a first fill operation;
decode said encoded right eye image of the stereoscopic frame pair to produce a decoded right eye image;
scale said decoded right eye image to generate a scaled decoded right eye image;
perform an inverse right eye transform on said scaled decoded right eye image to generate a right eye output image, wherein performing an inverse right eye transform includes performing both: i) a shift in a direction and amount which is based on received right eye transform information and ii) a second fill operation; and
wherein said scaling of said decoded left eye image and said decoded right eye image is by a first amount, said first amount being an amount indicated by said geometric recovery data, said geometric recovery data being received: i) with at least one of said encoded left eye image and said encoded right eye image or ii) prior to said encoded left and right eye images being received.
10. The playback device of claim 9 , wherein the geometric recovery data includes scaling information and image shift information.
11. The playback device of 10 , wherein the processor is configured to: shift the decoded left eye image by an amount indicated by received information as part of performing an inverse left eye transform.
12. The playback device of claim 9 , wherein said geometric recovery data indicates a scaling factor to be used to scale the decoded left eye image to generate a smaller scaled version of said decoded left eye image.
13. The method of claim 1 , wherein the inverse right eye transform includes a shift in a direction which is different from the direction of the shift performed as part of the inverse left eye transform.