Multifocal plane based method to produce stereoscopic viewpoints in a DIBR system (MFP-DIBR)

1. A method comprising:

generating a plurality of focal plane images using a description of three-dimensional (3D) content;

arranging the plurality of focal plane images in space;

receiving information indicating head movement of a user relative to a real world environment;

responsive to receiving the information indicating head movement of the user, synthesizing motion parallax by shifting and rotating one or more of the plurality of focal plane images in order to generate views for the user, the views comprising motion parallax information, wherein rotating one or more of the plurality of focal plane images comprises rotating one or more of the plurality of focal plane images relative to a fixed origin; and

displaying the plurality of focal plane images shifted and rotated to generate the views for the user.

2. The method of claim 1 , wherein displaying the plurality of focal plane images is performed by a multi-focal plane (MFP) display.

3. The method of claim 1 , wherein shifting and rotating one or more of the plurality of focal plane images provides stereo disparity between left and right eyes.

4. The method of claim 1 , wherein rotating one or more of the plurality of focal plane images comprises rotating a disparity vector for one or more of the focal plane images in relation to a disparity vector parallel to a horizon.

5. The method of claim 1 , further comprising processing the plurality of focal plane images to reduce image disparities caused by rotating one or more of the plurality of focal plane images.

6. The method of claim 1 , wherein shifting one or more of the plurality of focal plane images comprises scaling a disparity vector for the respective one or more focal plane images.

7. The method of claim 1 , wherein shifting one or more of the plurality of focal plane images comprises moving one or more of the plurality of focal plane images by an offset relative to the fixed origin.

8. The method of claim 1 , further comprising processing the plurality of focal plane images to reduce image disparities caused by shifting the focal plane images.

9. The method of claim 8 , wherein processing the plurality of focal plane images comprises filtering one or more of the focal plane images.

10. The method of claim 8 , wherein processing the plurality of focal plane images comprises:

determining depth blending weights for at least one of the plurality of focal plane images; and

generating at least one of the plurality of focal plane images using the respective depth blending weights.

11. The method of claim 10 , wherein generating at least one of the plurality of focal plane images comprises multiplying at least one of a plurality of textures by the respective depth blending weights.

12. The method of claim 1 , wherein displaying the plurality of focal plane images comprises combining shifted focal plane images to generate a stereoscopic image pair.

13. The method of claim 1 , further comprising measuring motion tracking sensor readings of a position of the user relative to the real-world environment to determine the head movement of the user.

14. The method of claim 13 ,

wherein synthesizing motion parallax comprises spatially scaling one or more of the plurality of focal plane images relative to each other using the determined head movement of the user, and

wherein the determined head movement of the user indicates axial motion.

15. The method of claim 1 , further comprising:

obtaining an input image from the description of the 3D content;

filtering the input image for low frequency content; and

redistributing the low frequency content from the filtered input image to the plurality of focal plane images.

16. The method of claim 1 , further comprising:

obtaining an input image from the description of the 3D content;

filtering the input image for high frequency content; and

decomposing the high frequency content from the filtered input image to the plurality of focal plane images.

17. A device comprising:

a processor; and

a non-transitory computer-readable medium storing instructions operative, when executed by the processor, to cause the device to:

generate a plurality of focal plane images using a description of three-dimensional (3D) content;

arrange the plurality of focal plane images in space;

receive information indicating head movement of a user relative to a real world environment;

responsive to receiving the information indicating head movement of the user, synthesize motion parallax by shifting and rotating one or more of the plurality of focal plane images in order to generate views for the user, the views comprising motion parallax information, wherein rotating one or more of the plurality of focal plane images comprises rotating one or more of the plurality of focal plane images relative to a fixed origin; and

display the plurality of focal plane images shifted and rotated to generate the views for the user.

18. A method comprising:

generating a plurality of focal plane images using a description of three-dimensional (3D) content;

receiving, from a tracker, information indicating motion of a viewer relative to a real-world environment;

responsive to receiving the information indicating motion of the viewer, synthesizing motion parallax by shifting and rotating one or more of the plurality of focal plane images in order to generate views for the viewer, the views comprising motion parallax information, wherein rotating one or more of the plurality of focal plane images comprises rotating one or more of the plurality of focal plane images relative to a fixed origin; and

rendering an image to a multi-focal plane (MFP) display using the shifted and rotated focal plane images.

19. The method of claim 1 , wherein displaying the plurality of focal plane images is performed by a two-dimensional (2D) display.

20. The method of claim 18 , wherein shifting and rotating one or more of the plurality of focal plane images provides stereo disparity between left and right eyes.

21. The method of claim 18 , wherein rotating one or more of the plurality of focal plane images comprises rotating a disparity vector for one or more of the focal plane images in relation to a disparity vector parallel to a horizon.

22. The method of claim 18 , wherein shifting one or more of the plurality of focal plane images comprises moving one or more of the plurality of focal plane images by an offset relative to the fixed origin.

23. The method of claim 18 , wherein rendering the image to the multi-focal plane (MFP) display comprises combining shifted focal plane images to generate a stereoscopic image pair.

24. The method of claim 18 , further comprising measuring motion tracking sensor readings of a position of the viewer relative to the real-world environment to determine the motion of the viewer.

25. The method of claim 24 ,

wherein synthesizing motion parallax comprises spatially scaling one or more of the plurality of focal plane images relative to each other using the determined motion of the viewer, and

wherein the determined motion of the viewer indicates axial motion.

26. An apparatus comprising:

a processor; and

a non-transitory computer-readable medium storing instructions operative, when executed by the processor, to cause the device to:

generate a plurality of focal plane images using a description of three-dimensional (3D) content;

receive, from a tracker, information indicating motion of a viewer relative to a real-world environment;

responsive to receiving the information indicating motion of the viewer, synthesize motion parallax by shifting and rotating one or more of the plurality of focal plane images in order to generate views for the viewer, the views comprising motion parallax information,

wherein rotating one or more of the plurality of focal plane images comprises rotating one or more of the plurality of focal plane images relative to a fixed origin; and

render an image to a multi-focal plane (MFP) display using the shifted and rotated focal plane images.

27. The apparatus of claim 26 , further comprising the multi-focal plane (MFP) display.