Systems and methods for reducing a number of focal planes used to display three-dimensional objects
Systems and methods for reducing a number of focal planes used to display a three-dimensional object are disclosed herein. In an embodiment, data defining a three-dimensional image according to a first plurality of focal planes are received. Pixel luminance values from the first plurality of focal planes are mapped to a second plurality of focal planes comprising fewer focal planes than the first plurality of focal planes. Data is stored identifying initial focal distances of the mapped pixel luminance values in the first plurality of focal planes. The second plurality of focal planes are then displayed on a near eye device which uses the data identifying initial focal distances of the mapped pixel luminance values to adjust a wavelength of light produced by the second plurality of images to cause the pixels to appear at their original focal distances.
1. A method comprising:
accessing a plurality of pairs of pixels for at least three focal planes inlcuding a front plane and a back plane, wherein each pair of pixels represents a voxel located between two of the at least three focal planes;
for each pair of pixels, generating a new pixel pair defining a new voxel, wherein the new voxel is located in one of: a position between the back plane and the front plane, a position on the back plane, or a position on the front plane;
generating on a 2D display a first image based on the back plane and a second image based on the front plane, wherein the 2D display periodically switches between display of the first image and display of the second image;
adjusting, by a spatial light modulator (SLM), light produced by the display of the first image and light produced by the display of the second image, wherein the adjustment is based on the plurality of pairs of pixels for the at least three focal planes; and
generating for display a 3D image based on light adjusted by the SLM.
2. The method of claim 1 , wherein the generating the new pixel pair defining the new voxel comprises:
identifying a first voxel, which is positioned between a first focal plane and a second focal plane of the at least three planes;
identifying a second voxel, which is located between the second focal plane and a third focal plane of the at least three planes;
identifying a first pair of two pixels of the first voxel wherein the first pair of two pixels have non-zero luminance values and are correlated in space through a depth blending algorithm;
identifying a second pair of two pixels of the second voxel wherein the second pair of two pixels have non-zero luminance values and are correlated in space through a depth blending algorithm;
mapping the first pair of two pixels to a first position between the back plane and the front plane based on non-zero luminance values of the first pair of two pixels; and
mapping the second pair of two pixels to a second position between the back plane and the front plane based on non-zero luminance values of the second pair of two pixels.
3. The method of claim 2 , further comprising recording, by the SLM, a distance of the first voxel to the new voxel position as a step function.
4. The method of claim 1 , wherein the generating of the new respective pixel pair defining the new respective voxel comprises performing a depth blending algorithm.
5. The method of claim 1 , wherein the adjusting by the SLM the light produced by the display of the first image and the light produced by the display of the second image comprises configuring the SLM to switch axial adjustment of the new voxels in time with the switching of the 2D display between the display of the first image and the display of the second image.
6. The method of claim 5 , further comprising adjusting by the SLM the light produced by display of the first image and the light produced by the display of the second image utilizes diffractive optics.
7. The method of claim 6 , further comprising applying an error-correction mechanism to mitigate aberrations and distortion in the 3D image resulting from the adjustment made by the SLM.
8. The method of claim 1 , wherein the adjusting by the SLM the light produced by the display of the first image and the light produced by the display of the second image comprises imparting by the SLM, specific phase shifts, to the light produced by the display of the first image and the light produced by the display of the second image.
9. The method of claim 1 , wherein the adjusting by the SLM the light produced by the display of the first image and the light produced by the display of the second image comprises adding by the SLM, quadratic terms, by a multifocal off-axis Fresnel lens of the SLM, to a wavefront produced by the display of the first image and a wavefront produced by the display of the second image.
10. The method of claim 1 , wherein the accessing the plurality of pairs of pixels for the at least three focal planes comprises receiving a first plurality of focal planes created through depth-blending techniques.
11. A system comprising:
input/output circuitry configured to:
receive data defining a three-dimensional image according to a first plurality of focal planes;
control circuitry configured to:
generate a new respective pixel pair defining a new respective voxel, wherein the new respective voxel is located in one of: a position between a back plane and a front plane, a position on the back plane, or a position on the front plane;
generate on a 2D display a first image based on the back plane and a second image based on the front plane, wherein the 2D display periodically switches between display of the first image and display of the second image;
a spatial light modulator (SLM) configured to:
adjust light produced by the display of the first image and light produced by the display of the second image, wherein the adjustment is based on a plurality of pairs of pixels for at least three focal planes; and
an eyepiece configured:
generate for display a 3D image based on light adjusted by the SLM.
12. The system of claim 11 , wherein the control circuitry is further configured to generate the new respective pixel pair defining the new respective voxel by:
identifying a first voxel, which is positioned between a first focal plane and a second focal plane of the at least three planes;
identifying a second voxel, which is located between the second focal plane and a third focal plane of the at least three planes;
identifying a first pair of two pixels of the first voxel wherein the first pair of two pixels have non-zero luminance values and are correlated in space through a depth blending algorithm;
identifying a second pair of two pixels of the second voxel wherein the second pair of two pixels have non-zero luminance values and are correlated in space through a depth blending algorithm;
mapping the first pair of two pixels to a first position between the back plane and the front plane based on respective non-zero luminance values of the first pair of two pixels; and
mapping the second pair of two pixels to a second position between the back plane and the front plane based on respective non-zero luminance values of the second pair of two pixels.
13. The system of claim 12 , wherein the control circuitry is further configured to:
record a distance of the first voxel to the new voxel position and register it as a step function by the SLM.
14. The system of claim 11 , wherein the control circuitry is further configured to:
generate the new respective pixel pair defining the new respective voxel by performing depth blending algorithm.
15. The system of claim 11 , wherein the control circuitry is further configured to:
adjust the light produced by the display of the first image and the light produced by the display of the second image by switching axial adjustment of new voxels in time with the switching of 2D display between the display of the first image and the display of the second image by further adjusting the SLM.
16. The system of claim 11 , wherein the control circuitry is further configured to:
adjust the light produced by the display of the first image and the light produced by the display of the second image by imparting by the SLM, specific phase shifts onto the light produced by the display of the first image and the light produced by the display of the second image by further adjusting the SLM.
17. The system of claim 11 , wherein the control circuitry is further configured to:
adjust light produced by the display of the first image and the light produced by the display of the second image by adding the SLM, quadratic terms, by a multifocal off-axis Fresnel lens of the SLM, to a wavefront produced by the display of the first image and a wavefront produced by the display of the second image by further adjusting the SLM.
18. The system of claim 11 , wherein the control circuitry is further configured to:
adjust the light produced by display of the first image and the light produced by the display of the second image by utilizing diffractive optics for the SLM.
19. The system of claim 18 , wherein the control circuitry is further configured to:
apply an error-correction mechanism to mitigate aberrations and distortion in the 3D image resulting by further adjusting the SLM.
20. The system of claim 11 , wherein the control circuitry is further configured to:
access the plurality of pairs of pixels for the at least three focal planes by receiving a first plurality of focal planes created through depth-blending techniques.