Dual composite light field device
An apparatus is disclosed for capturing image information. The apparatus includes a waveguide having opposed planar input and output faces. A diffractive optical element (DOE) is formed across the waveguide. The DOE is configured to couple a portion of the light passing through the waveguide into the waveguide. The light coupled into the waveguide is directed via total internal reflection to an exit location on the waveguide. The apparatus further includes a light sensor having an input positioned adjacent the exit location of the waveguide to capture light exiting therefrom and generate output signals corresponding thereto. A processor determines the angle and position of the coupled light with respect to the input face of the waveguide based on the output signals.
1. An apparatus comprising:
one or more processors;
a wearable head device comprising:
a transmissive display comprising:
a waveguide having an input surface and an output surface, the output surface having an exit location; and
a diffractive optical element (DOE) formed across the waveguide, the DOE configured to couple input light into the input surface of the waveguide and to direct the input light via total internal reflection to the exit location; and
a light sensor configured to receive the input light via the waveguide and to generate a sensor output signal based on the received input light,
wherein:
the one or more processors are configured to generate an output based on the sensor output signal, the output comprising a rectilinear array of pixel values,
the sensor output signal comprises one or more incoming pixel values, and
generating the output comprises determining a first pixel value of the rectilinear array of pixel values, based on the one or more incoming pixel values of the sensor output signal.
2. The apparatus of claim 1 , wherein the one or more processors are further configured to adjust an angle and a position of the light sensor with respect to the exit location.
3. The apparatus of claim 1 , wherein the one or more incoming pixel values comprise one or more pixel values in polar form and the rectilinear array of pixel values comprises one or more pixel values in rectangular form.
4. The apparatus of claim 1 , wherein generating the output further comprises determining a second pixel value of the rectilinear array, based on a closest pixel value of the rectilinear array for which there is a corresponding incoming pixel value.
5. The apparatus of claim 4 , wherein generating the output further comprises determining the second pixel value by performing an interpolation with respect to the closest pixel value.
6. The apparatus of claim 1 , wherein generating the output further comprises precomputing a relationship between the rectilinear array of pixel values and the incoming pixel values.
7. The apparatus of claim 1 , wherein the output is provided as input to an image processor.
8. A method comprising:
receiving, at a light sensor, input light coupled into an input surface of a waveguide of a transmissive display and directed via total internal reflection to an exit location of an output surface of the waveguide;
receiving, from the light sensor, a sensor output signal based on the received input light, the sensor output signal comprising one or more incoming pixel values; and
generating an output based on the sensor output signal, the output comprising a rectilinear array of pixel values;
wherein:
generating the output comprises determining a first pixel value of the rectilinear array of pixel values, based on the one or more incoming pixel values of the sensor output signal.
9. The method of claim 8 , further comprising adjusting an angle and a position of the light sensor with respect to the exit location.
10. The method of claim 8 , wherein the one or more incoming pixel values comprise one or more pixel values in polar form and the rectilinear array of pixel values comprises one or more pixel values in rectangular form.
11. The method of claim 8 , wherein generating the output further comprises determining a second pixel value of the rectilinear array, based on a closest pixel value of the rectilinear array for which there is a corresponding incoming pixel value.
12. The method of claim 11 , wherein generating the output further comprises determining the second pixel value by performing an interpolation with respect to the closest pixel value.
13. The method of claim 8 , wherein generating the output further comprises precomputing a relationship between the rectilinear array of pixel values and the incoming pixel values.
14. The method of claim 8 , further comprising providing the output as input to an image processor.
15. A non-transitory computer-readable medium storing instructions which, when executed by one or more processors, cause the one or more processors to perform a method comprising:
receiving, at a light sensor, input light coupled into an input surface of a waveguide of a transmissive display and directed via total internal reflection to an exit location of an output surface of the waveguide;
receiving, from the light sensor, a sensor output signal based on the received input light, the sensor output signal comprising one or more incoming pixel values; and
generating an output based on the sensor output signal, the output comprising a rectilinear array of pixel values;
wherein:
generating the output comprises determining a first pixel value of the rectilinear array of pixel values, based on the one or more incoming pixel values of the sensor output signal.
16. The non-transitory computer-readable medium of claim 15 , wherein the method further comprises adjusting an angle and a position of the light sensor with respect to the exit location.
17. The non-transitory computer-readable medium of claim 15 , wherein the one or more incoming pixel values comprise one or more pixel values in polar form and the rectilinear array of pixel values comprises one or more pixel values in rectangular form.
18. The non-transitory computer-readable medium of claim 15 , wherein generating the output further comprises determining a second pixel value of the rectilinear array, based on a closest pixel value of the rectilinear array for which there is a corresponding incoming pixel value.
19. The non-transitory computer-readable medium of claim 18 , wherein generating the output further comprises determining the second pixel value by performing an interpolation with respect to the closest pixel value.
20. The non-transitory computer-readable medium of claim 15 , wherein the method further comprises providing the output as input to an image processor.