IP Library Granted Patent US 11,044,460
Granted Patent B1
US 11,044,460 · App. 16/401,062 · Granted Jun 22, 2021

Polychromatic object imager

Inventors: Babak Amirsolaimani (Redmond, WA); Mohamed Tarek El-Haddad (Redmond, WA)
Assignee: FACEBOOK TECHNOLOGIES, LLC
H04N13/254G02B5/32G02B27/0093G06T7/55H04N5/33H04N13/25H04N13/296G06T2207/10028G06T2207/10048G06T2207/30201
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,044,460
App. No.
16/401,062
Granted
Jun 22, 2021
Kind
B1
Abstract

A three-dimensional object imager uses infrared light at different wavelengths to triangulate depth information of the object from wavelength-dependent detection of the infrared image of the object. The depth information is obtained by determining wavelength of infrared light impinging on different pixels of the array. The wavelength may be determined by breaking each pixel into a plurality of sub-pixels, each sub-pixel having its own spectral selectivity to light at different infrared wavelength. For eye imaging or eye tracking applications, this enables the preservation of an unobstructed field of view of the eye while obtaining real-time, dynamic information about eye position and orientation in an non-intrusive, inconspicuous manner.

Claims (37)

1. A three-dimensional (3D) imager for an eye tracking system, the 3D imager comprising:

an infrared light source for illuminating an eye with a fan of light beams, wherein different light beams of the fan of light beams are at different wavelengths within an infrared wavelength range;

an array of detector pixels including first and second sub-arrays of detector pixels having first and second overlapping different wavelength dependencies of responsivity, respectively, in the infrared wavelength range;

an image forming assembly configured to form an image of the eye illuminated with the fan of light beams on the first and second sub-arrays of the array of detector pixels, for use in the eye tracking system for determining at least one of position or orientation of the eye; and

a wavelength-selective reflector for placing in front of the eye, wherein the wavelength-selective reflector is configured to redirect at least some light beams of the fan of light beams, and to transmit towards the eye outside light in a visible wavelength range.

2. The 3D imager of claim 1 , further comprising a controller operably coupled to the array of detector pixels and configured to:

read out the image of the eye from the first and second sub-arrays of detector pixels; and

determine a distance to a portion of the eye, wherein an image of the portion of the eye is formed on at least one detector pixel of each one of the first and second sub-arrays of detector pixels, and wherein the distance is determined based on a comparison of signals from the corresponding detector pixels of the first and second sub-arrays of detector pixels.

3. The 3D imager of claim 2 , wherein each detector pixel of the array of detector pixels comprises first and second sub-pixels, the first sub-pixels forming the first sub-array and the second sub-pixels forming the second sub-array, wherein the controller is configured to determine the distance based on a comparison of the signals from the first and second sub-pixels.

4. The 3D imager of claim 1 , wherein the first and second sub-arrays of detector pixels are provided with first and second spectral filters, respectively, having first and second overlapping different wavelength dependencies of throughput, respectively, for providing the first and second overlapping different wavelength dependencies of responsivity, respectively.

5. The 3D imager of claim 1 , wherein the infrared light source comprises a polychromatic light source for emitting polychromatic light, and a dispersive element configured to receive the polychromatic light from the polychromatic light source and angularly disperse the polychromatic light into the fan of the light beams.

6. The 3D imager of claim 1 , wherein the responsivity of the first sub-array monotonically decreases with wavelength, and the responsivity of the second sub-array monotonically increases with wavelength within the infrared wavelength range.

7. The 3D imager of claim 1 , wherein the array of detector pixels further includes a third sub-array of pixels having a third wavelength dependence of responsivity overlapping with at least the second wavelength dependence of responsivity of the second sub-array.

8. The 3D imager of claim 1 , wherein the at least some light beams redirected by the wavelength-selective reflector comprise light beams of the fan of light beams reflected or scattered by the eye towards the wavelength-selective reflector.

9. The 3D imager of claim 1 , wherein the wavelength-selective reflector comprises at least one of a hot mirror or a polarization volume hologram (PVH).

10. The 3D imager of claim 9 , wherein the PVH is a part of the image forming assembly and has optical power for at least one of collimating or focusing the light beams reflected or scattered by the eye towards the PVH.

11. The 3D imager of claim 9 , wherein the PVH is a part of the image forming assembly and is configured for reducing an optical aberration of the image forming assembly.

12. The 3D imager of claim 1 , wherein the infrared light source comprises a superluminescent light-emitting diode.

13. A near-eye display comprising:

a projector for providing image light conveying an image in angular domain;

a pupil expander coupled to the projector for expanding the image light over an eyebox of the near-eye display; and

an eye tracker comprising:

an infrared light source for emitting a fan of light beams towards the eyebox, wherein different light beams of the fan of light beams are at different wavelengths within an infrared wavelength range;

an array of detector pixels including first and second sub-arrays of detector pixels having first and second overlapping different wavelength dependencies of responsivity, respectively, in the infrared wavelength range; and

an image forming assembly configured to form an image of an eye illuminated with the fan of light beams on the first and second sub-arrays of the array of detector pixels, for determining at least one of the eye position or orientation by the eye tracker.

14. The near-eye display of claim 13 , further comprising a controller operably coupled to the array of detector pixels and configured to:

read out the image of the eye from the first and second sub-arrays of detector pixels; and

determine a distance to a portion of the eye, wherein an image of the portion of the eye is formed on at least one detector pixel of each one of the first and second sub-arrays of detector pixels, and wherein the distance is determined based on a comparison of signals from the corresponding detector pixels of the first and second sub-arrays of detector pixels.

15. The near-eye display of claim 13 , further comprising a wavelength-selective reflector coupled to the pupil expander and configured to redirect at least some light beams of the fan of light beams reflected or scattered by the eye towards the wavelength-selective reflector.

16. The near-eye display of claim 15 , wherein the wavelength-selective reflector comprises at least one of a polarization volume hologram (PVH) or a hot mirror.

17. A method for three-dimensional eye imaging, the method comprising:

illuminating an eye with a fan of light beams, wherein different light beams of the fan of light beams are at different wavelengths within an infrared wavelength range; and

forming an image of the eye illuminated with the fan of light beams on an array of detector pixels including first and second sub-arrays of detector pixels having first and second overlapping different wavelength dependencies of responsivity, respectively, in the infrared wavelength range;

reading out the image of the eye from the array of detector pixels; and

determining a distance to a portion of the eye, wherein an image of the portion of the eye is formed on at least one detector pixel of each one of the first and second sub-arrays of detector pixels, and wherein the distance is determined based on a comparison of signals from the corresponding detector pixels of the first and second sub-arrays of detector pixels.

18. The method of claim 17 , wherein the determining is based on a ratio of the signals from the detector pixels of the first and second sub-arrays of detector pixels.

19. The method of claim 17 , further comprising redirecting at least some light beams of the fan of light beams reflected or scattered by the eye towards the array of detector pixels using a wavelength-selective reflector.

Assignments (2)
CHANGE OF NAME Recorded Jan 20, 2023
From: FACEBOOK TECHNOLOGIES, LLC
To: META PLATFORMS TECHNOLOGIES, LLC
Reel/Frame 062444/0855 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 30, 2020
From: AMIRSOLAIMANI, BABAK; EL-HADDAD, MOHAMED TAREK
To: FACEBOOK TECHNOLOGIES, LLC
Reel/Frame 051677/0797 →