IP Library Granted Patent US 10,585,477
Granted Patent B1
US 10,585,477 · App. 15/946,650 · Granted Mar 10, 2020

Patterned optical filter for eye tracking

Inventors: Robert Dale Cavin (Kirkland, WA); Alexander Jobe Fix (Seattle, WA); Andrew John Ouderkirk (Redmond, WA); Qi Zhang (Bellevue, WA); Robin Sharma (Redmond, WA); Brian Wheelwright (Sammamish, WA)
Assignee: Facebook Technologies, LLC
G06F3/013G02B27/0172G02B27/0179G06T7/70G02B2027/014G02B2027/0138G02B2027/0187G06T2207/10004G06T2207/10048
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,585,477
App. No.
15/946,650
Granted
Mar 10, 2020
Kind
B1
Abstract

An eyewear device has an optical element, a patterned optical filter, and a camera. The optical element receives light that includes light in a visible band and light in an infrared (IR) band. The patterned optical filter is disposed on the optical element and has a filtering portion and a plurality of non-filtering portions. The filtering portion is transmissive to light in the visible band and filtering of light in the IR band. The non-filtering portions are transmissive to light in the visible band and transmissive to light in the IR band. Some portion of the received light in the IR band passes through the non-filtering portions and illuminates a portion of an eye of a user with a pattern. The camera captures images of the portion of the eye that is illuminated with the pattern.

Claims (36)

1. An eyewear device comprising:

an optical element that receives light including light in a visible band and light in an infrared (IR) band;

a patterned optical filter disposed on the optical element, the patterned optical filter having a filtering portion and a plurality of non-filtering portions, the filtering portion is transmissive to light in the visible band and filtering of light in the IR band, and the plurality of non-filtering portions are transmissive to light in the visible band and transmissive to light in the IR band, wherein some portion of the received light in the IR band passes through the plurality of non-filtering portions and illuminates a portion of an eye of a user with a portion of a pattern formed by the portion of the received light in the IR band passing through the plurality of non-filtering portions; and

a camera configured to capture one or more images of the portion of the eye illuminated with the portion of the pattern.

2. The eyewear device of claim 1 , wherein the plurality of non-filtering portions comprises at least a first non-filtering portion and second non-filtering portion, and the first non-filtering portion is larger than the second non-filtering portion.

3. The eyewear device of claim 2 , wherein the first non-filtering portion has a diameter of at least 10 μm, and the second non-filtering portion has a diameter no greater than 1 μm.

4. The eyewear device of claim 1 , further comprising a controller configured to:

receive the one or more captured images; and

analyze the one or more captured images to estimate a position of the eye.

5. The eyewear device of claim 4 further comprising a display, wherein content presented by the display is based at least in part on the estimated position of the eye.

6. The eyewear device of claim 1 , wherein the optical element is a waveguide display.

7. The eyewear device of claim 1 , wherein the optical element includes a first surface and a second surface that is opposite the first surface and closer to the eye than the first surface, and the patterned optical filter is coupled to the first surface.

8. The eyewear device of claim 1 , wherein the optical element includes a first surface and a second surface that is opposite the first surface and closer to the eye than the first surface, and the patterned optical filter is coupled to the second surface.

9. The eyewear device of claim 1 , wherein the optical element includes a first surface and a second surface that is opposite the first surface and closer to the eye than the first surface, and the patterned optical filter is between the first surface and the second surface.

10. The eyewear device of claim 1 , further comprising at least one light source that is configured to emit light in the IR band and illuminate at least a portion of the eye, wherein the received light comprises light from the at least one light source.

11. The eyewear device of claim 10 , further comprising a controller configured to:

determine a level of ambient light in the IR band using the one or more captured images;

compare the level of ambient light in the IR band to a threshold level; and

in response to determining that the level of ambient light in the IR band is below the threshold level, instructing the at least one light source to emit light in the IR band.

12. The eyewear device of claim 1 , wherein the received light comprises ambient light from a local area of the eyewear device.

13. The eyewear device of claim 1 , wherein each non-filtering portion of the plurality of non-filtering portions is positioned at a distance of no more than 0.5 mm away from an adjacent non-filtering portion.

14. The eyewear device of claim 1 , wherein at least a first subset of the plurality of non-filtering portions are configured to diffract the light in the IR band.

15. An eyewear device comprising:

an optical element that receives light including light in a first band and light in a second band;

a patterned optical filter disposed on the optical element, the patterned optical filter having a filtering portion and a plurality of non-filtering portions, the filtering portion is transmissive to light in the first band and filtering of light in the second band, and the plurality of non-filtering portions are transmissive to light in the first band and transmissive to light in the second band, wherein some portion of the received light in the second band passes through the plurality of non-filtering portions and illuminates a portion of an eye of a user with a portion of a pattern formed by the portion of the received light in the second band passing through the plurality of non-filtering portions; and

a camera configured to capture one or more images of the portion of the eye illuminated with the portion of the pattern.

16. The eyewear device of claim 15 , wherein the plurality of non-filtering portions comprises at least a first non-filtering portion and second non-filtering portion, and the first non-filtering portion is larger than the second non-filtering portion.

17. The eyewear device of claim 16 , wherein the first non-filtering portion has a diameter of at least 10 μm, and the second non-filtering portion has a diameter no greater than 1 μm.

18. The eyewear device of claim 15 , wherein the optical element is a waveguide display.

19. The eyewear device of claim 15 , wherein the optical element includes a first surface and a second surface that is opposite the first surface and closer to the eye than the first surface, and the patterned optical filter is coupled to the first surface.

20. The eyewear device of claim 15 , wherein the optical element includes a first surface and a second surface that is opposite the first surface and closer to the eye than the first surface, and the patterned optical filter is coupled to the second surface.

21. The eyewear device of claim 15 , wherein the optical element includes a first surface and a second surface that is opposite the first surface and closer to the eye than the first surface, and the patterned optical filter is between the first surface and the second surface.

22. The eyewear device of claim 15 , further comprising at least one light source that is configured to emit light in the IR band and illuminate at least a portion of the eye, wherein the received light comprises light from the at least one light source.

23. A method for eye tracking comprising:

receiving, at a camera, an image of a portion of an eye illuminated by ambient light in a band of wavelengths, the ambient light having a pattern formed by a patterned optical filter disposed on an optical element, the patterned optical filter having a filtering portion filtering light in the band and a plurality of non-filtering portions transmitting light in the band; and

determining a position of the eye based on the image of the portion of the eye illuminated by the ambient light having the pattern.

Assignments (3)
CHANGE OF NAME Recorded Jun 8, 2022
From: FACEBOOK TECHNOLOGIES, LLC
To: META PLATFORMS TECHNOLOGIES, LLC
Reel/Frame 060315/0224 →
CHANGE OF NAME Recorded Sep 12, 2018
From: OCULUS VR, LLC
To: FACEBOOK TECHNOLOGIES, LLC
Reel/Frame 047178/0616 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 19, 2018
From: CAVIN, ROBERT DALE; FIX, ALEXANDER JOBE; OUDERKIRK, ANDREW JOHN; ZHANG, QI; SHARMA, ROBIN; WHEELWRIGHT, BRIAN
To: OCULUS VR, LLC
Reel/Frame 045584/0711 →
Cited By (6)
US 12,197,642 US 12,244,977 US 12,345,893 US 12,355,216 US 12,487,461 US 12,736,819