IP Library Granted Patent US 9,962,078
Granted Patent B2
US 9,962,078 · App. 15/295,915 · Granted May 8, 2018

Gaze tracking variations using dynamic lighting position

Inventor: Eric J. Larsen (Pacifica, CA)
Assignee: SONY INTERACTIVE ENTERTAINMENT INC.
A61B3/113A61B3/0025A61B3/14G06K9/00604G06T7/0012G06T2207/30041
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,962,078
App. No.
15/295,915
Granted
May 8, 2018
Kind
B2
Abstract

Aspects of the present disclosure relate to eye tracking systems and methods which track eyes by illuminating the eyes using a light source and detecting the eye illuminations using a sensor. Implementations of the present disclosure may utilize a light source with a dynamic lighting position to account for changes in lighting conditions during the tracking which interfere with detection of the eye illuminations, such as reflections in glasses which may obscure a user's eyes.

Claims (46)

1. A method comprising: capturing one or more images with the eye tracking device of an area illuminated by light emitted from an eye tracking device;

determining one or more gaze characteristics from analysis of the images based on eye illuminations within the images from the light emitted from the eye tracking device;

analyzing the images to detect a pre-defined change in lighting conditions in the images; and

triggering a change of a position of a source of the light upon detection of the pre-defined change in the light conditions.

2. The method of claim 1 , wherein the pre-defined change is an occurrence of glare which interferes with the eye illuminations in the images.

3. The method of claim 1 , wherein said determining the gaze characteristics based on the eye illuminations includes analyzing a Dark Pupil in the images which is generated by said emitting the light, wherein said analyzing the images to detect the pre-defined change in lighting conditions includes analyzing a location of the Dark Pupil for a bright spot at the location which exceeds a pre-defined size threshold, a pre-defined intensity threshold, or a combination thereof.

4. The method of claim 1 ,

wherein the eye tracking device has a plurality of light sources,

wherein the light emitted from the eye tracking device includes light initially emitted from one or more first light sources selected from the plurality of light sources and, after said triggering the change in the position, the light emitted from the eye tracking device includes light emitted from one or more second light sources selected from the plurality of light sources which are different from the first light sources, and

wherein said triggering the change includes triggering a change from emitting the light from the first light sources to emitting light from the second light sources.

5. The method of claim 4 , wherein the plurality of light sources are infrared LEDs, wherein the images are infrared images, and wherein triggering the change includes turning off the first infrared LEDs and turning on the second infrared LEDs.

6. The method of claim 4 , wherein the second light sources are offset from the first light sources in a vertical direction.

7. The method of claim 4 , wherein the pre-defined change is an occurrence of glare which interferes with the eye illuminations in the images.

8. The method of claim 1 , wherein said determining the gaze characteristics includes determining a gaze direction.

9. A system comprising:

an eye tracking device; and

a computing device, wherein the system is configured to perform a method, the method comprising: capturing one or more images with the eye tracking device of an area illuminated by light emitted from an eye tracking device;

determining one or more gaze characteristics from analysis of the images with the computing device based on eye illuminations within the images from said emitting the light;

analyzing the images with the computing device to detect a pre-defined change in lighting conditions in the images; and

triggering a change with the computing device of a position of a source of the light upon detection of the pre-defined change in the light conditions.

10. The system of claim 9 ,

wherein the eye tracking device has a plurality of light sources,

wherein the light emitted from the eye tracking device includes light initially emitted from one or more first light sources selected from the plurality of light sources and, after said triggering the change in the position, emitting light from one or more second light sources selected from the plurality of light sources which are different from the first light sources, and

wherein said triggering the change includes triggering a change from emitting the light from the first light sources to emitting light from the second light sources.

11. The system 10 , The method of claim 4 , wherein the plurality of light sources are infrared LEDs, wherein the images are infrared images, and wherein triggering the change includes turning off the first infrared LEDs and turning on the second infrared LEDs.

12. The system of claim 10 , wherein the pre-defined change is an occurrence of glare which interferes with the eye illuminations in the images.

13. The system of claim 9 ,

wherein the eye tracking device has one or more sets of light sources,

wherein each said set has a plurality of light sources offset in a vertical direction with respect to each other,

wherein said emitting the light includes initially emitting the light from one or more first light sources selected from each of the sets of the light sources and, after said change in the position, the light emitted from the eye tracking device includes light emitted from one or more second light sources selected from each of the sets of the light sources which are different from the first light sources, and

wherein said triggering the change includes triggering a change from emitting the light from the first light sources to emitting light from the second light sources.

14. The system of claim 13 , wherein the one or more sets are a plurality of sets of light sources, wherein each of the plurality of the sets are horizontally offset from each other.

15. The system of claim 9 , wherein the pre-defined change is an occurrence of glare which interferes with the eye illuminations in the images.

16. The system of claim 9 , wherein said determining the gaze characteristics based on the eye illuminations includes analyzing a Dark Pupil in the images which is generated by said emitting the light, wherein said analyzing the images to detect the pre-defined change in lighting conditions includes analyzing a location of the Dark Pupil for a bright spot at the location which exceeds a pre-defined size threshold, a pre-defined intensity threshold, or a combination thereof.

17. The system of claim 9 , wherein said determining the gaze characteristics includes determining a gaze direction.

18. A non-transitory computer readable medium having processor-executable instructions embodied therein, wherein execution of the instructions by a processor causes a processor to perform a method, the method comprising:

capturing one or more images with the eye tracking device of an area illuminated by light emitted from an eye tracking device;

determining one or more gaze characteristics from analysis of the images based on eye illuminations within the images from said emitting the light;

analyzing the images to detect a pre-defined change in lighting conditions in the images; and

triggering a change of a position of a source of the light upon detection of the pre-defined change in the light conditions.

19. The non-transitory computer readable medium of claim 18 , wherein the pre-defined change is an occurrence of glare which interferes with the eye illuminations in the images.

20. The non-transitory computer readable medium of claim 18 ,

wherein the pre-defined change is an occurrence of glare which interferes with the eye illuminations in the images,

wherein the eye tracking device has a plurality of light sources,

wherein the light emitted from the eye tracking device includes light initially emitted from one or more first light sources selected from the plurality of light sources and, after said triggering the change in the position, the light emitted from the eye tracking device includes light emitted from one or more second light sources selected from the plurality of light sources which are different from the first light sources, and

wherein said triggering the change includes triggering a change from emitting the light from the first light sources to emitting light from the second light sources.

Assignments (2)
CHANGE OF NAME Recorded Nov 14, 2017
From: SONY COMPUTER ENTERTAINMENT, INC
To: SONY INTERACTIVE ENTERTAINMENT INC.
Reel/Frame 044443/0823 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 9, 2017
From: LARSEN, ERIC
To: SONY COMPUTER ENTERTAINMENT INC.
Reel/Frame 040907/0513 →
Continuity (3)
Continuation 14493723 · Sep 23, 2014
Provisional Application 61881656 · Sep 24, 2013
Related Publication 20170027441A1 · Feb 2, 2017