IP Library Granted Patent US 11,507,185
Granted Patent B1
US 11,507,185 · App. 17/474,014 · Granted Nov 22, 2022

Electrooculography-based eye tracking using normalized electrode input

Inventors: David Schwarz (Morrisville, NC); Russell Speight VanBlon (Raleigh, NC); John W Nicholson (Cary, NC); Scott Li (Cary, NC)
Assignee: Lenovo (United States) Inc.
G06F3/013G01C19/56G06F3/0482
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,507,185
App. No.
17/474,014
Granted
Nov 22, 2022
Kind
B1
Abstract

In one aspect, a headset may include at least one processor, at least two electrodes accessible to the at least one processor, an inertial measurement unit (IMU) accessible to the at least one processor, and storage accessible to the at least one processor. The storage may include instructions executable by the at least one processor to receive input from the at least two electrodes, receive input from the IMU, and normalize the input from the at least two electrodes based on the input from the IMU. The instructions may then be executable to perform eye tracking using electrooculography (EOG) based on the normalized input from the at least two electrodes.

Claims (54)

1. A headset, comprising:

at least one processor;

a display accessible to the at least one processor;

at least two electrodes accessible to the at least one processor;

an inertial measurement unit (IMU) accessible to the at least one processor; and

storage accessible to the at least one processor and comprising instructions executable by the at least one processor to:

execute a calibration process at least in part at the headset at least in part by moving one or more graphical objects about the display and tracking a user's eyes as the user views the one or more graphical objects moving about the display;

receive input from the at least two electrodes;

receive input from the IMU;

normalize the input from the at least two electrodes based on the input from the IMU and data from the calibration process;

perform eye tracking, using electrooculography (EOG) that is executed based on the normalized input from the at least two electrodes, to identify user selection of a graphical object presented on the display.

2. The headset of claim 1 , wherein the instructions are executable to:

as part of the calibration process, present instructions on the display, the instructions instructing the user to follow the positioning of a first graphical object of the one or more graphical objects as the first graphical object moves about the display.

3. The headset of claim 1 , wherein the instructions are executable to:

as part of the calibration process, move a first graphical object of the one or more graphical objects about the display in multiple directions.

4. The headset of claim 3 , wherein the instructions are executable to:

as part of the calibration process, move the first graphical object about the display at a constant speed for the user to follow via smooth pursuit.

5. The headset of claim 1 , wherein the instructions are executable to:

as part of the calibration process, move a first graphical object of the one or more graphical objects to respective corners of the display to identify field of view extremes.

6. The headset of claim 1 , wherein the instructions are executable to:

present a graphical user interface (GUI) on the display, the GUI comprising a selector that is selectable to initiate the calibration process.

7. The headset of claim 6 , wherein the GUI comprises an option that is selectable a single time to set the headset to, for multiple future instances of eye tracking, execute the normalizing step and performance of eye tracking step.

8. The headset of claim 6 , wherein the GUI is presented during a setup process for the headset.

9. The headset of claim 1 , wherein the instructions are executable to:

present a graphical user interface (GUI) on the display, the GUI comprising an option that is selectable a single time to set the headset to, for multiple future instances of eye tracking, execute the normalizing step and performance of eye tracking step.

10. A method, comprising:

executing a calibration process at least in part at a headset at least in part by moving one or more graphical objects about a display of the headset and tracking a user's eyes via electrooculography (EOG) as the user views the one or more graphical objects moving about the display;

receiving input from at least two electrodes on the headset;

receiving input from an inertial measurement unit (IMU) on the headset;

normalizing the input from the at least two electrodes based on the input from the IMU and the calibration process to perform eye tracking; and

performing the eye tracking using EOG, the eye tracking executed based on the normalized input from the at least two electrodes.

11. The method of claim 10 , comprising:

as part of the calibration process, moving a first graphical object of the one or more graphical objects about the display in multiple directions.

12. The method of claim 11 , comprising:

as part of the calibration process, moving the first graphical object about the display at a constant speed for the user to follow via smooth pursuit.

13. The method of claim 10 , comprising:

presenting a graphical user interface (GUI) on the display, the GUI comprising a selector that is selectable to initiate the calibration process.

14. The method of claim 10 , comprising:

presenting a graphical user interface (GUI) on the display, the GUI comprising an option that is selectable a single time to set the headset to, for multiple future instances of eye tracking, execute the normalizing step and performing step.

15. At least one computer readable storage medium (CRSM) that is not a transitory signal, the computer readable storage medium comprising instructions executable by at least one processor to:

execute an eye tracking calibration process at least in part by moving one or more graphical objects about a display and tracking a user's eyes as the user views the one or more graphical objects moving about the display;

receive input from at least two electrodes on a headset;

receive input from an inertial measurement unit (IMU) on the headset; and

based on the eye tracking calibration process, process the input from the at least two electrodes and the input from the IMU to perform eye tracking.

16. The CRSM of claim 15 , wherein the instructions are executable to:

as part of the eye tracking calibration process, move a first graphical object of the one or more graphical objects about the display in multiple directions.

17. The CRSM of claim 16 , wherein the instructions are executable to:

as part of the eye tracking calibration process, move the first graphical object about the display at a constant speed for the user to follow via smooth pursuit.

18. The CRSM of claim 15 , wherein the instructions are executable to:

as part of the eye tracking calibration process, move a first graphical object of the one or more graphical objects to respective corners of the display to identify field of view extremes.

19. The CRSM of claim 15 , wherein the instructions are executable to:

present a graphical user interface (GUI) on the display, the GUI comprising a selector that is selectable to initiate the eye tracking calibration process.

20. The CRSM of claim 15 , wherein the instructions are executable to:

present a graphical user interface (GUI) on the display, the GUI comprising an option that is selectable a single time to set the at least one processor to, for multiple future instances of eye tracking, process input from the electrodes and input from the IMU to perform eye tracking.

Assignments (4)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Feb 20, 2025
From: LENOVO PC INTERNATIONAL LIMITED
To: LENOVO SWITZERLAND INTERNATIONAL GMBH
Reel/Frame 070269/0092 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Feb 19, 2025
From: LENOVO (SINGAPORE) PTE LTD.
To: LENOVO PC INTERNATIONAL LIMITED
Reel/Frame 070269/0019 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 7, 2022
From: LENOVO (UNITED STATES) INC.
To: LENOVO (SINGAPORE) PTE. LTD.
Reel/Frame 059632/0312 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 23, 2021
From: SCHWARZ, DAVID; VANBLON, RUSSELL SPEIGHT; NICHOLSON, JOHN W; LI, SCOTT
To: LENOVO (UNITED STATES) INC.
Reel/Frame 057581/0683 →