IP Library Granted Patent US 12699445
Granted Patent B2
US 12699445 · App. 18/795,358 · Granted Aug 4, 2026

Systems and methods for calibrating eye tracking

Inventors: Sebastian Sztuk (Virum, DK); Karol Constantine Hatzilias (Sammamish, WA); Kirk Erik Burgess (Newark, CA); Javier San Agustin Lopez (Deba, ES)
Assignee: Meta Platforms Technologies, LLC
G06F3/013G02B27/0093G02B27/0172G06V40/19G02B2027/0187
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12699445
App. No.
18/795,358
Filed
Aug 6, 2024
Granted
Aug 4, 2026
Kind
B2
Art Unit
2483
USPC
348/78
Abstract

A method for calibrating eye tracking data for a head wearable optical device includes receiving eye tracking data from an imaging device oriented towards a combiner. The method includes determining a gaze direction of an eye of a user based on the eye tracking data. The method includes receiving calibration data from the imaging device that includes an indication of positions of one or more calibration indicators. The method includes determining the gaze direction based at least in part on the calibration data received from the imaging device (or factors adjusted by the calibration data).

Claims (35)

1 . A head-wearable display device comprising:

an imaging device configured to provide calibration data indicating a position of a calibration indicator; and

processing circuitry configured to:

compare the position of the calibration indicator to a reference position for the calibration indicator to determine a difference in position for the calibration indicator;

determine that the difference in position for the calibration indicator is greater than a threshold; and

calibrate, responsive to the determination, a gaze direction of a user relative to the display device based at least in part on the difference in position.

2 . The head-wearable display device of claim 1 , wherein the one or more calibration indicators comprise one of an active fiducial or a passive fiducial.

3 . The head-wearable display device of claim 1 , wherein the one or more calibration indicators are positioned about a display of the display device outside of a viewing region of the user's eyes.

4 . The head-wearable display device of claim 1 , wherein the reference position for each calibration indicator is a baseline position before the display device is used by the user.

5 . The head-wearable display device of claim 1 , wherein the reference position for each calibration indicator is a position of each calibration indicator after a previous adjustment of calibration settings.

6 . The head-wearable display device of claim 1 , wherein the threshold comprises a trigger value that indicates the display device is to be calibrated.

7 . The head-wearable display device of claim 1 , wherein the imaging device is further configured to provide eye-tracking data of the user's eyes, the eye-tracking data used by the processing circuitry to identify the gaze direction.

8 . The head-wearable display device of claim 1 , wherein the processing circuitry is further configured to determine an offset amount for one of a gaze vector or a gaze location to calibrate eye tracking.

9 . The head-wearable display device of claim 1 , wherein the processing circuitry is further configured to calibrate, using the difference in position, a gaze vector or a gaze location for eye tracking.

10 . A display device comprising:

an imaging device configured to provide image data for eye tracking of a user's eyes and calibration data indicating a position of one or more calibration indicators; and

processing circuitry configured to:

determine a position and an orientation of a display of the display device relative to the imaging device based at least based on the position of the one or more calibration indicators;

compare the position and orientation of the display to a corresponding reference position and orientation to determine a difference in one of the position or the orientation of the display;

determine, based on at least the difference in one of the position or the orientation of the display, that a gaze vector for eye tracking is to be calibrated; and

calibrate, responsive to the determination, the gaze vector using at least the difference in one of the position or the orientation of the display.

11 . The display device of claim 10 , wherein the corresponding reference position and orientation of the display comprise a baseline reference before the display device is used by the user.

12 . The display device of claim 10 , wherein the corresponding reference position and orientation of the display comprises a reference position or orientation after one or more calibration settings are adjusted.

13 . The display device of claim 10 , wherein the processing circuitry is further configured to identify the position of the one or more calibration indicators from the calibration data.

14 . The display device of claim 12 , wherein the processing circuitry is further configured to identify the position as x, y and z coordinates.

15 . The display device of claim 10 , wherein the processing circuitry is further configured to identify the position of the display by determining a centroid of the one or more calibration indicators.

16 . A method for calibrating a display device, the method comprising:

receiving, by processing circuitry of a display device from an imaging device, image data for eye tracking of a user's eyes and calibration data indicating a position of a calibration indicator;

comparing, by the processing circuitry, the position of each calibration indicator of the calibration indicator to a reference position for each calibration indicator to determine a difference in position for the calibration indicator;

determining, by the processing circuitry, that the difference in position for the calibration indicator is greater than a threshold; and

calibrating, by the processing circuitry, responsive to the determination, the eye tracking of the display device using the difference in position.

17 . The method of claim 16 , further comprising calibrating, by the processing circuitry using the difference in position, a gaze vector of the eye tracking.

18 . The method of claim 16 , further comprising calibrating, by the processing circuitry using the difference in position, a gaze location of the eye tracking.

19 . The method of claim 16 , further comprising determining, by the processing circuitry, an offset amount for one of a gaze vector or a gaze location to calibrate the eye tracking.

20 . The method of claim 16 , wherein the reference position for each calibration indicator is one of a baseline position before the display device is used by the user or after a previous adjustment of the calibration settings.