IP Library Granted Patent US 10,307,053
Granted Patent B2
US 10,307,053 · App. 15/103,000 · Granted Jun 4, 2019

Method for calibrating a head-mounted eye tracking device

Inventor: Romain Fayolle (Charenton-le-Pont, FR)
Assignee: Essilor International
A61B3/113A61B3/0091G02B5/1866G02C11/10G06F3/013A61B2560/0238
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,307,053
App. No.
15/103,000
Granted
Jun 4, 2019
Kind
B2
Abstract

Method for calibrating a head-mounted eye tracking device, the method comprising: all acquisition step (S 3 ), during which eye data relating to the position of the eye of the wearer are acquired by the eye tracking device while having the wearer of the head-mounted eye tracking device look in a direction of reference with regard to the spectacle lens mount, an association step (S 4 ) during which the eye data acquired during the acquisition step are associated with the gaze direction corresponding to the direction of reference, a recording step (S 5 ), during which the associated eye data and the gaze direction are recorded—wherein the head-mounted mounted eye tracking device comprises a spectacle frame in which ophthalmic lenses are mounted and the gazing direction corresponding to the direction of reference is determined based on the dioptric function of the ophthalmic lenses.

Claims (37)

1. A method for calibrating a head-mounted eye tracking device, the method comprising:

acquiring eye data relating to a position of an eye of a wearer using at least one camera arranged on a spectacle frame of the head-mounted eye tracking device while having the wearer of the head-mounted eye tracking device look in a direction of reference;

associating the eye data acquired during the acquiring with a gaze direction corresponding to the direction of reference using a processor of the head-mounted eye tracking device;

recording the associated eye data and the gaze direction in a memory of the head-mounted eye tracking device,

providing a calibration support comprising at least a visual reference element to the wearer wearing the head-mounted eye tracking device; and

placing the calibration support between at least one eye of the wearer and a visual environment of the wearer in a known position relative to the wearer's eye and to the head-mounted eye tracking device so as to define with the visual reference element the direction of reference,

wherein the head-mounted eye tracking device comprises ophthalmic lenses mounted on the spectacle frame of the head-mounted eye tracking device, and the gazing direction corresponding to the direction of reference is determined based on a dioptric function of the ophthalmic lenses, and

wherein, during the placing, the calibration support is placed on at least one surface of at least one of the ophthalmic lenses and the gazing direction corresponding to the visual reference element is determined based on the dioptric function of the ophthalmic lenses.

2. The method according to claim 1 , wherein the acquiring, the associating, and the recording are repeated.

3. The method according to claim 1 , wherein the acquiring, the associating, and the recording step are repeated with at least one of the wearer gazing in a different direction of reference and at a different gazing distance.

4. The method according to claim 1 , wherein the head-mounted eye tracking device comprises at least a visual reference element in the form of a microstructured pattern designed to diffract an incident light beam towards the wearer's eye under specific lightning conditions.

5. The method according to claim 1 , wherein the calibration support comprises a plurality of visual reference elements, and the associating and recording are repeated for each visual reference element.

6. The method according to claim 1 , wherein the calibration support is transparent to visible light, and the at least one visual reference element is a microstructured pattern designed to diffract an incident light beam towards the wearer's eye.

7. The method according to claim 1 , wherein the calibration support is opaque to light.

8. The method according to claim 1 , wherein a switchable light source is attached to at least one opening in the calibration support, and is configured to highlight the visual reference element during the acquiring.

9. The method according to claim 1 , wherein during the placing the calibration support is placed on at least one surface of at least one of the ophthalmic lenses and the gazing direction corresponding to the reference element is determined based on a dioptric function of the ophthalmic lenses.

10. The method according to claim 1 , wherein the calibration support comprises an optical system generating a virtual image, and wherein a virtual display device is used to generate the at least one visual reference element.

11. The method according to claim 1 , wherein the method further comprises determining an eye tracking position during which a relative position of the head-mounted eye tracking device relative to a face of the wearer when being worn by the wearer is determined.

12. The method according to claim 11 , the method further comprising:

determining a deviation from an initial position of the relative position of the face of the wearer with respect to the head-mounted eye tracking device; and

adjusting an eye tracking function based on the deviation determined during the determining of the deviation,

wherein the initial position corresponds to the relative position of the face of the wearer with respect to the head-mounted eye tracking device during calibration.

13. The method according to claim 12 , wherein the determining of the deviation and the adjusting are repeated every 30 seconds.

14. The method according to claim 12 , wherein during the determining of the deviation, a distance between the eye and the eye tracking device and the relative position of a center of rotation of the eye with respect to the head-mounted eye tracking device are determined.

15. The method according to claim 14 , wherein the head-mounted eye tracking device further comprises at least two light sources configured to illuminate at least one eye of the wearer, and wherein the distance between the eye and the head-mounted eye tracking device is determined based on a shape formed by reflections of the light sources on a cornea of the eye of the wearer illuminated by the light sources.

16. A computer program product stored on a non-transitory computer readable medium comprising stored sequences of instructions that are accessible to a processor and which, when executed by the processor, causes the processor to carry out the following:

acquiring eye data relating to a position of an eye of a wearer using at least one camera arranged on a spectacle frame of a head-mounted eye tracking device while having the wearer of the head-mounted eye tracking device look in a direction of reference;

associating the eye data acquired during the associating with a gaze direction corresponding to the direction of reference using a processor of the head-mounted eye tracking device;

recording the associated eye data and the gaze direction in a memory of the head-mounted eye tracking device;

providing a calibration support comprising at least a visual reference element to the wearer wearing the head-mounted eye tracking device; and

placing the calibration support between at least one eye of the wearer and a visual environment of the wearer in a known position relative to the wearer's eye and to the head-mounted eye tracking device so as to define with the visual reference element the direction of reference,

wherein the at least one visual reference element is an optical opening in the calibration support, and

wherein the head-mounted eye tracking device comprises ophthalmic lenses mounted on the spectacle frame of the head-mounted eye tracking device, and the gazing direction corresponding to the direction of reference is determined based on a dioptric function of the ophthalmic lenses wherein, during the placing, the calibration support is placed on at least one surface of at least one of the ophthalmic lenses and the gazing direction corresponding to the visual reference element is determined based on the dioptric function of the ophthalmic lenses.

17. The computer program product according to claim 16 , wherein the stored sequences of instructions that are accessible to the processor and which, when executed by the processor, causes the processor to further carry out the following:

determining a deviation from an initial position of a relative position of a face of the wearer with respect to the head-mounted eye tracking device; and

adjusting an eye tracking function based on the deviation determined during the determining of the deviation,

wherein the initial position corresponds to the relative position of the face of the wearer with respect to the head-mounted eye tracking device during calibration.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 6, 2018
From: ESSILOR INTERNATIONAL (COMPAGNIE GÉNÉRALE D'OPTIQUE)
To: ESSILOR INTERNATIONAL
Reel/Frame 045853/0275 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 19, 2016
From: FAYOLLE, ROMAIN
To: ESSILOR INTERNATIONAL (COMPAGNIE GENERALE D'OPTIQUE)
Reel/Frame 040672/0363 →
Priority Claims (1)
EP 13306750 · Dec 17, 2013 · regional
Continuity (1)
Related Publication 20160302663A1 · Oct 20, 2016
Cited By (3)
US 12,293,017 US 12,353,617 US 12,566,342