IP Library Granted Patent US 12710816
Granted Patent B2
US 12710816 · App. 19/217,700 · Granted Aug 18, 2026

Camera field of view capturing eye reflection and eye views for gaze tracking

Inventors: Hao Qin (Saratoga, CA); Hua Gao (San Jose, CA); Oliver G Wenisch (Potsdam, DE); Tom Sengelaub (Oakland, CA)
Assignee: Apple Inc.
G06F3/013G02B27/0172G02B27/0179G02B2027/0123G02B2027/0138G02B2027/0178G02B2027/0187
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12710816
App. No.
19/217,700
Granted
Aug 18, 2026
Kind
B2
Abstract

Systems and apparatus may implement a camera field of view capturing eye reflection and eye views for gaze tracking. A light source may emit light that reaches the surface of an eye. A camera may be implemented with a field of view that includes a portion of a surface of the eye and a portion of a reflective surface of a lens that includes a reflection of the eye. A controller may cause the camera to capture images of the eye and reflection of the eye while the light source emits light.

Claims (43)

1 . A system, comprising:

a controller;

a lens with a reflective surface;

a camera, with a field of view that includes at least a portion of a surface of an eye and at least a portion of the reflective surface of the lens that includes at least a portion of a reflection of the eye that is different, at least in part, from the portion of the surface of the eye;

one or more light sources, wherein the one or more light sources are configured to emit light that reaches the surface of the eye; and

wherein the controller is configured to cause the camera to capture one or more images while the one or more light sources emit light to generate a composite view of the eye comprising different portions captured from the reflection and the surface of the eye.

2 . The system of claim 1 , wherein the light emitted from the one or more light sources is infrared light and wherein the reflective surface is a hot mirror.

3 . The system of claim 1 , wherein the camera comprises an anamorphic lens.

4 . The system of claim 1 , wherein the lens is curved.

5 . The system of claim 1 , wherein the controller is further configured to perform an eye enrollment technique for gaze tracking using the captured one or more images.

6 . The system of claim 1 , wherein the controller is further configured to perform a gaze tracking technique using the captured one or more images.

7 . The system of claim 1 , wherein the system further comprises a further camera, with a further field of view that includes at least a further portion of the surface of the eye and at least a further portion of the reflective surface of the lens that includes at least a further portion of the reflection of the eye; and

wherein the controller is further configured to cause the further camera to capture a further one or more images while the one or more light sources emit light.

8 . A head-mounted device, comprising:

a head-mountable frame, wherein the head-mounted frame comprises:

a controller;

a lens with a reflective surface;

a camera, with a field of view that includes at least a portion of a surface of an eye and at least a portion of the reflective surface of the lens that includes at least a portion of a reflection of the eye that is different, at least in part, from the portion of the surface of the eye;

one or more light sources, wherein the one or more light sources are configured to emit light that reaches the surface of the eye; and

wherein the controller is configured to cause the camera to capture one or more images while the one or more light sources emit light to generate a composite view of the eye comprising different portions captured from the reflection and the surface of the eye.

9 . The head-mounted device of claim 8 , wherein the light emitted from the one or more light sources is infrared light and wherein the reflective surface is a hot mirror.

10 . The head-mounted device of claim 8 , wherein the camera comprises an anamorphic lens.

11 . The head-mounted device of claim 8 , wherein the lens is curved.

12 . The head-mounted device of claim 8 , wherein the controller is further configured to perform an eye enrollment technique for gaze tracking using the captured one or more images.

13 . The head-mounted device of claim 8 , wherein the head-mounted device, further comprises a further camera, with a further field of view that includes at least a further portion of the surface of the eye and at least a further portion of the reflective surface of the lens that includes at least a further portion of the reflection of the eye; and

wherein the controller is further configured to cause the further camera to capture a further one or more images while the one or more light sources emit light.

14 . The head-mounted device of claim 8 , wherein the head-mounted device is a headset-type device.

15 . The head-mounted device of claim 8 , wherein the head-mounted device is a glasses-type device.

16 . A gaze-tracking system, comprising:

a controller;

a lens with a reflective surface;

a camera, with a field of view that includes at least a portion of a surface of an eye and at least a portion of the reflective surface of the lens that includes at least a portion of a reflection of the eye that is different, at least in part, from the portion of the surface of the eye;

one or more light sources, wherein the one or more light sources are configured to emit light that reaches the surface of the eye; and

wherein the controller is configured to:

cause the camera to capture one or more images while the one or more light sources emit light to generate a composite view of the eye comprising different portions from the reflection and the surface of the eye; and

perform one or more gaze-tracking techniques using the captured one or more images of the eye.

17 . The gaze-tracking system of claim 16 , wherein the light emitted from the one or more light sources is infrared light and wherein the reflective surface is a hot mirror.

18 . The gaze-tracking system of claim 16 , wherein the camera comprises an anamorphic lens.

19 . The gaze-tracking system of claim 16 , wherein the lens is curved.

20 . The gaze-tracking system of claim 16 , wherein the gaze tracking system, further comprises a further camera, with a further field of view that includes at least a further portion of the surface of the eye and at least a further portion of the reflective surface of the lens that includes at least a further portion of the reflection of the eye;

wherein the controller is further configured to:

cause the further camera to capture a further one or more images while the one or more light sources emit light; and

wherein the one or more gaze-tracking techniques is further performed using the further one or more images.