IP Library Granted Patent US 12,663,641
Granted Patent B2
US 12,663,641 · App. 18/562,996 · Granted Jun 23, 2026

Line-of-sight detection apparatus, display apparatus, line-of-sight detection system, and line-of-sight detection method

Inventors: Ryo Ogawa (Kanagawa, JP); Yuki Mamishin (Kanagawa, JP)
Assignee: Sony Group Corporation
G02B27/0093G02B27/0172G06F3/013G02B2027/014
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,663,641
App. No.
18/562,996
Granted
Jun 23, 2026
Kind
B2
Abstract

To obtain eye-related position information at an appropriate time. Provided is a line-of-sight detection apparatus line-of-sight detection apparatus including: an illumination unit that illuminates an eye with a plurality of illumination light rays; a determination unit that determines a time to cause the illumination unit to illuminate the eye; an illumination control unit that controls the illumination unit; an image pickup element having an event-driven function; and an arithmetic unit that computes eye-related position information, in which the illumination control unit causes the illumination unit to illuminate the eye on the basis of a determination result of the determination unit, the image pickup element generates event information by receiving light reflected from the eye, and the arithmetic unit computes the eye-related position information on the basis of the event information.

Claims (72)

1 . A line-of-sight detection apparatus, comprising:

an illumination unit that illuminates an eye with a plurality of illumination light rays;

a determination unit that determines a time to cause the illumination unit to illuminate the eye;

an illumination control unit that controls the illumination unit;

an image pickup element having an event-driven function; and

an arithmetic unit that computes eye-related position information,

wherein the illumination control unit causes the illumination unit to illuminate the eye on a basis of a determination result of the determination unit,

wherein the image pickup element generates event information by receiving light reflected from the eye,

wherein the arithmetic unit computes the eye-related position information on a basis of the event information,

wherein the determination unit obtains the determination result that a movement of a user has occurred on a basis of the event information, and

wherein the illumination control unit causes the illumination unit to illuminate the eye on a basis of the determination result.

2 . The line-of-sight detection apparatus according to claim 1 , wherein

the movement of the user includes an open/close movement of an eyelid, and

the determination unit obtains the determination result that the movement of the user has occurred in a case where the open/close movement of the eyelid has been made.

3 . The line-of-sight detection apparatus according to claim 1 , wherein

the movement of the user includes a change in pupil diameter size, and

the determination unit obtains the determination result that the movement of the user has occurred in a case where an amount of change in pupil diameter size is equal to or larger than a predetermined threshold.

4 . The line-of-sight detection apparatus according to claim 1 , wherein

the movement of the user includes a saccade, and

the determination unit obtains the determination result that the movement of the user has occurred in a case where velocity of the saccade is equal to or larger than a predetermined threshold.

5 . A line-of-sight detection apparatus, comprising:

an illumination unit that illuminates an eye with a plurality of illumination light rays;

a determination unit that determines a time to cause the illumination unit to illuminate the eye;

an illumination control unit that controls the illumination unit;

an image pickup element having an event-driven function;

an arithmetic unit that computes eye-related position information,

wherein the illumination control unit causes the illumination unit to illuminate the eye on a basis of a determination result of the determination unit,

wherein the image pickup element generates event information by receiving light reflected from the eye, and

wherein the arithmetic unit computes the eye-related position information on a basis of the event information; and

an environment detection unit that detects an environment of a user,

wherein the determination unit obtains the determination result that the environment of the user has changed on a basis of a detection result of the environment detection unit, and

wherein the illumination control unit causes the illumination unit to illuminate the eye on a basis of the determination result.

6 . The line-of-sight detection apparatus according to claim 5 , wherein

the detection result of the environment detection unit includes an illuminance, and

the determination unit obtains the determination result that the environment of the user has changed in a case where an amount of change in illuminance is equal to or larger than a predetermined threshold.

7 . A display apparatus, comprising:

a line-of-sight detection apparatus according to claim 1 .

8 . A display apparatus, comprising:

a line-of-sight detection apparatus, including:

an illumination unit that illuminates an eye with a plurality of illumination light rays;

a determination unit that determines a time to cause the illumination unit to illuminate the eye;

an illumination control unit that controls the illumination unit;

an image pickup element having an event-driven function; and

an arithmetic unit that computes eye-related position information,

wherein the illumination control unit causes the illumination unit to illuminate the eye on a basis of a determination result of the determination unit,

wherein the image pickup element generates event information by receiving light reflected from the eye, and

wherein the arithmetic unit computes the eye-related position information on a basis of the event information; and

an action detection unit that detects an action of a user,

wherein the determination unit obtains the determination result that an action of the user has been made on a basis of a detection result of the action detection unit, and

wherein the illumination control unit causes the illumination unit to illuminate the eye on a basis of the determination result of the action detection unit.

9 . The display apparatus according to claim 8 , wherein

the action of the user includes the display apparatus being worn by a head of the user, and

the determination unit obtains the determination result that the action of the user has been made in a case where the display apparatus is worn by the head of the user.

10 . The display apparatus according to claim 8 , wherein

the action of the user includes an operation of the user being made on the display apparatus, and

the determination unit obtains the determination result that the action of the user has been made in a case where the operation of the user is made on the display apparatus.

11 . A display apparatus, comprising:

a line-of-sight detection apparatus, comprising:

an illumination unit that illuminates an eye with a plurality of illumination light rays;

a determination unit that determines a time to cause the illumination unit to illuminate the eye;

an illumination control unit that controls the illumination unit;

an image pickup element having an event-driven function; and

an arithmetic unit that computes eye-related position information,

wherein the illumination control unit causes the illumination unit to illuminate the eye on a basis of a determination result of the determination unit,

wherein the image pickup element generates event information by receiving light reflected from the eye,

wherein the arithmetic unit computes the eye-related position information on a basis of the event information; and

a video detection unit that detects a video displayed by the display apparatus,

wherein the determination unit obtains the determination result that the video has changed on a basis of a detection result of the video detection unit, and

wherein the illumination control unit causes the illumination unit to illuminate the eye on a basis of the determination result.

12 . The display apparatus according to claim 11 , wherein

the detection result of the video detection unit includes a luminance of the video, and

the determination unit obtains the determination result that the video has changed in a case where an amount of change in luminance is equal to or larger than a predetermined threshold.