IP Library › Granted Patent US 12,271,522
Granted Patent B2
US 12,271,522 · App. 18/395,406 · Granted Apr 8, 2025

Line-of-sight detection device and head mounted display device

Inventors: Yoshihiko Konno (Tokyo, JP); Koichi Ito (Tokyo, JP)
Assignee: CANON KABUSHIKI KAISHA
G06F3/013
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,271,522
App. No.
18/395,406
Granted
Apr 8, 2025
Kind
B2
Abstract

A line-of-sight detection device according to the present invention includes: a lens; an image sensor disposed on an edge of the lens; and a plurality of light sources disposed along the edge of the lens, wherein in a 360° range around an optical axis of the lens, a number of light sources per degree is the maximum in a range on opposite side of the image sensor with respect to the optical axis of the lens.

Claims (40)

1. A line-of-sight detection device comprising:

an image sensor disposed on an edge of an opening portion and configured to capture an image of an eye facing a lens disposed on the opening potion; and

a plurality of light sources disposed along the edge of the opening portion and arranged to illuminate the eye, wherein

a number of light sources disposed on opposite side of the image sensor with respect to an optical axis of the lens is more than a number of light sources disposed on same side of image sensor with respect to the optical axis, and

light emitted from at least one of the plurality of light sources transmits through the lens, is reflected by the eye, transmits through the lens again, and enters the image sensor.

2. The line-of-sight detection device according to claim 1 , wherein

the opening portion includes an opening portion for a right eye and an opening portion for a left eye,

each of an image sensor for the right eye, which is disposed on an edge of the opening portion for the right eye and is disposed to capture the right eye of a user from the left eye side, and an image sensor for the left eye, which is disposed on an edge of the opening portion lens for the left eye and is disposed to capture the left eye of the user from the right eye side, is included as the image sensor, and

each of a plurality of light sources for the right eye disposed along the edge of the opening portion for the right eye and a plurality of light sources for the left eye disposed along the edge of the opening portion for the left eye is included as the plurality of light sources.

3. The line-of-sight detection device according to claim 1 , wherein in a 360° range around the optical axis, a number of light sources disposed in a range on opposite side of the image sensor with respect to the optical axis is more than a number of light sources disposed in a rest range which is a range of 360° around the optical axis minus the range on the opposite side of the image sensor with respect to the optical axis.

4. The line-of-sight detection device according to claim 3 , wherein

the range on the opposite side of the image sensor with respect to the optical axis is a 90° range around the optical axis as a center in a direction opposite of the image sensor.

5. The line-of-sight detection device according to claim 1 , wherein

the image sensor is disposed on left side or right side of the lens.

6. The line-of-sight detection device according to claim 5 , wherein

the image sensor is disposed on a horizontal line passing through the optical axis.

7. The line-of-sight detection device according to claim 1 , wherein

a number of light sources disposed on lower side of the lens is more than a number of light sources disposed on upper side of the lens.

8. The line-of-sight detection device according to claim 7 , wherein

a number of light sources disposed on lower side of a horizontal line passing through the optical axis is more than a number of light sources disposed on upper side of the horizontal line.

9. The line-of-sight detection device according to claim 3 , wherein

a number of light sources disposed in the range on the opposite side of the image sensor with respect to the optical axis is at least 3 more than a number of light sources disposed in the rest range.

10. The line-of-sight detection device according to claim 1 , further comprising a processor configured to control each of the plurality of light sources, wherein

in a case where a lateral direction of the eye substantially matches with a lateral direction of the lens, the processor lights a first light source group which includes only light sources disposed on upper side of the optical axis of the lens.

11. The line-of-sight detection device according to claim 10 , wherein

in the case where the lateral direction of the eye substantially matches with the longitudinal direction of the lens, the processor lights a second light source group which is different from the first light source group, and

a part of the plurality of light sources is included in both the first light source group and the second light source group.

12. The line-of-sight detection device according to claim 10 , wherein

in a case where a number of Purkinje images formed on the image sensor is less than a predetermined number, the processor temporarily lights at least one light source which is not lit.

13. A head mounted display device comprising:

the line-of-sight detection device according to claim 1 ;

the opening portion;

the lens; and

a display panel, wherein

the lens directs light from the display panel to the eye.

14. The line-of-sight detection device according to claim 3 , wherein

the range on the opposite side of the image sensor with respect to the optical axis is a 120° range with the optical axis as a center in a direction opposite of the image sensor.

15. The line-of-sight detection device according to claim 1 , wherein the image sensor is configured to capture the image of the eye including a Purkinje image of at least one of the plurality of light sources and a pupil image of the eye.

16. The line-of-sight detection device according to claim 1 , wherein a number of all light sources disposed on the edge of the opening portion is more than a number of all image sensors disposed on the edge of the opening portion.

17. The line-of-sight detection device according to claim 15 , wherein the image sensor is disposed to left side or right side of all light sources disposed on the edge of the opening portion.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 4, 2024
From: KONNO, YOSHIHIKO; ITO, KOICHI
To: CANON KABUSHIKI KAISHA
Reel/Frame 066629/0155 →
Priority Claims (1)
JP 2022-208202 · Dec 26, 2022 · national
Continuity (1)
Related Publication 20240211036A1 · Jun 27, 2024
References Cited (13)
US 11138429B2 · Eskilsson · 2021 [cited by applicant]
US 20140078283A1 · Nistico · 2014 [cited by applicant]
US 20150098620A1 · Wu · 2015 [cited by applicant]
US 20150185503A1 · Tate · 2015 [cited by examiner]
US 20190278987A1 · Eskilsson · 2019 [cited by applicant]
US 20220261079A1 · Tornéus · 2022 [cited by applicant]
JP 3186072B2 · 2001 [cited by applicant]
JP 2020095205A · 2020 [cited by applicant]
JP 2023170238A · 2023 [cited by applicant]
KR 20240068647A · 2024 [cited by examiner]
WO 2022162276A1 · 2022 [cited by applicant]
KR-20240068647-A (Year: 2024). [cited by examiner]
The above patent documents were cited in a European Search Report issued on Apr. 19, 2024, a copy of which is enclosed, that issued in the corresponding European Patent Application No. 23219142.9. [cited by applicant]
Cited By (1)
US 12,669,866