IP Library › Granted Patent US 12,118,145
Granted Patent B2
US 12,118,145 · App. 18/321,926 · Granted Oct 15, 2024

Electronic apparatus

Inventor: Yoshihiro Mizuo (Tokyo, JP)
Assignee: CANON KABUSHIKI KAISHA
G06F3/013G02B27/0093G02B27/0172H04N13/344G02B2027/0178
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,118,145
App. No.
18/321,926
Granted
Oct 15, 2024
Kind
B2
Abstract

An electronic apparatus according to the present invention, includes at least one memory and at least one processor which function as: a first acquisition unit configured to acquire right line-of-sight information on a line-of-sight of a right eye of a user; a second acquisition unit configured to acquire left line-of-sight information on a line-of-sight of a left eye of the user; and a control unit configured to control such that right eye calibration is performed on a basis of right line-of-sight information which is acquired by the first acquisition unit at a first timing, and left eye calibration is performed on a basis of left line-of-sight information which is acquired by the second acquisition unit at a second timing which is different from the first timing.

Claims (62)

1. An electronic apparatus comprising at least one memory and at least one processor which function as:

a first acquisition unit configured to acquire right line-of-sight information on a line-of-sight of a right eye of a user;

a second acquisition unit configured to acquire left line-of-sight information on a line-of-sight of a left eye of the user; and

a control unit configured to control the electronic apparatus such that right eye calibration is performed on a basis of right line-of-sight information which is acquired by the first acquisition unit at a first timing, and left eye calibration is performed on a basis of left line-of-sight information which is acquired by the second acquisition unit at a second timing which is different from the first timing, wherein

the control unit further controls the electronic apparatus such that a simultaneous both eye calibration is performed on a basis of the right line-of-sight information acquired by the first acquisition unit and the left line-of-sight information acquired by the second acquisition unit.

2. The electronic apparatus according to claim 1 , wherein

in a state where the user is wearing a head mounted display,

a first display of the head mounted display faces the right eye of the user, and

a second display of the head mounted display faces the left eye of the user,

the first acquisition unit acquires the right line-of-sight information of the user viewing the first display in a state where the user is wearing the head mounted display,

the second acquisition unit acquires the left line-of-sight information of the user viewing the second display in a state where the user is wearing the head mounted display, and

the control unit

controls the electronic apparatus such that the second display is turned OFF and a first index is displayed on the first display in a case of the right eye calibration, and

controls the electronic apparatus such that the first display is turned OFF and a second index is displayed on the second display in a case of the left eye calibration.

3. The electronic apparatus according to claim 1 , wherein

the control unit

controls the electronic apparatus to instruct the user to close the left eye in a case of the right eye calibration, and

controls the electronic apparatus to instruct the user to close the right eye in a case of the left eye calibration.

4. The electronic apparatus according to claim 1 , wherein

the control unit controls the electronic apparatus such that the simultaneous both eye calibration is performed on a basis of the right line-of-sight information acquired by the first acquisition unit at a third timing which is after the first timing and the second timing and the left line-of-sight information acquired by the second acquisition unit at the third timing.

5. The electronic apparatus according to claim 4 , wherein

the first timing is a timing at which a first index is displayed,

the second timing is a timing at which a second index is displayed, and

the third timing is a timing at which a third index is displayed.

6. The electronic apparatus according to claim 1 , wherein

in a state where the user is wearing a head mounted display,

a first display of the head mounted display faces the right eye of the user, and

a second display of the head mounted display faces the left eye of the user,

the first acquisition unit acquires the right line-of-sight information of the user viewing the first display in a state where the user is wearing the head mounted display,

the second acquisition unit acquires the left line-of-sight information of the user viewing the second display in a state where the user is wearing the head mounted display, and

the control unit controls the electronic apparatus to display an index on each of the first display and the second display in a case of the simultaneous both eye calibration.

7. The electronic apparatus according to claim 6 , wherein

the control unit controls the electronic apparatus to display a plurality of indexes, of which depth positions viewed from the user are different, on each of the first display and the second display in a case of the simultaneous both eye calibration.

8. The electronic apparatus according to claim 6 , wherein

the control unit controls the electronic apparatus to display a plurality of indexes, of which directions viewed from the user are different, on each of the first display and the second display in a case of the simultaneous both eye calibration.

9. The electronic apparatus according to claim 1 , wherein

in the simultaneous both eye calibration, weight information on at least one of the right line-of-sight information and the left line-of-sight information is determined, the weight information being used for acquiring a gazing position of the user by combining the right line-of-sight information acquired by the first acquisition unit and the left line-of-sight information acquired by the second acquisition unit.

10. The electronic apparatus according to claim 9 , wherein

in the simultaneous both eye calibration, the weight information, for acquiring a predetermined gazing position by combining the right line-of-sight information and the left line-of-sight information, is determined on a basis of a line-of-sight position corresponding to the right line-of-sight information acquired by the first acquisition unit and a line-of-sight position corresponding to the left line-of-sight information acquired by the second acquisition unit.

11. The electronic apparatus according to claim 9 , wherein

in the simultaneous both eye calibration, the weight information is determined on a basis of a size of a fluctuation range of a line-of-sight position corresponding to the right line-of-sight information acquired by the first acquisition unit and a size of a fluctuation range of a line-of-sight position corresponding to the left line-of-sight information acquired by the second acquisition unit.

12. The electronic apparatus according to claim 9 , wherein

in the simultaneous both eye calibration, the weight information is determined on a basis of a position of a fluctuation range of a line-of-sight position corresponding to the right line-of-sight information acquired by the first acquisition unit and a position of a fluctuation range of a line-of-sight position corresponding to the left line-of-sight information acquired by the second acquisition unit.

13. The electronic apparatus according to claim 1 , wherein

the at least one memory and the at least one processor further function as:

a third acquisition unit configured to acquire a result of the simultaneous both eye calibration corresponding to the right line-of-sight information acquired by the first acquisition unit and the left line-of-sight information acquired by the second acquisition unit; and

an estimation unit configured to estimate a gazing position of the user, on a basis of the right line-of-sight information acquired by the first acquisition unit, the left line-of-sight information acquired by the second acquisition unit, and the result of the simultaneous both eye calibration acquired by the third acquisition unit.

14. The electronic apparatus according to claim 13 , wherein

the at least one memory and the at least one processor further function as a fourth acquisition unit configured to acquire distance information from the user to an object that exists in a range based on the right line-of-sight information acquired by the first acquisition unit and the left line-of-sight information acquired by the second acquisition unit, wherein

the third acquisition unit acquires information corresponding to the range and the distance information as the result of the simultaneous both eye calibration.

15. The electronic apparatus according to claim 13 , wherein

the estimation unit estimates a gazing position of the user on a basis of a position of a fluctuation range of a line-of-sight position corresponding to the right line-of-sight information acquired by the first acquisition unit, a position of a fluctuation range of a line-of-sight position corresponding to the left line-of-sight information acquired by the second acquisition unit, and a result of the simultaneous both eye calibration acquired by the third acquisition unit.

16. The electronic apparatus according to claim 1 , wherein

the right eye calibration is performed for improving accuracy of the right line-of-sight information to be acquired,

the left eye calibration is performed for improving accuracy of the left line-of-sight information to be acquired, and

the simultaneous both eye calibration is performed for improving estimation accuracy of a gazing position of the user.

17. A control method of an electronic apparatus, comprising:

acquiring right line-of-sight information on a line-of-sight of a right eye of a user at a first timing;

acquiring left line-of-sight information on a line-of-sight of a left eye of the user at a second timing;

controlling the electronic apparatus such that right eye calibration is performed on a basis of the acquired right line-of-sight information, and left eye calibration is performed on a basis of the acquired left line-of-sight information; and

controlling the electronic apparatus such that a simultaneous both eye calibration is performed on a basis of the acquired right line-of-sight information and the acquired left line-of-sight information.

18. A non-transitory computer readable medium that stores a program, wherein the program causes a computer to execute the control method according to claim 17 .

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 29, 2023
From: MIZUO, YOSHIHIRO
To: CANON KABUSHIKI KAISHA
Reel/Frame 064121/0230 →
Priority Claims (1)
JP 2022-092010 · Jun 7, 2022 · national
Continuity (1)
Related Publication 20230393655A1 · Dec 7, 2023