IP Library Granted Patent US 11,240,419
Granted Patent B2
US 11,240,419 · App. 16/882,708 · Granted Feb 1, 2022

Electronic device that can execute function in accordance with line of sight of user, method of controlling electronic device, and non-transitory computer readable medium

Inventor: Shogo Fujiwara (Tokyo, JP)
Assignee: CANON KABUSHIKI KAISHA
H04N5/23212G06F3/013H04N5/232933H04N5/232939
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,240,419
App. No.
16/882,708
Granted
Feb 1, 2022
Kind
B2
Abstract

An electronic device comprising: a line-of-sight detection unit configured to detect a viewed position of a user; and a control unit configured to perform control such that, 1) in a first operation mode, a first function corresponding to a fact that there is gazing is executed in accordance with a state in which a first condition is satisfied, and 2) in a second operation mode, a second function corresponding to a fact that there is gazing is executed in accordance with a state in which a second condition is satisfied, wherein the first condition is a condition regarding the viewed position representing a fact that the user has been gazing for a first period, the second condition is a condition regarding the viewed position representing a fact that the user has been gazing for a second period longer than the first period.

Claims (61)

1. An electronic device comprising at least one memory and at least one processor which function as:

a line-of-sight detection unit configured to detect a viewed position of a user; and

a control unit configured to perform control such that, 1) in a first operation mode, a first function corresponding to a fact that there is gazing is executed in accordance with a state in which a first condition is satisfied in the line-of-sight detection unit, and 2) in a second operation mode, a second function corresponding to a fact that there is gazing is executed in accordance with a state in which a second condition is satisfied in the line-of-sight detection unit, wherein

the first condition is a condition regarding the viewed position representing a fact that the user has been gazing for a first period,

the second condition is a condition regarding the viewed position representing a fact that the user has been gazing for a second period longer than the first period, and

the first operation mode is an imaging mode for performing imaging by an imaging unit.

2. The electronic device according to claim 1 , wherein the first function is to execute autofocus at a gazing position.

3. The electronic device according to claim 1 , wherein the second operation mode is at least one of a reproduction mode for reproducing a recorded image and a setting mode for performing setting of the electronic device.

4. The electronic device according to claim 1 , wherein the second function is a function corresponding to a display item displayed at a gazing position among a plurality of display items displayed on a display unit.

5. The electronic device according to claim 4 , wherein the second function is a function of displaying a hierarchy which is lower than the display item displayed at the gazing position among the plurality of display items displayed on the display unit.

6. The electronic device according to claim 1 , wherein

the control unit is further configured to perform control such that, in a third operation mode, a third function corresponding to a fact that there is gazing is executed in accordance with a state in which a third condition is satisfied in the line-of-sight detection unit,

the third condition is a condition regarding the viewed position representing a fact that the user has been gazing for a third period longer than the second period.

7. The electronic device according to claim 6 ,

wherein the second operation mode is a display mode in which a first number of selectable options are displayed on a display unit,

the third operation mode is a display mode in which a second number of selectable options are displayed on the display unit, and

the second number larger than the first number.

8. The electronic device according to claim 7 , wherein the second operation mode and the third operation mode are operation modes different from an imaging mode for performing imaging using an imaging unit, and are at least one of a reproduction mode for reproducing a recorded image and a setting mode for performing setting of the electronic device.

9. The electronic device according to claim 1 , wherein the control unit is further configured to perform control such that, 1) in the first operation mode, the first function in accordance with a line-of-sight detection result is not executed until continuation of the state in which a condition regarding the viewed position corresponding to a fact that there is gazing is satisfied reaches the first period in the line-of-sight detection unit, and 2) in the second operation mode, the second function in accordance with a line-of-sight detection result is not executed until continuation of the state in which the condition regarding the viewed position corresponding to a fact that there is gazing is satisfied reaches the second period in the line-of-sight detection unit.

10. The electronic device according to claim 1 , wherein the control unit is further configured to perform control such that, in the line-of-sight detection unit in the first operation mode, 1) a first identification display indicating an area corresponding to a gazing position on a display unit is performed in accordance with a state in which a condition regarding the viewed position representing a fact that gazing has been performed for a fourth period shorter than the first period is satisfied, and 2) after the first identification display is performed and before the first period is reached, the first identification display is terminated in accordance with a state in which a condition regarding the viewed position representing a fact that the user keeps gazing is not satisfied.

11. The electronic device according to claim 1 , wherein the control unit is further configured to perform control such that, in the line-of-sight detection unit in the second operation mode, 1) a second identification display indicating an area corresponding to a gazing position on a display unit is performed in accordance with a state in which a condition regarding the viewed position representing a fact that gazing has been performed for a fifth period shorter than the second period is satisfied, and 2) after the second identification display is performed and before the second period is reached, the second identification display is terminated in accordance with a state in which a condition regarding the viewed position representing a fact that the user keeps gazing is not satisfied.

12. The electronic device according to claim 1 , wherein

the electronic device is an imaging device, and

the imaging unit is a lens unit included in the electronic device.

13. An electronic device comprising at least one memory and at least one processor which function as:

a line-of-sight detection unit configured to detect a viewed position of a user, and

a control unit configured to perform control such that, 1) in a first operation mode, a first function corresponding to a fact that there is gazing is executed in accordance with a state in which a first condition is satisfied in the line-of-sight detection unit, and 2) in a second operation mode, a second function corresponding to a fact that there is gazing is executed in accordance with a state in which a second condition is satisfied in the line-of-sight detection unit, wherein

the first condition is a condition regarding the viewed position representing a fact that the user has been gazing for a first period,

the second condition is a condition regarding the viewed position representing a fact that the user has been gazing for a second period longer than the first period,

the first operation mode is a display mode in which a first number of selectable options are displayed on a display unit,

the second operation mode is a display mode in which a second number of selectable options are displayed on the display unit, and

the second number larger than the first number.

14. The electronic device according to claim 13 , wherein the first function and the second function are functions corresponding to display items displayed at gazing positions among a plurality of display items displayed on a display unit.

15. The electronic device according to claim 14 , wherein the first function and the second function are functions for displaying lower hierarchies which are lower than the display items displayed at the gazing positions among the plurality of display items displayed on the display unit.

16. The electronic device according to claim 13 , wherein the first operation mode and the second operation mode are operation modes different from an imaging mode for performing imaging using an imaging unit, and are at least one of a reproduction mode for reproducing a recorded image and a setting mode for performing setting of the electronic device.

17. The electronic device according to claim 13 , wherein

the control unit is further configured to perform control such that, in a third operation mode, a third function corresponding to a fact that there is gazing is executed in accordance with a state in which a third condition is satisfied in the line-of-sight detection unit,

the third condition is a condition regarding the viewed position representing a fact that the user has been gazing for a third period longer than the second period.

18. The electronic device according to claim 17 ,

wherein the third operation mode is a display mode in which a third number of selectable options are displayed on the display unit, and

the third number larger than the second number.

19. The electronic device according to claim 18 , wherein the second operation mode and the third operation mode are operation modes different from an imaging mode for performing imaging using an imaging unit, and are at least one of a reproduction mode for reproducing a recorded image and a setting mode for performing setting of the electronic device.

20. The electronic device according to claim 13 , wherein the control unit is further configured to perform control such that, 1) in the first operation mode, the first function in accordance with a line-of-sight detection result is not executed until continuation of the state in which a condition regarding the viewed position corresponding to a fact that there is gazing is satisfied reaches the first period in the line-of-sight detection unit, and 2) in the second operation mode, the second function in accordance with a line-of-sight detection result is not executed until continuation of the state in which the condition regarding the viewed position corresponding to a fact that there is gazing is satisfied reaches the second period in the line-of-sight detection unit.

21. The electronic device according to claim 13 , wherein the control unit is further configured to perform control such that, in the line-of-sight detection unit in the first operation mode, 1) a first identification display indicating an area corresponding to a gazing position on a display unit is performed in accordance with a state in which a condition regarding the viewed position representing a fact that gazing has been performed for a fourth period shorter than the first period is satisfied, and 2) after the first identification display is performed and before the first period is reached, the first identification display is terminated in accordance with a state in which a condition regarding the viewed position representing a fact that the user keeps gazing is not satisfied.

22. The electronic device according to claim 13 , wherein the control unit is further configured to perform control such that, in the line-of-sight detection unit in the second operation mode, 1) a second identification display indicating an area corresponding to a gazing position on a display unit is performed in accordance with a state in which a condition regarding the viewed position representing a fact that gazing has been performed for a fifth period shorter than the second period is satisfied, and 2) after the second identification display is performed and before the second period is reached, the second identification display is terminated in accordance with a state in which a condition regarding the viewed position representing a fact that the user keeps gazing is not satisfied.

23. A method of controlling an electronic device including a line-of-sight detection unit configured to detect a viewed position of a user, comprising:

a first controlling step of performing control such that, in a first operation mode, a first function corresponding to a fact that there is gazing is executed in accordance with a state in which a first condition is satisfied in the line-of-sight detection unit; and

a second controlling step of performing control such that, in a second operation mode, a second function corresponding to a fact that there is gazing is executed in accordance with a state in which a second condition is satisfied in the line-of-sight detection unit, wherein

the first condition is a condition regarding the viewed position representing a fact that the user has been gazing for a first period,

the second condition is a condition regarding the viewed position representing a fact that the user has been gazing for a second period longer than the first period, and

the first operation mode is an imaging mode for performing imaging by an imaging unit.

24. A non-transitory computer readable medium that stores a program, wherein the program causes a computer to execute the method of controlling the electronic device according to claim 23 .

25. A method of controlling an electronic device including a line-of-sight detection unit configured to detect a viewed position of a user, comprising:

a first controlling step of performing control such that, in a first operation mode, a first function corresponding to a fact that there is gazing is executed in accordance with a state in which a first condition is satisfied in the line-of-sight detection unit; and

a second controlling step of performing control such that, in a second operation mode, a second function corresponding to a fact that there is gazing is executed in accordance with a state in which a second condition is satisfied in the line-of-sight detection unit, wherein

the first condition is a condition regarding the viewed position representing a fact that the user has been gazing for a first period,

the second condition is a condition regarding the viewed position representing a fact that the user has been gazing for a second period longer than the first period,

the first operation mode is a display mode in which a first number of selectable options are displayed on a display unit,

the second operation mode is a display mode in which a second number of selectable options are displayed on the display unit, and

the second number larger than the first number.

26. A non-transitory computer readable medium that stores a program, wherein the program causes a computer to execute the method of controlling the electronic device according to claim 25 .

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 27, 2020
From: FUJIWARA, SHOGO
To: CANON KABUSHIKI KAISHA
Reel/Frame 053313/0158 →
Priority Claims (1)
JP JP2019-100195 · May 29, 2019 · national
Continuity (1)
Related Publication 20200382693A1 · Dec 3, 2020