IP Library Granted Patent US 12,229,335
Granted Patent B2
US 12,229,335 · App. 18/063,536 · Granted Feb 18, 2025

Electronic device

Inventor: Tomoyuki Shiozaki (Kanagawa, JP)
Assignee: Canon Kabushiki Kaisha
G06F3/013G06F3/14G06T7/62G06V40/193G06V2201/07
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,229,335
App. No.
18/063,536
Granted
Feb 18, 2025
Kind
B2
Abstract

An electronic device includes: at least one memory storing instructions; and at least one processor which, upon execution of the instructions, configures the at least one processor to function as: an estimation unit configured to estimate a gaze area of a user; a detection unit configured to detect one or more objects present in a gaze direction of the user; and a selection unit configured to select one object from the one or more objects on a basis of the gaze area.

Claims (50)

1. An electronic device comprising:

at least one memory storing instructions; and

at least one processor which, upon execution of the instructions, configures the at least one processor to function as:

an estimation unit configured to estimate a gaze area of a user;

a detection unit configured to detect one or more objects present in a gaze direction of the user; and

a selection unit configured to select one object from the one or more objects on a basis of the gaze area, wherein

in a case where a plurality of objects is detected by the detection unit, the selection unit selects the one object by comparing a size of the gaze area and a size of each of the plurality of objects.

2. The electronic device according to claim 1 , wherein

the selection unit selects, from the plurality of objects, an object with a size closest to the size of the gaze area.

3. The electronic device according to claim 2 , wherein

the selection unit selects, from the plurality of objects, an object with a size ratio as compared to the gaze area that is closest to 1.

4. The electronic device according to claim 1 , wherein

the selection unit selects, from the plurality of objects, an object with a size ratio as compared to the gaze area that is within a predetermined range.

5. The electronic device according to claim 1 , wherein

the detection unit detects an object that overlaps the gaze area.

6. The electronic device according to claim 1 , wherein

execution of the stored instructions further configures the at least one processor to function as:

a control unit configured to control to perform processing based on a selection result of the selection unit.

7. The electronic device according to claim 6 , wherein

the control unit causes display, on a display device, information related to the object selected by the selection unit.

8. The electronic device according to claim 1 , wherein

execution of the stored instructions further configures the at least one processor to function as:

an acquisition unit configured to acquire eyeball information related to an eye condition of the user, and

the estimation unit estimates the gaze area based on the eyeball information.

9. The electronic device according to claim 8 , wherein

the eyeball information includes gaze position information related to a gaze position and microsaccade information related to at least one of an occurrence frequency and amplitude of microsaccades.

10. The electronic device according to claim 8 , wherein

the acquisition unit acquires the eyeball information from a detection result of an event-based vision sensor.

11. The electronic device according to claim 1 , wherein

the selection unit does not select an object in a case where a size of the gaze area is larger than a predetermined threshold.

12. An electronic device comprising:

at least one memory storing instructions; and

at least one processor which, upon execution of the instructions, configures the at least one processor to function as:

a selection unit configured to select one object from one or more objects present in a gaze direction of a user, wherein

the selection unit selects a larger object in a case where microsaccades of the user are large than in a case where the microsaccades of the user are small, and

the selection unit selects a larger object in a case where an occurrence frequency of the microsaccades is large than in a case where the occurrence frequency of the microsaccades is small.

13. The electronic device according to claim 12 , wherein

the selection unit selects a larger object in a case where an amplitude of the microsaccades is large than in a case where the amplitude of the microsaccades is small.

14. The electronic device according to claim 12 , wherein

the selection unit selects a larger object in a case where an attenuation rate of the microsaccades is small than in a case where the attenuation rate of the microsaccades is large.

15. A control method of an electronic device, comprising:

estimating a gaze area of a user;

detecting one or more objects present in a gaze direction of the user; and

selecting one object from the one or more objects on a basis of the gaze area, wherein

in a case where a plurality of objects is detected, in the selecting the one object is selected by comparing a size of the gaze area and a size of each of the plurality of objects.

16. A non-transitory computer readable medium that stores instructions that, when executed by a computer, causes a control method for an electronic device to be performed, the control method comprising:

estimating a gaze area of a user;

detecting one or more objects present in a gaze direction of the user; and

selecting one object from the one or more objects on a basis of the gaze area, wherein

in a case where a plurality of objects is detected, in the selecting the one object is selected by comparing a size of the gaze area and a size of each of the plurality of objects.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 5, 2023
From: SHIOZAKI, TOMOYUKI
To: CANON KABUSHIKI KAISHA
Reel/Frame 062277/0498 →
Priority Claims (1)
JP 2021-201782 · Dec 13, 2021 · national
Continuity (1)
Related Publication 20230185371A1 · Jun 15, 2023
References Cited (19)
US 10607401B2 · Lindh · 2020 [cited by examiner]
US 11388331B2 · Matsuo · 2022 [cited by examiner]
US 20110175932A1 · Yu · 2011 [cited by examiner]
US 20150130740A1 · Cederlund · 2015 [cited by examiner]
US 20190011983A1 · Yasuda · 2019 [cited by examiner]
US 20200257360A1 · Klingström · 2020 [cited by examiner]
US 20210349607A1 · Thunstr?m · 2021 [cited by examiner]
US 20210373657A1 · Connor · 2021 [cited by examiner]
US 20220070567A1 · Skoglund · 2022 [cited by examiner]
US 20220326766A1 · Spencer · 2022 [cited by examiner]
US 20230011551A1 · Usami · 2023 [cited by examiner]
US 20230029585A1 · Chono · 2023 [cited by examiner]
US 20230110964A1 · Spencer · 2023 [cited by examiner]
US 20240028113A1 · Funamoto · 2024 [cited by examiner]
US 20240037990A1 · Chono · 2024 [cited by examiner]
US 20240069702A1 · Yasuda · 2024 [cited by examiner]
US 20240220009A1 · Dryer · 2024 [cited by examiner]
JP 2018163466A · 2018 [cited by applicant]
JP 2019003312A · 2019 [cited by applicant]