IP Library › Granted Patent US 12,393,270
Granted Patent B2
US 12,393,270 · App. 18/353,177 · Granted Aug 19, 2025

Control apparatus, image pickup apparatus, control method, and storage medium

Inventor: Shohei Funamoto (Tokyo, JP)
Assignee: CANON KABUSHIKI KAISHA
G06F3/013H04N23/632H04N23/611
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,393,270
App. No.
18/353,177
Granted
Aug 19, 2025
Kind
B2
Abstract

A control apparatus includes a processor configured to detect a gaze point of a user on an image based on a visual line, acquire at least one feature area detected using the image, set at least one selection determining area each corresponding to one of the one feature area, select as a main object area a first feature area among the at least one feature area when the gaze point is included in the first feature area, select as the main object area a second feature area corresponding to one selection determining area including the gaze point in a case where the gaze point is not included in the at least one feature area and the gaze point is included in the at least one selection determining area, and set a condition in selecting the main object area using information on the at least one feature area.

Claims (55)

1. A control apparatus comprising:

a memory storing instructions; and

a processor configured to execute the instructions to:

detect a gaze point of a user on an image based on a visual line of the user,

acquire at least one feature area detected using the image,

set at least one selection determining area each corresponding to one of the one feature area,

select as a main object area a first feature area among the at least one feature area in a case where the gaze point is included in the first feature area,

select as the main object area a second feature area corresponding to one selection determining area including the gaze point in a case where the gaze point is not included in the at least one feature area and the gaze point is included in the at least one selection determining area,

set a condition in selecting the main object area using information on the at least one feature area,

set a size of the at least one selection determining area using the information on the at least one feature area, and

reduce a selection determining area corresponding to the first feature area in a case where the processor selects the first feature area and then cancels selection of the first feature area within a predetermined time.

2. The control apparatus according to claim 1 , wherein the processor is configured to expand a selection determining area corresponding to a third feature area among the at least one feature area in a case where a type of the third feature area is a type of an object selected by the user.

3. The control apparatus according to claim 1 , wherein the processor is configured to reduce a selection determining area corresponding to a third feature area among the at least one feature area in a case where a type of the third feature area is not a type of an object selected by the user.

4. The control apparatus according to claim 1 , wherein the processor is configured to expand a selection determining area corresponding to a third feature area among the at least one feature area in a case where the third feature area includes a preset object.

5. The control apparatus according to claim 1 , wherein the processor is configured to expand a selection determining area corresponding to a third feature area among the at least one feature area in a case where the gaze point is included in the third feature area.

6. The control apparatus according to claim 1 , wherein the at least one selection determining area includes a first selection determining area and a second selection determining area, and

wherein the processor is configured to expand the first selection determining area so that the first selection determining area and the second selection determining area do not overlap each other.

7. The control apparatus according to claim 1 , wherein the at least one selection determining area includes a plurality of selection determining areas, and

wherein in a case where the gaze point is included in the plurality of selection determining areas in selecting the second feature area, the processor is configured to determine a selection determining area having a largest size ratio to a corresponding feature area among the plurality of selection determining areas as the one selection determining area.

8. The control apparatus according to claim 1 , wherein the processor is configured to set priority of the at least one feature area that is used to select the second feature area using the information on the at least one feature area.

9. The control apparatus according to claim 8 , wherein the at least one selection determining area includes a plurality of selection determining areas, and

wherein in a case where the gaze point is included in the plurality of selection determining areas in selecting the second feature area, the processor is configured to determine the one selection determining area according to priority of a corresponding feature area among the plurality of selection determining areas.

10. The control apparatus according to claim 8 , wherein the at least one feature area includes a third feature area whose type is a type of an object selected by the user, and a fourth feature area whose type is not a type of the object selected by the user, and

wherein the processor is configured to set priority of the third feature area higher than that of the fourth feature area.

11. The control apparatus according to claim 8 , wherein the at least one feature area includes a third feature area that includes the gaze point and a fourth feature area that does not include the gaze point, and

wherein the processor is configured to set priority of the third feature area higher than that of the fourth feature area.

12. The control apparatus according to claim 8 , wherein in a case where the gaze point is included in a third feature area among the at least one feature area, thus the processor sets priority of the third feature area to a first priority, and then the gaze point is no longer included in a selection determining area corresponding to the third feature area, the processor is configured to set the priority of the third feature area to a second priority lower than the first priority.

13. The control apparatus according to claim 8 , wherein the at least one feature area includes a third feature area that includes a preset object, and a fourth feature area that does not include the preset object, and

wherein the processor is configured to set priority of the third feature area higher than that of the fourth feature area.

14. The control apparatus according to claim 8 , wherein the at least one feature area includes a plurality of feature areas, and

wherein in a case where the processor selects the first feature area and then cancels selection of the first feature area within a predetermined time, the processor is configured to set priority of the first feature area to be lower than that of a feature area different from the first feature area.

15. An image pickup apparatus comprising:

a control apparatus; and

an image sensor,

wherein the control apparatus includes:

a memory storing instructions; and

a processor configured to execute the instructions to:

detect a gaze point of a user on an image based on a visual line of the user,

acquire at least one feature area detected using the image,

set at least one selection determining area each corresponding to one of the one feature area,

select as a main object area a first feature area among the at least one feature area in a case where the gaze point is included in the first feature area,

select as the main object area a second feature area corresponding to one selection determining area including the gaze point in a case where the gaze point is not included in the at least one feature area and the gaze point is included in the at least one selection determining area,

set a condition in selecting the main object area using information on the at least one feature area,

set a size of the at least one selection determining area using the information on the at least one feature area, and

reduce a selection determining area corresponding to the first feature area in a case where the processor selects the first feature area and then cancels selection of the first feature area within a predetermined time.

16. A control method comprising the steps of:

detecting a gaze point of a user on an image based on a visual line of the user;

acquiring at least one feature area detected using the image;

setting at least one selection determining area each corresponding to one of the one feature area,

selecting as a main object area a first feature area among the at least one feature area in a case where the gaze point is included in the first feature area,

selecting as the main object area a second feature area corresponding to one selection determining area including the gaze point in a case where the gaze point is not included in the at least one feature area and the gaze point is included in the at least one selection determining area, and

setting a condition in selecting the main object area using information on the at least one feature area,

setting a size of the at least one selection determining area using the information on the at least one feature area, and

reducing a selection determining area corresponding to the first feature area in a case where the processor selects the first feature area and then cancels selection of the first feature area within a predetermined time.

17. A non-transitory computer-readable storage medium storing a program that causes a computer to execute the control method according to claim 16 .

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 27, 2023
From: FUNAMOTO, SHOHEI
To: CANON KABUSHIKI KAISHA
Reel/Frame 064396/0835 →
Priority Claims (1)
JP 2022-114914 · Jul 19, 2022 · national
Continuity (1)
Related Publication 20240028113A1 · Jan 25, 2024
References Cited (3)
US 20150022682A1 · Seita · 2015 [cited by examiner]
JP 2021034756A · 2021 [cited by applicant]
JP 2021105694A · 2021 [cited by applicant]