IP Library Granted Patent US 11,729,503
Granted Patent B2
US 11,729,503 · App. 17/132,686 · Granted Aug 15, 2023

Image capturing apparatus and control method thereof

Inventors: Minoru Hirose (Kanagawa, JP); Kuniaki Sugitani (Kanagawa, JP); Yasuyuki Suzuki (Kanagawa, JP); Satoshi Kimoto (Saitama, JP); Ryotaro Takahashi (Tokyo, JP); Takayuki Akaguma (Tokyo, JP); Kengo Takeuchi (Kanagawa, JP)
Assignee: Canon Kabushiki Kaisha
H04N23/675G06F3/013G06T7/20G06T7/73H04N5/76H04N23/62H04N23/695H04N23/667
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,729,503
App. No.
17/132,686
Granted
Aug 15, 2023
Kind
B2
Abstract

An image capturing apparatus includes a memory device that stores a set of instructions, and at least one processor that executes the set of instructions to function as, a first detection unit configured to detect a position of a gazing point in an image based on a line-of-sight of a user, a first setting unit configured to set an object detection range based on the position of the gazing point and an image capturing condition, a second detection unit configured to detect a feature area from the image, and a second setting unit configured to set a focus detection area based on a position of the feature area included in the object detection range.

Claims (94)

1. An image capturing apparatus comprising:

a memory device that stores a set of instructions; and

at least one processor that executes the set of instructions to function as:

a first detection unit configured to detect a position of a gazing point in an image based on a line-of-sight of a user;

a first setting unit configured to set an object detection range based on the position of the gazing point;

a second detection unit configured to detect a feature area from the image; and

a second setting unit configured to set a position of a focus detection area which is to be arranged in the image based on a position of the feature area included in the object detection range,

wherein the first setting unit sets the object detection range according to a size of the focus detection area.

2. The image capturing apparatus according to claim 1 ,

wherein the image capturing apparatus is operable in an autofocus area mode,

wherein the autofocus area mode includes at least a first mode in which a focus detection area having a first size is arranged in the image and a second mode in which a focus detection area having a second size larger than the first size is arranged in the image, and

wherein, in the second mode, the first setting unit sets the object detection range to be wider than the object detection range to be set in the first mode.

3. The image capturing apparatus according to claim 1 , wherein the first setting unit sets the object detection range according to a shape of the focus detection area.

4. The image capturing apparatus according to claim 1 , wherein, in a case where a predetermined amount or more of the feature area is not included in the object detection range, the second setting unit does not change the position of the focus detection area.

5. The image capturing apparatus according to claim 1 , wherein, in a case where a predetermined amount or more of the feature area is not included in the object detection range, the second setting unit sets the position of the focus detection area based on the position of the gazing point.

6. The image capturing apparatus according to claim 2 , further comprising a smoothing unit configured to smooth, based on a plurality of positions of gazing points detected in a predetermined period, the position of a gazing point,

wherein the smoothing unit smooths a position such that a smoothing effect becomes greater as the size of the focus detection area becomes smaller.

7. The image capturing apparatus according to claim 1 , further comprising:

a calibration unit configured to acquire dispersion of a plurality of positions of the gazing points each detected by the first detection unit; and

a first storage unit configured to store the dispersion of the plurality of positions of the gazing points acquired by the calibration unit,

wherein the first setting unit sets the object detection range according to the dispersion of the plurality of positions of the gazing points stored in the first storage unit.

8. The image capturing apparatus according to claim 1 further comprising:

a third detection unit configured to detect an attitude of the image capturing apparatus;

a calibration unit configured to acquire dispersion of a plurality of positions of the gazing points each detected by the first detection unit; and

a second storage unit configured to store the dispersion of the plurality of positions of the gazing points acquired by the calibration unit in association with the attitude detected by the third detection unit,

wherein the first setting unit sets the object detection range according to the dispersion of the plurality of positions of the gazing points stored in the second storage unit in association with the attitude detected by the third detection unit.

9. The image capturing apparatus according to claim 1 ,

wherein, in a case where a degree of certainty of the position of the gazing point detected by the first detection unit is a first degree of certainty, the first setting unit sets the object detection range wider than the object detection range that is set in a case where the degree of certainty is a second degree of certainty that is greater in a degree of certainty of the position of the gazing point than the first degree of certainty.

10. An image capturing apparatus comprising:

a memory device that stores a set of instructions; and

at least one processor that executes the set of instructions to function as:

a first detection unit configured to detect a position of a gazing point in an image based on a line-of-sight of a user;

a first setting unit configured to set an object detection range based on the position of the gazing point and an image capturing condition;

a second detection unit configured to detect a feature area from the image; and

a second setting unit configured to set a position of a focus detection area which is to be arranged in the image based on a position of the feature area included in the object detection range,

wherein the image capturing condition is a recording mode, and

wherein, in a case where the recording mode is a moving image recording mode, the first setting unit sets the object detection range wider than the object detection range that is set in a case where the recording mode is a still image recording mode.

11. An image capturing apparatus comprising:

a memory device that stores a set of instructions; and

at least one processor that executes the set of instructions to function as:

a first detection unit configured to detect a position of a gazing point in an image based on a line-of-sight of a user;

a first setting unit configured to set an object detection range based on the position of the gazing point and an image capturing condition;

a second detection unit configured to detect a feature area from the image;

a second setting unit configured to set a position of a focus detection area which is to be arranged in the image based on a position of the feature area included in the object detection range; and

a third setting unit configured to set a frame rate for recording a moving image,

wherein the first setting unit sets the object detection range based on the frame rate for recording the moving image.

12. An image capturing apparatus comprising:

a memory device that stores a set of instructions; and

at least one processor that executes the set of instructions to function as:

a first detection unit configured to detect a position of a gazing point in an image based on a line-of-sight of a user;

a first setting unit configured to set an object detection range based on the position of the grazing point and an image capturing condition;

a second detection unit configured to detect a feature area from the image; and

a second setting unit configured to set a position of a focus detection area which is to be arranged in the image based on a position of the feature area included in the object detection range,

wherein the image capturing condition is a movement of an object detected, and

wherein, in a case where the object is a moving object, the first setting unit sets the object detection range wider than the object detection range that is set in a case where the object is not a moving object.

13. The image capturing apparatus according to claim 12 , wherein, in a case where the object is a moving object, the first setting unit sets the object detection range that is wide in a moving direction of the moving object.

14. An image capturing apparatus comprising:

a memory device that stores a set of instructions; and

at least one processor that executes the set of instructions to function as:

a first detection unit configured to detect a position of a gazing point in an image based on a line-of-sight of a user;

a first setting unit configured to set an object detection range based on the position of the gazing point and an image capturing condition;

a second detection unit configured to detect a feature area from the image; and

a second setting unit configured to set a position of a focus detection area which is to be arranged in the image based on a position of the feature area included in the object detection range,

wherein the image capturing condition is whether or not the image capturing apparatus is being panned, and

wherein, in a case where the image capturing apparatus is being panned, the first setting unit sets the object detection range wider than the object detection range that is set in a case where the image capturing apparatus is not being panned.

15. The image capturing apparatus according to claim 14 , wherein, in a case where the image capturing apparatus is being panned, the first setting unit sets the object detection range that is wide in a panning direction of the image capturing apparatus.

16. An image capturing apparatus comprising:

a memory device that stores a set of instructions; and

at least one processor that executes the set of instructions to function as:

a first detection unit configured to detect a position of a gazing point in an image based on a line-of-sight of a user;

a first setting unit configured to set an object detection range based on the position of the gazing point and an image capturing condition;

a second detection unit configured to detect a feature area from the image; and

a second setting unit configured to set a position of a focus detection area which is to be arranged in the image based on a position of the feature area included in the object detection range,

wherein the image capturing condition is followability of an object in a focus adjustment operation,

wherein the first setting unit determines a size of the object detection range based on a degree of intensity of the followability,

wherein the followability is a degree of following sensitivity for change in an object speed, and

wherein, in a case where the degree of the following sensitivity for change in the object speed is a first degree of following sensitivity, the first setting unit sets the object detection range wider than the object detection range that is set in a case where the degree of the following sensitivity is a second degree of following sensitivity that is lower than the first degree of the following sensitivity.

17. An image capturing apparatus comprising:

a memory device that stores a set of instructions; and

at least one processor that executes the set of instructions to function as:

a first detection unit configured to detect a position of a gazing point in an image based on a line-of-sight of a user;

a first setting unit configured to set an object detection range based on the position of the gazing point and an image capturing condition;

a second detection unit configured to detect a feature area from the image; and

a second setting unit configured to set a position of a focus detection area which is to be arranged in the image based on a position of the feature area included in the object detection range,

wherein the image capturing condition is followability of an object in a focus adjustment operation,

wherein the first setting unit determines a size of the object detection range based on a degree of intensity of the followability,

wherein the followability is a degree of object changeability, and

wherein, in a case where the degree of the object changeability is a first degree of object changeability, the first setting unit sets the object detection range narrower than the object detection range that is set in a case where the degree of the object changeability is a second degree of object changeability that is lower than the first degree of the object changeability.

18. A method for controlling an image capturing apparatus, the method comprising:

detecting, as first detection, a position of a gazing point in an image based on a line-of-sight of a user;

setting, as first setting, an object detection range based on the position of the gazing point;

detecting, as second detection, a feature area from the image; and

setting, as second setting, a position of a focus detection area which is to be arranged in the image based on a position of the feature area included in the object detection range,

wherein the first setting sets the object detection range according to a size of the focus detection area.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 5, 2021
From: HIROSE, MINORU; SUGITANI, KUNIAKI; SUZUKI, YASUYUKI; KIMOTO, SATOSHI; TAKAHASHI, RYOTARO; AKAGUMA, TAKAYUKI; TAKEUCHI, KENGO
To: CANON KABUSHIKI KAISHA
Reel/Frame 056755/0113 →
Priority Claims (1)
JP 2019-238006 · Dec 27, 2019 · national
Continuity (1)
Related Publication 20210203856A1 · Jul 1, 2021