IP Library › Granted Patent US 11,451,704
Granted Patent B2
US 11,451,704 · App. 16/902,602 · Granted Sep 20, 2022

Image capturing apparatus, method for controlling the same, and storage medium

Inventor: Kenji Ouchi (Tokyo, JP)
Assignee: CANON KABUSHIKI KAISHA
H04N5/23218G06N3/08G06V10/10H04N5/23222H04N5/23299H04N5/232411
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,451,704
App. No.
16/902,602
Granted
Sep 20, 2022
Kind
B2
Abstract

The present invention eliminates meaningless searching for an object, and increases the probability that an image the user likes can be obtained. An image capturing apparatus comprises an image capturing device configured to capture an object image, an object detection unit configured to detect an object from image data captured by the image capturing device, a state detection unit configured to detect information pertaining to a state in which the image capturing apparatus is being held, and a control unit configured to control a range in which the object detection unit searches for an object, on the basis of state information of the image capturing apparatus detected by the state detection unit.

Claims (54)

1. An image capturing apparatus, comprising:

an image capturing device configured to capture an object image;

at least one processor or circuit configured to function as:

an object detection unit configured to detect an object from image data captured by the image capturing device;

a changing unit configured to change an orientation of the image capturing device so that the image capturing device faces in a direction of an object;

a state detection unit configured to detect information pertaining to a state in which the image capturing apparatus is being held; and

a control unit configured to control a changing range of an orientation of the image capturing device during the object detection unit searches for an object, on the basis of state information of the image capturing apparatus detected by the state detection unit,

wherein the control unit makes the changing range of the orientation of the image capturing device during the object detection unit searches for an object wider in a case where a holding state of the image capturing apparatus is a stationary capturing state than in a case where the holding state of the image capturing apparatus is not the stationary capturing state.

2. The image capturing apparatus according to claim 1 , wherein

the state in which the image capturing apparatus is not the stationary capturing state includes at least one of a handheld state, being hung from a neck, a wearable state.

3. The image capturing apparatus according to claim 1 , wherein

the control unit sets a range to search for an object to an angular range that is horizontally symmetrical with respect to a travel direction of the image capturing apparatus.

4. The image capturing apparatus according to claim 1 , wherein

the state detection unit detects information of an attachment attached to the image capturing apparatus, and the control unit controls the range in which the object detection unit searches for an object in accordance with the information of the attached attachment.

5. The image capturing apparatus according to claim 1 , wherein

a different neural network is provided for each state of the image capturing apparatus, and a neural network suited to the state of the image capturing apparatus is applied.

6. The image capturing apparatus according to claim 1 , wherein the at least one processor or circuit is configured to further function as an automatic image capturing unit configured to make the image capturing device to perform image capturing based on information of the object detected by the object detection unit and record the captured image.

7. The image capturing apparatus according to claim 6 , wherein the at least one processor or circuit is configured to further function as

an image capturing frequency determination unit configured to determine an image capturing frequency of the automatic image capturing unit, and

wherein the image capturing frequency is determined on the basis of the state information of the image capturing apparatus.

8. The image capturing apparatus according to claim 6 , wherein the automatic image capturing unit controls to automatically carry out the image capturing operation using parameters generated by a machine learning.

9. The image capturing apparatus according to claim 8 , wherein the image capturing operation is changed by updating the parameters based on the machine learning using data output by the image capturing device.

10. The image capturing apparatus according to claim 1 , wherein the at least one processor or circuit is configured to further function as

a low-power mode control unit, and

wherein low-power mode control is carried out on the basis of the state information of the image capturing apparatus.

11. The image capturing apparatus according to claim 1 , wherein the changing unit causes the image capturing device to rotate in a pan direction or a tilt direction.

12. An image capturing apparatus, comprising:

an image capturing device configured to capture an object image;

at least one processor or circuit configured to function as:

an object detection unit configured to detect an object from image data captured by the image capturing device;

a state detection unit configured to detect information pertaining to a state in which the image capturing apparatus is being held; and

a control unit configured to control a range in which the object detection unit searches for an object, on the basis of state information of the image capturing apparatus detected by the state detection unit,

wherein the control unit limits the range in which the object detection unit searches for an object so that a user's body is not visible.

13. The image capturing apparatus according to claim 12 , wherein the at least one processor or circuit is configured to further function as

a changing unit configured to change an orientation of the image capturing device so that the image capturing device faces in a direction of an object.

14. The image capturing apparatus according to claim 13 , wherein

the changing unit causes the image capturing device to rotate in a pan direction or a tilt direction.

15. The image capturing apparatus according to claim 13 , wherein

the range for searching for an object is a range in which the changing unit changes the orientation of the image capturing device.

16. The image capturing apparatus according to claim 12 , wherein the control unit limits the range in which the object detection unit searches for an object so that the user's body is not visible in a state the image capturing apparatus being hung from a neck or a wearable state.

17. The image capturing apparatus according to claim 12 , wherein a different neural network is provided for each state of the image capturing apparatus, and a neural network suited to the state of the image capturing apparatus is applied.

18. The image capturing apparatus according to claim 12 , wherein the at least one processor or circuit is configured to further function as an automatic image capturing unit configured to make the image capturing device to perform image capturing based on information of the object detected by the object detection unit and record the captured image.

19. A method of controlling an image capturing apparatus, the image capturing apparatus including an image capturing device configured to capture an object image, and the method comprising:

detecting an object from image data captured by the image capturing device;

changing an orientation of the image capturing device so that the image capturing device faces in a direction of an object;

detecting information pertaining to a state in which the image capturing apparatus is being held; and

controlling a changing range of an orientation of the image capturing device during an object is searched for in the object detection, on the basis of state information of the image capturing apparatus detected in the state detection,

wherein in the controlling, the changing range of the orientation of the image capturing device during an object is searched for in the object detection is set to be wider in a case where a holding state of the image capturing apparatus is a stationary capturing state than in a case where the holding state of the image capturing apparatus is not the stationary capturing state.

20. A non-transitory computer-readable storage medium in which is stored a program for causing a computer to execute a method of controlling an image capturing apparatus, the image capturing apparatus including an image capturing device configured to capture an object image, and the method comprising:

detecting an object from image data captured by the image capturing device;

changing an orientation of the image capturing device so that the image capturing device faces in a direction of an object;

detecting information pertaining to a state in which the image capturing apparatus is being held; and

controlling a changing range of an orientation of the image capturing device during an object is searched for in the object detection, on the basis of state information of the image capturing apparatus detected in the state detection,

wherein in the controlling, the changing range of the orientation of the image capturing device during an object is searched for in the object detection is set to be wider in a case where a holding state of the image capturing apparatus is a stationary capturing state than in a case where the holding state of the image capturing apparatus is not the stationary capturing state.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 26, 2020
From: OUCHI, KENJI
To: CANON KABUSHIKI KAISHA
Reel/Frame 053062/0880 →
Priority Claims (2)
JP JP2017-242228 · Dec 18, 2017 · national
JP JP2017-254402 · Dec 28, 2017 · national
Continuity (2)
Continuation PCTJP2018044548 · Dec 4, 2018
Related Publication 20200314331A1 · Oct 1, 2020