IP Library › Granted Patent US 10,893,191
Granted Patent B2
US 10,893,191 · App. 16/229,127 · Granted Jan 12, 2021

Image capturing apparatus, method of controlling the same, and storage medium

Inventor: Hideki Kadoi (Tokyo, JP)
Assignee: CANON KABUSHIKI KAISHA
H04N5/23222G06K9/20G06K9/627G06K9/6262H04N5/23216
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,893,191
App. No.
16/229,127
Filed
Dec 21, 2018
Granted
Jan 12, 2021
Kind
B2
Art Unit
2697
USPC
348/222.1
Abstract

An image capturing apparatus includes an acquisition unit configured to acquire data concerning a captured image captured by an image capturing unit, a learning unit configured to learn a condition of an image that a user likes, based on supervised data, a control circuit configured to decide automatic image capturing by the image capturing unit based on the condition learned by the learning unit and to register, as the supervised data, data acquired by the acquisition unit for a captured image obtained by image capturing performed based on an instruction of the user, and data acquired by the acquisition unit for captured images for learning which are captured before and/or after the image capturing performed based on an instruction of the user.

Claims (27)

1. An image capturing apparatus comprising:

an image capturing device configured to capture an image;

a control circuit configured to decide whether or not to perform an automatic image capturing by the image capturing device, using parameters obtained in a learning operation in which a learning circuit learns conditions of images that a user likes based on supervised data;

wherein the control circuit sets a score used by the learning circuit in the learning operation, to a first image captured by the image capturing device based on an instruction of a user and a plurality of second images continuously captured by the image capturing device before and/or after the image capturing of the first image, and registers the first and second images and the scores as the supervised data, and

wherein the scores set to the plurality of second images are lower than the score set to the first image.

2. The apparatus according to claim 1 , further comprising a development circuit configured to develop the captured image, the development circuit developing the the plurality of second images under a condition different from that for the first image.

3. The apparatus according to claim 1 , wherein the image capturing instruction of the user is performed by input of a predetermined voice command.

4. The apparatus according to claim 1 , wherein the image capturing instruction of the user is performed via an external apparatus capable of communicating with the image capturing apparatus.

5. The apparatus according to claim 1 , wherein a supervised value of each of the plurality of second images is determined such that the larger a difference between an image capturing condition of the first image and that of each of the plurality of second images becomes, the larger a difference between a supervised value of the first image and that of each of the plurality of second images becomes.

6. The apparatus according to claim 1 , wherein a supervised value of each of the plurality of second images is determined such that the larger a difference between a shutter timing of the first image and that of each of the plurality of second images becomes, the larger a difference between a supervised value of the first image and that of each of the plurality of second images becomes.

7. The apparatus according to claim 1 , wherein the control circuit registers at least some of the plurality of second images as negative supervised data.

8. The apparatus according to claim 7 , wherein the control circuit registers, as the negative supervised data, an image of the plurality of second images, whose similarity to the first image is lower than a threshold.

9. The apparatus according to claim 1 , wherein the plurality of second images are images captured by changing an image capturing condition of the first image and at least one of conditions of focus, exposure, white balance, strobe light emission, and zoom.

10. The apparatus according to claim 1 , wherein the plurality of second images are generated from a moving image captured immediately before or immediately after the first image capturing performed.

11. The apparatus according to claim 1 , wherein the plurality of second images are continuously shot images captured immediately before or immediately after capturing the first image capturing performed.

12. The apparatus according to claim 1 , wherein the image capturing device captures the plurality of second images using an electronic shutter.

13. The apparatus according to claim 1 , wherein when the number of supervised data is smaller than a predetermined number, the control circuit causes the image capturing device to capture the plurality of second images.

14. The apparatus according to claim 1 , wherein

in a vector formed by combining feature amounts of input layers of the neural network, if a difference between data of the first image and data of each of the plurality of second images is not less than a predetermined value, the plurality of second images are not used as the supervised data.

15. A method of controlling an image capturing apparatus, comprising:

controlling to decide whether or not to perform an automatic image capturing by an image capturing device, using parameters obtained in a learning operation in which a learning circuit learns conditions of images that a user likes based on supervised data;

wherein, in the controlling, a score used by a learning circuit in the learning operation is set to a first image captured by the image capturing device based on an instruction of a user and a plurality of second images continuously captured by the image capturing device before and/or after the image capturing of the first image, and the first and second images and the scores are registered as the supervised data, and

wherein the scores set to the plurality of second images are lower than the score set to the first image.

16. A non-transitory computer-readable storage medium storing a program configured to cause a computer to execute step of a method of controlling an image capturing apparatus, the method comprising:

controlling to decide whether or not to perform an automatic image capturing by an image capturing device, using parameters obtained in a learning operation in which a learning circuit learns conditions of images that a user likes based on supervised data;

wherein, in the controlling, a score used by a learning circuit in the learning operation is set to a first image captured by the image capturing device based on an instruction of a user and a plurality of second images continuously captured by the image capturing device before and/or after the image capturing of the first image, and the first and second images and the scores are registered as the supervised data, and

wherein the scores set to the plurality of second images are lower than the score set to the first image.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 8, 2019
From: KADOI, HIDEKI
To: CANON KABUSHIKI KAISHA
Reel/Frame 048544/0941 →
Priority Claims (2)
JP 2017-250104 · Dec 26, 2017 · national
JP 2018-203255 · Oct 29, 2018 · national
Continuity (1)
Related Publication 20190199917A1 · Jun 27, 2019