Information processing apparatus, learning device, imaging apparatus, control method of information processing apparatus, and program
An information processing apparatus includes a processor and a memory connected to or built in the processor. In a case in which imaging accompanied by a focus operation in which a specific subject is used as a focus target region is performed by an image sensor, the processor outputs specific subject data related to a specific subject image indicating the specific subject in a captured image obtained by the imaging as data used in machine learning.
1 . An information processing apparatus comprising:
a processor; and
a memory connected to or built in the processor,
wherein,
the processor displays a plurality of label candidates on a screen for selection and receives a selected label among the plurality of label candidates, wherein each of the plurality of label candidates is a class of a subject image,
in a case in which imaging accompanied by a focus operation in which a specific subject is used as a focus target region is performed by an image sensor, the processor extracts an image of the focus target region as a specific subject image from a captured image obtained by the imaging, and generates training data comprising the specific subject data related to the specific subject image indicating the specific subject in a captured image obtained by the imaging, the selected label which is a class of the specific subject image, and coordinates of the focused target region in the captured image
the processor transmits the generated training data to a computing device for machine learning.
2 . The information processing apparatus according to claim 1 ,
wherein the machine learning is supervised machine learning, and
the processor
gives a label, which is the class of the specific subject image, to the specific subject data, and
outputs the specific subject data as the training data used in the supervised machine learning.
3 . The information processing apparatus according to claim 1 ,
wherein the processor displays the focus target region in an aspect that is distinguishable from other image regions in a state in which a video for display based on a signal output from the image sensor is displayed on a monitor, and
the specific subject image is an image corresponding to a position of the focus target region in the captured image.
4 . The information processing apparatus according to claim 3 ,
wherein the processor displays the focus target region in the aspect that is distinguishable from the other image regions by displaying a frame that surrounds the focus target region in the video for display.
5 . The information processing apparatus according to claim 4 ,
wherein a position of the frame is changeable in accordance with a given position change instruction.
6 . The information processing apparatus according to claim 4 ,
wherein a size of the frame is changeable in accordance with a given size change instruction.
7 . The information processing apparatus according to claim 1 ,
wherein the processor
displays a video for display based on a signal output from the image sensor on a monitor,
receives designation of the focus target region in the video for display, and
extracts the specific subject image based on a region of which a similarity evaluation value indicating a degree of similarity to the focus target region is within a first predetermined range in a predetermined region including the focus target region.
8 . The information processing apparatus according to claim 7 ,
wherein the processor displays the focus target region in an aspect that is distinguishable from other image regions.
9 . The information processing apparatus according to claim 7 ,
wherein at least one of the focus target region or the specific subject image is determined in units of division regions obtained by dividing the predetermined region.
10 . The information processing apparatus according to claim 7 ,
wherein the similarity evaluation value is a value based on a focus evaluation value used in the focus operation.
11 . The information processing apparatus according to claim 7 ,
wherein the similarity evaluation value is a color evaluation value based on color information of the predetermined region.
12 . The information processing apparatus according to claim 7 ,
wherein the processor performs abnormality detection processing in a case in which a degree of difference between a specific subject image for display indicating the specific subject in the video for display and the specific subject image exceeds a second predetermined range, and
the specific subject image for display is determined based on the similarity evaluation value.
13 . The information processing apparatus according to claim 1 ,
wherein the specific subject data includes coordinates of the specific subject image, and
the processor outputs the captured image and the coordinates of the specific subject image as the training data used in the machine learning.
14 . The information processing apparatus according to claim 1 ,
wherein the specific subject data is the specific subject image cut out from the captured image, and
the processor outputs the cut out specific subject image as the training data used in the machine learning.
15 . The information processing apparatus according to claim 1 ,
wherein the processor
stores the training data in the memory, and
performs the machine learning using the training data stored in the memory.
16 . The information processing apparatus of claim 1 ,
wherein the coordinates of the focused target region are position coordinates of at least two corners of the focused target region in the captured image.
17 . A learning device comprising:
a reception device that receives the training data output from the information processing apparatus according to claim 1 ; and
an operation device that performs the machine learning using the training data received by the reception device.
18 . An imaging apparatus comprising:
the information processing apparatus according to claim 1 ; and
the image sensor.
19 . The imaging apparatus according to claim 18 ,
wherein the image sensor performs the imaging at a plurality of focus positions, and
for a plurality of the captured images obtained by performing the imaging, the processor outputs coordinates of the specific subject image obtained from a focus image in which the specific subject is in focus as coordinates of the specific subject image in an out-of-focus image in which the specific subject is not in focus.
20 . A control method of an information processing apparatus, the method comprising:
displaying a plurality of label candidates on a screen for selection and receiving a selected label among the plurality of label candidates, wherein each of the plurality of label candidates is a class of a subject image;
in a case in which imaging accompanied by a focus operation in which a specific subject is used as a focus target region is performed by an image sensor, extracting an image of the focus target region as a specific subject image from a captured image obtained by the imaging, and generating training data comprising the specific subject data related to the specific subject image indicating the specific subject in a captured image obtained by the imaging, the selected label which is a class of the specific subject image, and coordinates of the focused target region in the captured image; and
transmitting the generated training data to a computing device for machine learning.
21 . A non-transitory computer-readable storage medium storing a program executable by a computer to perform a process comprising:
displaying a plurality of label candidates on a screen for selection and receiving a selected label among the plurality of label candidates, wherein each of the plurality of label candidates is a class of a subject image;
in a case in which imaging accompanied by a focus operation in which a specific subject is used as a focus target region is performed by an image sensor, extracting an image of the focus target region as a specific subject image from a captured image obtained by the imaging, and generating training data comprising the specific subject data related to the specific subject image indicating the specific subject in a captured image obtained by the imaging, the selected label which is a class of the specific subject image, and coordinates of the focused target region in the captured image; and
transmitting the generated training data to a computing device for machine learning.