Image processing apparatus, method of controlling the same, and a non-transitory computer-readable storage medium that output inference results and store management information of images
An image processing apparatus includes a memory storing a program that, when executed, causes processor(s) to detect subjects from an image, to classify the detected subjects by performing inference processing to output first and second inference results, to generate an image file including image data of the image and the first inference results without the second, and to record the image file in a recording medium, and to store management information, including information specifying the image file and the second inference results in a management file different from the image file and that is recorded in the recording medium. The management file includes management information of a plurality of the images. The first inference results are results of the inference processing for a main subject among the detected subjects and the second inference results are results of the inference processing for subjects for the detected subjects other than the subject.
1 . An image processing apparatus comprising:
one or more processors;
a memory; and
a program stored in the memory that, when executed by the one or more processors, causes the one or more processors to perform:
detecting a plurality of subjects including a main subject and another subject from an image;
performing inference processing for classifying the plurality of detected subjects to acquire inference results including first inference results and second inference results, wherein the first inference results are at least a portion of inference results of the inference processing for the main subject among the plurality of detected subjects and the second inference results include inference results of the inference processing for the other subject among the plurality of detected subjects;
generating an image file that includes image data of the image and the first inference results for the main subject without the second inference results for the other subject, and recording the image file in a recording medium, wherein the first inference results are included in the image file according to a first format defined in a predetermined standard; and
storing management information, including information for specifying the image file and the second inference results for the other subject, in a management file that is different from the image file and that is recorded in the recording medium according to a second format, wherein the second format, which is unique to a manufacturer of the image processing apparatus, does not allow use of the management file without using software from the manufacturer.
2 . The image processing apparatus according to claim 1 , wherein the management information further includes information regarding an inference model used by a processing unit for the inference processing.
3 . The image processing apparatus according to claim 1 , wherein the main subject is determined, from among the plurality of detected subjects, based on at least one of sizes of the subject areas in the image, sizes of a specific part of the subjects in the image, and a displacement amount of the subjects from a center position of the image.
4 . The image processing apparatus according to claim 1 , wherein the main subject is a subject detected within a designated area in the image.
5 . The image processing apparatus according to claim 1 , wherein the management information further includes the first inference results.
6 . The image processing apparatus according to claim 1 , wherein the management file includes pieces of the management information respectively associated with a plurality of image files.
7 . The image processing apparatus according to claim 1 , wherein the program stored in the memory that, when executed by the one or more processors, further causes the one or more processors to perform:
determining whether an external display apparatus that is connected to the image processing apparatus can use the management file; and
transmitting the image file to the external display apparatus,
wherein, in the transmitting, the image file and the management file are transmitted to the external display apparatus if it is determined in the determining that the external display apparatus can use the management file, and, in the transmitting, only the image file is transmitted to the external display apparatus if it is determined in the determining that the external display apparatus cannot use the management file.
8 . The image processing apparatus according to claim 7 , wherein, in the determining, it is determined that the external display apparatus can use the management file if the external display apparatus uses predetermined software that can be used to refer to the management file.
9 . The image processing apparatus according to claim 7 , wherein, in the determining, it is determined that the external display apparatus can use the management file if the external display apparatus returns a response to a predetermined command.
10 . The image processing apparatus according to claim 7 , wherein, in the determining, it is determined that the external display apparatus can use the management file if a predetermined user registration has been performed on the external display apparatus.
11 . The image processing apparatus according to claim 1 , further comprising an image sensor for capturing the image.
12 . A method of controlling an image processing apparatus, the method comprising:
detecting a plurality of subjects including a main subject and another subject from an image;
performing inference processing for classifying the plurality of detected subjects to acquire inference results including first inference results and second inference results, wherein the first inference results are at least a portion of inference results of the inference processing for the main subject among the plurality of detected subjects and the second inference results include inference results of the inference processing for the other subjects of the plurality of detected subjects;
generating an image file that includes image data of the image and the first inference results for the main subject without the second inference results for the other subject, and recording the image file in a recording medium, wherein the first inference results are included in the image file according to a first format defined in a predetermined standard; and
storing management information, including information for specifying the image file and the second inference results for the other subject, in a management file that is different from the image file and that is recorded in the recording medium according to a second format, wherein the second format, which is unique to a manufacturer of the image processing apparatus, does not allow usage of the management file without using software from the manufacturer.
13 . A non-transitory computer-readable storage medium storing one or more programs including instructions that, when executed by a processor of an image processing apparatus, cause the image processing apparatus to perform:
detecting a plurality of subjects including a main subject and another subject from an image;
performing inference processing for classifying the plurality of detected subjects to acquire inference results including first inference results and second inference results, wherein the first inference results are at least a portion of inference results of the inference processing for the main subject among the plurality of detected subjects and the second inference results include inference results of the inference processing for the other subjects of the plurality of detected subjects;
generating an image file that includes image data of the image and the first inference results for the main subject without the second inference results for the other subject, and recording the image file in a recording medium, wherein the first inference results are included in the image file according to a first format defined in a predetermined standard; and
storing management information, including information for specifying the image file and second inference results for the other subject, in a management file that is different from the image file and that is recorded in the recording medium according to a second format, wherein the second format, which is unique to a manufacturer of the image processing apparatus, does not allow usage of the management file without using software from the manufacturer.