Image processing apparatus and control method of image processing apparatus
An image processing apparatus includes an acquisition unit configured to acquire an image captured by an imaging unit, and image capturing information at the time of image capturing of the image, and a calculation unit configured to calculate an object side pixel dimension of a target subject in the image based on the image capturing information and a pixel dimension of the imaging unit, wherein the acquisition unit acquires in-focus information indicating an in-focus state of a subject in an image, as the image capturing information, and wherein the calculation unit calculates the object side pixel dimension based on the in-focus information.
1. An image processing apparatus comprising:
an acquisition unit configured to acquire an image captured by an imaging unit, and image capturing information at the time of image capturing of the image;
a calculation unit configured to calculate an object side pixel dimension of a target subject in the image based on the image capturing information and a pixel dimension of the imaging unit; and
an image processing unit configured to process the image captured by the imaging unit, based on the object side pixel dimension,
wherein the acquisition unit acquires in-focus information indicating an in-focus state of a subject in an image, as the image capturing information,
wherein the calculation unit calculates the object side pixel dimension based on the in-focus information, and
wherein, in a subject region in which calculation of the object side pixel dimension has failed, the image processing unit estimates the object side pixel dimension of the subject region in which calculation of the object side pixel dimension has failed, by using a size of a subject region detected by a subject detection unit, and a size of a subject region detected by the subject detection unit in a subject region in which the object side pixel dimension has been calculated, and calculates an estimated object side pixel dimension.
2. The image processing apparatus according to claim 1 ,
wherein the acquisition unit acquires output destination information regarding an output destination device that outputs the image, and
wherein the image processing unit generates an output image by converting the image based on the output destination information in such a manner that a subject of the image is in full scale in an output on the output destination device, based on the object side pixel dimension calculated by the calculation unit.
3. The image processing apparatus according to claim 1 , wherein the image processing unit records information into image data in such a manner that the object side pixel dimension and the estimated object side pixel dimension are discriminable.
4. The image processing apparatus according to claim 1 , wherein, when a plurality of subjects having the object side pixel dimension are combined into one image, by selecting one subject from the plurality of subjects and changing a size of the subject, the image processing unit changes a size of a subject having the object side pixel dimension that is other than the subject while maintaining a relative size.
5. The image processing apparatus according to claim 1 , wherein, using the number of pixels of a subject detected by subject detection and the object side pixel dimension, the image processing unit calculates a size of the subject, and in a case where a calculated dimension of the subject is larger or smaller than a prestored dimension of the subject by a threshold value or more, the image processing unit performs subject clipping based on the prestored dimension of the subject.
6. The image processing apparatus according to claim 1 , wherein, in a case where full scale printing is set, the image processing unit calculates a size of a printed product using the object side pixel dimension of a main subject, and generates a divided image for printing based on a set sheet size.
7. The image processing apparatus according to claim 1 , wherein, by using the object side pixel dimension of each of a plurality of subjects in an image, the image processing unit converts images of the plurality of subjects in accordance with actual sizes, and generates an image by which dimensions of the plurality of subjects are relatively compared.
8. The image processing apparatus according to claim 1 , wherein the calculation unit calculates the object side pixel dimension based on at least any one of a variation amount of a focal length corresponding to the in-focus information, a subject distance, and a principal point position of an optical system.
9. The image processing apparatus according to claim 1 , wherein, using a subject distance to an in-focus subject as the image capturing information, the calculation unit calculates the object side pixel dimension in the subject distance.
10. The image processing apparatus according to claim 1 , wherein the calculation unit calculates the object side pixel dimension based on an image capturing magnification corresponding to the in-focus information.
11. The image processing apparatus according to claim 1 ,
wherein the acquisition unit acquires depth distribution information corresponding to the image, and
wherein the calculation unit calculates the object side pixel dimension at each pixel position of the depth distribution information using the depth distribution information.
12. The image processing apparatus according to claim 11 , wherein the calculation unit acquires a subject distance to at least one subject existing at an arbitrary position in the image, using the depth distribution information, and calculates the object side pixel dimension in the subject distance using the subject distance.
13. The image processing apparatus according to claim 11 , wherein the depth distribution information is at least any one of distribution information of a parallax amount indicated by a phase difference signal corresponding to the image, distribution information of a defocus amount of a subject existing in the image, and distribution information of a subject distance to a subject existing in the image.
14. The image processing apparatus according to claim 1 , wherein the output destination information is information regarding at least any one of a print sheet dimension, a display screen dimension, and a display screen resolution.
15. The image processing apparatus according to claim 1 , further comprising a control unit configured to calculate the number of pixels per at least one unit length from an object side pixel dimension calculated by the calculation unit, and record the number of pixels per unit length in association with a corresponding image.
16. The image processing apparatus according to claim 15 , wherein the control unit records, as the number of pixels per unit length, pixel per inch (PPI) information into an image file in an Exchangeable image file format (Exif) format together with image data of a corresponding image.
17. The image processing apparatus according to claim 15 ,
wherein, by executing face detection processing on the image and executing the calculation unit using a subject distance of a detected face region, the image processing unit calculates an object side pixel dimension or the number of pixels per unit length of at least one region of the image, and
wherein the control unit records at least either one of the object side pixel dimension and the number of pixels per unit length in association with the corresponding image.
18. The image processing apparatus according to claim 1 , wherein, based on the number of pixels of a region that is designated by a graphical user interface (GUI) to be superimposed on the image, the control unit calculates a dimension of the region that is designated by the GUI, from the object side pixel dimension, and displays the dimension on a display unit.
19. An imaging apparatus comprising:
an image sensor configured to acquire a phase difference signal from a plurality of photoelectric conversion units;
the image processing apparatus according to claim 1 ; and
a conversion unit.
20. A display device comprising:
the image processing apparatus according to claim 1 ; and
a display unit configured to display the image.
21. A printing apparatus comprising:
the image processing apparatus according to claim 1 ; and
a printing unit configured to print the image.
22. An image processing method comprising:
acquiring an image captured by an imaging unit, and image capturing information at the time of image capturing of the image; and
calculating an object side pixel dimension of a subject in the image based on the image capturing information and a pixel dimension of the imaging unit; and
processing the image captured by the imaging unit, based on the object side pixel dimension,
wherein, in the acquiring, in-focus information indicating an in-focus state of a subject in an image is acquired as the image capturing information,
wherein, in the calculating, the object side pixel dimension is calculated based on the in-focus information, and
wherein, in a subject region in which calculation of the object side pixel dimension has failed, the processing estimates the object side pixel dimension of the subject region in which calculation of the object side pixel dimension has failed, by using a size of a subject region detected by a subject detection unit, and a size of a subject region detected by the subject detection unit in a subject region in which the object side pixel dimension has been calculated, and calculates an estimated object side pixel dimension.
23. A non-transitory storage medium storing a program for causing a computer to execute a procedure to be executed by each unit of the image processing apparatus according to claim 1 .