Image processing device and image processing method

1 . An image processing device comprising:

at least one memory and at least one processor which function as a plurality of units comprising:

(1) a first acquisition unit configured to acquire a real space image obtained by capturing a real space and first image quality information, which is image quality information on the real space image;

(2) a second acquisition unit configured to (a) acquire at least one image, (b) generate a virtual object from the at least one image, and (c) acquire, from metadata added to the at least one image, second image quality information, which is image quality information on the virtual object;

(3) a correction unit configured to correct, based on the first image quality information and the second image quality information, image quality of at least one of the real space image and the virtual object; and

(4) a control unit configured to control a display to display a combined image obtained by combining the real space image and the virtual object, at least one of which having image quality that has been corrected by the correction unit.

2 . The image processing device according to claim 1 , wherein the at least one memory and the at least one processor further function as a detection unit configured to detect a change in a scene of the real space image, and

wherein the correction unit corrects the image quality of at least one of the real space image and the image quality of the virtual object based on (1) the change in the scene, (2) the first image quality information, and (3) the second image quality information.

3 . The image processing device according to claim 2 , wherein the correction unit corrects the image quality of the real space image without correcting the image quality of the virtual object in a case where the detection unit detects the change of the scene.

4 . The image processing device according to claim 2 , wherein the detection unit detects the change in the scene in a case where an amount of change in color or brightness within an angle of view of the real space image exceeds a first value or in a case where an amount of movement of an object within the angle of view exceeds a second value.

5 . The image processing device according to claim 1 , wherein the image quality information includes at least one of information of color, information of white balance, information of brightness, information of noise reduction, and information of how light is incident.

6 . The image processing device according to claim 5 , wherein the correction unit corrects a setting of a first item of the virtual object such that the setting of the first item of the virtual object matches a setting of a first item of the real space image, and

wherein the first item is at least one of noise reduction and how light is incident.

7 . The image processing device according to claim 5 , wherein the correction unit corrects a setting of a second item of the real space image such that the setting of the second item of the real space image matches a setting of a second item of the virtual object, and

wherein the second item is at least one of color, white balance, and brightness.

8 . The image processing device according to claim 1 , wherein the second acquisition unit acquires the second image quality information from metadata added to one image among the at least one image.

9 . The image processing device according to claim 1 , wherein the second acquisition unit acquires the second image quality information from metadata of an image among the at least one image, the image corresponding to an orientation of the virtual object at a time of being placed on the combined image.

10 . The image processing device according to claim 1 , wherein the second acquisition unit acquires a plurality of images and generates the virtual object based on the plurality of images, and

wherein the second acquisition unit acquires the second image quality information from metadata of two or more images among the plurality of images, the two or more images having identical settings of color, white balance, and brightness.

11 . The image processing device according to claim 1 , wherein the correction unit does not correct the image quality of the virtual object in a case where specific information is insufficient in metadata acquired by the second acquisition unit.

12 . The image processing device according to claim 1 , wherein, in a case where specific information is insufficient in metadata acquired by the second acquisition unit, the correction unit compensates for insufficiency of the specific information in accordance with a user operation.

13 . The image processing device according to claim 1 , wherein the second acquisition unit acquires a plurality of virtual objects and the second image quality information on each of the plurality of virtual objects,

wherein the correction unit corrects, based on the first image quality information and a plurality of pieces of the second image quality information, the image quality of at least one of the real space image and the plurality of virtual objects such that the plurality of virtual objects have identical image quality settings, and

wherein the control unit displays the combined image obtained by combining the real space image and the plurality of virtual objects, at least one of the real space image and the plurality of virtual objects having had image quality corrected by the correction unit.

14 . The image processing device according to claim 1 , wherein the virtual object is generated on a basis of an image obtained by capturing an object,

wherein time information related to shooting date and time of the image obtained by capturing the object is set to the virtual object, and

wherein the correction unit corrects the image quality of the virtual object based on the time information, the first image quality information, and the second image quality information.

15 . An image processing method comprising:

a first acquisition step of acquiring a real space image obtained by capturing a real space and first image quality information, which is image quality information on the real space image;

a second acquisition step of (a) acquiring at least one image, (b) generating a virtual object from the at least one image, and (c) acquiring, from metadata added to the at least one image, second image quality information, which is image quality information on the virtual object;

a correction step of correcting, based on the first image quality information and the second image quality information, image quality of at least one of the real space image and the virtual object; and

a control step of controlling a display to display a combined image obtained by combining the real space image and the virtual object, at least one of which having image quality that has been corrected in the correction step.

16 . A non-transitory computer-readable medium that stores a program, wherein the program causes a computer to execute an image processing method that includes:

a first acquisition step of acquiring a real space image obtained by capturing a real space and first image quality information, which is image quality information on the real space image;

a second acquisition step of (a) acquiring at least one image, (b) generating a virtual object from the at least one image, and (c) acquiring, from metadata added to the at least one image, second image quality information, which is image quality information on the virtual object;

a correction step of correcting, based on the first image quality information and the second image quality information, image quality of at least one of the real space image and the virtual object; and

a control step of controlling a display to display a combined image obtained by combining the real space image and the virtual object, at least one of which having image quality that has been corrected in the correction step.