Image processing apparatus, image processing method, display apparatus, and control method for display apparatus for generating and displaying a combined image of a high-dynamic-range image and a low-dynamic-range image
An image processing apparatus according to the present invention includes: a generating unit configured to generate a combined image in which a graphic image is combined on a non-combined image; and an outputting unit configured to output the combined image, wherein when generating a combined image in which a graphic image with a narrower dynamic range than the non-combined image is combined on the non-combined image, the generating unit generates a combined image in which brightness of at least one region among a region of the graphic image and a region of a periphery thereof is limited to a first threshold or lower.
1. An image processing method comprising:
generating a combined image in which a second image is combined on a first image; and
outputting the combined image, wherein
when generating a combined image in which a second image with a narrower dynamic range than the first image is combined on the first image, a combined image in which brightness of at least one region among a region of the second image and a region of a periphery thereof is limited to a first threshold or lower is generated.
2. An image processing apparatus comprising:
a processor; and
a memory storing a program which, when executed by the processor, causes the image processing apparatus to execute:
generating a combined image in which a second image is combined on a first image; and
outputting the combined image, wherein
when generating a combined image in which a second image with a narrower dynamic range than the first image is combined on the first image, a combined image in which brightness of at least one region among a region of the second image and a region of a periphery thereof is limited to a first threshold or lower is generated.
3. The image processing apparatus according to claim 2 , wherein
brightness of the combined image is limited by limiting brightness of the first image.
4. The image processing apparatus according to claim 3 , wherein
the image processing apparatus caused by the program further executes acquiring a base image and difference information for generating the first image by extending a dynamic range of the base image,
the difference information is corrected, and
the combined image is generated using the difference information after correction, the base image, and the second image.
5. The image processing apparatus according to claim 4 , wherein
the difference information is brightness ratio information representing, for each pixel, a ratio between a gradation value before extending a dynamic range and a gradation value after extending the dynamic range.
6. The image processing apparatus according to claim 4 , wherein
the difference information is a tone map representing a correspondence relationship between a gradation value before extending a dynamic range and a gradation value after extending the dynamic range.
7. The image processing apparatus according to claim 2 , wherein
the second image is an image having set transparency, and
brightness of the combined image is limited by correcting the transparency of the second image.
8. The image processing apparatus according to claim 2 , wherein
a combined image in which brightness is not limited is generated, and
brightness of the combined image in which brightness is not limited is limited in order to generate the combined image in which brightness is limited.
9. The image processing apparatus according to claim 2 , wherein
a nearby high-brightness region which includes a pixel with a gradation value equal to or higher than a second threshold and the distance of which from the second image is equal to or less than a third threshold is detected, and
a combined image in which brightness of the nearby high-brightness region is limited to the first threshold or lower is generated.
10. The image processing apparatus according to claim 2 , wherein
the combined image is generated for each frame,
the combined image is outputted to a display unit,
the display unit displays the combined image for each frame,
the image processing apparatus caused by the program further executes determining whether or not attention of a user is focused on the second image in the displayed combined image based on a region of the second image, and
a process for generating the combined image in which brightness is limited is omitted when it is determined that the attention of the user is not focused on the second image.
11. The image processing apparatus according to claim 10 , wherein
when a user operation with respect to the second image has not been performed for a period of time equal to or longer than a fourth threshold, it is determined that the attention of the user is not focused on the second image.
12. The image processing apparatus according to claim 10 , wherein
when a region of the second image is changing at a higher rate than a fifth threshold, it is determined that the attention of the user is not focused on the second image.
13. The image processing apparatus according to claim 2 , wherein
the image processing apparatus caused by the program further executes determining whether or not the first image is an HDR image, wherein
the combined image in which brightness is limited is generated when the first image is determined to be the HDR image.
14. The image processing apparatus according to claim 13 , wherein
it is determined that the first image is an HDR image when the number of bits in the first image is equal to or larger than 8.
15. The image processing apparatus according to claim 13 , wherein
it is determined that the first image is an HDR image when a data format of the first image is a floating point format.
16. The image processing apparatus according to claim 13 , wherein
it is determined that the first image is an HDR image when a data format of the first image is an OpenEXR format.
17. The image processing apparatus according to claim 13 , wherein
it is determined that the first image is an HDR image when a base image and difference information for generating the first image are input to the image processing apparatus.
18. The image processing apparatus according to claim 2 , wherein the first threshold is a value corresponding to brightness of the second image.
19. The image processing apparatus according to claim 2 , wherein the first threshold is 100 [cd/m 2 ].
20. The image processing apparatus according to claim 2 , wherein brightness of the second image is lower than brightness of the first image.
21. A non-transitory computer readable medium that stores a program, wherein
the program causes a computer to execute the image processing method,
the image processing method includes:
generating a combined image in which a second image is combined on a first image; and
outputting the combined image, and
when generating a combined image in which a second image with a narrower dynamic range than the first image is combined on the first image, a combined image in which brightness of at least one region among a region of the second image and a region of a periphery thereof is limited to a first threshold or lower is generated.
22. A display apparatus comprising:
the image processing apparatus according to claim 2 ;
a light-emitting unit;
a display unit configured to display age on a screen by modulating light emitted from the light-emitting unit;
a processor; and
a memory storing a program which, when executed by the processor, causes the display apparatus to execute controlling emission brightness of the light-emitting unit, wherein when a combined image, in which a second image with a narrower dynamic range than a first image is combined on the first image, is generated, the emission brightness of the light-emitting unit is limited so that display brightness of at least one region among a region of the second image and a region of a periphery thereof is limited to a threshold or lower.
23. An image processing method comprising:
generating a combined image in which a second image is combined on a first image; and
outputting the combined image, wherein
when generating a combined image in which a second image with a narrower dynamic range than the first image is combined on the first image, a combined image in which brightness of at least one region among a region of the second image and a region of a periphery thereof is reduced is outputted.
24. An image processing apparatus comprising:
a processor; and
a memory storing a program which, when executed by the processor, causes the image processing apparatus to execute:
generating a combined image in which a second image is combined on a first image; and
outputting the combined image, wherein
when generating a combined image in which a second image with a narrower dynamic range than the first image is combined on the first image, a combined image in which brightness of at least one region among a region of the second image and a region of a periphery thereof is reduced is outputted.
25. The image processing apparatus according to claim 24 , wherein
brightness of the combined image is reduced by reducing brightness of the first image.
26. The image processing apparatus according to claim 24 , wherein
the second image is an image having set transparency, and
brightness of the combined image is reduced by correcting the transparency of the second image.
27. The image processing apparatus according, to claim 24 , wherein
a combined image in which brightness of a nearby high-brightness region is reduced is outputted, the nearby high-brightness region including a pixel with a gradation value equal to or higher than a first threshold, and the distance from the second image to the nearby high-brightness region being equal to or less than a second threshold.
28. The image processing apparatus according to claim 24 , wherein
the image processing apparatus caused by the program further executes determining whether or not the first image is an HDR image, wherein
the combined image in which brightness is reduced is outputted when the first image is determined to be the HDR image.
29. The image processing apparatus according to claim 24 , wherein brightness of the second image is lower than brightness of the first image.
30. A display apparatus comprising:
the image processing apparatus according to claim 24 ;
a light-emitting unit;
a display unit configured to display an image on a screen by imodulating light emitted from the light-emitting unit;
a processor; and
a memory storing a program which, when executed by the processor causes the display apparatus to execute controlling emission brightness of the light-emitting unit, wherein
when a combined image, in which a second image with a narrower dynamic range than a first image is combined on the first image, is generated, the emission brightness of the light-emitting unit is reduced so that display brightness of at least one region among a region of the second image and a region of a periphery thereof is reduced.