Image processing device, image display system, method, and program for generating a composite image

1. An image processing device comprising:

circuitry configured to

acquire at least one first image, and

set, when generating a composite image obtained by combining a selected first image captured in a first exposure time and a second image that includes an image corresponding to a partial region of the at least one first image and is captured in a second exposure time shorter than the first exposure time, the at least one first image and the second image being input from an image sensor, imaging timing of the second image to timing closer to timing of outputting the composite image to a display device than imaging timing of the at least one first image,

wherein the selected first image is selected according to whether the partial region includes a predetermined region of interest.

2. The image processing device according to claim 1 , wherein

resolution of the first image is first resolution, and

resolution of the second image is second resolution higher than the first resolution.

3. The image processing device according to claim 1 , wherein

the predetermined region of interest is displayed by the composite image, and

a region other than the region of interest is displayed based on the first image.

4. The image processing device according to claim 3 , wherein

a plurality of the first images having different camera exposure timings are acquired and held, and

when the region other than the region of interest is displayed based on the first image, display is performed using any one of the first images in which a time from the camera exposure timing to the timing of output to the display device is relatively short among the plurality of first images.

5. The image processing device according to claim 3 , wherein

the control unit sets a timing adjustment margin for absorbing a fluctuation in imaging timing accompanying a change in the region of interest before and after the imaging timing of the second image, and

sets the imaging timing of the first image at timing other than the timing adjustment margin and the imaging timing of the second image.

6. The image processing device according to claim 1 , wherein

the first image is a binning image, and

the second image is a blur-reduced image in which the second exposure time is set for a purpose of blur reduction.

7. The image processing device according to claim 1 , wherein

the control unit generates the composite image and outputs the composite image to the display device in real time.

8. An image display system comprising:

an imaging device that includes an image sensor, wherein the imaging device is configured to output at least one first image captured in a first exposure time and having first resolution and a second image that includes an image corresponding to a partial region of the at least one first image and is captured in a second exposure time shorter than the first exposure time and having second resolution higher than the first resolution;

an image processing device including circuitry configured to generate and output a composite image obtained by combining a selected first image and the second image; and

a display device configured to display the input composite image,

wherein the selected first image is selected according to whether the partial region includes a predetermined region of interest.

9. The image display system according to claim 8 , wherein

the imaging device is configured to be worn by a user,

the image display system includes a line-of-sight direction detection device that is configured to detect a line-of-sight direction of the user, and

the region of interest is set based on the line-of-sight direction.

10. A method executed by an image processing device that controls an image sensor, the method comprising:

inputting, from the image sensor, at least one first image captured in a first exposure time and a second image that includes an image corresponding to a partial region of the at least one first image and is captured in a second exposure time shorter than the first exposure time;

generating a composite image obtained by combining a selected first image and the second image; and

setting an imaging timing of the second image to timing closer to timing of outputting the composite image to a display device than imaging timing of the first image,

wherein the selected first image is selected according to whether the partial region includes a predetermined region of interest.

11. A non-transitory computer-readable storage medium having embodied thereon a program, which when executed by an image processing device that controls an image sensor by a computer, causes the computer to execute a method, the method comprising:

inputting, from the image sensor, at least one first image captured in a first exposure time and a second image that includes an image corresponding to a partial region of the at least one first image and is captured in a second exposure time shorter than the first exposure time;

generating a composite image obtained by combining a selected first image and the second image; and

setting an imaging timing of the second image to timing closer to timing of outputting the composite image to a display device than imaging timing of the first image,

wherein the selected first image is selected according to whether the partial region includes a predetermined region of interest.