Image processing device, image display device, image processing method, and image display method

1. An image processing device, comprising:

a separation unit configured to separate a flicker pattern from an image obtained based on capture of, at multiple exposure times, an image containing a scene that emits light on a basis of a flicker pattern converted from an audio signal; and

a conversion unit configured to convert the separated flicker pattern to an original audio signal.

2. The image processing device according to claim 1 , wherein

the audio signal that acts as a basis for the flicker pattern is a signal that is earlier than the image by a certain amount of time.

3. The image processing device according to claim 1 , wherein

the separation unit is further configured to separate the flicker pattern from an image captured at a second exposure time that is shorter than a first exposure time.

4. The image processing device according to claim 1 , further comprising an imaging unit configured to capture the image containing the scene over at least two exposure times of a first exposure time, and a second exposure time that is shorter than the first exposure time.

5. The image processing device according to claim 4 , wherein the imaging unit is further configured to conduct the capture over the second exposure time at a higher frame rate than the capture over the first exposure time.

6. The image processing device according to claim 5 , wherein the imaging unit is further configured to conduct the capture over the second exposure time at a higher frame rate than the capture over the first exposure time based on an execution of a sampling process on pixels in a horizontal direction when conducting the capture over the second exposure time.

7. The image processing device according to claim 5 , wherein the imaging unit is further configured to conduct the capture over the second exposure time at a higher frame rate than the capture over the first exposure time based on pixel addition in a horizontal direction when conducting the capture over the second exposure time.

8. The image processing device according to claim 5 , wherein the imaging unit is further configured to conduct the capture over the second exposure time at a higher frame rate than the capture over the first exposure time only in a range of pixels containing the scene occupying a field of view of a captured image.

9. The image processing device according to claim 1 , further comprising a playback control unit configured to control a playback of an audio based on the audio signal, on a basis of an image containing the scene occupying a field of view of a captured image.

10. The image processing device according to claim 9 , wherein

the playback control unit is further configured to control the playback of the audio based on the audio signal, on a basis of a size of the image containing the scene occupying the field of view.

11. The image processing device according to claim 10 , wherein the playback control unit is further configured to control a volume of the audio based on the audio signal, on a basis of the size of the image containing the scene occupying the field of view.

12. The image processing device according to claim 9 , wherein the playback control unit is further configured to control a localization of the audio based on the audio signal, on a basis of a position of the image containing the scene occupying the field of view.

13. The image processing device according to claim 1 , further comprising an orientation analysis unit configured to analyze an orientation of an image containing the scene occupying a field of view of a captured image.

14. The image processing device according to claim 13 , wherein the orientation analysis unit is further configured to recognize a certain marker included in the image containing the scene.

15. The image processing device according to claim 13 , wherein when the separation unit is further configured to separate the flicker pattern, the orientation analysis unit is further configured to output information specifying a range of the image containing the scene occupying the field of view of the captured image.

16. The image processing device according to claim 1 , wherein the original audio signal is one of AM-modulated or FM-modulated.

17. The image processing device according to claim 1 , wherein the original audio signal is coded by a certain coding scheme.

18. An image display device, comprising:

a delay unit that delays an image signal by a certain delay time;

a flicker pattern conversion unit configured to convert, into a flicker pattern, an audio signal with attached information about the certain delay time; and

an image display unit configured to:

display an image based on the image signal delayed by the delay unit; and

cause a backlight to emit light on a basis of the flicker pattern converted by the flicker pattern conversion unit.

19. An image processing method, comprising:

separating a flicker pattern from an image obtained by capturing, at multiple exposure times, an image containing a scene that emits light on a basis of a flicker pattern converted from an audio signal; and

converting the separated flicker pattern to an original audio signal.

20. An image display method, comprising:

delaying an image signal by a certain delay time;

converting, into a flicker pattern, an audio signal with attached information about the certain delay time by which to delay; and

displaying an image based on the delayed image signal, while also causing a backlight to emit light on a basis of the converted flicker pattern.