Image processing device, image processing method, program, and image processing system that use parallax information
[Object] Observation is made possible by switching between a stereoscopic vision image and a depth-of-field extended image correspondingly to a situation. [Solution] An image processing device according to the present disclosure, includes a photographing situation acquiring section that acquires information with regard to a photographing situation of an image for a left eye or an image for a right eye, and a determining section that determines correspondingly to the information with regard to the photographing situation whether to perform stereoscopic vision image processing for the image for a left eye or the image for a right eye, or whether to perform two-dimensional depth-of-field extension processing with at least one of the image for a left eye or the image for a right eye. With this, it becomes possible to observe by switching between a stereoscopic vision image and a depth-of-field extended image correspondingly to a situation.
1. An image processing device, comprising:
circuitry configured to:
acquire an image for a left eye and an image for a right eye output by a medical imaging device;
generate parallax information based on the image for a left eye and the image for a right eye;
determine a parallax angle between the image for a left eye and the image for a right eye from the parallax information; and
on condition that the parallax angle between the image for a left eye and the image for a right eye is less than two degrees perform stereoscopic vision image processing for the image for a left eye and the image for a right eye; and
on condition that a parallax angle between the image for a left eve and the image for a right eye is equal to or greater than two degrees, perform two-dimensional depth-of-field extension processing with at least one of the image for a left eye or the image for a right eye,
wherein the two-dimensional depth-of-field extension is processed based on distance information between the medical imaging device and an object generated based on the parallax information.
2. The image processing device according to claim 1 , wherein the circuitry is further configured to perform inverse transformation for at least one of the image for a left eye or the image for a right eye on a basis of a blur function corresponding to a depth amount.
3. The image processing device according to claim 1 , wherein among respective images of R, G, and B colors, different in in-focus position, correspondingly to a depth position, the circuitry is further configured to synthesize an image with most high-frequency components to an image of another color at a same depth position, thereby creating a depth-of-field extended image.
4. The image processing device according to claim 3 ,
wherein the circuitry is further configured to control illumination in order to adjust an in-focus position of each of the respective images of R, G, and B colors.
5. The image processing device according to claim 1 , wherein the circuitry is further configured to create a depth-of-field extended image by synthesizing a plurality of images imaged at different in-focus positions for each frame.
6. The image processing device according to claim 1 , wherein the circuitry is further configured to extend a depth-of-field of each of the image for a left eye and the image for a right eye that have been imaged at different in-focus positions, and create a depth-of-field extended image by synthesizing the image for a left eye and the image for a right eye in each of which the depth-of-field has been extended.
7. The image processing device according to claim 6 , wherein the circuitry is further configured to change a synthesis ratio of each of the image for a left eye and the image for a right eye correspondingly to a depth position or a defocus position.
8. The image processing device according to claim 6 , wherein circuitry is further configured to perform alignment between the image for a left eye and the image for a right eye, and synthesizing.
9. The image processing device according to claim 6 , wherein the circuitry is further configured to cut out a common range between the image for a left eye and the image for a right eye, and perform synthesizing.
10. An image processing method, comprising:
acquiring an image for a left eye and an image for a right eye output by a medical imaging device;
generating parallax information based on the image for a left eye and the image for a right eye;
determining a parallax angle between the image for a left eye and the image for a right eye from the parallax information; and
responding to a first condition, wherein the parallax angle between the image for a left eye and the image for a right eye is less than two degrees, by performing stereoscopic vision image processing for the image for a left eye and the image for a right eye;
and responding to a second condition, wherein the parallax angle between the image for a left eye and the image for a right eye is equal to or greater than two degrees, by performing two-dimensional depth of field extension processing with at least one of the image for a left eye or the image for a right eye,
wherein the two-dimensional depth-of-field extension is processed based on distance information between the medical imaging device and an object generated based on the parallax information.
11. A non-transitory computer readable medium having stored thereon a program, that, when executed by a computer execute processing, the processing comprising:
acquiring an image for a left eye and an image for a right eye output by a. medical imaging device;
generating parallax information based on the image for a left eye and the image for a right eve;
determining a parallax angle between the image for a left eye and the image for a right eye from the parallax information; and
on condition that the parallax angle between the image for a left eye and the image for a right eye is less than two degrees,
performing stereoscopic vision image processing for the image for a left eve and the image for a right eye; and
on condition that the parallax angle between the image for a left eye and the image for a right eye is equal to or greater than two degrees, performing two-dimensional depth-of-field extension processing with at least one of the image for a left eye or the image for a right eye,
wherein the two-dimensional depth-of-field extension is processed based on distance information between the medical imaging device and an object generated based on the parallax information.
12. An imaging system, comprising:
an imaging device that images an image for a left eye and an image for a right eye; and
an image processing device that includes circuitry configured to:
acquire an image for a left eve and an image for a right eye,
generate parallax information based on the image for a left eye and the image for a right eye,
determine a parallax angle between the image for a left eye and the image for a right eve from the parallax information; and
on condition that the parallax angle between the image for a left eye and the image for a right eye is less than two degrees perform stereoscopic vision image processing for the image for a left eye and the image for a right eye; and
on condition that the parallax angle between the image for a left eye and the image for a right eye is equal to or greater than two degrees perform two-dimensional depth-of-field extension processing with at least one of the image for a left eye or the image for a right eye,
wherein the two-dimensional depth-of-field extension is processed based on distance information between the imaging device and an object generated based on the parallax information.