Image processing device, image processing method, and program
[Object] To improve work efficiency with respect to work using a transparent object, such as a transparent operation tool, for example. [Solution] An image region where an object exists as a target region is detected on the basis of a second captured image, when a first captured image is a captured image obtained by selectively receiving a light of a first wavelength band, and the second captured image is a captured image obtained by selectively receiving a light of a second wavelength band, the captured images being obtained by capturing the object that is transparent for the light of the first wavelength band and is opaque for the light of the second wavelength band. Subsequently, an outline of the object is superimposed on the first captured image on the basis of information of the target region detected by the target detecting unit.
1. An image processing device comprising:
processing circuitry configured to
detect an image region where an object exists as a target region on the basis of a second captured image, when a first captured image is a captured image obtained by selectively receiving a light of a first wavelength band, and the second captured image is a captured image obtained by selectively receiving a light of a second wavelength band, the captured images being obtained by capturing the object that is transparent for the light of the first wavelength band and is opaque for the light of the second wavelength band; and
superimpose an outline of the object on the first captured image on the basis of information of the target region.
2. The image processing device according to claim 1 , wherein
the processing circuitry detects the target region on the basis of the second captured image and the first captured image.
3. The image processing device according to claim 1 , wherein
the processing circuitry
generates a second edge image based on the second captured image and a first edge image based on the first captured image by performing an edge extraction with respect to each of the second captured image and the first captured image,
performs a template matching using a template of the object for each of the second edge image and the first edge image, and
detects, as the target region, an image region that is detected by the template matching for the second edge image and does not overlap with an image region detected by the template matching for the first edge image.
4. The image processing device according to claim 3 , wherein
the processing circuitry
performs the edge extraction with respect to the second captured image and a plurality of first captured images obtained by selectively receiving lights of different wavelength bands in the first wavelength band, and generates the second edge image based on the second captured image and a plurality of first edge images based on the plurality of first captured images,
performs the template matching for each of the generated edge images, and
detects, as the target region, an image region that is detected by the template matching for the second edge image and does not overlap with any one of image regions detected by the template matching for the plurality of first edge images.
5. The image processing device according to claim 1 , wherein,
when a left eye side second captured image and a right eye side second captured image are a left eye image and a right eye image obtained by stereoscopically capturing images of the object by means of an image sensor that selectively receives a light of the second wavelength band, respectively, the processing circuitry detects the target region on the basis of distance information calculated on the basis of a parallax between the left eye side second captured image and the right eye side second captured image.
6. The image processing device according to claim 5 , wherein
the processing circuitry generates a distance image of the second captured image and a distance image of the first captured image on the basis of the distance information calculated with respect to each of the second captured image and the first captured image, generates a difference image between the distance image of the second captured image and the distance image of the first captured image, and detects the target region on the basis of the difference image.
7. The image processing device according to claim 1 , wherein
the processing circuitry decides the target region used in superimposition of the outline by the processing circuitry, on the basis of a detection result of the target region with respect to a plurality of frame images.
8. The image processing device according to claim 1 , wherein
the processing circuitry is configured to correct an optical distortion generated by the object with respect to the target region in the first captured image.
9. The image processing device according to claim 8 , wherein
the processing circuitry identifies a type of the object on the basis of the second captured image, and
the processing circuitry corrects the optical distortion with a correction characteristic according to the type of the object identified by processing circuitry.
10. The image processing device according to claim 8 , wherein,
when a left eye side second captured image and a right eye side second captured image are a left eye image and a right eye image obtained by stereoscopically capturing images of the object by means of an image sensor that selectively receives a light of the second wavelength band, respectively,
the processing circuitry generates three-dimensional position information of the object on the basis of the left eye side second captured image and the right eye side second captured image, and detects an orientation of the object on the basis of the three-dimensional position information, and
the processing circuitry corrects the optical distortion with a correction characteristic according to the orientation of the object detected by the processing circuitry.
11. The image processing device according to claim 10 , wherein
the processing circuitry corrects the optical distortion with a correction characteristic according to a distance of the object.
12. An image processing method comprising:
detecting, using processing circuitry, as a target region, an image region where an object exists on the basis of a second captured image, when a first captured image is a captured image obtained by selectively receiving a light of a first wavelength band, and the second captured image is a captured image obtained by selectively receiving a light of a second wavelength band, the captured images being obtained by capturing the object that is transparent for the light of the first wavelength band and is opaque for the light of the second wavelength band; and
superimposing an outline of the object on the first captured image on the basis of information of the target region.
13. A non-transitory computer readable medium including executable instructions, which when executed by a computer cause the computer to:
detect, as a target region, an image region where an object exists on the basis of a second captured image, when a first captured image is a captured image obtained by selectively receiving a light of a first wavelength band, and the second captured image is a captured image obtained by selectively receiving a light of a second wavelength band, the captured images being obtained by capturing the object that is transparent for the light of the first wavelength band and is opaque for the light of the second wavelength band; and
superimpose an outline of the object on the first captured image on the basis of information of the target region.