Image processing apparatus and method
The present disclosure relates to an image processing apparatus and a method capable of performing on-line sensing without synchronizing and without using a specialized device. An image corner corresponding point detection unit detects an image corner of an input image from a captured image captured by a camera, and associates four image corner points of a corrected image to be projected by a projector with four image corner points of the detected captured image, thereby detecting four image corner corresponding points. An attitude estimation unit estimates a relative attitude of the projector and the camera from the four image corner corresponding points. The present disclosure can be applied to, for example, a projection imaging device that projects an image with a projector, captures the image projected by the projector, and updates a presentation position.
1. An image processing apparatus, comprising:
a correction unit configured to correct an input image to generate a corrected image, wherein
the correction of the input image is based on attitude estimation information indicating an attitude estimation result of a projector, and
the projector projects the corrected image;
an image corner correspondence detection unit configured to detect image corner corresponding points based on association of an image corner point of a captured image with an image corner point of the corrected image;
an attitude estimation unit configured to estimate an attitude of the projector to generate the attitude estimation information, wherein the estimation of the attitude of the projector is based on the image corner corresponding points; and
an imaging trigger control unit configured to:
execute a read ahead of the input image; and
transmit an imaging trigger to an imaging unit based on a detection of an image frame of the input image.
2. The image processing apparatus according to claim 1 , further comprising the imaging unit configured to:
capture the projected image; and
generate the captured image based on the capture of the projected image.
3. The image processing apparatus according to claim 1 , further comprising:
a black band detection unit configured to detect a black band in the input image, wherein
the image corner point of the corrected image is determined from a region different from the black band, and
the determination of the image corner point of the corrected image is based on the detection of the black band.
4. The image processing apparatus according to claim 3 , wherein the attitude estimation unit is further configured to:
evaluate a degree of matching between an image frame of the corrected image and an image frame of the captured image, wherein the corrected image includes less than four image corner points; and
estimate the attitude of the projector based on the evaluation of the degree of matching.
5. The image processing apparatus according to claim 4 , wherein the attitude estimation unit is further configured to:
evaluate, as the evaluation of the degree of matching, a proximity degree of parameters of straight lines indicating the image frame of the captured image; and
estimate the attitude of the projector based on the evaluation of the proximity degree of parameters of the straight lines.
6. The image processing apparatus according to claim 4 , wherein
the attitude estimation unit is further configured to estimate the attitude of the projector based on match between edge points in an image frame of an image and edge points in the image frame of the captured image,
the match corresponds to the evaluation of the degree of matching,
the imaging unit is further configured to generate the image based on capture of the corrected image, and
the capture of the corrected image is based on the attitude estimation information.
7. An image processing method, comprising:
in an image processing apparatus:
correcting an input image for generating a corrected image, wherein
the correction of the input image is based on attitude estimation information indicating an attitude estimation result of a projector, and
the projector projects the corrected image;
detecting image corner corresponding points based on association of an image corner point of a captured image with an image corner point of the corrected image;
estimating an attitude of the projector for generating the attitude estimation information, wherein the estimation of the attitude of the projector is based on the detected image corner corresponding points;
executing a read ahead of the input image; and
transmitting an imaging trigger to an imaging unit based on a detection of an image frame of the input image.