Image processing unit, image processing method, and projection system
An image processing unit of the disclosure includes an imaging section that acquires a plurality of partial images as a captured image, by imaging a projection screen provided by a projector through division of the projection screen into a plurality of regions to have partially overlapping imaging regions, and an estimation section that performs an operation a plurality of times on a basis of the captured image, the operation being performed to estimate a projection transformation matrix for linking of the partial images adjacent to each other.
1. An image processing unit, comprising:
circuitry configured to:
image a projection screen, wherein the projection screen is provided by a projector;
acquire a plurality of partial images as a captured image based on a division of the projection screen into a plurality of regions, wherein the plurality of regions has partially overlapped imaging regions; and
perform first estimation of a projection transformation matrix based on the captured image, wherein
the first estimation of a projection transformation matrix is performed in a case where a first image pattern composed of the plurality of partial images is projected by the projector as the projection screen, and
each partial image of the plurality of partial images has an image feature point with a unique local feature amount.
2. The image processing unit according to claim 1 , wherein the circuitry is further configured to:
link the plurality of partial images based on the projection transformation matrix to generate a stitch image; and
calibrate the projection screen projected by the projector based on the stitch image.
3. The image processing unit according to claim 1 , wherein the circuitry is further configured to perform second estimation of the projection transformation matrix based on the captured image and a result of the first estimation, wherein the second estimation is performed in a case where a second image pattern is projected by the projector as the projection screen.
4. The image processing unit according to claim 1 , wherein the first image pattern includes, around the image feature point of each of the plurality of partial images, a first pixel of lightness higher than a specific lightness and a second pixel of lightness lower than the specific lightness.
5. The image processing unit according to claim 3 , wherein in a case where the second image pattern is projected, arrangement spacing between image feature points on the captured image is substantially equal.
6. The image processing unit according to claim 5 , wherein a value of arrangement spacing between image feature points in the second image pattern is greater than a value of a projection transformation error of the projection transformation matrix in the first estimation and is smaller than a specific value.
7. The image processing unit according to claim 3 , wherein the projection and imaging of the first image pattern is independent to the projection and imaging of the second image pattern.
8. The image processing unit according to claim 3 , wherein the circuitry is further configured to perform the first estimation of the projection transformation matrix and the second estimation of the projection transformation matrix based on the captured image in a case where the projection screen projected by the projector is composed of a combination of the first image pattern and the second image pattern.
9. An image processing method, comprising:
imaging a projection screen, wherein the projection screen is provided by a projector;
acquiring a plurality of partial images as a captured image based on a division of the projection screen into a plurality of regions, wherein the plurality of regions has partially overlapping imaging regions; and
performing first estimation of a projection transformation matrix based on the captured image, wherein
the first estimation of the projection transformation matrix is performed in a case where a first image pattern composed of the plurality of partial images is projected by the projector as the projection screen, and
each partial image of the plurality of partial images has an image feature point with a unique local feature amount.
10. A projection system, comprising:
a projector configured to project a projection screen; and
circuitry configured to:
image the projection screen;
acquire a plurality of partial images as a captured image based on a division of the projection screen into a plurality of regions, wherein the plurality of regions has partially overlapped imaging regions; and
perform first estimation of a projection transformation matrix based on the captured image, wherein
the first estimation of the projection transformation matrix is performed in a case where a first image pattern composed of the plurality of partial images is projected by the projector as the projection screen, and
each partial image of the plurality of partial images has an image feature point with a unique local feature amount.