Information processing device, information processing method, program, projection device, and information processing system
There is provided an information processing device, an information processing method, a program, a projection device, and an information processing system capable of correcting distortion of a projection image by use of any image capturing device. The information processing device detects corresponding points on a projection image and a plurality of captured images on the basis of the projection image and the plurality of captured images, the projection image being projected on a projection surface by a projection device, the plurality of captured images having been obtained by image capturing of the projection image at a plurality of image capturing positions, estimates image capturing parameters including the plurality of image capturing positions and attitudes during image capturing at each of the image capturing positions and projection parameters including a position and an attitude of the projection device on the basis of corresponding point information indicating a relationship between the corresponding points, generates correction data used for geometric correction of an input image on the basis of the corresponding point information, the image capturing parameters, and the projection parameters, and transmits the correction data. The present technology can be applied to an information processing device that controls projection of a projector.
1. An information processing device comprising:
a detection unit configured to detect corresponding points on a projection image and a plurality of captured images on a basis of the projection image and the plurality of captured images, the projection image being projected on a projection surface by a projection device, the plurality of captured images having been obtained by image capturing of the projection image at a plurality of image capturing positions;
an estimation unit configured to estimate image capturing parameters including the plurality of image capturing positions and attitudes during image capturing at each of the image capturing positions and projection parameters including a position and an attitude of the projection device on a basis of corresponding point information indicating a relationship between the corresponding points;
a guide control unit configured to output information serving as a guide for the plurality of image capturing positions;
a generation unit configured to generate correction data used for geometric correction of an input image on a basis of the corresponding point information, the image capturing parameters, and the projection parameters; and
a transmission unit configured to transmit the correction data,
wherein the detection unit, the estimation unit, the guide control unit, the generation unit, and the transmission unit are each implemented via at least one processor.
2. The information processing device according to claim 1 , wherein
the correction data is information used in the projection device, and
the transmission unit transmits the correction data to the projection device.
3. The information processing device according to claim 1 , further comprising:
a capturing unit configured to capture an image of the projection image projected on the projection surface by the projection device.
4. The information processing device according to claim 1 , wherein
the number of the captured images is three or more.
5. The information processing device according to claim 1 , wherein
the detection unit detects the corresponding points on an added captured image in a case where an estimation error of the projection surface obtained on a basis of the image capturing parameters is larger than a threshold value.
6. The information processing device according to claim 5 , wherein
the estimation unit switches a combination of the plurality of captured images and estimates the image capturing parameters.
7. The information processing device according to claim 6 , wherein
the estimation unit selects the combination of the captured images used for generation of the correction data on a basis of the estimation error of the projection surface or on a basis of dispersion of image capturing angles, the estimation error having been obtained on a basis of the image capturing parameters.
8. The information processing device according to claim 1 , wherein
the estimation unit estimates image capturing parameters of an added captured image on a basis of an image capturing parameter common to the captured images.
9. The information processing device according to claim 1 ,
wherein the guide control unit outputs the information serving as the guide for the image capturing positions on a basis of the image capturing parameters.
10. The information processing device according to claim 9 , wherein
the guide control unit displays a position different from the image capturing positions at which image capturing has already been performed.
11. The information processing device according to claim 10 , wherein
the detection unit detects the corresponding points by use of a captured image obtained by image capturing at the position different from the image capturing positions at which image capturing has already been performed.
12. The information processing device according to claim 9 , wherein
the guide control unit outputs information used to designate a predetermined position on the projection surface, and
the information processing device further comprises a determining unit that determines an image capturing position causing an estimation error at the designated position on the projection surface.
13. The information processing device according to claim 12 , wherein
the detection unit detects the corresponding points by use of a captured image obtained by performing image capturing again using a position different from the determined image capturing position as an image capturing position.
14. The information processing device according to claim 9 , wherein
the guide control unit outputs information used to designate a predetermined position on the projection surface, and
the transmission unit transmits, to the projection device, information indicating that another pattern having a higher density than a density of a pattern projected as the projection image is projected in a predetermined range including the designated position on the projection surface.
15. The information processing device according to claim 14 , wherein
the detection unit detects the corresponding points by use of a captured image obtained by image capturing of the projected another pattern.
16. The information processing device according to claim 1 , wherein
the detection unit detects the corresponding points on a basis of each of a plurality of captured images obtained by image capturing of a projection image projected in each of a plurality of projection regions obtained by division of the entire projection surface, and
the generation unit integrates a plurality of pieces of the correction data generated for the respective projection images.
17. An information processing method performed by an information processing device, the information processing method comprising:
detecting corresponding points on a projection image and a plurality of captured images on a basis of the projection image and the plurality of captured images, the projection image being projected on a projection surface by a projection device, the plurality of captured images having been obtained by image capturing of the projection image at a plurality of image capturing positions;
estimating image capturing parameters including the plurality of image capturing positions and attitudes during image capturing at each of the image capturing positions and projection parameters including a position and an attitude of the projection device on a basis of corresponding point information indicating a relationship between the corresponding points;
outputting information serving as a guide for the plurality of image capturing positions;
generating correction data used for geometric correction of an input image on a basis of the corresponding point information, the image capturing parameters, and the projection parameters; and
transmitting the correction data.
18. A non-transitory computer-readable storage medium having embodied thereon a program, which when executed by a computer causes the computer to execute a processing method, the processing method comprising:
detecting corresponding points on a projection image and a plurality of captured images on a basis of the projection image and the plurality of captured images, the projection image being projected on a projection surface by a projection device, the plurality of captured images having been obtained by image capturing of the projection image at a plurality of image capturing positions;
estimating image capturing parameters including the plurality of image capturing positions and attitudes during image capturing at each of the image capturing positions and projection parameters including a position and an attitude of the projection device on a basis of corresponding point information indicating a relationship between the corresponding points;
outputting information serving as a guide for the plurality of image capturing positions;
generating correction data used for geometric correction of an input image on a basis of the corresponding point information, the image capturing parameters, and the projection parameters; and
transmitting the correction data.
19. A projection device comprising:
a projection unit configured to project a projection image on a projection surface;
a reception unit configured to
receive correction data used for geometric correction of an input image, the correction data having been transmitted from an information processing device that detects corresponding points on the projection image and a plurality of captured images obtained by image capturing of the projection image at a plurality of image capturing positions on a basis of the projection image and the plurality of captured images,
estimate image capturing parameters including the plurality of image capturing positions and attitudes during image capturing at each of the image capturing positions and projection parameters including a position and an attitude of the projection device on a basis of corresponding point information indicating a relationship between the corresponding points, and
generate the correction data on a basis of the corresponding point information, the image capturing parameters, and the projection parameters;
a guide control unit configured to output information serving as a guide for the plurality of image capturing positions; and
a generation unit configured to perform the geometric correction on the input image on a basis of the correction data and generates a corrected image,
wherein the projection unit, the reception unit, the guide control unit, and the generation unit are each implemented via at least one processor.
20. An information processing system comprising:
an information processing device including
a detection unit configured to detect corresponding points on a projection image and a plurality of captured images on a basis of the projection image and the plurality of captured images, the projection image being projected on a projection surface by a projection device, the plurality of captured images having been obtained by image capturing of the projection image at a plurality of image capturing positions,
an estimation unit configured to estimate image capturing parameters including the plurality of image capturing positions and attitudes during image capturing at each of the image capturing positions and projection parameters including a position and an attitude of the projection device on a basis of corresponding point information indicating a relationship between the corresponding points,
a guide control unit configured to output information serving as a guide for the plurality of image capturing positions,
a first generation unit configured to generate correction data used for geometric correction of an input image on a basis of the corresponding point information, the image capturing parameters, and the projection parameters, and
a transmission unit configured to transmit the correction data; and
the projection device including
a projection unit that projects the projection image on the projection surface,
a reception unit that receives the correction data transmitted from the information processing device, and
a second generation unit that performs the geometric correction on the input image on a basis of the correction data and generates a corrected image,
wherein the detection unit, the estimation unit, the guide control unit, the first generation unit, the transmission unit, the projection unit, the reception unit, and the second generation unit are each implemented via at least one processor.