Method and system for projector calibration
The present disclosure relates to a method for calibrating a projector. The method includes projecting a test pattern onto a scene or an object within the scene and capturing the test pattern using a camera. Once the test pattern image has been captured by the camera, the method further includes estimating by a processing element a perspective projection matrix, warping the estimated projection matrix based on a non-linear distortion function, and modifying the projector to project light based on the distortion function. The present disclosure also relates to a presentation or projection system including two types of projectors for projecting an output presentation having a second image overlaid on a first image.
1. A method of calibrating a projector comprising:
receiving by a processing element a first calibration image of a first calibration pattern projected onto a projection surface;
generating a perspective projection matrix by the processing element by modeling the projector as a pinhole device with a pinhole approximation to provide a first calibration approximation based on the first calibration image and the first calibration pattern; and
determining by the processing element a two-dimensional non-linear mapping function to correct inaccuracies in the first calibration approximation resulting from the pinhole approximation by analyzing the first calibration image to compensate for distortion characteristics inherent to the projector.
2. The method of claim 1 , wherein the first calibration pattern comprises a plurality of pattern elements.
3. The method of claim 2 , further comprising detecting by the processing element the plurality of pattern elements using an image analysis algorithm and determining by the processing element a three-dimensional position of the plurality of pattern elements.
4. The method of claim 2 , further comprising determining by the processing element a transformation amount for each of the pluralities of pattern elements.
5. The method of claim 1 , wherein the non-linear mapping function is determined based on the perspective projection matrix and the first calibration image.
6. The method of claim 5 , wherein the non-linear mapping function is determined by comparing by the processing element the first calibration image and the perspective projection matrix.
7. The method of claim 1 , further comprising generating by the processing element a calibrated image by transforming the first calibration image using the non-linear mapping function.
8. The method of claim 1 , further comprising creating by the processing element a look up table using the non-linear mapping function.
9. The method of claim 8 , further comprising interpolating by the processing element values within the look up table to increase the number of values.
10. The method of claim 1 , further comprising:
receiving by the processing element a second calibration image of a second calibration pattern projected onto a projection surface, wherein the second calibration pattern is different than the first calibration pattern.
11. The method of claim 10 , wherein generation of the perspective projection matrix further comprises analyzing the second calibration image and the second calibration pattern.
12. The method of claim 1 , wherein the two-dimensional non-linear mapping function results in a second calibration approximation that is more accurate than the first calibration approximation.
13. A system for calibrating a laser projector with non-uniform distortion characteristics comprising:
a laser projector, wherein the laser projector projects a first calibration pattern onto a three-dimensional projection surface;
a camera, wherein the camera captures a first calibration image of the first calibration pattern projected onto the three-dimensional projection surface; and
a computing device, in electrical communication with the camera and having at least one processing element, performs the following operations:
generates a perspective projection matrix by modeling the laser projector as a pinhole device with a pinhole approximation to provide a first calibration approximation based on the first calibration image; and
determines a distortion map for the laser projector that maps two-dimensional positions on a virtual image plane of the laser projector to three-dimensional positions on the three-dimensional projection surface by comparing the first calibration approximation to the first calibration image and the first calibration pattern to correct inaccuracies in the first calibration approximation resulting from the pinhole approximation, wherein the distortion map determines distortion inherent to the laser projector.
14. The system of claim 13 , wherein the computing device further analyzes the first calibration image with an image analysis algorithm to determine a plurality of pattern elements of the first calibration pattern within the first calibration image.
15. The system of claim 14 , wherein the first calibration approximation is based on the analysis of the first calibration image.
16. The system of claim 15 , wherein the first calibration image comprises a structured light pattern defining a plurality of elements.
17. The system of claim 14 , wherein the processing element further determines the three-dimensional positions of the plurality of pattern elements by a depth detection algorithm.
18. The system of claim 14 , wherein the processing element:
detects the plurality of pattern elements using a blob detection algorithm; and
further interpolates points that fall between the pattern elements within the first calibration image.
19. The system of claim 14 , wherein the processing element creates a modified output image by transforming an input image by applying the distortion map to the input image, wherein the modified output image is corrected for distortion of the laser projector.
20. A projection system comprising:
a video projector projecting a first image onto a projection surface; and
a laser projector projecting a second image onto the projection surface, wherein the laser projector is calibrated using a perspective projection matrix by modeling the laser projector as a pinhole device with a pinhole approximation to provide a first calibration approximation based on the first image and a non-linear mapping function to correct inaccuracies in the first calibration approximation resulting from the pinhole approximation and determine a distortion map to adjust for distortion intrinsic to the laser projector;
wherein the second image overlays the first image on the projection surface.
21. The projection system of claim 20 , wherein the second image is aligned with a first portion of the first image to provide an accent to the first image.