Convolution-based camera and display calibration
Techniques for calibrating cameras and displays are disclosed. An image of a target is captured using a camera. The target includes a tessellation having a repeated structure of tiles. The target further includes unique patterns superimposed onto the tessellation. Matrices are formed based on pixel intensities within the captured image. Each of the matrices includes values each corresponding to the pixel intensities within one of the tiles. The matrices are convolved with kernels to generate intensity maps. Each of the kernels is generated based on a corresponding unique pattern of the unique patterns. An extrema value is identified in each of the intensity maps. A location of each of the unique patterns within the image is determined based on the extrema value for each of the intensity maps. A device calibration is performed using the location of each of the unique patterns.
1. A method for performing a device calibration, the method comprising:
capturing an image of a target using a camera, the target including a tessellation having a repeated structure of tiles, the target further including one or more unique patterns superimposed onto the tessellation;
forming one or more matrices based on pixel intensities of the image, wherein each of the one or more matrices includes a plurality of values each corresponding to the pixel intensities within one of the tiles;
convolving the one or more matrices with one or more kernels to generate one or more intensity maps, wherein each of the one or more kernels is generated based on a corresponding unique pattern of the one or more unique patterns being superimposed onto the tessellation;
identifying an extrema value in each of the one or more intensity maps;
determining a location of each of the one or more unique patterns within the image based on the extrema value for each of the one or more intensity maps; and
performing the device calibration using the location of each of the one or more unique patterns.
2. The method of claim 1 , wherein performing the device calibration includes:
calibrating the camera using the location of each of the one or more unique patterns.
3. The method of claim 1 , further comprising:
rendering the target on a display.
4. The method of claim 3 , wherein performing the device calibration includes:
calibrating the display using the location of each of the one or more unique patterns.
5. The method of claim 1 , further comprising:
dividing the image into a plurality of image regions, wherein a matrix of the one or more matrices is formed for each of the plurality of image regions.
6. The method of claim 1 , wherein forming the one or more matrices includes:
for each of the one or more matrices, calculating each of the plurality of values by averaging the pixel intensities within a corresponding tile of the tiles.
7. A non-transitory computer-readable medium comprising instructions that, when executed by one or more processors, cause the one or more processors to perform operations comprising:
capturing an image of a target using a camera, the target including a tessellation having a repeated structure of tiles, the target further including one or more unique patterns superimposed onto the tessellation;
forming one or more matrices based on pixel intensities of the image, wherein each of the one or more matrices includes a plurality of values each corresponding to the pixel intensities within one of the tiles;
convolving the one or more matrices with one or more kernels to generate one or more intensity maps, wherein each of the one or more kernels is generated based on a corresponding unique pattern of the one or more unique patterns being superimposed onto the tessellation;
identifying an extrema value in each of the one or more intensity maps;
determining a location of each of the one or more unique patterns within the image based on the extrema value for each of the one or more intensity maps; and
performing a device calibration using the location of each of the one or more unique patterns.
8. The non-transitory computer-readable medium of claim 7 , wherein performing the device calibration includes:
calibrating the camera using the location of each of the one or more unique patterns.
9. The non-transitory computer-readable medium of claim 7 , wherein the operations further comprise:
rendering the target on a display.
10. The non-transitory computer-readable medium of claim 9 , wherein performing the device calibration includes:
calibrating the display using the location of each of the one or more unique patterns.
11. The non-transitory computer-readable medium of claim 7 , wherein the operations further comprise:
dividing the image into a plurality of image regions, wherein a matrix of the one or more matrices is formed for each of the plurality of image regions.
12. The non-transitory computer-readable medium of claim 7 , wherein forming the one or more matrices includes:
for each of the one or more matrices, calculating each of the plurality of values by averaging the pixel intensities within a corresponding tile of the tiles.
13. A system comprising:
one or more processors; and
a non-transitory computer-readable medium comprising instructions that, when executed by the one or more processors, cause the one or more processors to perform operations comprising:
capturing an image of a target using a camera, the target including a tessellation having a repeated structure of tiles, the target further including one or more unique patterns superimposed onto the tessellation;
forming one or more matrices based on pixel intensities of the image, wherein each of the one or more matrices includes a plurality of values each corresponding to the pixel intensities within one of the tiles;
convolving the one or more matrices with one or more kernels to generate one or more intensity maps, wherein each of the one or more kernels is generated based on a corresponding unique pattern of the one or more unique patterns being superimposed onto the tessellation;
identifying an extrema value in each of the one or more intensity maps;
determining a location of each of the one or more unique patterns within the image based on the extrema value for each of the one or more intensity maps; and
performing a device calibration using the location of each of the one or more unique patterns.
14. The system of claim 13 , wherein performing the device calibration includes:
calibrating the camera using the location of each of the one or more unique patterns.
15. The system of claim 13 , wherein the operations further comprise:
rendering the target on a display.
16. The system of claim 15 , wherein performing the device calibration includes:
calibrating the display using the location of each of the one or more unique patterns.
17. The system of claim 13 , wherein the operations further comprise:
dividing the image into a plurality of image regions, wherein a matrix of the one or more matrices is formed for each of the plurality of image regions.
18. The system of claim 13 , wherein forming the one or more matrices includes:
for each of the one or more matrices, calculating each of the plurality of values by averaging the pixel intensities within a corresponding tile of the tiles.