Camera calibration system
A camera calibration system jointly calibrates multiple cameras in a camera rig system. The camera calibration system obtains configuration information about the multiple cameras in the camera rig system, such as position and orientation for each camera relative to other cameras. The camera calibration system estimates calibration parameters (e.g., rotation and translation) for the multiple cameras based on the obtained configuration information. The camera calibration system receives 2D images of a test object captured by the multiple cameras and obtains known information about the test object such as location, size, texture and detailed information of visually distinguishable points of the test object. The camera calibration system then generates a 3D model of the test object based on the received 2D images and the estimated calibration parameters. The generated 3D model is evaluated in comparison with the actual test object to determine a calibration error. The calibration parameters for the cameras are updated to reduce the calibration error for the multiple cameras.
1. A method for calibrating a camera rig system, the method comprising:
receiving configuration information about a plurality of cameras in the camera rig system, the plurality of cameras sharing an overlapped part in their respective fields of view in which a test object is located; and
for each adjacent pair of cameras of the plurality of cameras:
identifying calibration parameters for the pair of cameras;
receiving a plurality of images of the test object captured by the pair of cameras, the test object having known calibration measures;
creating a 3D model of the test object based on the identified calibration parameters and the received plurality of images;
calculating a calibration error that reflects differences between calibration measures of the created 3D model of the test object and the known calibration measures of the test object; and
modifying the calibration parameters for the pair of cameras to reduce the calibration error.
2. The method of claim 1 , wherein the configuration information includes, for each camera among the plurality of cameras, position and orientation relative to the other cameras among the plurality of cameras.
3. The method of claim 1 , wherein the calibration measures of the test object include at least one of the following: location, size, texture, shape and detailed information of visually distinguishable points on the test object.
4. The method of claim 1 , wherein the calibration parameters include rotation and translation information for each camera of the pair of cameras.
5. The method of claim 1 , wherein the camera rig system includes a plurality of cameras and a plurality of known objects, wherein each known object is viewed by at least two cameras and each camera views at least two known objects.
6. The method of claim 1 , further comprising performing additional iterations of calibration until the calibration error is below a calibration error threshold.
7. The method of claim 1 , wherein the camera rig system includes a plurality of peripheral cameras, at least one top axis camera, and at least one bottom axis camera.
8. The method of claim 7 , wherein the at least one top axis camera and at least one bottom axis camera are vertically offset relative to the plurality of peripheral cameras to limit overlap between fields of view.
9. A non-transitory computer-readable storage medium storing computer program instructions for calibrating a camera rig system, the computer program instructions when executed by a computer processor causes the processor to perform steps of:
receiving configuration information about a plurality of cameras in the camera rig system, the plurality of cameras sharing an overlapped part in their respective fields of view in which a test object is located; and
for each adjacent pair of cameras of the plurality of cameras:
identifying calibration parameters for the pair of cameras;
receiving a plurality of images of the test object captured by the pair of cameras, the test object having known calibration measures;
creating a 3D model of the test object based on the identified calibration parameters and the received plurality of images;
calculating a calibration error that reflects differences between calibration measures of the created 3D model of the test object and the known calibration measures of the test object; and
modifying the calibration parameters for the pair of cameras to reduce the calibration error.
10. The non-transitory computer-readable storage medium of claim 9 , wherein the configuration information includes, for each camera among the plurality of cameras, position and orientation relative to the other cameras among the plurality of cameras.
11. The non-transitory computer-readable storage medium of claim 9 , wherein the calibration measures of the test object include at least one of the following: location, size, texture, shape and detailed information of visually distinguishable points on the test object.
12. The non-transitory computer-readable storage medium of claim 9 , wherein the calibration parameters include rotation and translation information for each camera of the pair of cameras.
13. The non-transitory computer-readable storage medium of claim 9 , wherein the camera rig system includes a plurality of cameras and a plurality of known objects, wherein each known object is viewed by at least two cameras and each camera views at least two known objects.
14. The non-transitory computer-readable storage medium of claim 9 , further comprising performing additional iterations of calibration until the calibration error is below a calibration error threshold.
15. The non-transitory computer-readable storage medium of claim 9 , wherein the camera rig system includes a plurality of peripheral cameras, at least one top axis camera, and at least one bottom axis camera.
16. The non-transitory computer-readable storage medium of claim 15 , wherein the at least one top axis camera and at least one bottom axis camera are vertically offset relative to the plurality of peripheral cameras to limit overlap between fields of view.