IP Library Granted Patent US 10,666,925
Granted Patent B2
US 10,666,925 · App. 15/957,501 · Granted May 26, 2020

Stereoscopic calibration using a multi-planar calibration target

Inventors: Adam S Rowell (Palo Alto, CA); Sheldon S Fernandes (San Jose, CA); Amruta Kulkarni (Blacksburg, VA); Han Jin (Milpitas, CA)
H04N13/246H04N5/772H04N9/8227H04N13/178H04N13/189H04N13/239H04N13/257H04N13/296
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,666,925
App. No.
15/957,501
Granted
May 26, 2020
Kind
B2
Abstract

A system of calibrating a multi-camera device that include two or more planar calibration targets, arranged in a non-planar orientation. The system mechanically moves the calibration targets relative to the multi-camera device to change the relative orientation. The system records images with the multi-camera device at various orientations. The recorded images contain one or more of the constituent planar calibration targets. The system identifies and extracts the pixel coordinates of each constituent planar calibration target from each image.

Claims (24)

1. A system of calibrating a multi-camera device, comprising:

a. Three planar calibration targets, arranged in a non-planar orientation;

b. Mechanically moving the three planar calibration targets relative to the multi-camera device to change the relative orientation;

c. Recording images with the multi-camera device at various orientations, wherein the recorded images contain one or more of the three planar calibration targets;

d. Identifying and extracting the pixel coordinates of each three planar calibration targets from each image, and wherein multiple patterns of the pixel coordinates of the three planar calibration targets are recorded as if the multiple patterns are the same target, and

wherein one or more multi-camera devices record calibration images as the non-planar calibration target moves relative to all of the multi-camera devices simultaneously,

wherein the three planar calibration targets are distinguished from one other based on color.

2. The system of claim 1 , wherein the pixel coordinates of each planar target in each image are used to compute the intrinsic camera calibration parameters of each camera module in the multi-camera device.

3. The system of claim 2 , wherein the pixel coordinates of each planar target in each image and the computed camera intrinsic parameters are used to compute one or more stereoscopic camera calibration parameters.

4. The system of claim 3 , wherein the multi-camera device is a stereoscopic camera, where each of the two camera modules contains a fisheye lens.

5. The system of claim 1 , wherein the one or more multi-camera devices being calibrated remain stationary, as the non-planar target is rotated around a fixed axis as the camera capture the calibration images.

6. The system of claim 1 , wherein the cameras, calibration targets, and mechanism for moving the cameras relative to the targets are all contained in a light box.

7. The system of claim 6 , wherein the constituent planar calibration targets are distinguished from one other by analyzing the recorded images in the RGB color-space, the HSV color-space, or the YUV color-space.

8. The system of claim 7 , wherein the constituent planar calibration targets are distinguished from one another based on characteristic markers, patterns, size, or shape.

9. The system of claim 1 , wherein during the calibration process, not all of the constituent planar calibration targets need to be fully visible in every camera's image frames.

10. The system of claim 1 , wherein the calibration targets and multi-camera devices are mechanically moved relative to each other by using a programmable robotic arm.

11. The system of claim 1 , wherein the process of recording images on each multi-camera device continues until a minimum threshold of a calibration accuracy metric is achieved, during which process the calibration parameters and the calibration accuracy are periodically recomputed to test the accuracy.

12. The system of claim 1 , wherein the stereoscopic calibration parameters include relative yaw, pitch, or roll between the two or more camera modules, or the stereoscopic calibration parameters include the stereoscopic essential matrix, stereoscopic fundamental matrix, or rotation matrix between two or more camera modules.

13. The system of claim 1 , wherein the recorded images are used to perform color or contrast calibration between two or more camera modules in the multi-camera device.

14. A system of calibrating a multi-camera device, comprising:

a. Three planar calibration targets, arranged in a non-planar orientation;

b. Mechanically moving the three planar calibration targets relative to the multi-camera device to change the relative orientation;

c. Recording images with the multi-camera device at various orientations, wherein the recorded images contain one or more of the three planar calibration targets;

d. Identifying and extracting the pixel coordinates of each three planar calibration targets from each image, and wherein multiple patterns of the pixel coordinates of the three planar calibration targets are recorded as if the multiple patterns are the same target.

Assignments (5)
REAFFIRMATION OF PATENT ASSIGNMENT AGREEMENT Recorded Apr 16, 2026
From: R. HEWEN & CO., LLC
To: ARTIFICIAL INTELLIGENCE INDUSTRY ASSOCIATION, INC.
Reel/Frame 075409/0743 →
CHANGE OF NAME Recorded Apr 2, 2026
From: ARTIFICIAL INTELLIGENCE IMAGING ASSOCIATION, INC.
To: ARTIFICIAL INTELLIGENCE INDUSTRY ASSOCIATION, INC.
Reel/Frame 074260/0967 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 16, 2025
From: BLUWHALE AI, INC.
To: R. HEWEN & CO., LLC
Reel/Frame 071724/0284 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 16, 2025
From: R. HEWEN & CO., LLC
To: ARTIFICIAL INTELLIGENCE IMAGING ASSOCIATION, INC.
Reel/Frame 071724/0575 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 10, 2023
From: JIN, HAN; ROWELL, ADAM; FERNANDES, SHELDON S.; KULKARNI, AMRUTA
To: BLUWHALE AI, INC.
Reel/Frame 064201/0550 →
Continuity (3)
Continuation In Part 15139328 · Apr 27, 2016
Provisional Application 62154703 · Apr 29, 2015
Related Publication 20190132577A1 · May 2, 2019