IP Library Granted Patent US 11,335,030
Granted Patent B2
US 11,335,030 · App. 16/860,635 · Granted May 17, 2022

Camera-calibration system and method thereof

Inventor: Rajesh Kumar Kamma (Haryana, IN)
Assignee: Mando Mobility Solutions Corporation
G06T7/85H04N17/002G06T2207/30208G06T2207/30252
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,335,030
App. No.
16/860,635
Granted
May 17, 2022
Kind
B2
Abstract

A camera calibration system according to an exemplary embodiment includes a first camera capturing the surroundings of a vehicle; a second camera capturing the surroundings of the vehicle and having an overlapping field of view that overlaps with a field of view of the first camera; and a controller configured to receive a first image obtained by the first camera and a second image obtained by the second camera, detect a plurality of calibration markers positioned in the overlapping field of view in the first image and assign a tag to each of the plurality of calibration markers detected in the first image, detect a plurality of calibrate markers positioned in the overlapping field of view in the second image and assign a tag to each of the plurality of calibrate markers detected in the second image, and calibrate the field of view of at least one of the first camera and the second camera based on the tag assigned to each of the plurality of calibration markers detected in the first image and the tag assigned to each of the plurality of calibration markers detected in the second image.

Claims (55)

1. A camera calibration system:

a first camera capturing the surroundings of a vehicle;

a second camera capturing the surroundings of the vehicle and having an overlapping field of view that overlaps with a field of view of the first camera; and

a controller configured to:

receive a first image obtained by the first camera and a second image obtained by the second camera,

detect a plurality of calibration markers positioned in the overlapping field of view in the first image and assign a tag to each of the plurality of calibration markers detected in the first image,

detect a plurality of calibrate markers positioned in the overlapping field of view in the second image and assign a tag to each of the plurality of calibrate markers detected in the second image, and

calibrate the field of view of at least one of the first camera and the second camera based on the tag assigned to each of the plurality of calibration markers detected in the first image and the tag assigned to each of the plurality of calibration markers detected in the second image.

2. The camera calibration system according to claim 1 , wherein:

the controller is further configured to:

detect a plurality of classification markers positioned in the overlapping field of view in the first image and determine an x-axis direction and a y-axis direction of the first image based on the plurality of classification markers detected in the first image, and

detect a plurality of classification markers positioned in the overlapping field of view in the second image and determine an x-axis direction and a y-axis direction of the second image based on the plurality of classification markers detected in the second image.

3. The camera calibration system according to claim 2 , wherein:

the controller is further configured to:

determine a first calibration marker as a reference marker for assigning a tag to each of the plurality of calibrate markers detected in the first image based on position and angle of at least one of the plurality of calibration markers or a plurality of classification markers detected in the first image, and

determine a second calibration marker as a reference marker for assigning a tag to each of the plurality of calibrate markers detected in the second image based on position and angle of at least one of the plurality of calibration markers or a plurality of classification markers detected in the second image.

4. The camera calibration system according to claim 3 , wherein:

the controller is further configured to:

assign an x-axis direction tag and a y-axis direction tag to each of the plurality of calibration markers detected in the first image based on the determined first calibration marker, and

assign an x-axis direction tag and a y-axis direction tag to each of the plurality of calibration markers detected in the second image based on the determined second calibration marker.

5. The camera calibration system according to claim 1 , wherein:

the controller is configured to calibrate the field of view of at least one of the first camera and the second camera by comparing positions of the tags assigned to each of the plurality of calibration markers detected in the first image with positions of the tags assigned to each of the plurality of calibration markers detected in the second image.

6. The camera calibration system according to claim 2 , wherein:

the controller is configured to determine vertexes of checkerboard pattern positioned in the overlapping field of view as the plurality of the classification markers.

7. The camera calibration system according to claim 1 , wherein:

the controller is configured to determine a center point of circles positioned in the overlapping field of view as the plurality of calibration markers.

8. The camera calibration method comprising:

acquiring a first image captured by a first camera and a second image captured by a second camera, the second camera having an overlapping field of view that overlaps with a field of view of the first camera;

detecting a plurality of calibration markers positioned in the overlapping field of view in the first image;

assigning a tag to each of the plurality of calibration markers detected in the first image;

detecting a plurality of calibrate markers positioned in the overlapping field of view in the second image;

assigning a tag to each of the plurality of calibration markers detected in the second image; and

calibrating the field of view of at least one of the first camera and the second camera based on the tag assigned to each of the plurality of calibration markers detected in the first image and the tag assigned to each of the plurality of calibration markers detected in the second image.

9. The camera calibration method according to claim 8 , further comprising:

detecting a plurality of classification markers positioned in the overlapping field of view in the first image;

determining an x-axis direction and a y-axis direction of the first image based on the plurality of classification markers detected in the first image;

detecting a plurality of classification markers positioned in the overlapping field of view in the second image; and

determining an x-axis direction and a y-axis direction of the second image based on the plurality of classification markers detected in the second image.

10. The camera calibration method according to claim 9 , further comprising:

determining a first calibration marker as a reference marker for assigning a tag to each of the plurality of calibrate markers detected in the first image based on position and angle of at least one of the plurality of calibration markers or a plurality of classification markers detected in the first image; and

determining a second calibration marker as a reference marker for assigning a tag to each of the plurality of calibrate markers detected in the second image based on position and angle of at least one of the plurality of calibration markers or a plurality of classification markers detected in the second image.

11. The camera calibration method according to claim 10 , wherein:

assigning of the tag to each of the plurality of calibration markers detected in the first image comprising:

assigning an x-axis direction tag and a y-axis direction tag to each of the plurality of calibration markers detected in the first image based on the determined first calibration marker, and

assigning of the tag to each of the plurality of calibration markers detected in the second image comprising:

assigning an x-axis direction tag and a y-axis direction tag to each of the plurality of calibration markers detected in the second image based on the determined second calibration marker.

12. The camera calibration method according to claim 8 , wherein:

calibrating of the field of view of at least one of the first camera and the second camera comprising:

calibrating the field of view of at least one of the first camera and the second camera by comparing positions of the tags assigned to each of the plurality of calibration markers detected in the first image with positions of the tags assigned to each of the plurality of calibration markers detected in the second image.

13. The camera calibration method according to claim 9 , wherein:

detecting of the plurality of classification markers positioned in the overlapping field of view comprising:

determining vertexes of checkerboard pattern positioned in the overlapping field of view as the plurality of the classification markers.

14. The camera calibration method according to claim 8 , wherein

detecting of the plurality of calibration markers positioned in the overlapping field of view in the first image comprising:

determining a center point of circles positioned in the overlapping field of view as the plurality of calibration markers.

Assignments (3)
MERGER Recorded Aug 15, 2022
From: MANDO MOBILITY SOLUTIONS CORPORATION
To: HL KLEMOVE CORP.
Reel/Frame 061148/0166 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Nov 1, 2021
From: MANDO CORPORATION
To: MANDO MOBILITY SOLUTIONS CORPORATION
Reel/Frame 058598/0480 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 22, 2021
From: KAMMA, RAJESH KUMAR
To: MANDO CORPORATION
Reel/Frame 057562/0405 →
Priority Claims (1)
KR 10-2019-0050313 · Apr 30, 2019 · national
Continuity (1)
Related Publication 20200349738A1 · Nov 5, 2020