IP Library › Granted Patent US 11,636,623
Granted Patent B2
US 11,636,623 · App. 17/360,845 · Granted Apr 25, 2023

Systems and methods for camera alignment using pre-distorted targets

Inventors: Nijumudheen Muhassin (Jefferson Hills, PA); Yew Kwang Low (Singapore, SG); Jayesh Dwivedi (Pittsburgh, PA)
Assignee: Motional AD LLC
G06T7/80H04N5/2254
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,636,623
App. No.
17/360,845
Granted
Apr 25, 2023
Kind
B2
Abstract

Provided are systems and methods for camera alignment using pre-distorted targets. Some methods described include selecting a configuration of shapes, and determining targets by pre-distorting the shapes according to the inverse of the distortion function of the lens system to be aligned. Images of pre-distorted targets are then compared to the original configuration of shapes, to perform camera alignment. Alignment is thus accomplished in simpler and more accurate manner. Systems and computer program products are also provided.

Claims (30)

1. A device comprising:

at least one processor; and

at least one memory storing instructions which, when executed by the at least one processor, cause the at least one processor to:

determine at least one first shape based on projection of the at least one first shape through a first lens onto a first sensor causing generation of at least one predetermined second shape in a first image; and

cause projection of the at least one first shape through a second lens onto a second sensor, wherein the projection of the at least one first shape through the second lens onto the second sensor causes generation of at least one second shape in a second image, wherein alignment of the second lens with the second sensor is based on a comparison of the at least one second shape to the at least one predetermined second shape.

2. The device of claim 1 , wherein the instructions, when executed by the at least one processor, further cause the at least one processor to determine a difference between the at least one second shape and the at least one predetermined second shape to generate the comparison.

3. The device of claim 2 , wherein the difference comprises a difference between at least one of a size, a shape, or a position in the second image of the at least one second shape to at least one of a size, a shape, or a position in the first image of the at least one predetermined second shape.

4. The device of claim 1 , wherein the instructions, when executed by the at least one processor, further cause the at least one processor to cause an alignment of the second lens with the second sensor based on the comparison.

5. The device of claim 1 , wherein the instructions, when executed by the at least one processor, further cause the at least one processor to determine a principal point based on a geometric center of the at least one second shape.

6. The device of claim 5 , wherein the instructions, when executed by the at least one processor, further cause the at least one processor to:

cause projection of an additional shape at the principal point through the second lens onto the second sensor; and

determine an effective focal length of the second lens based on the additional shape.

7. The device of claim 5 , wherein the instructions, when executed by the at least one processor, further cause the at least one processor to, based on the principal point, cause a-calibration of a camera comprising the second lens and the second sensor.

8. The device of claim 1 , wherein the instructions, when executed by the at least one processor, further cause the at least one processor to select the at least one predetermined second shape.

9. The device of claim 1 , wherein the instructions, when executed by the at least one processor, further cause the at least one processor to determine a modulation transfer function of the second lens based on at least one edge of the at least one second shape.

10. The device of claim 1 , wherein the at least one predetermined second shape comprises at least one rectangle.

11. A method comprising:

determining a first pattern of shapes based on projection of the first pattern of shapes through a first lens onto a first sensor causing generation of a second pattern of shapes in a first image; and

causing projection of the first pattern of shapes through a second lens onto a second sensor, wherein the projection of the first pattern of shapes through the second lens onto the second sensor causes generation of a third pattern of shapes in a second image, wherein alignment of the second lens with the second sensor is based on a comparison of the third pattern of shapes to the second pattern of shapes.

12. The method of claim 11 , further comprising determining a difference between the third pattern of shapes and the second pattern of shapes to generate the comparison.

13. The method of claim 12 , wherein the difference comprises a difference between at least one of a size, a shape, or a position in the second image of the third pattern of shapes to at least one of a size, a shape, or a position in the first image of the second pattern of shapes.

14. The method of claim 11 , further comprising causing an alignment of the second lens with the second sensor based on the comparison.

15. The method of claim 11 , further comprising determining a principal point based on a geometric center of the third pattern of shapes.

16. The method of claim 15 , further comprising:

causing projection of an additional shape at the principal point through the second lens onto the second sensor; and

determining an effective focal length of the second lens at based on the additional shape.

17. The method of claim 15 , further comprising, based on the principal point, causing calibration of a camera comprising the second lens and the second sensor.

18. The method of claim 11 , further comprising determining a modulation transfer function of the second lens based on at least one edge of the third pattern of shapes.

19. The method of claim 11 , wherein the second pattern of shapes comprises at least one rectangle.

20. The method of claim 11 , wherein a camera of a vehicle comprises the second lens and the second sensor.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Feb 9, 2023
From: LOW, YEW KWANG; MUHASSIN, NIJUMUDHEEN; DWIVEDI, JAYESH
To: MOTIONAL AD LLC
Reel/Frame 062643/0075 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 28, 2021
From: MUHASSIN, NIJUMUDHEEN; KWANG, LOW YEW; DWIVEDI, JAYESH
To: MOTIONAL AD LLC
Reel/Frame 056693/0827 →
Continuity (1)
Related Publication 20220414931A1 · Dec 29, 2022
Cited By (3)
US 12,288,362 US 12,481,030 US 12,705,790