IP Library Granted Patent US 11,673,567
Granted Patent B2
US 11,673,567 · App. 16/847,847 · Granted Jun 13, 2023

Integrated fiducial marker for simultaneously calibrating sensors of different types

Inventor: Huan Yang Chang (Santa Clara, CA)
Assignee: PlusAI, Inc.
B60W50/06G01S19/51G06T7/80G01S7/40G01S7/497G06T2207/30204
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,673,567
App. No.
16/847,847
Granted
Jun 13, 2023
Kind
B2
Abstract

The present teaching relates to different configurations for facilitating calibration of multiple sensors of different types. A plurality of fiducial markers are arranged in space for simultaneously calibrating multiple sensors of different types. Each of the plurality of fiducial markers has a feature point thereon and is provided to enable the multiple sensors to calibrate by detecting the features points and estimating their corresponding 3D coordinates with respect to respective coordinate systems of the multiple sensors.

Claims (47)

1. A system comprising:

a plurality of fiducial markers arranged in space for calibration of multiple sensors of different types, wherein

each of the plurality of fiducial markers has a feature point to facilitate the calibration of the multiple sensors based on detection of the feature points and estimation of corresponding 3D coordinates of the feature points with respect to respective coordinate systems of the multiple sensors, each feature point based on an intersection of a plurality of planar facets on each fiducial marker, the plurality of planar facets having different colors from each other.

2. The system of claim 1 , wherein, for each fiducial marker,

each of the plurality of planar facets is of a triangle shape;

each of two adjacent sides of each of the triangle shaped planar facets touches in alignment with a side of another triangle shaped planar facet; and

vertices of the two adjacent sides of each of the triangle shaped planar facets touch to form an intersection point of the fiducial marker; and

the intersection point corresponds to the feature point of the fiducial marker.

3. The system of claim 1 , wherein

the feature point of each fiducial marker is where the different colors meet.

4. The system of claim 1 , wherein the feature point of each fiducial marker is detected visually or detected based on a geometric measurement associated with the feature point on the fiducial marker.

5. The system of claim 1 , wherein each fiducial marker comprises a sub-structure with a designated portion that reflects a signal upon receiving the signal.

6. The system of claim 5 , wherein the sub-structure is attached to the fiducial marker near the feature point, inwardly or outwardly, and reachable by the signal.

7. The system of claim 1 , wherein the plurality of fiducial markers:

are distributed in space within a field of view of the multiple sensors; and

are grouped together to form a 3D construct, wherein the feature points of the plurality of the fiducial markers are facing the same direction.

8. A method comprising:

providing a plurality of fiducial markers for calibration of multiple sensors of different types, wherein

each of the plurality of fiducial markers has a feature point to facilitate the calibration of the multiple sensors based on detection of the feature points and estimation of corresponding 3D coordinates of the feature points with respect to respective coordinate systems of the multiple sensors, each feature point based on an intersection of a plurality of planar facets on each fiducial marker, the plurality of planar facets having different colors from each other; and

controlling a vehicle to adjust a pose of the vehicle to facilitate the calibration of the multiple sensors.

9. The method of claim 8 , wherein, for each fiducial marker,

each of the plurality of planar facets is of a triangle shape;

each of two adjacent sides of each of the triangle shaped planar facets touches in alignment with a side of another triangle shaped planar facet;

vertices of the two adjacent sides of each of the triangle shaped planar facets touch to form the feature point of the 3D structure; and

the intersection point corresponds to the feature point of the fiducial marker.

10. The method of claim 8 , wherein

the feature point of each fiducial marker is where the different colors meet.

11. The method of claim 8 , wherein

the feature point of each fiducial marker is detected visually or detected based on a geometric measurement associated with the feature point on the fiducial marker.

12. The method of claim 8 , wherein each fiducial marker comprises a sub-structure with a designated portion that reflects a signal upon receiving the signal.

13. The method of claim 12 , wherein the sub-structure is attached to the fiducial marker near the feature point, inwardly or outwardly, and reachable by the signal.

14. The method of claim 8 , wherein the plurality of fiducial markers:

are distributed in space within a field of view of the multiple sensors; and

are grouped together to form a 3D construct, wherein the feature points of the plurality of the fiducial markers are facing the same direction.

15. A system for calibration of multiple sensors of different types, comprising:

a plurality of fiducial markers arranged in space for the calibration of the multiple sensors of different types, wherein

each of the plurality of fiducial markers has a feature point to facilitate the calibration of the multiple sensors based on detection of the feature points and estimation of corresponding 3D coordinates of the feature points with respect to respective coordinate systems of the multiple sensors, each feature point based on an intersection of a plurality of planar facets on each fiducial marker, the plurality of planar facets having different colors from each other.

16. The system of claim 15 , wherein, for each fiducial marker,

each of the plurality of planar facets is of a triangle shape;

each of two adjacent sides of each of the triangle shaped planar facets touches in alignment with a side of another triangle shaped planar facet;

vertices of the two adjacent sides of each of the triangle shaped planar facets touch to form the feature point of the fiducial marker; and

the intersection point corresponds to the feature point of the fiducial marker.

17. The system of claim 15 , wherein the feature point of each fiducial marker is where the different colors meet.

18. The system of claim 15 , wherein the feature point of each fiducial marker is detected visually or detected based on a geometric measurement associated with the feature point on the fiducial marker.

19. The system of claim 15 , wherein each of the fiducial markers comprises a sub-structure with a designated portion that reflects a signal upon receiving the signal.

20. The system of claim 19 ,

wherein the sub-structure is attached to the fiducial marker near the feature point, inwardly or outwardly, and reachable by the signal.

Assignments (3)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 19, 2021
From: PLUSAI LIMITED
To: PLUSAI, INC.
Reel/Frame 056909/0574 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Feb 26, 2021
From: PLUSAI CORP
To: PLUSAI LIMITED
Reel/Frame 055423/0456 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 15, 2020
From: CHANG, HUAN YANG
To: PLUSAI CORP
Reel/Frame 052935/0446 →
Continuity (1)
Related Publication 20210316743A1 · Oct 14, 2021