IP Library Granted Patent US 12,260,593
Granted Patent B2
US 12,260,593 · App. 18/093,659 · Granted Mar 25, 2025

Extrinsic calibration of multiple vehicle sensors using combined target detectable by multiple vehicle sensors

Inventors: Adam Cadien (San Francisco, CA); Zhonghua Ma (San Francisco, CA); Jabeer Ahmed (San Francisco, CA); Nicholas Semansky (San Francisco, CA)
Assignee: GM Cruise Holdings LLC
G06T7/80G01S7/40G01S7/497G01S7/5205G01S13/08G01S15/08G01S17/08G06T7/70
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,260,593
App. No.
18/093,659
Granted
Mar 25, 2025
Kind
B2
Abstract

Sensors coupled to a vehicle are calibrated, optionally using a dynamic scene with sensor targets around a motorized turntable that rotates the vehicle to different orientations. One vehicle sensor captures a representation of one feature of a sensor target, while another vehicle sensor captures a representation of a different feature of the sensor target, the two features of the sensor target having known relative positioning on the target. The vehicle generates a transformation that maps the captured representations of the two features to positions around the vehicle based on the known relative positioning of the two features on the target.

Claims (26)

1. A system for vehicle sensor calibration, the system comprising:

a memory; and

a processor coupled to the memory, wherein the processor is configured to:

receive a range capture dataset from a range sensor of a vehicle in a calibration environment,

identify, in the range capture dataset, a range-based representation of a sensor target that is located in the calibration environment, wherein the sensor target includes a surface with an aperture, wherein a portion of the calibration environment external to the sensor target is discernable through the aperture from a perspective of the range sensor, wherein the range-based representation of the sensor target includes a range-based representation of the aperture,

generate a transformation to calibrate the range sensor of the vehicle, and calibrate the range sensor of the vehicle using the transformation,

receive a sensor capture dataset from a second sensor of the vehicle, and

identify, in the sensor capture dataset, a representation of the aperture in the surface of the sensor target, wherein, to calibrate the range sensor of the vehicle using the transformation, the processor is configured to perform extrinsic calibration of the range sensor of the vehicle and the second sensor of the vehicle using the transformation.

2. The system of claim 1 , wherein, to calibrate the range sensor of the vehicle using the transformation, the processor is configured to perform intrinsic calibration of the range sensor of the vehicle using the transformation.

3. The system of claim 1 , wherein the processor is configured to:

identify, in the sensor capture dataset, a representation of a marking on the surface of the sensor target, wherein the transformation is based on a relative positioning of the marking and the aperture, wherein, to calibrate the range sensor of the vehicle using the transformation, the processor is configured to perform extrinsic calibration of the range sensor of the vehicle and the second sensor of the vehicle using the transformation.

4. A method for vehicle sensor calibration, the method comprising:

receiving a range capture dataset from a range sensor of a vehicle in a calibration environment,

identifying, in the range capture dataset, a range-based representation of a sensor target that is located in the calibration environment, wherein the sensor target includes a surface with an aperture, wherein a portion of the calibration environment external to the sensor target is discernable through the aperture from a perspective of the range sensor, wherein the range-based representation of the sensor target includes a range-based representation of the aperture,

generating a transformation to calibrate the range sensor of the vehicle, and calibrating the range sensor of the vehicle using the transformation;

receiving a sensor capture dataset from a second sensor of the vehicle, and

identifying, in the sensor capture dataset, a representation of the aperture in the surface of the sensor target, wherein the calibrating of the range sensor of the vehicle using the transformation includes performing extrinsic calibration of the range sensor of the vehicle and the second sensor of the vehicle using the transformation.

5. The method of claim 4 , wherein the calibrating of the range sensor of the vehicle using the transformation includes performing intrinsic calibration of the range sensor of the vehicle using the transformation.

6. The method of claim 4 , further comprising:

identifying, in the sensor capture dataset, a representation of a marking on the surface of the sensor target, wherein the transformation is based on a relative positioning of the marking and the aperture, wherein the calibrating of the range sensor of the vehicle using the transformation includes performing extrinsic calibration of the range sensor of the vehicle and the second sensor of the vehicle using the transformation.

7. A method for vehicle sensor calibration, the method comprising:

receiving a range capture dataset from a range sensor of a vehicle in a calibration environment,

identifying, in the range capture dataset, a range-based representation of a sensor target that is located in the calibration environment, wherein the sensor target includes a surface with an aperture, wherein a portion of the calibration environment external to the sensor target is discernable through the aperture from a perspective of the range sensor, wherein the range-based representation of the sensor target includes a range-based representation of the aperture,

generating a transformation to calibrate the range sensor of the vehicle, and calibrating the range sensor of the vehicle using the transformation

receiving a sensor capture dataset from a second sensor of the vehicle, and

identifying, in the sensor capture dataset, a representation of a marking on the surface of the sensor target, wherein the transformation is based on a relative positioning of the marking and the aperture, wherein the calibrating of the range sensor of the vehicle using the transformation includes performing extrinsic calibration of the range sensor of the vehicle and the second sensor of the vehicle using the transformation.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 5, 2023
From: CADIEN, ADAM; MA, ZHONGHUA; AHMED, JABEER; SEMANSKY, NICHOLAS
To: GM CRUISE HOLDINGS LLC
Reel/Frame 062287/0215 →
Continuity (2)
Continuation 16457823 · Jun 28, 2019
Related Publication 20230154047A1 · May 18, 2023
References Cited (30)
US 2461181A · Paul et al. · 1949 [cited by applicant]
US 4106345A · Saunders et al. · 1978 [cited by applicant]
US 4242685A · Sanford · 1980 [cited by examiner]
US 5724743A · Jackson · 1998 [cited by applicant]
US 6999896B2 · Takahashi · 2006 [cited by applicant]
US 9182477B2 · Jones et al. · 2015 [cited by applicant]
US 9221396B1 · Zhu et al. · 2015 [cited by applicant]
US 9945927B2 · Baba · 2018 [cited by applicant]
US 10578713B2 · Yomo et al. · 2020 [cited by applicant]
US 11067693B2 · Walls et al. · 2021 [cited by applicant]
US 11150326B2 · Yu et al. · 2021 [cited by applicant]
US 11209526B2 · Park et al. · 2021 [cited by applicant]
US 20050104793A1 · Yuanzhu · 2005 [cited by examiner]
US 20130194145A1 · Sano · 2013 [cited by examiner]
US 20140333467A1 · Inomata · 2014 [cited by applicant]
US 20160116573A1 · Appia et al. · 2016 [cited by applicant]
US 20170227634A1 · Matsumoto et al. · 2017 [cited by applicant]
US 20170343654A1 · Valois · 2017 [cited by examiner]
US 20190056483A1 · Bradley · 2019 [cited by examiner]
US 20190056484A1 · Bradley · 2019 [cited by examiner]
US 20190204425A1 · Abari · 2019 [cited by examiner]
US 20190204427A1 · Abari · 2019 [cited by examiner]
US 20200174107A1 · Briggs · 2020 [cited by examiner]
CN 101698303A · 2011 [cited by examiner]
CN 104680535A · 2015 [cited by examiner]
EP 3125196A1 · 2017 [cited by applicant]
Amazon, “ANT-1F, Ant 1F, Bendix Weather Radar Antenna Drive and Dish,” Aug. 28, 2015, retrieved from the Internet URL: https://www.amazon.com/ANT-1F-ANT1F-Bendix-Weather-Antenna/dp/B014JROZXG. [cited by applicant]
BIDGEE., “Solar Powered School Zone Flashing Light Warning System,” posted on Wikimedia Commons on the Internet; Apr. 25, 2009, 1 page. [cited by applicant]
Wikipedia, “School Zone,” 2021, retrieved on May 13, 2022, 2 pages, retrieved from the internet URL: https://en.wikipedia.org/w/index.php?title=School_zone&oldid=1053850966. [cited by applicant]
Wu S., et al., “Using Mobile LiDAR Point Clouds for Traffic Sign Detection and Sign Visibility Estimation,” IEEE International Geoscience and Remote Sensing Symposium (IGARSS), 2015, pp. 565-568. [cited by applicant]