IP Library Granted Patent US 11,615,553
Granted Patent B1
US 11,615,553 · App. 17/725,636 · Granted Mar 28, 2023

Calibration of detection system to vehicle using a mirror

Inventors: Craig Lewin Robinson (Palo Alto, CA); Volker Grabe (Redwood City, CA); Colin Braley (Mountain View, CA); Zachary Morriss (San Francisco, CA); Stephanie McArthur (Mountain View, CA); Andrew Crawford (San Francisco, CA)
Assignee: Waymo LLC
G06T7/80B60R1/12B60W50/00B60W2050/0083G06T2207/20048G06T2207/30252
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,615,553
App. No.
17/725,636
Granted
Mar 28, 2023
Kind
B1
Abstract

The disclosure provides for a method of calibrating a detection system that is mounted on a vehicle. The method includes detecting characteristics of the mirror and characteristics of a vehicle portion using the detection system. The mirror reflects the vehicle portion to be detected using the detection system. The method also includes determining a first transform based on the detected one or more of mirror characteristics, determining a second transform based on the one or more vehicle portion characteristics, and determining a third transform based on a known position of the vehicle portion in relation to the vehicle. Further, the method includes determining a position of the detection system relative to the vehicle based on the first, second, and third transforms and then calibrating the detection system using the determined position of the detection system relative to the vehicle.

Claims (36)

1. A method of calibrating a first detection system that is mounted on a vehicle, the method comprising:

detecting, using the first detection system in communication with one or more computing devices, at least one stationary object at a first relative pose;

detecting, using a second detection system in communication with the one or more computing devices, the at least one stationary object, the second detection system being remote from the vehicle at a second relative pose;

determining a position of the first detection system relative to the vehicle based on the first relative pose and the second relative pose; and

calibrating, by the one or more computing devices, the first detection system using the determined position of the first detection system relative to the vehicle, wherein the vehicle is autonomously operated using the calibrated detection system to detect locations of objects in the vehicle's environment.

2. The method of claim 1 , further comprising, determining, a first transform based on the first relative pose and the second relative pose, and wherein determining the position of the first detection system relative to the vehicle is further based on the first transform.

3. The method of claim 2 , wherein determining the first transform includes comparing the first relative pose and the second relative pose.

4. The method of claim 3 , wherein comparing the first relative pose and the second relative pose includes comparing first characteristics of the at least one stationary object detected by the first detection system and second characteristics of the at least one stationary object detected by the second detection system.

5. The method of claim 1 , further comprising:

detecting, by the one or more computing devices, at least a portion of the vehicle using the second detection system; and

determining, by the one or more computing devices, a first transform based on one or more characteristics of the detected vehicle portion, and wherein determining the position of the first detection system relative to the vehicle is further based on the first transform.

6. The method of claim 5 , wherein determining the second transform includes comparing the one or more characteristics of the detected vehicle portion with known one or more vehicle portion characteristics.

7. The method of claim 1 , further comprising:

determining, a first transform based on the first relative pose and the second relative pose;

detecting, by the one or more computing devices, at least a portion of the vehicle using the second detection system; and

determining, by the one or more computing devices, a second transform based on one or more characteristics of the detected vehicle portion, and wherein determining the position of the first detection system relative to the vehicle based on the first transform and the second transform.

8. The method of claim 7 , wherein determining the first transform includes comparing the first relative pose and the second relative pose.

9. The method of claim 8 , wherein comparing the first relative pose and the second relative pose includes comparing first characteristics of the at least one stationary object detected by the first detection system and second characteristics of the at least one stationary object detected by the second detection system.

10. The method of claim 7 , wherein determining the second transform includes comparing the one or more characteristics of the detected vehicle portion with known one or more vehicle portion characteristics.

11. The method of claim 10 , wherein the one or more characteristics of the detected vehicle portion include fiducials on the vehicle portion.

12. The method of claim 7 , further comprising determining, by the one or more computing devices, a third transform based on a known position of the vehicle portion in relation to the vehicle; and wherein determining the position of the first detection system relative to the vehicle is further based on the third transform.

13. A system for calibrating a first detection system that is mounted on a vehicle, the method comprising:

one or more computing devices configured to:

receive, from a first detection system in communication with one or more computing devices, at least one stationary object at a first relative pose;

receive, from a second detection system in communication with the one or more computing devices, the at least one stationary object, the second detection system being remote from the vehicle at a second relative pose;

determine a position of the first detection system relative to the vehicle based on the first relative pose and the second relative pose; and

calibrate the first detection system using the determined position of the first detection system relative to the vehicle, wherein the vehicle is autonomously operated using the calibrated detection system to detect locations of objects in the vehicle's environment.

14. The system of claim 13 , further comprising the first detection system.

15. The system of claim 14 , further comprising the vehicle.

16. The system of claim 13 , further comprising the second detection system.

17. The system of claim 13 , wherein the one or more computing devices are further configured to determine a first transform based on the first relative pose and the second relative pose, and to determine the position of the first detection system relative to the vehicle further based on the first transform.

18. The system of claim 17 , wherein the one or more computing devices are further configured to determine a second transform based on a known position of the vehicle portion in relation to the vehicle, and to determine the position of the first detection system relative to the vehicle further based on the second transform.

19. The system of claim 13 , wherein the one or more computing devices are further configured to:

detect at least a portion of the vehicle using the second detection system; and

determine a first transform based on one or more characteristics of the detected vehicle portion, and wherein determining the position of the first detection system relative to the vehicle is further based on the first transform.

20. The system of claim 19 , wherein the one or more computing devices are further configured to determine a second transform based on a known position of the vehicle portion in relation to the vehicle, and to determine the position of the first detection system relative to the vehicle further based on the second transform.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 21, 2022
From: ROBINSON, CRAIG LEWIN; GRABE, VOLKER; BRALEY, COLIN; MORRISS, ZACHARY; MCARTHUR, STEPHANIE; CRAWFORD, ANDREW
To: WAYMO LLC
Reel/Frame 059661/0517 →
Continuity (2)
Continuation 17163772 · Feb 1, 2021
Continuation 16032417 · Jul 11, 2018