IP Library Granted Patent US 10,520,593
Granted Patent B2
US 10,520,593 · App. 16/213,784 · Granted Dec 31, 2019

Installation and use of vehicle light ranging system

Inventors: Angus Pacala (San Francisco, CA); Dmitri Garbuzov (San Francisco, CA); Daniel Lu (San Francisco, CA); Kairen Wong (San Mateo, CA)
Assignee: OUSTER, INC.
G01S7/497B60Q9/008G01C21/20G01C21/30G01S7/4808G01S7/51G01S17/42G01S17/936G05D1/0214G05D1/0238B60R1/00G01C21/3647G05D2201/0213
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,520,593
App. No.
16/213,784
Granted
Dec 31, 2019
Kind
B2
Abstract

Methods, systems, and devices are provided for calibrating a light ranging system and using the system to track environmental objects. In embodiments, the approach involves installing light ranging devices, such as lidar devices, on the vehicle exterior. The light ranging system may be calibrated using a calibration device to scan the vehicle exterior and construct a three-dimensional model of the vehicle exterior comprising the positions of the installed light ranging devices on the vehicle exterior. The calibrated light ranging system may use the model in conjunction with ranging data collected by the installed light ranging devices to track objects in the environment. In this way, the light ranging system may detect a proximity of environmental objects and help a driver of the vehicle avoid potential collisions. The light ranging system may further measure the vehicle exterior and thereby detect changes to the vehicle exterior.

Claims (62)

1. A method for calibrating a light ranging system including a control unit and one or more light ranging devices, the method comprising:

scanning, by a calibration imaging device, a vehicle and the one or more light ranging devices installed on the vehicle to produce imaging data, each light ranging device including a laser source and a photosensor;

computing a primary model of an exterior of the vehicle based on the imaging data, the primary model including a coordinate frame;

determining one or more model positions of the one or more light ranging devices on the primary model relative to the coordinate frame of the primary model, the one or more model positions corresponding to physical positions of the one or more light ranging devices on the exterior of the vehicle; and

outputting the primary model of the exterior of the vehicle and the one or more model positions of the one or more light ranging devices on the primary model in a format usable by the control unit to determine distances between the exterior of the vehicle and one or more environmental surfaces using measurements from the one or more light ranging devices.

2. The method of claim 1 , wherein the primary model is three-dimensional.

3. The method of claim 1 , further comprising installing the one or more light ranging devices on the vehicle.

4. The method of claim 1 , wherein determining the one or more model positions of the one or more light ranging devices on the primary model comprises:

for each of the one or more light ranging devices:

estimating a starting position of the light ranging device on the primary model;

loading one or more housing dimensions of the light ranging device; and

determining the model position of the light ranging device on the primary model based on matching the one or more housing dimensions of the light ranging device to a portion of the primary model comprising the estimated starting position.

5. The method of claim 4 , wherein the estimating the starting position of the light ranging device on the primary model is based on user input.

6. The method of claim 1 , wherein the calibration imaging device is of a same type as the one or more light ranging devices.

7. The method of claim 1 , further comprising:

measuring, using the one or more light ranging devices, the exterior of the vehicle to construct one or more partial models of the exterior of the vehicle, the one or more partial models defined relative to the coordinate frame of the primary model; and

refining the one or more model positions of the one or more light ranging devices based on minimizing an error between the primary model and the one or more partial models.

8. The method of claim 1 , further comprising:

surveying, using the one or more light ranging devices, an environment around the vehicle, wherein the one or more light ranging devices comprise a primary light ranging device and one or more secondary light ranging devices;

constructing a primary model of the environment based on a first set of ranging data from the primary light ranging device;

constructing one or more secondary models of the environment based on one or more additional sets of ranging data from the one or more secondary light ranging devices; and

refining the one or more model positions of the one or more light ranging devices based on minimizing an error between the primary model and the one or more secondary models.

9. The method of claim 1 , wherein the calibration imaging device is one of the one or more light ranging devices.

10. A system for calibrating a light ranging system including a control unit and one or more light ranging devices, the system comprising:

a calibration imaging device configured to scan a vehicle and the one or more light ranging devices installed on the vehicle to produce imaging data, each light ranging device including a laser source and a photosensor; and

a processor communicably coupled with the calibration imaging device, wherein the processor is configured to:

compute a primary model of an exterior of the vehicle based on the imaging data, the primary model including a coordinate frame;

determine one or more model positions of the one or more light ranging devices on the primary model relative to the coordinate frame of the primary model, the one or more model positions corresponding to physical positions of the one or more light ranging devices on the exterior of the vehicle; and

output the primary model of the exterior of the vehicle and the one or more model positions of the one or more light ranging devices on the primary model in a format usable by the control unit to determine distances between the exterior of the vehicle and one or more environmental surfaces using measurements from the one or more light ranging devices.

11. The system of claim 10 , wherein determining the one or more model positions of the one or more light ranging devices on the primary model comprises:

for each of the one or more light ranging devices:

estimating a starting position of the light ranging device on the primary model;

loading one or more housing dimensions of the light ranging device; and

determining the model position of the light ranging device on the primary model based on matching the one or more housing dimensions of the light ranging device to a portion of the primary model comprising the estimated starting position.

12. The system of claim 10 , wherein the calibration imaging device is of a same type as the one or more light ranging devices.

13. The system of claim 10 , wherein the processor is further configured to:

measure, using the one or more light ranging devices, the exterior of the vehicle to construct one or more partial models of the exterior of the vehicle, the one or more partial models defined relative to the coordinate frame of the primary model; and

refine the one or more model positions of the one or more light ranging devices based on minimizing an error between the primary model and the one or more partial models.

14. The system of claim 10 , wherein the processor is further configured to:

survey, using the one or more light ranging devices, an environment around the vehicle, wherein the one or more light ranging devices comprise a primary light ranging device and one or more secondary light ranging devices;

construct a primary model of the environment based on a first set of ranging data from the primary light ranging device;

construct one or more secondary models of the environment based on one or more additional sets of ranging data from the one or more secondary light ranging devices; and

refine the one or more model positions of the one or more light ranging devices based on minimizing an error between the primary model and the one or more secondary models.

15. A non-transitory computer-readable medium storing instructions for controlling a processor, communicably coupled with a calibration imaging device, to perform a method for calibrating a light ranging system including a control unit and one or more light ranging devices, the method comprising:

receiving imaging data obtained from the calibration imaging device configured to scan a vehicle and the one or more light ranging devices installed on the vehicle;

computing a primary model of an exterior of the vehicle based on the imaging data, the primary model including a coordinate frame;

determining one or more model positions of the one or more light ranging devices on the primary model relative to the coordinate frame of the primary model, the one or more model positions corresponding to physical positions of the one or more light ranging devices on the exterior of the vehicle; and

outputting the primary model of the exterior of the vehicle and the one or more model positions of the one or more light ranging devices on the primary model in a format usable by the control unit to determine distances between the exterior of the vehicle and one or more environmental surfaces using measurements from the one or more light ranging devices.

16. The non-transitory computer-readable medium of claim 15 , wherein determining the one or more model positions of the one or more light ranging devices on the primary model comprises:

for each of the one or more light ranging devices:

estimating a starting position of the light ranging device on the primary model;

loading one or more housing dimensions of the light ranging device; and

determining the model position of the light ranging device on the primary model based on matching the one or more housing dimensions of the light ranging device to a portion of the primary model comprising the estimated starting position.

17. The non-transitory computer-readable medium of claim 16 , wherein the estimating the starting position of the light ranging device on the primary model is based on user input.

18. The non-transitory computer-readable medium of claim 15 , wherein the method further comprises:

measuring, using the one or more light ranging devices, the exterior of the vehicle to construct one or more partial models of the exterior of the vehicle, the one or more partial models defined relative to the coordinate frame of the primary model; and

refining the one or more model positions of the one or more light ranging devices based on minimizing an error between the primary model and the one or more partial models.

19. The non-transitory computer-readable medium of claim 15 , wherein the method further comprises:

surveying, using the one or more light ranging devices, an environment around the vehicle, wherein the one or more light ranging devices comprise a primary light ranging device and one or more secondary light ranging devices;

constructing a primary model of the environment based on a first set of ranging data from the primary light ranging device;

constructing one or more secondary models of the environment based on one or more additional sets of ranging data from the one or more secondary light ranging devices; and

refining the one or more model positions of the one or more light ranging devices based on minimizing an error between the primary model and the one or more secondary models.

Assignments (6)
CORRECTIVE ASSIGNMENT TO CORRECT THE ADD THE SECOND ASSIGNEE PREVIOUSLY RECORDED AT REEL: 65350 FRAME: 826. ASSIGNOR(S) HEREBY CONFIRMS THE ASSIGNMENT. Recorded Dec 29, 2023
From: HERCULES CAPITAL, INC.
To: OUSTER, INC.; SENSE PHOTONICS, INC.
Reel/Frame 066432/0458 →
RELEASE OF INTELLECTUAL PROPERTY SECURITY INTEREST AT REEL/FRAME NO. 059859/0035 Recorded Oct 25, 2023
From: HERCULES CAPITAL, INC.
To: OUSTER, INC.
Reel/Frame 065350/0826 →
SECURITY INTEREST Recorded Apr 29, 2022
From: OUSTER, INC.; SENSE PHOTONICS, INC.
To: HERCULES CAPITAL, INC., AS AGENT
Reel/Frame 059859/0035 →
RELEASE OF SECURITY INTEREST Recorded Apr 28, 2022
From: SILICON VALLEY BANK
To: OUSTER, INC.
Reel/Frame 059763/0484 →
SECURITY INTEREST Recorded Mar 6, 2020
From: OUSTER, INC.
To: SILICON VALLEY BANK
Reel/Frame 052035/0339 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Nov 13, 2019
From: PACALA, ANGUS; GARBUZOV, DMITRI; LU, DANIEL; WONG, KAIREN
To: OUSTER, INC.
Reel/Frame 050999/0840 →
Continuity (3)
Provisional Application 62665439 · May 1, 2018
Provisional Application 62595996 · Dec 7, 2017
Related Publication 20190178998A1 · Jun 13, 2019