IP Library Granted Patent US 11,333,762
Granted Patent B2
US 11,333,762 · App. 16/779,291 · Granted May 17, 2022

Merging data from multiple LiDAR devices

Inventors: Maurilio Di Cicco (Singapore, SG); Karan Rajendra Shetti (Singapore, SG)
Assignee: Motional AD LLC
G01S17/42G01S17/894G01S17/931
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,333,762
App. No.
16/779,291
Granted
May 17, 2022
Kind
B2
Abstract

Among other things, a method includes receiving first LiDAR point cloud information from a first LiDAR device and second LiDAR point cloud information from a second LiDAR device, generating third point cloud information according to merging the first and second LiDAR point cloud information, and operating the vehicle based upon the third LiDAR point cloud information.

Claims (35)

1. A vehicle, comprising:

at least two LiDAR devices configured to detect light reflected from objects proximate to the vehicle and generate LiDAR point cloud information based on the detected light, wherein a first LiDAR device is at a first position of the vehicle and is configured for a first starting angle and a first frequency, and a second LiDAR device is at a second position of the vehicle and is configured for a second starting angle and a second frequency;

one or more computer-readable media storing computer-executable instructions;

one or more processors communicatively coupled to the at least two LiDAR devices and configured to execute the computer executable instructions, the execution carrying out operations including:

receiving first LiDAR point cloud information from the first LiDAR device and second LiDAR point cloud information from the second LiDAR device,

receiving first timestamp information associated with the first LiDAR point cloud information and second timestamp information associated with the second LiDAR point cloud information, and

in accordance with the first and second LiDAR point cloud information, first and second timestamp information, first starting angle, a first frequency, second starting angle, and second frequency, generating third point cloud information merging the first and second LiDAR point cloud information, wherein generating the third point cloud information comprises generating a data structure representing voxels oriented in accordance with polar coordinates, wherein a respective point of the first LiDAR point cloud information or second LiDAR point cloud information is assigned to one of the voxels of the data structure; and

a control circuit communicatively coupled to the one or more processors, wherein the control circuit is configured to operate the vehicle based upon the third LiDAR point cloud information.

2. The vehicle of claim 1 , the operations including

determining that a first detected light point of the first LiDAR point cloud information and a second detected light point of the second LiDAR point cloud information correspond to the same location relative to the vehicle, and

in accordance with the first and second information corresponding to the same location relative to the vehicle, generating combined LiDAR point cloud information including the first and second detected light points.

3. The vehicle of claim 2 , wherein the first timestamp information represents a first time, wherein the first time is a time at which a first point of the first LiDAR point cloud information was detected, and the second timestamp information represents a second time, wherein the second time is a time at which a second point of the second LiDAR point cloud information was detected.

4. The vehicle of claim 3 , wherein the time at which the first point was detected is based on a laser emission time of a block of points detected at a first azimuth and a first offset value specific to the first point.

5. The vehicle of claim 3 , the operations comprising determining a correspondence between the first time and the second time in accordance with the first starting angle, first frequency, second starting angle, and second frequency.

6. The vehicle of claim 1 , wherein the first LiDAR device is configured for a first starting angle different from the second starting angle.

7. The vehicle of claim 1 , wherein generating third point cloud information comprises generating a quantity of voxels of the data structure in accordance with a predetermined resolution.

8. The vehicle of claim 1 , the execution carrying out operations further comprising:

receiving a plurality of voxel metrics; and

merging the first point cloud information and second point cloud information to generate the third point cloud information based on the voxel metrics.

9. The vehicle of claim 1 , wherein a quantity of voxels of the data structure is generated in accordance with a number of the objects proximate to the vehicle.

10. The vehicle of claim 1 , wherein a first voxel is associated with a frequency at which point cloud data is used to update points of the voxel.

11. The vehicle of claim 10 , the execution carrying out operations further comprising determining if the voxel meets a threshold of point density, and based on the determination, adjusting the frequency at which the point cloud data is used to update the points of the voxel.

12. The vehicle of claim 1 , the execution carrying out operations further comprising processing the first LiDAR point cloud information and second LiDAR point cloud information based on the first position and the second position.

13. The vehicle of claim 1 , wherein the at least two LiDAR devices are synchronized.

14. The vehicle of claim 1 , wherein the first frequency is different from the second frequency.

15. A method comprising:

on a vehicle:

receiving first LiDAR point cloud information from a first LiDAR device and second LiDAR point cloud information from a second LiDAR device, wherein the first LiDAR device and the second LiDAR device are respectively configured to detect light reflected from objects proximate to the vehicle and generate LiDAR point cloud information based on the detected light, wherein the first LiDAR device is at a first position of the vehicle and is configured for a first starting angle and a first frequency, and the second LiDAR device is at a second position of the vehicle and is configured for a second starting angle and a second frequency;

receiving first timestamp information associated with the first LiDAR point cloud information and second timestamp information associated with the second LiDAR point cloud information; and

in accordance with the first and second LiDAR point cloud information, first and second timestamp information, first starting angle, a first frequency, second starting angle, and second frequency, generating third point cloud information according to merging the first and second LiDAR point cloud information, wherein generating the third point cloud information comprises generating a data structure representing voxels oriented in accordance with polar coordinates, wherein a respective point of the first LiDAR point cloud information or second LiDAR point cloud information is assigned to one of the voxels of the data structure; and operating the vehicle based upon the third LiDAR point cloud information.

16. A non-transitory computer-readable storage medium comprising one or more programs for execution by one or more processors of a first device of a vehicle, the one or more programs including instructions which, when executed by the one or more processors, cause the first device to perform operations comprising:

receiving first LiDAR point cloud information from a first LiDAR device and second LiDAR point cloud information from a second LiDAR device, wherein the first LiDAR device and the second LiDAR device are respectively configured to detect light reflected from objects proximate to the vehicle and generate LiDAR point cloud information based on the detected light, wherein the first LiDAR device is at a first position of the vehicle and is configured for a first starting angle and a first frequency, and the second LiDAR device is at a second position of the vehicle and is configured for a second starting angle and a second frequency;

receiving first timestamp information associated with the first LiDAR point cloud information and second timestamp information associated with the second LiDAR point cloud information; and

in accordance with the first and second LiDAR point cloud information, first and second timestamp information, first starting angle, a first frequency, second starting angle, and second frequency, generating third point cloud information according to merging the first and second LiDAR point cloud information, wherein generating the third point cloud information comprises generating a data structure representing voxels oriented in accordance with polar coordinates, wherein a respective point of the first LiDAR point cloud information or second LiDAR point cloud information is assigned to one of the voxels of the data structure; and

operating the vehicle based upon the third LiDAR point cloud information.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 23, 2020
From: APTIV TECHNOLOGIES LIMITED
To: MOTIONAL AD LLC
Reel/Frame 053861/0235 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 28, 2020
From: DI CICCO, MAURILIO; SHETTI, KARAN RAJENDRA
To: APTIV TECHNOLOGIES LIMITED
Reel/Frame 053329/0264 →
Priority Claims (1)
DK PA201970131 · Feb 27, 2019 · national
Continuity (2)
Provisional Application 62799391 · Jan 31, 2019
Related Publication 20200249353A1 · Aug 6, 2020
Cited By (2)
US 12,345,804 US 12,437,638