IP Library Granted Patent US 12,181,584
Granted Patent B2
US 12,181,584 · App. 17/148,691 · Granted Dec 31, 2024

Systems and methods for monitoring LiDAR sensor health

Inventors: Hsin Miao (Sunnyvale, CA); Willibald Brems (Bavaria, DE); Dikpal Reddy (Palo Alto, CA)
Assignee: VOLKSWAGEN GROUP OF AMERICA INVESTMENTS, LLC
G01S17/931G01S7/4808G01S7/4873
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,181,584
App. No.
17/148,691
Granted
Dec 31, 2024
Kind
B2
Abstract

Systems and methods for generating operating an autonomous vehicle. The methods comprise: obtaining LiDAR point cloud data generated by a LiDAR system of the autonomous vehicle; inspecting the LiDAR point cloud data to infer a health of LiDAR beams; identifying bad quality point cloud data based on the inferred health of the LiDAR beams; removing the bad quality point cloud data from the LiDAR point cloud data to generate modified LiDAR point cloud data; and causing the autonomous vehicle to perform at least one autonomous driving operation or mode change based on the modified LiDAR point cloud data.

Claims (46)

1. A method for operating an autonomous vehicle, comprising:

obtaining, by a computing device, LiDAR point cloud data generated by a LiDAR system of the autonomous vehicle;

inspecting, by the computing device, the LiDAR point cloud data to infer a health of LiDAR beams;

identifying, by the computing device, bad quality point cloud data based on the inferred health of the LiDAR beams;

removing, by the computing device, the bad quality point cloud data from the LiDAR point cloud data to generate modified LiDAR point cloud data; and

causing, by the computing device, the autonomous vehicle to perform at least one autonomous driving operation or mode change based on the modified LiDAR point cloud data;

wherein the health of the LiDAR beam is inferred by computing a plurality of metrics based on characteristics of a LiDAR point cloud defined by the LiDAR point cloud data; and

wherein a metric of the plurality of metrics is generated by:

determining a first number representing a total number of data points in the LIDAR point cloud that have a first intensity value of a plurality of intensity values, and a second number representing a total number of data points in the LIDAR point cloud that have a different second intensity value of the plurality of intensity values;

combining the first number and the second number to obtain a third number; and

setting a value of the metric equal to the third number.

2. The method according to claim 1 , wherein the health of the LiDAR beam is inferred by further computing a confidence score based on the plurality of metrics.

3. The method according to claim 2 , wherein the health of the LiDAR beam is inferred by further classifying the LiDAR beam as a faulty beam or a good beam based on the confidence score.

4. The method according to claim 3 , wherein the LiDAR beam is classified as a faulty beam when the confidence score is less than a threshold value.

5. The method according to claim 1 , wherein the plurality of metrics comprise at least one of a shape context metric, and a height metric.

6. The method according to claim 1 , wherein the plurality of metrics are determined based on at least one of a total number of data points in the LiDAR point cloud, intensity values of the LiDAR point cloud, and z-coordinate values for data points in the LiDAR point cloud.

7. The method according to claim 1 , wherein another metric of the plurality of metrics is equal to a total number of data points in the LiDAR point cloud.

8. The method according to claim 1 , wherein another metric of the plurality of metrics is generated by:

using a z-coordinate value to compute a distance from each given data point to an average z-coordinate value;

determining a standard deviation of the z-coordinate values for data points in a LiDAR point cloud;

dividing each distance by the standard deviation to obtain a value;

computing an average of the values.

9. A system, comprising:

a processor;

a non-transitory computer-readable storage medium comprising programming instructions that are configured to cause the processor to implement a method for operating an autonomous vehicle, wherein the programming instructions comprise instructions to:

obtain LiDAR point cloud data generated by a LiDAR system of the autonomous vehicle;

inspect the LiDAR point cloud data to infer a health of LiDAR beams;

identify bad quality point cloud data based on the inferred health of the LiDAR beams;

remove the bad quality point cloud data from the LiDAR point cloud data to generate modified LiDAR point cloud data; and

cause the autonomous vehicle to perform at least one autonomous driving operation or mode change based on the modified LiDAR point cloud data;

wherein the health of the LiDAR beam is inferred by computing a plurality of metrics based on characteristics of a LiDAR point cloud defined by the LiDAR point cloud data; and

wherein a metric of the plurality of metrics is generated by:

determining a first number representing a total number of data points in the LIDAR point cloud that have a first intensity value of a plurality of intensity values, and a second number representing a total number of data points in the LIDAR point cloud that have a different second intensity value of the plurality of intensity values;

combining the first number and the second number to obtain a third number; and

setting a value of the metric equal to the third number.

10. The system according to claim 9 , wherein the health of the LiDAR beam is inferred by further computing a confidence score based on the plurality of metrics.

11. The system according to claim 10 , wherein the health of the LiDAR beam is inferred by further classifying the LiDAR beam as a faulty beam or a good beam based on the confidence score.

12. The system according to claim 11 , wherein the LiDAR beam is classified as a faulty beam when the confidence score is less than a threshold value.

13. The system according to claim 9 , wherein the plurality of metrics comprise at least one of an outlier metric, a shape context metric, and a height metric.

14. The system according to claim 9 , wherein the plurality of metrics are determined based on at least one of a total number of data points in the LiDAR point cloud, intensity values of the LiDAR point cloud, and z-coordinate values for data points in the LiDAR point cloud.

15. The system according to claim 9 , wherein another metric of the plurality of metrics is equal to a total number of data points in the LiDAR point cloud.

16. The system according to claim 9 , wherein another metric of the plurality of metrics is generated by:

using a z-coordinate value to compute a distance from each given data point to an average z-coordinate value;

determining a standard deviation of the z-coordinate values for data points in a LiDAR point cloud;

dividing each distance by the standard deviation to obtain a value;

computing an average of the values.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Oct 9, 2024
From: ARGO AI, LLC
To: VOLKSWAGEN GROUP OF AMERICA INVESTMENTS, LLC
Reel/Frame 069177/0099 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 14, 2021
From: MIAO, HSIN; BREMS, WILLIBALD; REDDY, DIKPAL
To: ARGO AI, LLC
Reel/Frame 054916/0623 →
Continuity (1)
Related Publication 20220221585A1 · Jul 14, 2022
Cited By (1)
US 12,429,561