IP Library › Granted Patent US 11,447,128
Granted Patent B2
US 11,447,128 · App. 16/862,223 · Granted Sep 20, 2022

Method and system for operating an on-vehicle LiDAR sensor

Inventors: Negin Lashkari (Markham, CA); Arash Mohtat (North York, CA); Kai Yue Peter Yap (Markham, CA)
Assignee: GM Global Technology Operations LLC
B60W30/08B60W40/02B60W40/10B60W2420/52B60W2510/20B60W2520/28B60W2555/20
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,447,128
App. No.
16/862,223
Granted
Sep 20, 2022
Kind
B2
Abstract

A spatial monitoring system for a vehicle includes a LiDAR sensor, sensors arranged to monitor ambient environmental states, sensors arranged to monitor vehicle operating conditions, and a controller. The controller includes an instruction set that is executable to monitor the ambient environmental states and the vehicle operating conditions. The LiDAR sensor captures a point cloud, and the instruction set is executable to determine point cloud metrics. Desired control parameters for the LiDAR sensor are determined based upon the ambient environmental conditions, the vehicle operating conditions, and the point cloud metrics, and the LiDAR sensor is controlled based upon the desired control parameters. The LiDAR sensor is controlled to capture an image of a field-of-view proximal to the vehicle based upon the desired control parameters.

Claims (52)

1. A spatial monitoring system for a vehicle, the spatial monitoring system comprising:

a LiDAR sensor;

a first plurality of sensors arranged to monitor ambient environmental states, including one or more of temperature, pressure, humidity, and precipitation;

a second plurality of sensors arranged to monitor vehicle operating conditions;

a controller, in communication with the first plurality of sensors and the second plurality of sensors, and operatively connected to the LiDAR sensor, the controller including an instruction set, the instruction set being executable to:

monitor, via the first plurality of sensors, the ambient environmental states,

monitor, via the second plurality of sensors, the vehicle operating conditions,

capture, via the LiDAR sensor, a point cloud,

determine point cloud metrics for the point cloud, and determine desired control parameters for the LiDAR sensor based upon the ambient

environmental conditions, the vehicle operating conditions, and the point cloud metrics, and control the LiDAR sensor to capture an image of a field-of-view proximal to the vehicle based upon the desired control parameters.

2. The spatial monitoring system of claim 1 , wherein the LiDAR sensor comprises a mechanical spinning LiDAR sensor, wherein the desired control parameters comprise a spinning rate and a laser power level; and

wherein the instruction set being executable to determine the desired control parameters for the LiDAR sensor based upon the ambient environmental conditions, the vehicle operating conditions and the point cloud metrics comprises the instruction set being executable to determine the desired control parameters for one of the spinning rate and the laser power level of the LiDAR sensor based upon the ambient environmental conditions, the vehicle operating conditions and the point cloud metrics.

3. The spatial monitoring system of claim 1 , wherein the LiDAR sensor comprises a solid state LiDAR sensor, wherein the desired control parameters comprise a scanning pattern, a scan density across the field-of-view, a frame rate, and a laser power for the LiDAR sensor, and

wherein the instruction set being executable to determine the desired control parameters for the LiDAR sensor based upon the ambient environmental conditions, the vehicle operating conditions and the point cloud metrics comprises the instruction set being executable to determine the desired control parameters for one of the scanning pattern, the scan density across the field-of-view, the frame rate, and the laser power for the LiDAR sensor based upon the ambient environmental conditions, the vehicle operating conditions and the point cloud metrics.

4. The spatial monitoring system of claim 1 , wherein the first plurality of sensors arranged to monitor ambient environmental states comprises a plurality of sensors configured to monitor ambient pressure and temperature.

5. The spatial monitoring system of claim 1 , wherein the second plurality of sensors arranged to monitor vehicle operating conditions comprises a plurality of sensors configured to monitor vehicle wheel speed and steering angle.

6. The spatial monitoring system of claim 1 , wherein the instruction set being executable to determine point cloud metrics of the LiDAR sensor comprises the instruction set being executable to determine a quantity of points with zero range or reflectivity values, mean, median, standard deviation and a minimum/maximum interval of range and reflectivity for nonzero measurements for the point cloud of the LiDAR sensor.

7. The spatial monitoring system of claim 1 , wherein the instruction set being executable to determine the desired control parameters for the LiDAR sensor based upon the ambient environmental conditions, the vehicle operating conditions, and the point cloud metrics of the LiDAR sensor comprises the instruction set being executable to employ a reinforcement learning routine in a simulation pre-training mode to determine the desired control parameters for the LiDAR sensor that maximize the point cloud metrics of the LiDAR sensor based upon the ambient environmental conditions and the vehicle operating conditions.

8. The spatial monitoring system of claim 1 , wherein the instruction set being executable to determine the desired control parameters for the LiDAR sensor based upon the ambient environmental conditions, the vehicle operating conditions, and the point cloud metrics of the LiDAR sensor comprises the instruction set being executable to employ a reinforcement learning routine in-use to determine the desired control parameters for the LiDAR sensor that maximize the point cloud metrics of the LiDAR sensor based upon the ambient environmental conditions and the vehicle operating conditions.

9. A vehicle, comprising:

an advanced driver assistance system (ADAS) and a spatial monitoring system;

wherein the spatial monitoring system includes:

a LiDAR sensor;

a first plurality of sensors arranged to monitor ambient environmental states, including one or more of temperature, pressure, humidity, and precipitation;

a second plurality of sensors arranged to monitor vehicle operating conditions; and

a controller, in communication with the first plurality of sensors and the second plurality of sensors, and operatively connected to the LiDAR sensor, the controller including an instruction set, the instruction set being executable to:

monitor, via the first plurality of sensors, the ambient environmental states, monitor, via the second plurality of sensors, the vehicle operating conditions, capture, via the LiDAR sensor, a point cloud,

determine metrics for the point cloud, and

determine desired control parameters for the LiDAR sensor based upon the ambient environmental conditions, the vehicle operating conditions, and the point cloud metrics, and

control the LiDAR sensor to capture an image of a field-of-view proximal to the vehicle based upon the desired control parameters;

wherein the ADAS controls operation of the vehicle based upon the image of a field-of- view proximal to the vehicle.

10. The vehicle of claim 9 , wherein the LiDAR sensor comprises a mechanical spinning LiDAR sensor, wherein the desired control parameters comprise a spinning rate and a laser power level; and

wherein the instruction set being executable to determine the desired control parameters for the LiDAR sensor based upon the ambient environmental conditions, the vehicle operating conditions and the point cloud metrics comprises the instruction set being executable to determine the desired control parameters for one of the spinning rate and the laser power level of the LiDAR sensor based upon the ambient environmental conditions, the vehicle operating conditions and the point cloud metrics.

11. The vehicle of claim 9 , wherein the LiDAR sensor comprises a solid state LiDAR sensor, wherein the desired control parameters comprise a scanning pattern, a scan density across the field-of-view, a frame rate, and a laser power for the LiDAR sensor, and

wherein the instruction set being executable to determine the desired control parameters for the LiDAR sensor based upon the ambient environmental conditions, the vehicle operating conditions and the point cloud metrics comprises the instruction set being executable to determine the desired control parameters for one of the scanning pattern, the scan density across the field-of-view, the frame rate, and the laser power for the LiDAR sensor based upon the ambient environmental conditions, the vehicle operating conditions and the point cloud metrics.

12. The vehicle of claim 9 , wherein the first plurality of sensors arranged to monitor ambient environmental states comprises a plurality of sensors configured to monitor ambient pressure and temperature.

13. The vehicle of claim 9 , wherein the second plurality of sensors arranged to monitor vehicle operating conditions comprises a plurality of sensors configured to monitor vehicle wheel speed and steering angle.

14. The vehicle of claim 9 , wherein the instruction set being executable to determine point cloud metrics of the LiDAR sensor comprises the instruction set being executable to determine a quantity of points with zero range or reflectivity values, mean, median, standard deviation and a minimum/maximum interval of range and reflectivity for nonzero measurements for the point cloud of the LiDAR sensor.

15. The vehicle of claim 9 , wherein the instruction set being executable to determine the desired control parameters for the LiDAR sensor based upon the ambient environmental conditions, the vehicle operating conditions, and the point cloud metrics of the LiDAR sensor comprises the instruction set being executable to employ a reinforcement learning routine in a simulation pre-training mode to determine the desired control parameters for the LiDAR sensor that maximize the point cloud metrics of the LiDAR sensor based upon the ambient environmental conditions and the vehicle operating conditions.

16. The vehicle of claim 9 , wherein the instruction set being executable to determine the desired control parameters for the LiDAR sensor based upon the ambient environmental conditions, the vehicle operating conditions, and the point cloud metrics of the LiDAR sensor comprises the instruction set being executable to employ a reinforcement learning routine in-use to determine the desired control parameters for the LiDAR sensor that maximize the point cloud metrics of the LiDAR sensor based upon the ambient environmental conditions and the vehicle operating conditions.

17. A method for monitoring a spatial environment for a vehicle, method comprising:

monitoring a plurality of ambient environmental states, including one or more of temperature, pressure, humidity, and precipitation;

monitoring vehicle operating conditions;

capturing, via a LiDAR sensor, a point cloud,

determining metrics for the point cloud, and

determining desired control parameters for the LiDAR sensor based upon the ambient environmental conditions, the vehicle operating conditions, and the point cloud metrics, and controlling the LiDAR sensor to capture an image of a field-of-view proximal to the vehicle based upon the desired control parameters.

18. The method of claim 17 ,

wherein monitoring vehicle operating conditions includes monitoring an ambient pressure and ambient temperature;

wherein monitoring vehicle operating conditions comprises monitoring vehicle wheel speed and steering angle; and

wherein determining metrics for the point cloud comprises determining a quantity of points with zero range or reflectivity values, and a mean, a median, a standard deviation, and a minimum/maximum interval of range and reflectivity for nonzero measurements for the point cloud of the LiDAR sensor.

19. The method of claim 17 , wherein determining the desired control parameters for the LiDAR sensor based upon the ambient environmental conditions, the vehicle operating conditions, and the point cloud metrics of the LiDAR sensor comprises executing a reinforcement learning routine in a simulation pre-training mode to determine the desired control parameters for the LiDAR sensor that maximize the point cloud metrics of the LiDAR sensor based upon the ambient environmental conditions and the vehicle operating conditions.

20. The method of claim 17 , determining the desired control parameters for the LiDAR sensor based upon the ambient environmental conditions, the vehicle operating conditions, and the point cloud metrics of the LiDAR sensor comprises executing a reinforcement learning routine in-use to determine the desired control parameters for the LiDAR sensor that maximize the point cloud metrics of the LiDAR sensor based upon the ambient environmental conditions and the vehicle operating conditions.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 29, 2020
From: LASHKARI, NEGIN; MOHTAT, ARASH; YAP, KAI YUE PETER
To: GM GLOBAL TECHNOLOGY OPERATIONS LLC
Reel/Frame 052529/0966 →
Continuity (1)
Related Publication 20210339738A1 · Nov 4, 2021