IP Library › Granted Patent US 11,320,520
Granted Patent B2
US 11,320,520 · App. 16/183,483 · Granted May 3, 2022

Lidar peak detection using time-to-digital converter and multi-pixel photon counter for autonomous driving vehicles

Inventors: Yang Han (Sunnyvale, CA); Yaoming Shen (Sunnyvale, CA); Xiangfei Zhou (Sunnyvale, CA)
Assignee: BAIDU USA LLC
G01S7/4865G01S7/4863G01S17/931G05D1/0088G05D1/0248G04F10/005
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,320,520
App. No.
16/183,483
Granted
May 3, 2022
Kind
B2
Abstract

A LIDAR scanning system uses a combination of a time-to-digital conversion (TDC) device and a multi-pixel photon counter (MPPC) to determine the peak location (time) and magnitude of a reflection of a laser beam off of an object. A configurable trigger threshold of the TDC indicates that a sufficient number of MPPC pixels have triggered that the peak detection module should begin sampling and storing MPPC counts of triggered pixels. When the light received from the reflected laser beam falls below the trigger threshold of the TDC, the MPPC stops sampling the MPPC counts. The peak magnitude of the reflection of the laser beam is determined from the highest sample count of the MPPC. A time at which the peak magnitude occurred is determined as the midpoint of TDC trigger points. The peak magnitude MPPC count is correlated to an intensity value.

Claims (31)

1. A LIDAR device for an autonomous driving vehicle (ADV), comprising:

a laser transmitter to emit an initial laser beam;

a time-to-digital conversion (TDC) device to be triggered at a trigger threshold;

a multi-pixel photon counter (MPPC) having an array of single photon avalanche diodes (SPADs), each SPAD having an output of 0 or 1, wherein each SPAD in the array of SPADs has a probability of outputting a 1 that is dependent upon an intensity of light received and a configured trigger level corresponding to a maximum sensing distance range for each SPAD in the array of SPADs, wherein the MPPC is to output an analog signal corresponding to an MPCC count representing a summation of an output of 0's and 1's of all SPADs in the MPPC for each reflected pulse of the initial laser beam, and starts sampling and storing the MPCC count when the analog signal exceeds the trigger threshold of the TDC device to trigger the TDC device and stops sampling and storing the MPCC count when the analog signal falls below falls below the trigger threshold, wherein the MPPC is to determine a highest MPPC count of the sampled and stored MPPC counts as a peak magnitude of a reflection of the initial laser beam, wherein the TDC device is to determine a time of the peak magnitude of the reflection of the initial laser beam based on a combination of factors including a time at which the initial laser beam is emitted, a time at which the TDC device is triggered, a sampling rate of the MPPC, and a sample number corresponding to the highest MPPC count; and

a processing module coupled to the MPPC and the TDC device to generate LIDAR information from the peak magnitude and a time-of-flight from the time at which the initial laser beam is emitted to the time of the peak magnitude, wherein the LIDAR information is utilized to navigate the ADV responsive to one or more obstacles detected by the LIDAR device.

2. The LIDAR device of claim 1 , wherein the MPPC and the TDC device are incorporated into a single sensor.

3. The LIDAR device of claim 1 , wherein the trigger threshold of the TDC corresponds to a maximum sensing range for the LIDAR device.

4. The LIDAR device of claim 1 , wherein the processing module is further configured to correlate the MPPC count with an intensity value of the reflected pulse of the initial laser beam.

5. The LIDAR device of claim 4 , wherein the processing module is further configured to correlate the intensity value and a time-of-flight of the reflected pulse of the initial laser beam with one or more attributes of an object that reflected the pulse of the initial laser beam.

6. An autonomous driving vehicle (ADV), comprising:

a light detection and range (LIDAR) device, wherein the LIDAR device comprises:

a laser transmitter to emit an initial laser beam;

a time-to-digital conversion (TDC) device to be triggered at a trigger threshold;

a multi-pixel photon counter (MPPC) having an array of single photon avalanche diodes (SPADs), each SPAD having an output of 0 or 1, wherein each SPAD in the array of SPADs has a probability of outputting a 1 that is dependent upon an intensity of light received and a configured trigger level corresponding to a maximum sensing distance range for each SPAD in the array of SPADs, wherein the MPPC is to output an analog signal corresponding to an MPCC count representing a summation of an output of 0's and 1's of all SPADs in the MPPC for each reflected pulse of the initial laser beam, and starts sampling and storing the MPCC count when the analog signal exceeds the trigger threshold of the TDC device to trigger the TDC device and stops sampling and storing the MPCC count when the analog signal falls below falls below the trigger threshold, wherein the MPPC is to determine a highest MPPC count of the sampled and stored MPPC counts as a peak magnitude of a reflection of the initial laser beam, wherein the TDC device is to determine a time of the peak magnitude of the reflection of the initial laser beam based on a combination of factors including a time at which the initial laser beam is emitted, a time at which the TDC device is triggered, a sampling rate of the MPPC, and a sample number corresponding to the highest MPPC count; and

a processing module coupled to the MPPC and the TDC device to generate LIDAR information from the peak magnitude and a time-of-flight from the time at which the initial laser beam is emitted to the time of the peak magnitude;

a perception and planning system coupled to the LIDAR device and configured to utilize the LIDAR information to navigate the ADV responsive to one or more obstacles detected by the LIDAR device.

7. The ADV of claim 6 , wherein the processing module is further configured to correlate the MPPC count with an intensity value of the reflected pulse of the initial laser beam.

8. A computer-implemented method, practiced on a LIDAR device comprising a laser emitter, an multi-pixel photon counter (MPPC), a time-to-digital conversion (TDC) device, and a processing module, the method comprising:

emitting an initial laser beam by the laser emitter;

measuring, by the MPPC, a peak magnitude of a reflection of the initial laser beam, wherein MPPC comprises an array of single photon avalanche diodes (SPADs), each SPAD having an output of 0 or 1, wherein each SPAD in the array of SPADs has a probability of outputting a 1 that is dependent upon an intensity of light received and a configured trigger level corresponding to a maximum sensing distance range for the each SPAD in the array of SPADs, wherein the MPPC is to output an analog signal corresponding to an MPCC count representing a summation of an output of 0's and 1's of all SPADs in the MPPC for each reflected pulse of the initial laser beam, and starts sampling and storing the MPCC count when the analog signal exceeds the trigger threshold of the TDC device to trigger the TDC device and stops sampling and storing the MPCC count when the analog signal falls below falls below the trigger threshold, wherein the MPPC is to determine a highest MPPC count of the sampled and stored MPPC counts as a peak magnitude of a reflection of the initial laser beam;

determining, by the TDC device having a configurable trigger threshold, a time of the peak magnitude of the reflection of the initial laser beam based on a combination of factors including a time at which the initial laser beam is emitted, a time at which the TDC device is triggered, a sampling rate of the MPPC, and a sample number corresponding to the highest MPPC count; and

generating LIDAR information from the peak magnitude, and a time-of-flight from the time at which the initial laser beam is emitted to the time of the peak magnitude, wherein the LIDAR information is utilized to navigate an autonomous driving vehicle (ADV) responsive to one or more obstacles detected by the LIDAR.

9. The method of claim 8 , further comprising:

correlating the MPPC account with an intensity value of the reflected pulse of the initial laser beam.

10. The method of claim 9 , further comprising:

correlating the intensity value and a time-of-flight of the reflected pulse of the initial laser beam with one or more attributes of an object that reflected the pulse of the initial laser beam.

11. The method of claim 8 , wherein the MPPC and the TDC device are incorporated into a single sensor.

12. The method of claim 8 , wherein the trigger threshold of the TDC corresponds to a maximum sensing range for the LIDAR device.

13. The ADV of claim 7 , wherein the processing module is further configured to correlate the intensity value and a time-of-flight of the reflected pulse of the initial laser beam with one or more attributes of an object that reflected the pulse of the initial laser beam.

14. The ADV of claim 6 , wherein the MPPC and the TDC device are incorporated into a single sensor.

15. The ADV of claim 6 , wherein the trigger threshold of the TDC corresponds to a maximum sensing range for the LIDAR device.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 18, 2019
From: HAN, YANG; SHEN, YAOMING; ZHOU, XIANGFEI
To: BAIDU USA LLC
Reel/Frame 048626/0280 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Nov 16, 2018
From: HAN, YANG; SHEN, YAOMING; ZHOU, XIANFEI
To: BAIDU USA LLC
Reel/Frame 047532/0502 →
Continuity (1)
Related Publication 20200142038A1 · May 7, 2020