IP Library Granted Patent US 10,473,770
Granted Patent B1
US 10,473,770 · App. 16/232,973 · Granted Nov 12, 2019

Multi-pulse fusion analysis for LiDAR ranging

Inventors: Zhenghan Zhu (Mountain View, CA); Yue Lu (Mountain View, CA); Jihua Li (Mountain View, CA); John K. Wu (Mountain View, CA)
Assignee: Didi Research America, LLC
G01S7/487G01S17/10G01S17/936
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,473,770
App. No.
16/232,973
Granted
Nov 12, 2019
Kind
B1
Abstract

In some embodiments, a method for operating a light detection and ranging (LiDAR) system in an automobile provides a more accurate range estimate by combining multiple processed waveforms which are weighted according to their signal to noise ratios. At least one waveform is transmitted within a first time period, and reflected of an object. The reflected waveform is received and processed to improve the signal to noise ratio (SNR). The processing produces a higher number of output waveforms, such as through processing convolution. The SNR for each of the output waveforms is determined. An estimated range to the object from each output waveform is determined. The estimated ranges are then weighted according to their SNRs, and combined to provide an final determined range to the object.

Claims (50)

1. A method for operating a light detection and ranging (LiDAR) system in an automobile, the method comprising:

generating, by a logic circuit, a laser pulse group transmission trigger signal;

transmitting, by a laser source in response to the laser pulse group transmission trigger signal, a transmitted plurality of laser pulses within a first time period;

receiving, at a photodetector, a plurality of reflected pulses corresponding to the transmitted plurality of laser pulses as reflected off an object;

amplifying the plurality of reflected pulses;

converting, in an analog to digital converter, the plurality of reflected pulses into a plurality of digital reflected pulses;

processing, in a matched filter, the plurality of digital reflected pulses using convolution with a replica of the transmitted plurality of laser pulses to improve a signal to noise ratio and producing a higher number of output peaks than the plurality of reflected pulses;

determining the signal-to-noise ratio (SNR) for each of the output peaks;

determining, in a processor, a range to the object from each of the output peaks;

weighting, in the processor, the range to the object from each of the output peaks by a corresponding signal to noise ratio for each of the output peaks to provide a plurality of weighted ranges;

combining, in the processor, the weighted ranges to provide an final determined range to the object; and

using the final determined range to control an aspect of the automobile.

2. The method of claim 1 wherein the transmitted plurality of laser pulses are in the infrared frequencies.

3. The method of claim 1 wherein there are at least 3 output peaks and the combining is performed using an equation which includes (SNR1*Rest1+SNR2*Rest2+SNR3*Rest3)/(SNR1+SNR2+SNR3), where SNR1 is a signal-to-noise ratio (SNR) of a first peak, SNR2 is a SNR of a second peak, SNR3 is a SNR of a third peak, and Rest is the estimated range.

4. The method of claim 3 wherein the matched filter uses convolution.

5. The method of claim 1 wherein the transmitted plurality of laser pulses comprises a waveform having 2-5 peaks.

6. The method of claim 1 further comprising marking the final determined range as a point on a two dimensional point graph; and

repeating the claim elements of claim 1 multiple times for a plurality of objects to create a two dimensional collection of points that are dynamically and continuously updated in real-time, forming a point cloud.

7. The method of claim 1 wherein the matched filter comprises a time domain matched filter.

8. The method of claim 7 wherein the matched filter is a finite impulse response filter in the digital domain that uses a conjugate reversal of the transmitted plurality of laser pulses as filter coefficients.

9. A light detection and ranging (LiDAR) apparatus for an automobile, the apparatus comprising:

a logic circuit having an output laser pulse group transmission trigger signal;

a laser source, coupled to the logic circuit, having a laser output that transmits a plurality of laser pulses within a first time period in response to the output laser pulse group transmission trigger signal;

a photodetector positioned to receive a plurality of reflected pulses corresponding to the plurality of laser pulses as reflected off an object;

an amplifier, coupled to the photodetector to amplify the reflected pulses;

an analog to digital converter coupled to the amplifier to convert the reflected pulses into digital reflected pulses;

a matched filter coupled to the analog to digital converter to use convolution to compare the digital reflected pulses with a replica of the transmitted plurality of laser pulses to improve a signal to noise ratio and producing a higher number of output peaks than the number of reflected pulses;

a processor configured to determine the signal-to-noise ratio (SNR) for each of the output peaks;

non-transitory, computer readable code, embedded on media accessible by the processor, to determine a range to the object from each of the output peaks;

the non-transitory, computer readable code further being operable to weight the range to the object from each of the output peaks by a corresponding signal to noise ratio for each of the output peaks to provide a plurality of weighted ranges; and

the non-transitory, computer readable code further being operable to combine the weighted ranges to provide a final determined range to the object.

10. The apparatus of claim 9 wherein the transmitted plurality of laser pulses are in the infrared frequencies.

11. The apparatus of claim 9 wherein there are at least 3 output peaks and the computer readable code operable to combine the weighted ranges combines using an equation which includes (SNR1*Rest1+SNR2*Rest2+SNR3*Rest3)/(SNR1+SNR2+SNR3), where SNR1 is a signal-to-noise ratio (SNR) of a first peak, SNR2 is a SNR of a second peak and SNR3 is a SNR of a third peak, and Rest is the estimated range.

12. The apparatus of claim 11 wherein the matched filter uses convolution.

13. The apparatus of claim 11 wherein the transmitted plurality of laser pulses comprises a waveform having 2-5 peaks.

14. The apparatus of claim 11 wherein the matched filter comprises a time domain matched filter.

15. The apparatus of claim 11 wherein the matched filter is a finite impulse response filter in a digital domain that uses a conjugate reversal of the transmitted plurality of laser pulses as filter coefficients.

16. The apparatus of claim 11 wherein the code for calculating the SNR further comprises code for processing each output peak by dividing each output peak amplitude value by an RMS value of the noise.

17. A method comprising:

generating, by a logic circuit, a laser pulse group transmission trigger signal;

transmitting, by a laser source in response to the laser pulse group transmission trigger signal, at least one transmitted laser pulse within a first time period;

receiving, at a photodetector, at least one reflected pulse corresponding to the transmitted pulse as reflected off an object;

converting, in an analog to digital converter, the reflected pulse into a digital reflected pulse;

processing, in a matched filter, the digital reflected pulse using convolution with a replica of the transmitted laser pulse to produce a plurality of output peaks;

determining the signal-to-noise ratio (SNR) for each of the output peaks;

determining, in a processor, a range to the object using a fusion of the peaks and weighting, in the processor, by a corresponding SNR for each of the output peaks to provide a plurality of weighted numbers;

combining, in the processor, the weighted numbers to provide an final determined range to the object.

18. The method of claim 17 wherein the matched filter comprises a time-domain type matched filter.

19. The method of claim 18 wherein the matched filter is a finite impulse response filter in the digital domain that uses a conjugate reversal of the transmitted laser pulse as filter coefficients.

20. The method of claim 17 wherein the SNR is determined by processing each output peak by dividing each output peak amplitude value by an RMS value of a detected noise.

Assignments (4)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 15, 2023
From: BEIJING VOYAGER TECHNOLOGY CO., LTD.
To: GUANGZHOU WOYA LAIDELING TECHNOLOGY CO., LTD.
Reel/Frame 064598/0156 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 20, 2020
From: DIDI RESEARCH AMERICA, LLC
To: VOYAGER (HK) CO., LTD.
Reel/Frame 052201/0853 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 20, 2020
From: VOYAGER (HK) CO., LTD.
To: BEIJING VOYAGER TECHNOLOGY CO., LTD.
Reel/Frame 052201/0866 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 27, 2018
From: ZHU, ZHENGHAN; LU, YUE; LI, JIHUA; WU, JOHN K.
To: DIDI RESEARCH AMERICA, LLC
Reel/Frame 047858/0335 →
Cited By (6)
US 12,313,775 US 12,399,278 US 12,399,279 US 12,442,923 US 12,663,518 US 12,712,797