IP Library › Granted Patent US 12,748,199
Granted Patent B2
US 12,748,199 · App. 18/778,648 · Granted Sep 29, 2026

Methods for detecting lidar aperture fouling

Inventors: Jingyuan Linda Zhang (Menlo Park, CA); Caner Onal (Palo Alto, CA)
Assignee: Waymo LLC
G01S7/497B60S1/56G01S17/931G01S2007/4977
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,748,199
App. No.
18/778,648
Granted
Sep 29, 2026
Kind
B2
Abstract

An example method includes receiving point cloud information about a field of view of a lidar system. The point cloud information includes spatiotemporal and amplitude information about return light received. The method also includes determining, based on the point cloud information, a set of bright light returns from at least one highly reflective object. The bright light returns include return light having an amplitude above a photon threshold and a corresponding bright light return range. The method yet further includes determining, based on the point cloud information, a set of crosstalk returns. The crosstalk returns include return light having a corresponding crosstalk return range. The method includes adjusting, based on a normalized number of crosstalk returns, at least one of: a cleaning system, an operating mode of a lidar system, or an operating mode of a vehicle.

Claims (55)

1 . A light detection and ranging (lidar) system comprising:

at least one light-emitter device configured to emit light pulses;

at least one detector; and

a controller comprising at least one processor and a memory, wherein the at least one processor executes instructions stored in the memory so as to perform operations, the operations comprising:

causing the at least one light-emitter device to emit at least one light pulse;

receiving, from the at least one detector, information indicative of return light;

determining, based on the received information, at least one bright light return associated with at least one highly reflective object;

classifying a portion of the return light as crosstalk light; and

determining a normalized number of crosstalk returns based on an apparent size of the at least one highly reflective object.

2 . The lidar system of claim 1 , wherein the crosstalk light has a corresponding crosstalk return range that is within a range tolerance with respect to a bright light return range to the at least one highly reflective object.

3 . The lidar system of claim 2 , wherein the range tolerance is within 50 centimeters of the bright light return range.

4 . The lidar system of claim 2 , wherein the range tolerance is between −30 centimeters and +50 centimeters with respect to the bright light return range.

5 . The lidar system of claim 2 , wherein the bright light return range comprises a distance of between 0.1 meter to 200 meters.

6 . The lidar system of claim 1 , further comprising:

at least one optical surface; and

a cleaning system, wherein the operations additionally include:

causing, based on the normalized number of crosstalk returns, the cleaning system to clean the at least one optical surface.

7 . The lidar system of claim 6 , wherein the at least one optical surface comprises: an optical window, an optical lens, or a reflective surface.

8 . The lidar system of claim 6 , wherein the cleaning system comprises at least one of: a compressed gas jet, a fluid jet, or a mechanical wiper.

9 . A method comprising:

receiving information indicative of return light;

determining, from the received information, at least one bright light return associated with at least one highly reflective object;

classifying a portion of the return light as crosstalk light;

determining a normalized number of crosstalk returns based on an apparent size of the at least one highly reflective object; and

adjusting, based on the normalized number of crosstalk returns, at least one of: a cleaning system, an operating mode of a lidar system, or an operating mode of a vehicle.

10 . The method of claim 9 , further comprising:

causing at least one light-emitter device to emit emitted light pulses into an environment, wherein the return light comprises at least a portion of the emitted light pulses that have interacted with objects in the environment.

11 . The method of claim 9 , wherein the crosstalk light has a corresponding crosstalk return range that is within a range tolerance with respect to a bright light return range to the at least one highly reflective object.

12 . The method of claim 11 , wherein the range tolerance is within 50 centimeters of the bright light return range.

13 . The method of claim 11 , wherein the range tolerance is between −30 centimeters and +50 centimeters with respect to the bright light return range.

14 . The method of claim 9 , wherein adjusting, based on the normalized number of crosstalk returns, at least one of: the cleaning system, the operating mode of the lidar system, or the operating mode of the vehicle comprises:

turning on a wiper;

turning on a fluid jet cleaning system;

turning on a compressed gas cleaning system;

changing a spatial resolution of the lidar system;

changing a temporal resolution of the lidar system;

changing a maximum range of the lidar system;

changing a maximum speed of the vehicle;

adjusting a route of the vehicle;

scheduling a vehicle repair; or

scheduling a sensor cleaning appointment.

15 . The method of claim 9 , wherein determining the at least one bright light return comprises:

comparing an amplitude of the return light to a photon threshold, and wherein the at least one bright light return is determined where the amplitude of the return light is greater than the photon threshold.

16 . A method comprising:

receiving point cloud information, wherein the point cloud information comprises spatiotemporal and amplitude information about return light received by a lidar system;

determining, based on the point cloud information, a set of bright light returns from at least one highly reflective object;

classifying a portion of the point cloud information as crosstalk light;

determining a normalized number of crosstalk returns based on an apparent size of the at least one highly reflective object; and

adjusting, based on the normalized number of crosstalk returns, at least one of: a cleaning system, an operating mode of the lidar system, or an operating mode of a vehicle.

17 . The method of claim 16 , wherein the crosstalk light has a corresponding crosstalk return range that is within a range tolerance with respect to a bright light return range to the at least one highly reflective object.

18 . The method of claim 17 , wherein the range tolerance is within 50 centimeters of the bright light return range.

19 . The method of claim 17 , wherein the bright light return range comprises a distance of between 0.1 meter to 200 meters.

20 . The method of claim 16 , further comprising:

adjusting a position or an orientation of the lidar system; and

carrying out the other method steps with the adjusted position or the adjusted orientation of the lidar system.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 22, 2024
From: ZHANG, JINGYUAN LINDA; ONAL, CANER
To: WAYMO LLC
Reel/Frame 068040/0016 →
Continuity (2)
Continuation 17455239 · Nov 17, 2021
Related Publication 20240369691A1 · Nov 7, 2024
References Cited (45)
US 10466342B1 · Zhu · 2019 [cited by applicant]
US 10604120B2 · Newman · 2020 [cited by examiner]
US 10802121B1 · Krishnan · 2020 [cited by examiner]
US 10830880B2 · Subasingha · 2020 [cited by applicant]
US 10884129B2 · Wu · 2021 [cited by applicant]
US 11059458B2 · Frederick · 2021 [cited by examiner]
US 11427163B2 · Kubota · 2022 [cited by examiner]
US 11668804B2 · Herman · 2023 [cited by examiner]
US 11971507B2 · Avlas · 2024 [cited by examiner]
US 12000963B2 · Kim · 2024 [cited by examiner]
US 20100020306A1 · Hall · 2010 [cited by applicant]
US 20140060582A1 · Hartranft · 2014 [cited by applicant]
US 20190094346A1 · Dumoulin · 2019 [cited by applicant]
US 20190129009A1 · Eichenholz · 2019 [cited by examiner]
US 20190353761A1 · Kim · 2019 [cited by applicant]
US 20190369258A1 · Hall · 2019 [cited by examiner]
US 20200025896A1 · Gunnam · 2020 [cited by applicant]
US 20200025928A1 · Gaalema · 2020 [cited by applicant]
US 20200047717A1 · Frederick · 2020 [cited by applicant]
US 20200064452A1 · Avlas · 2020 [cited by applicant]
US 20200114907A1 · Sims, III · 2020 [cited by applicant]
US 20200139939A1 · Kubota · 2020 [cited by applicant]
US 20200249329A1 · Herman · 2020 [cited by applicant]
US 20200249354A1 · Yeruhami · 2020 [cited by examiner]
US 20200408908A1 · Donovan · 2020 [cited by applicant]
US 20210025997A1 · Rosenzweig · 2021 [cited by examiner]
US 20210080558A1 · Gosala · 2021 [cited by applicant]
US 20210096228A1 · Behzadi · 2021 [cited by applicant]
US 20210124018A1 · Gassend · 2021 [cited by examiner]
US 20210208258A1 · Kim · 2021 [cited by examiner]
US 20210293929A1 · Dong · 2021 [cited by applicant]
CN 113567961A · 2021 [cited by applicant]
DE 102020102818A1 · 2020 [cited by examiner]
DE 102019128907A1 · 2021 [cited by applicant]
DE 102020201837A1 · 2021 [cited by applicant]
DE 102020119116B3 · 2021 [cited by examiner]
EP 3605137A1 · 2020 [cited by applicant]
JP 2017067559A · 2017 [cited by applicant]
WO 2020186236A1 · 2020 [cited by applicant]
WO 2020197613W · 2020 [cited by applicant]
WO WO2020086142A2 · 2021 [cited by examiner]
Diehm et al., “Mitigation of crosstalk effects in multi-LiDAR configurations,” Electro-Optical Remote Sensing XII, Proceedings of the International Society for Optics and Photonics (SPIE), 2018, 12 pages. [cited by applicant]
Montalban et al., “A Quantitative Analysis of Point Clouds from Automotive Lidars Exposed to Artificial Rain and Fog,” Atmosphere, 2021, 25 pages, vol. 12, No. 738, https://doi.org/10.3390/atmos12060738. [cited by applicant]
PCT International Search Report and Written Opinion, Application No. PCT/US2022/079799, mailed Mar. 15, 2023, 10 pages. [cited by applicant]
Wallace et al., “Waveform LiDAR for Adverse Weather Conditions,” IEEE Transactions on Vehicular Technology, 2020, 15 pages. [cited by applicant]