IP Library › Granted Patent US 12,344,198
Granted Patent B1
US 12,344,198 · App. 18/470,676 · Granted Jul 1, 2025

Rain detection using exterior microphones

Inventors: David Donald Logan (Morgan Hill, CA); Nehemia Girma Terefe (Foster City, CA); Xuan Zhong (San Jose, CA)
Assignee: Zoox, Inc.
B60S1/0859H04R1/086H04R2499/13
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,344,198
App. No.
18/470,676
Granted
Jul 1, 2025
Kind
B1
Abstract

A method includes receiving an audio signal from a microphone and processing the audio signal to identify a signal component that is associated with a resonance of at least part of a microphone unit disposed on a vehicle. The microphone unit includes the microphone and a protective element arranged to shield the microphone from environmental material. The method includes determining, based at least in part on the identified signal components, a characteristic indicative of the protective element having shielded the microphone from environmental material.

Claims (79)

1. A system comprising:

a microphone unit for mounting on a vehicle, the microphone unit comprising a housing, a microphone, and a protective mesh arranged to shield the microphone from environmental material, wherein the housing and the protective mesh delimit a cavity of the microphone unit;

one or more processors; and

one or more non-transitory computer-readable media storing instructions which, when executed by the one or more processors, cause the one or more processors to perform operations comprising:

receiving an audio signal from the microphone;

processing the audio signal to identify a signal component that is associated with a resonance of the cavity of the microphone unit, the identified signal component having a frequency depending on an extent to which perforations of the protective mesh are plugged by water; and

determining, based at least in part on the frequency of the identified signal component, a characteristic quantifying rainfall in a vicinity of the vehicle.

2. The system of claim 1 , wherein:

the operations comprise determining a rate at which the frequency of the identified signal component changes due to variations in the extent to which the perforations of the protective mesh are plugged by water; and

the determining of the characteristic is based at least in part on the determined rate at which at which the frequency of the identified signal component changes.

3. The system of claim 1 , wherein:

the operations comprise:

determining an average frequency of the signal component within a temporal window; and

obtaining data indicating a speed of the vehicle within the temporal window; and

the determining of the characteristic uses the determined average frequency and the indicated speed of the vehicle.

4. The system of claim 1 , wherein:

the signal component is a first signal component;

the operations further comprise identifying, within the audio signal, second signal components that are associated with reverberations caused by water droplets landing on the protective mesh;

the operations comprise determining an occurrence rate of the second signal components; and

the determining of the characteristic further uses the determined occurrence rate of the second signal components.

5. A method comprising:

receiving an audio signal from a microphone;

processing the audio signal to identify a signal component that is associated with a resonance of at least part of a microphone unit disposed on a vehicle, the microphone unit comprising the microphone and a protective element arranged to shield the microphone from environmental material; and

determining, based at least in part on the identified signal components, a characteristic indicative of the protective element having shielded the microphone from environmental material.

6. The method of claim 5 , wherein:

the protective element is perforated;

the identified signal component is associated with a resonance of a cavity delimited by the protective element and a housing of the microphone unit;

the identified signal component has a frequency depending on an extent to which perforations of the protective element are plugged by environmental material; and

the determining of the characteristic is based at least in part on the frequency of the identified signal component.

7. The method of claim 6 , wherein:

the method comprises determining a rate at which the frequency of the identified signal component changes due to variations in the extent to which the perforations of the protective mesh are plugged by water; and

the determining of the characteristic is based at least in part on the determined rate at which at which the frequency of the identified signal component changes due to variations in the extent to which the perforations of the protective mesh are plugged by water.

8. The method of claim 6 , wherein:

the method further comprises:

determining an average frequency of the identified signal component within a temporal window; and

obtaining data indicating a speed of the vehicle within the temporal window; and

the determining of the characteristic uses the determined average frequency and the indicated speed of the vehicle.

9. The method of claim 5 , wherein:

the signal component is associated with a reverberation caused by a liquid droplet landing on the protective element;

the method comprises determining an occurrence rate of signal components that are associated with reverberations caused by liquid droplets landing on the protective element; and

the determining of the characteristic uses the determined occurrence rate of the signal components that are associated with reverberations caused by liquid droplets landing on the protective element.

10. The method of claim 9 , wherein:

the signal component is a first signal component; and

the method further comprises identifying a second signal component that is associated with a resonance of a cavity delimited by the protective element and a housing of the microphone unit, the second signal component having a frequency depending on an extent to which perforations of the protective element are plugged by environmental material; and

the determining of the characteristic is further based on the frequency of the second signal components.

11. The method of claim 5 , wherein the characteristic is a characteristic of rainfall in a vicinity of the vehicle.

12. The method of claim 11 , wherein:

the microphone unit is a first microphone unit; and

the method comprises:

receiving a second audio signal from a second microphone unit disposed on the vehicle and oriented differently to the first microphone unit; and

processing the first audio signal and the second audio signal to determine a direction of the rainfall relative to the vehicle.

13. The method of claim 5 , comprising processing the audio signal to detect a siren in a vicinity of the vehicle.

14. One or more non-transitory computer-readable media storing instructions executable by one or more processors, wherein the instructions, when executed, cause the one or more processors to perform operations comprising:

receiving an audio signal from a microphone;

processing the audio signal to identify a signal component that is associated with a resonance of at least part of a microphone unit disposed on a vehicle, the microphone unit comprising the microphone and a protective element arranged to shield the microphone from environmental material; and

determining, based at least in part on the identified signal component, a characteristic indicative of the protective element having shielded the microphone from environmental material.

15. The one or more non-transitory computer-readable storage media of claim 14 , wherein:

the protective element is perforated;

the identified signal components are associated with a resonance of a cavity delimited by the protective element and a housing of the microphone unit;

the identified signal component has a frequency depending on an extent to which perforations of the protective element are plugged by environmental material; and

the determining of the characteristic is based at least in part on the frequency of the identified signal component.

16. The one or more non-transitory computer-readable storage media of claim 15 , wherein:

the operations comprise determining a rate at which the frequency of the identified signal component changes due to variations in the extent to which the perforations of the protective mesh are plugged by water; and

the determining of the characteristic is based at least in part on the determined rate at which at which the frequency of the identified signal component changes due to variations in the extent to which the perforations of the protective mesh are plugged by water.

17. The one or more non-transitory computer-readable storage media of claim 16 , wherein:

the operations further comprise:

determining an average frequency of the identified signal component within a temporal window; and

obtaining data indicating a speed of the vehicle within the temporal window; and

determining the characteristic uses the determined average frequency shift.

18. The one or more non-transitory computer-readable storage media of claim 14 , wherein:

the signal components is associated with a reverberation caused by a liquid droplets landing on the protective element;

the operations comprise determining an occurrence rate of signal components that are associated with reverberations caused by liquid droplets landing on the protective element; and

the determining of the characteristic uses the determined occurrence rate of signal components that are associated with reverberations caused by liquid droplets landing on the protective element.

19. The one or more non-transitory computer-readable storage media of claim 14 , wherein the characteristic is a characteristic of rainfall in a vicinity of the vehicle.

20. The one or more non-transitory computer-readable storage media of claim 19 , wherein:

the microphone unit is a first microphone unit; and

the operations comprise:

receiving a second audio signal from a second microphone unit disposed on the vehicle and oriented differently to the first microphone unit; and

processing the first audio signal and the second audio signal to determine a direction of the rainfall relative to the vehicle.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 20, 2023
From: LOGAN, DAVID DONALD; TEREFE, NEHEMIA GIRMA; ZHONG, XUAN
To: ZOOX, INC.
Reel/Frame 064968/0467 →
References Cited (25)
US 6771788B1 · Soutar · 2004 [cited by examiner]
US 6774356B2 · Heslin · 2004 [cited by examiner]
US 11729538B2 · Chng · 2023 [cited by examiner]
US 12003929B1 · Zhong · 2024 [cited by examiner]
US 12049199B2 · Khamis · 2024 [cited by examiner]
US 20040264016A1 · Ostreko · 2004 [cited by examiner]
US 20050114128A1 · Hetherington · 2005 [cited by examiner]
US 20100277821A1 · Roth · 2010 [cited by examiner]
US 20120213399A1 · Li · 2012 [cited by examiner]
US 20160234356A1 · Thomas · 2016 [cited by examiner]
US 20160234594A1 · Ogura · 2016 [cited by examiner]
US 20200112782A1 · Kargus, IV · 2020 [cited by examiner]
US 20200396539A1 · Vitt · 2020 [cited by examiner]
US 20210163129A1 · Thomas · 2021 [cited by examiner]
US 20210258672A1 · Banter · 2021 [cited by examiner]
US 20220155429A1 · Kobayashi · 2022 [cited by examiner]
US 20220187448A1 · Shand · 2022 [cited by examiner]
US 20220417627A1 · Marron-Baez · 2022 [cited by examiner]
US 20240080631A1 · Guha · 2024 [cited by examiner]
JP 2021530394A · 2021 [cited by applicant]
KR 1020210015194A · 2021 [cited by applicant]
KR 1020220013579A · 2022 [cited by applicant]
KR 1020220036453A · 2022 [cited by applicant]
WO 2022236783A1 · 2022 [cited by applicant]
International Search Report and Written Opinion dated Mar. 31, 2025 for International PCT Application No. PCT/US2024/060384. [cited by applicant]