IP Library Granted Patent US 12,223,831
Granted Patent B2
US 12,223,831 · App. 18/508,354 · Granted Feb 11, 2025

Detecting and responding to sirens

Inventors: David Harrison Silver (Millbrae, CA); Angus Leigh (Mountain View, CA); Benjamin Ingram (Santa Clara, CA); Jennifer Taylor (Palo Alto, CA); Vaibhav Nangia (East Palo Alto, CA)
Assignee: Waymo LLC
G08G1/0965G06F16/683G06F16/686G08G1/166H04R3/005G08G1/09623G08G1/09626H04R2499/13
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,223,831
App. No.
18/508,354
Granted
Feb 11, 2025
Kind
B2
Abstract

The technology relates to detecting and responding to emergency vehicles. This may include using a plurality of microphones to detect a siren noise corresponding to an emergency vehicle and to estimate a bearing of the emergency vehicle. This estimated bearing is compared to map information to identify a portion of roadway on which the emergency vehicle is traveling. In addition, information identifying a set of objects in the vehicle's environment as well as characteristics of those objects is received from a perception system is used to determine whether one of the set of objects corresponds to the emergency vehicle. How to respond to the emergency vehicle is determined based on the estimated bearing and identified road segments and the determination of whether one of the set of objects corresponds to the emergency vehicle. This determined response is then used to control the vehicle in an autonomous driving mode.

Claims (25)

1. A vehicle comprising:

a plurality of time-synchronized microphones configured to detect a siren noise of an emergency vehicle; and

one or more processors operably coupled with the plurality of time-synchronized microphones, the one or more processors configured to use output from the plurality of time- synchronized microphones to perform a comparison of an estimated bearing of the emergency vehicle to map information identifying locations of one or more road segments, and control the vehicle in an autonomous driving mode to perform a maneuver in response to a result of the comparison.

2. The vehicle of claim 1 , wherein the one or more processors are configured to control the vehicle in the autonomous driving mode to perform the maneuver in response to the detection of the siren noise prior to visual detection of the emergency vehicle.

3. The vehicle of claim 1 , wherein the one or more processors are further configured to use the output from the plurality of time-synchronized microphones to estimate a range to the emergency vehicle.

4. The vehicle of claim 1 , wherein the one or more processors are further configured to use the output from the plurality of time-synchronized microphones to estimate a velocity of the emergency vehicle.

5. The vehicle of claim 1 , wherein the maneuver is the vehicle changing from a first lane to a second lane.

6. The vehicle of claim 1 , wherein the maneuver is pulling the vehicle over onto a shoulder area.

7. The vehicle of claim 1 , wherein the maneuver is decreasing a speed of the vehicle.

8. The vehicle of claim 1 , wherein the one or more processors are further configured to perform beamforming to focus the time-synchronized microphones on one or more possible locations of the siren noise.

9. A method comprising:

receiving, by one or more processors of a vehicle operating in an autonomous driving mode, output from a plurality of time-synchronized microphones;

detecting in the output, by the one of more processors, a siren noise of an emergency vehicle in an external environment of the vehicle operating in the autonomous driving mode;

performing, by the one or more processors, a comparison of an estimated bearing of the emergency vehicle to map information identifying locations of one or more road segments; and

controlling, by the one or more processors, the vehicle in the autonomous driving mode to perform a maneuver in response to a result of the comparison.

10. The method of claim 9 , wherein controlling the vehicle in the autonomous driving mode to perform the maneuver in response to the detection of the siren noise is performed prior to visual detection of the emergency vehicle.

11. The method of claim 9 , further comprising:

using, by the one or more processors, the output from the plurality of time-synchronized microphones to estimate a range to the emergency vehicle.

12. The method of claim 9 , further comprising:

using, by the one or more processors, the output from the plurality of time-synchronized microphones to estimate a velocity of the emergency vehicle.

13. The method of claim 9 , wherein the maneuver is the vehicle changing from a first lane to a second lane.

14. The method of claim 9 , wherein the maneuver is pulling the vehicle over onto a shoulder area.

15. The method of claim 9 , wherein the maneuver is decreasing a speed of the vehicle.

16. The method of claim 9 , further comprising:

performing, by the one or more processors, beamforming to focus the time-synchronized microphones on one or more possible locations of the siren noise.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Nov 14, 2023
From: SILVER, DAVID HARRISON; LEIGH, ANGUS; INGRAM, BENJAMIN; TAYLOR, JENNIFER; NANGIA, VAIBHAV
To: WAYMO LLC
Reel/Frame 065552/0589 →
Continuity (7)
Continuation 18118341 · Mar 7, 2023
Continuation 17476830 · Sep 16, 2021
Continuation 16843928 · Apr 9, 2020
Continuation 16392745 · Apr 24, 2019
Continuation 15689336 · Aug 29, 2017
Provisional Application 62525423 · Jun 27, 2017
Related Publication 20240087451A1 · Mar 14, 2024
References Cited (117)
US 3691559A · Jackson · 1972 [cited by applicant]
US 4212085A · Miller et al. · 1980 [cited by applicant]
US 4952931A · Serageldin et al. · 1990 [cited by applicant]
US 6362749B1 · Brill · 2002 [cited by applicant]
US 7057528B1 · Ewing et al. · 2006 [cited by applicant]
US 7245232B1 · Caouette · 2007 [cited by applicant]
US 7616128B2 · Ohno et al. · 2009 [cited by applicant]
US 7675431B1 · Caouette · 2010 [cited by applicant]
US 8094040B1 · Cornett et al. · 2012 [cited by applicant]
US 8838321B1 · Ferguson · 2014 [cited by applicant]
US 9103903B2 · Funayama et al. · 2015 [cited by applicant]
US 9249742B2 · Sangameswaran et al. · 2016 [cited by applicant]
US 9278689B1 · Delp · 2016 [cited by applicant]
US 9305223B1 · Ogale et al. · 2016 [cited by applicant]
US 9397630B2 · Wang et al. · 2016 [cited by applicant]
US 9544692B2 · Hui et al. · 2017 [cited by applicant]
US 9704397B1 · Bjorklund et al. · 2017 [cited by applicant]
US 9751463B1 · Ramcharitar et al. · 2017 [cited by applicant]
US 9763003B2 · Usher et al. · 2017 [cited by applicant]
US 10051599B2 · Lowe et al. · 2018 [cited by applicant]
US 10109190B1 · Baptiste · 2018 [cited by applicant]
US 10284317B1 · Sanchez et al. · 2019 [cited by applicant]
US 10351148B2 · Hakeem et al. · 2019 [cited by applicant]
US 20010002467A1 · Ogo · 2001 [cited by applicant]
US 20010007969A1 · Mizushima · 2001 [cited by applicant]
US 20020008635A1 · Ewing et al. · 2002 [cited by applicant]
US 20030191640A1 · Gemello et al. · 2003 [cited by applicant]
US 20040071046A1 · Kervern et al. · 2004 [cited by applicant]
US 20040233067A1 · Cho · 2004 [cited by applicant]
US 20080133223A1 · Son et al. · 2008 [cited by applicant]
US 20080150755A1 · Van et al. · 2008 [cited by applicant]
US 20090179774A1 · Mohan et al. · 2009 [cited by applicant]
US 20090322559A1 · Yen et al. · 2009 [cited by applicant]
US 20100033313A1 · Keady et al. · 2010 [cited by applicant]
US 20100228482A1 · Yonak · 2010 [cited by applicant]
US 20100253597A1 · Seder et al. · 2010 [cited by applicant]
US 20100260355A1 · Muraoka et al. · 2010 [cited by applicant]
US 20110175755A1 · Yoshioka et al. · 2011 [cited by applicant]
US 20120136559A1 · Rothschild · 2012 [cited by applicant]
US 20120306664A1 · Geter · 2012 [cited by applicant]
US 20130049985A1 · Eisenson et al. · 2013 [cited by applicant]
US 20130154875A1 · Sierwald · 2013 [cited by applicant]
US 20130303910A1 · Hubbard et al. · 2013 [cited by applicant]
US 20140056438A1 · Baalu et al. · 2014 [cited by applicant]
US 20140098964A1 · Rosca et al. · 2014 [cited by applicant]
US 20140136096A1 · Funayama et al. · 2014 [cited by applicant]
US 20140140552A1 · Hui et al. · 2014 [cited by applicant]
US 20140241126A1 · Funayama et al. · 2014 [cited by applicant]
US 20150036832A1 · Usher et al. · 2015 [cited by applicant]
US 20150073662A1 · Schmüdderich et al. · 2015 [cited by applicant]
US 20150110344A1 · Okumura · 2015 [cited by examiner]
US 20150117669A1 · Kwon · 2015 [cited by applicant]
US 20150266422A1 · Chundrlik, Jr. · 2015 [cited by examiner]
US 20160070788A1 · Vrazic · 2016 [cited by applicant]
US 20160155452A1 · Sharifi et al. · 2016 [cited by applicant]
US 20160210858A1 · Foster et al. · 2016 [cited by applicant]
US 20160355125A1 · Herbert · 2016 [cited by examiner]
US 20170028850A1 · Miller et al. · 2017 [cited by applicant]
US 20170092256A1 · Ebenezer · 2017 [cited by applicant]
US 20170113684A1 · Banvait et al. · 2017 [cited by applicant]
US 20170174262A1 · Kobayashi et al. · 2017 [cited by applicant]
US 20170213459A1 · Ogaz · 2017 [cited by examiner]
US 20170249839A1 · Becker et al. · 2017 [cited by applicant]
US 20170305427A1 · Kim et al. · 2017 [cited by applicant]
US 20180033300A1 · Hansen · 2018 [cited by applicant]
US 20180043262A1 · Gohara · 2018 [cited by applicant]
US 20180072222A1 · Herbert · 2018 [cited by examiner]
US 20180132043A1 · Bakish · 2018 [cited by examiner]
US 20180132052A1 · Muench et al. · 2018 [cited by applicant]
US 20180156893A1 · Kotake et al. · 2018 [cited by applicant]
US 20180211528A1 · Seifert · 2018 [cited by examiner]
US 20180233047A1 · Mandeville-Clarke · 2018 [cited by applicant]
US 20180237033A1 · Hakeem et al. · 2018 [cited by applicant]
US 20180261237A1 · Moore et al. · 2018 [cited by applicant]
US 20180302738A1 · Di Censo et al. · 2018 [cited by applicant]
US 20180350391A1 · Moore et al. · 2018 [cited by applicant]
US 20180364732A1 · Yaldo et al. · 2018 [cited by applicant]
US 20190027032A1 · Arunachalam · 2019 [cited by applicant]
US 20190035268A1 · Madigan et al. · 2019 [cited by applicant]
US 20190049989A1 · Akotkar · 2019 [cited by examiner]
US 20190246225A1 · Wacquant et al. · 2019 [cited by applicant]
US 20190280664A1 · Kawauchi et al. · 2019 [cited by applicant]
US 20190294169A1 · Shabtai et al. · 2019 [cited by applicant]
US 20200031337A1 · Soltanian · 2020 [cited by examiner]
US 20200118418A1 · Benjamin · 2020 [cited by examiner]
US 20200211394A1 · King et al. · 2020 [cited by applicant]
US 20210046930A1 · Wang · 2021 [cited by applicant]
US 20210387653A1 · He et al. · 2021 [cited by applicant]
CN 101755294A · 2010 [cited by applicant]
CN 106537175A · 2017 [cited by applicant]
CN 106564496A · 2017 [cited by applicant]
DE 102010022165A1 · 2011 [cited by applicant]
EP 1990650A1 · 2008 [cited by applicant]
GB 2509343A · 2014 [cited by applicant]
JP H0644489A · 1994 [cited by applicant]
JP 2001155259A · 2001 [cited by applicant]
JP 2007050724A · 2007 [cited by applicant]
JP 2010067164A · 2010 [cited by applicant]
JP 2014206804A · 2014 [cited by applicant]
JP 2015022453A · 2015 [cited by applicant]
WO 2017151937A1 · 2017 [cited by applicant]
Final Notice of Reasons for Rejection for Japanese Patent Application No. 2019-565175, Jul. 29, 2021. [cited by applicant]
International Search Report and Written Opinion for PCT Application No. PCT/US2018/039496, dated Oct. 18, 2018. 14 pages. [cited by applicant]
Japanese Office Action for Application No. 2019-565175 dated Jan. 5, 2021. [cited by applicant]
Korean Notice of Allowance for Application No. 10-2019-7037451 dated Jan. 20, 2022. [cited by applicant]
Notice of Reasons for Rejection for Japanese Patent Application No. 2019-565175, Mar. 24, 2022. [cited by applicant]
The First Office Action for Chinese Patent Application No. 202210001406.6, Aug. 4, 2023, 16 Pages. [cited by applicant]
RESNA 26th International Annual Conference, Technology & Disability: Research, Design, Practice & Policy, 2003, 6 pages. [cited by applicant]
“Kalman_Filter”, <https://en.wikipedia.org/wiki/Kalman_filter>, Downloaded on Jun. 26, 2017, 29 pges. [cited by applicant]
“Precision and recall”, <https://en.wikipedia.org/wiki/Precision_and_recall>, Downloaded on Jun. 26, 2017, 8 pages. [cited by applicant]
“Precision Time Protocol”, <https://en.wikipedia.org/wiki/Precision_ Time_Protocol>, Downloaded on Jun. 26, 2017, 8 pages. [cited by applicant]
“Radar Tracker”, <https://en.wikipedia.org/wiki/Radar_tracker>, Downloaded on Jun. 26, 2017, 6 pages. [cited by applicant]
“Statistical Classification”, <https://en.wikipedia.org/wiki/Statistical_classification>, Downloaded on Jun. 26, 2017, 6 pages. [cited by applicant]
Bendler , et al., “Emergency Vehicle Detector”, ECE4007 Senior Design Project, Sep. 15, 2008, 16 pages. [cited by applicant]
Knapp , et al., “The Generalized Correlation Method for Estimation of Time Delay”, IEEE Transactions on Acoustic, Speech and Signal Processing, vol. ASSP-24, No. 4, Aug. 1976. [cited by applicant]
Severdaks , et al., “Vehicle Counting and Motion Direction Detection Using Microphone Array”, Elektronika IR Elektrotechnika, 2013, 4 pages. [cited by applicant]
Summons to Attend Oral Proceedings Pursuant to Rule 115(1) EPC for European Patent Application No. 18750275.2, Dec. 11, 2024, 10 Pages. [cited by applicant]