IP Library Granted Patent US 10,049,157
Granted Patent B2
US 10,049,157 · App. 14/844,754 · Granted Aug 14, 2018

Siren signal source detection, recognition and localization

Inventor: Sacha Vrazic (Munich, DE)
Assignee: AISIN SEIKI KABUSHIKI KAISHA
G06F17/30743G06F17/30752H04R3/005
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,049,157
App. No.
14/844,754
Granted
Aug 14, 2018
Kind
B2
Abstract

A system comprises a microphone unit to be mounted in a first vehicle, which receives an audio signal from outside the first vehicle, processes the audio signal and outputs a microphone signal, a storage unit which stores a database containing, for each siren signal pattern of a plurality of siren signal patterns sounded by second vehicles, components of sparse models respectively corresponding to the plurality of siren signal patterns, and an identifying unit which matches the microphone signal with the components of the sparse models, and detects, based on a result of the matching, at least one of the second vehicles sounding a siren signal pattern of the plurality of siren signal patterns. According to an embodiment, the system further comprises a localizing unit which localizes the at least one second vehicle based on differences between timings of at least three microphone signals output from the microphone unit.

Claims (52)

1. A system comprising:

a microphone unit to be mounted in a first vehicle, configured to receive an audio signal from outside the first vehicle, process the audio signal and output a microphone signal;

a storage unit storing a database containing, for each siren signal pattern of a plurality of siren signal patterns sounded by second vehicles, components of sparse models respectively corresponding to the plurality of siren signal patterns; and

an identification unit configured to match the microphone signal with the components of the sparse models, and to detect, based on a result of the matching, at least one of the second vehicles sounding a siren signal pattern of the plurality of siren signal patterns.

2. The system of claim 1 , wherein the identification unit is configured to match the microphone signal with the components of the sparse models at time-varying instants of the microphone signal, identify the siren signal pattern sounded by the at least one second vehicle based on a result of the matching, and recognize the at least one second vehicle based on the identified siren signal pattern.

3. The system of claim 1 , wherein

the database contains at least two warped versions of the sparse models, and

the identification unit is configured to match the microphone signal with the components of each version of the sparse models at time-varying instants of the microphone signal, and, based on the matching result,

identify the siren signal pattern sounded by the at least one second vehicle and recognize the at least one second vehicle based on the identified siren signal pattern, and/or

detect an instant of time at which the identified siren signal pattern begins, and/or

detect speed of the at least one second vehicle and/or whether the at least one second vehicle is approaching or receding the first vehicle.

4. The system of claim 1 , wherein the identification unit is configured to subtract a remodeled siren signal that is remodeled from sparse models corresponding to the identified siren signal pattern from the microphone signal and continue the matching of the microphone signal, from which the remodeled siren signal has been removed, with the components of the sparse models.

5. The system of claim 1 , further comprising:

a localization unit,

wherein the microphone unit comprises at least three microphones each outputting a microphone signal,

the identification unit is configured to perform the matching for each of the at least three microphone signals and output a remodeled siren signal from sparse models corresponding to the identified signal pattern at a timing corresponding to the timing of each of the at least three microphone signals to the localization unit, and

the localization unit is configured to localize the at least one second vehicle based on differences between timings of the at least three microphone signals.

6. The system of claim 1 , wherein

the microphone unit comprises a first microphone, a second microphone and a third microphone, which are arranged in a plane and respectively output a first microphone signal, a second microphone signal and a third microphone signal,

the identification unit is configured to perform the matching of the microphone signal for each of the first microphone signal, the second microphone signal and the third microphone signal, identify the siren signal pattern sounded by the at least one second vehicle based on results of the matching and output a remodeled siren signal from sparse models corresponding to the identified siren signal pattern at a first timing corresponding to a timing of the first microphone signal, output a remodeled siren signal from sparse models at a second timing corresponding to a timing of the second microphone signal and output a remodeled siren signal from sparse models at a third timing corresponding to a timing of the third microphone signal, and

the system further comprises a localization unit configured to localize the at least one second vehicle based on differences between the first, second and third timings.

7. The system of claim 5 , wherein the localization unit is configured to track changes of location of the at least one second vehicle based on the remodeled siren signal continuously output by the identification unit for each of the at least three microphone signals.

8. The system of claim 1 , wherein the identification unit is configured to match the microphone signal over a predetermined time window with the components of the sparse model generated with respect to the predetermined time window.

9. A method for a system comprising a microphone unit to be mounted in a first vehicle, which receives an audio signal from outside the first vehicle, processes the audio signal and outputs a microphone signal, and a storage unit which stores a database containing, for each siren signal pattern of a plurality of siren signal patterns sounded by second vehicles, components of sparse models respectively corresponding to the plurality of siren signal patterns, the method comprising:

matching the microphone signal with the components of the sparse models; and

detecting, based on a result of the matching, at least one of the second vehicles sounding a siren signal pattern of the plurality of siren signal patterns.

10. The method of claim 9 , wherein the matching comprises:

matching the microphone signal with the components of the sparse models at continuous instants of time of the microphone signal;

identifying the siren signal pattern sounded by the at least one second vehicle based on a result of the matching; and

recognizing the at least one second vehicle based on the identified siren signal pattern.

11. The method of claim 9 , wherein the database contains at least two warped versions of the sparse models, and the method comprises:

matching the microphone signal with the components of each version of the sparse models at continuous instants of time of the microphone signal, and, based on the matching result,

identifying the siren signal pattern sounded by the at least one second vehicle and recognizing the at least one second vehicle based on the identified siren signal pattern, and/or

detecting an instant of time at which the identified siren signal pattern begins, and/or

detecting speed of the at least one second vehicle and/or whether the at least one second vehicle is approaching or receding the first vehicle.

12. The method of claim 9 , comprising:

subtracting a remodeled siren signal that is remodeled from sparse models corresponding to the identified siren signal pattern from the microphone signal and continuing the matching of the microphone signal, from which the remodeled siren signal has been removed, with the components of the sparse models.

13. The method of claim 9 , wherein the microphone unit comprises at least three microphones each outputting a microphone signal, and the method comprises:

performing the matching for each of the at least three microphone signals and outputting a remodeled siren signal from sparse models corresponding to the identified signal pattern at a timing corresponding to the timing of each of the at least three microphone signals; and

localizing the at least one second vehicle based on differences between timings of the at least three microphone signals.

14. The method of claim 9 , wherein the microphone unit comprises a first microphone, a second microphone and a third microphone, which are arranged in a plane and respectively output a first microphone signal, a second microphone signal and a third microphone signal, and the method comprises:

performing the matching of the microphone signal for each of the first microphone signal, the second microphone signal and the third microphone signal;

identifying the siren signal pattern sounded by the at least one second vehicle based on results of the matching;

outputting a remodeled siren signal from sparse models corresponding to the identified siren signal pattern at a first timing corresponding to a timing of the first microphone signal, outputting a remodeled siren signal from sparse models at a second timing corresponding to a timing of the second microphone signal and outputting a remodeled siren signal from sparse models at a third timing corresponding to a timing of the third microphone signal; and

localizing the at least one second vehicle based on differences between the first, second and third timings.

15. The method of claim 13 , further comprising:

tracking changes of location of the at least one second vehicle based on the remodeled siren signal continuously output for each of the at least three microphone signals.

16. The method of claim 9 , the matching comprising:

matching the microphone signal over a predetermined time window with the components of the sparse model generated with respect to the predetermined time window.

17. A computer program product including a program for a processing device, comprising software code portions for performing the steps of claim 9 when the program is run on the processing device.

18. The computer program product according to claim 17 , wherein the computer program product comprises a computer-readable medium on which the software code portions are stored.

19. The computer program product according to claim 17 , wherein the program is directly loadable into an internal memory of the processing device.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 21, 2016
From: VRAZIC, SACHA
To: AISIN SEIKI KABUSHIKI KAISHA
Reel/Frame 038975/0236 →
Priority Claims (1)
DE 10 2014 217 681 · Sep 4, 2014 · national
Continuity (1)
Related Publication 20160070788A1 · Mar 10, 2016
Cited By (1)
US 12,682,748