IP Library › Granted Patent US 11,303,994
Granted Patent B2
US 11,303,994 · App. 16/926,618 · Granted Apr 12, 2022

Reduction of sensitivity to non-acoustic stimuli in a microphone array

Inventor: Brandon Hook (Grand Blanc, MI)
Assignee: Peiker Acustic GmbH
H04R1/326G10L21/0264G10L25/03G10L25/51H04R3/005H04R3/02H04R29/006G10L2021/02166H04R2410/07
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,303,994
App. No.
16/926,618
Granted
Apr 12, 2022
Kind
B2
Abstract

Techniques are described for reducing sensitivity to non-acoustic stimuli. In some embodiments, differential beamforming is applied to microphone signals generated based on responses of microphones to an acoustic stimulus and a non-acoustic stimulus. Compensated signals can be generated based on the microphone signals such that the compensated signals are in phase with respect to the acoustic stimulus. The non-acoustic stimulus is detectable by comparing a first signal to a second signal to determine that one signal has a greater instantaneous magnitude. The first signal can be a beamformed signal or signal derived therefrom, and the second signal can be an average of the compensated signals or signal derived therefrom. An output audio signal can be generated by switching or cross fading between the beamformed signal and a noise-reduced signal such that a contribution of the noise-reduced signal is increased and a contribution of the beamformed signal is decreased.

Claims (74)

1. A method comprising:

receiving a first microphone signal generated based on a response of a first microphone in a microphone array to an acoustic stimulus and a non-acoustic stimulus;

receiving a second microphone signal generated based on a response of a second microphone in the microphone array to the acoustic stimulus and the non-acoustic stimulus;

generating a beamformed signal by combining the first microphone signal and the second microphone signal using differential beamforming;

generating a first compensated signal based on the first microphone signal;

generating a second compensated signal based on the second microphone signal, wherein the first compensated signal and the second compensated signal are in phase with respect to the acoustic stimulus;

generating an average signal corresponding to an average of the first compensated signal and the second compensated signal;

detecting the presence of the non-acoustic stimulus in the first and the second compensated signals, wherein the detecting comprises:

comparing a first signal to a second signal, wherein the first signal is the beamformed signal or a signal derived from the beamformed signal, and wherein the second signal is the average signal or a signal derived from the average signal; and

determining, based on a result of the comparing, that an instantaneous magnitude of the first signal is greater than that of the second signal; and

responsive to the determining that the instantaneous magnitude of the first signal is greater than that of the second signal, generating an output audio signal by switching or cross fading between the beamformed signal and a noise-reduced signal such that a contribution of the noise-reduced signal to the output audio signal is increased and a contribution of the beamformed signal to the output audio signal is decreased.

2. The method of claim 1 , further comprising:

generating the first signal as a root mean square of the beamformed signal.

3. The method of claim 1 , further comprising:

generating the second signal as a root mean square of the average signal.

4. The method of claim 1 , further comprising:

repeatedly determining, at regular intervals, which of the first compensated signal and the second compensated signal has a lower instantaneous magnitude; and

generating the noise-reduced signal by crossfading between the first compensated signal and the second compensated signal such that whichever of the first compensated signal and the second compensated signal has a lower instantaneous magnitude at any particular interval is favored.

5. The method of claim 4 , wherein determining which of the first compensated signal and the second compensated signal has a lower instantaneous magnitude comprises:

generating a first magnitude value by rectifying the first compensated signal;

generating a second magnitude value by rectifying the second compensated signal; and

comparing the first magnitude value to the second magnitude value to identify which of the first compensated signal and the second compensated signal has a lower instantaneous magnitude.

6. The method of claim 4 , further comprising:

determining that the first compensated signal has the least instantaneous magnitude among a set of compensated signals corresponding to each of the microphones in the microphone array.

7. The method of claim 4 , wherein generating the noise-reduced signal comprises:

switching or cross fading between the first compensated signal and the second compensated signal such that a contribution of the first compensated signal to an input of a low-pass filter is increased based on the first compensated signal having a lower instantaneous magnitude than the second compensated signal;

inputting the average signal to a high-pass filter; and

summing an output of the low-pass filter with an output of the high-pass filter to generate the noise-reduced signal.

8. The method of claim 4 , wherein generating the noise-reduced signal comprises:

switching to the first compensated signal such that the second compensated signal does not contribute to the noise-reduced signal.

9. The method of claim 1 , wherein the first compensated signal and the second compensated signal have equal magnitude and phase relationship to the acoustic stimulus.

10. The method of claim 1 , wherein the beamformed signal corresponds to an overall response of the microphone array that is more directional at lower frequencies and less directional at higher frequencies, and wherein the noise-reduced signal corresponds to an overall response that is omnidirectional at the lower frequencies and less directional at the higher frequencies.

11. A system comprising:

a microphone array including a first microphone and a second microphone;

a beamformer configured to:

receive a first microphone signal generated based on a response of the first microphone to an acoustic stimulus and a non-acoustic stimulus;

receive a second microphone signal generated based on a response of the second microphone to the acoustic stimulus and the non-acoustic stimulus; and

generate a beamformed signal by combining the first microphone signal and the second microphone signal using differential beamforming;

an output signal generator; and

a noise detection subsystem configured to:

generate a first compensated signal based on the first microphone signal;

generate a second compensated signal based on the second microphone signal, wherein the first compensated signal and the second compensated signal are in phase with respect to the acoustic stimulus;

generate an average signal corresponding to an average of the first compensated signal and the second compensated signal;

detect the presence of the non-acoustic stimulus in the first and the second compensated signals, wherein to detect the presence of the non-acoustic stimulus, the noise detection subsystem is configured to:

compare a first signal to a second signal, wherein the first signal is the beamformed signal or a signal derived from the beamformed signal, and wherein the second signal is the average signal or a signal derived from the average signal; and

determine, based on a result of the comparison, that an instantaneous magnitude of the first signal is greater than that of the second signal; and

responsive to determining that the instantaneous magnitude of the first signal is greater than that of the second signal, instruct the output signal generator to generate an output audio signal by switching or cross fading between the beamformed signal and a noise-reduced signal such that a contribution of the noise-reduced signal to the output audio signal is increased and a contribution of the beamformed signal to the output audio signal is decreased.

12. The system of claim 11 , wherein the noise detection subsystem is configured to generate the first signal as a root mean square of the beamformed signal.

13. The system of claim 11 , wherein the noise detection subsystem is configured to generate the second signal as a root mean square of the average signal.

14. The system of claim 11 , wherein the noise detection subsystem is configured to:

repeatedly determine, at regular intervals, which of the first compensated signal and the second compensated signal has a lower instantaneous magnitude; and

generate the noise-reduced signal by crossfading between the first compensated signal and the second compensated signal such that whichever of the first compensated signal and the second compensated signal has a lower instantaneous magnitude at any particular interval is favored.

15. The system of claim 14 , wherein to determine which of the first compensated signal and the second compensated signal has a lower instantaneous magnitude, the noise detection subsystem is configured to:

generate a first magnitude value by rectifying the first compensated signal;

generate a second magnitude value by rectifying the second compensated signal; and

compare the first magnitude value to the second magnitude value to identify which of the first compensated signal and the second compensated signal has a lower instantaneous magnitude.

16. The system of claim 14 , wherein the noise detection subsystem is configured to determine that the first compensated signal has the least instantaneous magnitude among a set of compensated signals corresponding to each of the microphones in the microphone array.

17. The system of claim 14 , wherein to generate the noise-reduced signal, the noise reduction subsystem is configured to:

switch or cross fade between the first compensated signal and the second compensated signal such that a contribution of the first compensated signal to an input of a low-pass filter is increased based on the first compensated signal having a lower instantaneous magnitude than the second compensated signal;

input the average signal to a high-pass filter; and

sum an output of the low-pass filter with an output of the high-pass filter to generate the noise-reduced signal.

18. The system of claim 14 , wherein the noise reduction subsystem is configured to switch to the first compensated signal such that the second compensated signal does not contribute to the noise-reduced signal.

19. The system of claim 11 , wherein the beamformed signal corresponds to an overall response of the microphone array that is more directional at lower frequencies and less directional at higher frequencies, and wherein the noise-reduced signal corresponds to an overall response that is omnidirectional at the lower frequencies and less directional at the higher frequencies.

20. A non-transitory computer-readable storage medium containing instructions that, when executed by one or more processors of a computer, cause the one or more processors to:

receive a first microphone signal generated based on a response of a first microphone in a microphone array to an acoustic stimulus and a non-acoustic stimulus;

receive a second microphone signal generated based on a response of a second microphone in the microphone array to the acoustic stimulus and the non-acoustic stimulus;

generate a beamformed signal by combining the first microphone signal and the second microphone signal using differential beamforming;

generate a first compensated signal based on the first microphone signal;

generate a second compensated signal based on the second microphone signal, wherein the first compensated signal and the second compensated signal are in phase with respect to the acoustic stimulus;

generate an average signal corresponding to an average of the first compensated signal and the second compensated signal;

detect the presence of the non-acoustic stimulus in the first and the second compensated signals by:

comparing a first signal to a second signal, wherein the first signal is the beamformed signal or a signal derived from the beamformed signal, and wherein the second signal is the average signal or a signal derived from the average signal; and

determining, based on a result of the comparing, that an instantaneous magnitude of the first signal is greater than that of the second signal; and

responsive to determining that the instantaneous magnitude of the first signal is greater than that of the second signal, generate an output audio signal by switching or cross fading between the beamformed signal and a noise-reduced signal such that a contribution of the noise-reduced signal to the output audio signal is increased and a contribution of the beamformed signal to the output audio signal is decreased.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 13, 2021
From: VALEO NORTH AMERICA, INC.
To: PEIKER ACUSTIC GMBH
Reel/Frame 055908/0215 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 10, 2020
From: HOOK, BRANDON
To: VALEO NORTH AMERICA, INC.
Reel/Frame 053186/0364 →
Continuity (2)
Provisional Application 62873962 · Jul 14, 2019
Related Publication 20210014605A1 · Jan 14, 2021
Cited By (3)
US 12,200,448 US 12,507,022 US 12,659,656