Microphone array processing system
View Patent ↗An audio system is provided that employs time-frequency analysis and/or synthesis techniques for processing audio obtained from a microphone array. These time-frequency analysis/synthesis techniques can be more robust, provide better spatial resolution, and have less computational complexity than existing adaptive filter implementations. The time-frequency techniques can be implemented for dual microphone arrays or for microphone arrays having more than two microphones. Many different time-frequency techniques may be used in the audio system. As one example, the Gabor transform may be used to analyze time and frequency components of audio signals obtained from the microphone array.
1. A method of reducing noise using a plurality of microphones, the method comprising:
receiving a first audio signal from a first microphone in a microphone array;
receiving a second audio signal from a second microphone in the microphone array, one or both of the first and second audio signals comprising voice audio;
applying a Gabor transform to the first audio signal to produce first Gabor coefficients with respect to a set of frequency bins;
applying the Gabor transform to the second audio signal to produce second Gabor coefficients with respect to the set of frequency bins;
computing, for each of the frequency bins, a difference in phase, magnitude, or both phase and magnitude between the first and second Gabor coefficients;
determining, for each of the frequency bins, whether the difference meets a threshold;
for each of the frequency bins in which the difference meets the threshold, assigning a first weight, and for each of the frequency bins in which the difference does not meet the threshold, assigning a second weight;
forming an audio beam by at least (1) combining the first and second Gabor coefficients to produce combined Gabor coefficients and (2) applying the first and second weights to the combined Gabor coefficients to produce overall Gabor coefficients; and
applying an inverse Gabor transform to the overall Gabor coefficients to obtain an output audio signal;
wherein said combining the first and second Gabor coefficients and said applying the first and second weights to the combined Gabor coefficients cause the output audio signal to have less noise than the first and second audio signals; and
wherein the method is implemented by a hardware processor.
2. The method of claim 1 , wherein said computing the difference comprises computing the difference in phase when the first and second microphones are configured in a broadside array.
3. The method of claim 2 , wherein the broadside array is installed in a laptop or tablet computing device.
4. The method of claim 1 , wherein said computing the difference comprises computing the difference in magnitude when the first and second microphones are configured in an end-fire array.
5. The method of claim 4 , wherein the end-fire array is installed in a mobile phone.
6. The method of claim 1 , wherein said forming the audio beam comprises adaptively combining the first and second Gabor coefficients based at least partly on the assigned first and second weights.
7. The method of claim 1 , further comprising smoothing the first and second weights with respect to both time and frequency prior to applying the first and second weights to the combined Gabor coefficients.
8. A system for reducing noise using a plurality of microphones, the system comprising:
a transform component configured to apply a time-frequency transform to a first microphone signal to produce a first transformed audio signal in a time-frequency domain and to apply the time-frequency transform to a second microphone signal to produce a second transformed audio signal in the time-frequency domain;
an analysis component configured to compare differences in one or both of phase and magnitude between the first and second transformed audio signals in the time-frequency domain and to calculate noise filter parameters based at least in part on the differences;
a signal combiner configured to combine the first and second transformed audio signals to produce a combined transformed audio signal;
a time-frequency noise filter implemented in one or more processors, the time-frequency noise filter configured to filter the combined transformed audio signal based at least partly on the noise filter parameters to produce an overall transformed audio signal; and
an inverse transform component configured to apply an inverse transform to the overall transformed audio signal from the time-frequency domain to a time domain to obtain an output audio signal.
9. The system of claim 8 , wherein the analysis component is configured to calculate the noise filter parameters to enable the noise filter to attenuate portions of the combined transformed audio signal based on the differences in phase, wherein the noise filter applies more attenuation for relatively larger differences in the phase and less attenuation for relatively smaller differences in the phase.
10. The system of claim 8 , wherein the analysis component is configured to calculate the noise filter parameters to enable the noise filter to attenuate portions of the combined transformed audio signal based on the differences in magnitude, wherein the noise filter applies less attenuation for relatively larger differences in the magnitude and more attenuation for relatively smaller differences in the magnitude.
11. The system of claim 8 , wherein the analysis component is further configured to compare the differences in phase between the first and second transformed audio signals by computing an argument of a combination of the first and second transformed audio signals.
12. The system of claim 8 , wherein the analysis component is further configured to compare the differences in magnitude between the first and second transformed audio signals by computing a ratio of the first and second transformed audio signals.
13. The system of claim 8 , wherein the signal combiner is further configured to combine the first and second transformed audio signals adaptively based at least partly on the differences identified by the analysis component.
14. The system of claim 8 , wherein said time-frequency transform comprises one or more of the following: a Gabor transform, a short-time Fourier transform, a wavelet transform, and a chirplet transform.
15. Non-transitory physical computer storage configured to store instructions that, when implemented by one or more processors, cause the one or more processors to implement operations for reducing noise using a plurality of microphones, the operations comprising:
receiving a first audio signal from a first microphone positioned at an electronic device;
receiving a second audio signal from a second microphone positioned at the electronic device;
transforming the first audio signal into a first transformed audio signal in a time-frequency domain;
transforming the second audio signal into a second transformed audio signal in the time-frequency domain;
comparing a difference between the first and second transformed audio signals in the time-frequency domain;
constructing a noise filter based at least in part on the difference; and
applying the noise filter to a combination of the first and second transformed audio signals to produce noise-filtered audio signal; and
transforming the noise-filtered audio signal from the time-frequency domain to a time domain to produce an output noise-filtered audio signal.
16. The non-transitory physical computer storage of claim 15 , wherein the operations further comprise smoothing parameters of the noise filter prior to applying the noise filter.