System and method for spatial noise suppression based on phase information
Disclosed herein are systems, methods, and non-transitory computer-readable storage media for suppressing spatial noise based on phase information. The method transforms audio signals to frequency-domain data and identifies time-frequency points that have a parameter (e.g., signal-to-noise ratio) above a threshold. Based on these points, unwanted signals can be attenuated the desired audio source can be isolated. The method can work on a microphone array that includes two microphones or more.
1. A method comprising:
receiving a first audio signal via a first microphone, and a second audio signal via a second microphone;
performing a short-time Fourier transform of the first audio signal and the second audio signal to yield frequency-domain data;
identifying, in the frequency-domain data and based on a first phase of the first audio signal and a second phase of the second audio signal, time-frequency points having a parameter above a threshold; and
generating an audio signal based on the time-frequency points.
2. The method of claim 1 , wherein generating the audio signal further comprises applying an inverse short-time Fourier transform.
3. The method of claim 1 , wherein generating the audio signal further comprises attenuating time-frequency points having a parameter below the threshold.
4. The method of claim 1 , wherein the first audio signal and the second audio signal each represent part of an audio space at a same time.
5. The method of claim 4 , wherein the audio space is one of a two-dimensional audio space or a three-dimensional audio space.
6. The method of claim 4 , wherein the audio space comprises a plurality of audio sources, and wherein one of the plurality of audio sources is a desired audio source.
7. The method of claim 1 , further comprising receiving a third audio signal, wherein the short-time Fourier transform incorporates the third audio signal.
8. The method of claim 1 , further comprising:
forming a delay-and-sum beamformer with the first microphone and the second microphone; and
aiming the delay-and-sum beamformer at a desired audio source.
9. The method of claim 8 , wherein forming the delay-and-sum beamformer further comprises time-aligning the first microphone and the second microphone such that, when the first audio signal and the second audio signal are added, the desired audio source is added coherently and other audio sources are added incoherently.
10. The method of claim 1 , wherein identifying the time-frequency points further comprises smoothing the frequency-domain data.
11. The method of claim 10 , wherein smoothing the frequency-domain data further comprises applying a time-frequency averaging filter.
12. The method of claim 10 , wherein smoothing the frequency-domain data further comprises applying a sliding frequency window and identifying a minimum value in the sliding frequency window.
13. The method of claim 1 , wherein the first audio signal and the second audio signal are from an audio space comprising a plurality of separate audio sources, and wherein performing the short-time Fourier transform occurs in parallel for each of the plurality of separate audio sources.
14. The method of claim 1 , wherein the parameter is a signal-to-noise ratio.
15. A system comprising:
a processor;
a first microphone;
a second microphone; and
a computer-readable storage medium storing instructions which, when executed by the processor, cause the processor to perform operations comprising:
receiving a first audio signal via the first microphone, and a second audio signal via the second microphone, wherein the first audio signal and the second audio signal originate from an audio space comprising a plurality of regions;
performing a short-time Fourier transform of the first audio signal and the second audio signal for each of the plurality of regions to yield scanned frequency-domain data;
identifying, in the scanned frequency-domain data and based on a first phase of the first audio signal and a second phase of the second audio signal, a time-frequency point having a highest signal-to-noise ratio; and
marking a region in the audio space corresponding to the time-frequency point having the highest signal-to-noise ratio as a desired audio source.
16. The system of claim 15 , wherein the computer-readable storage medium stores additional instructions which, when executed by the processor, cause the processor to perform further operations comprising:
generating a reconstructed audio signal of the desired audio source from the first audio signal and the second audio signal based on the time-frequency point.
17. The system of claim 15 , wherein the time-frequency point has the highest signal-to-noise ratio for a desired audio signal type.
18. A computer-readable storage device storing instructions which, when executed by a processor, cause the processor to perform operations comprising:
forming a delay-and-sum beamformer using a first microphone and a second microphone;
aiming the delay-and-sum beamformer at an audio source to receive a first audio signal via the first microphone, and a second audio signal via the second microphone, wherein the first audio signal and the second audio signal are from the audio source, to yield a short-time Fourier transform of the first audio signal and the second audio signal;
generating frequency-domain data based on the short-time Fourier transform;
identifying, in the frequency-domain data and based on a first phase of the first audio signal and a second phase of the second audio signal, time-frequency points having a signal-to-noise ratio above a threshold for the audio source; and
isolating a desired audio signal of the audio source by retaining the time-frequency points and attenuating all other time-frequency points in the frequency-domain data.
19. The computer-readable storage device of claim 18 , wherein aiming the delay-and-sum beamformer further comprises steering the delay-and-sum beamformer to a location adjacent to the audio source, whereby a wider-range spatial suppression is achieved.
20. The computer-readable storage device of claim 18 , wherein forming the delay-and-sum beamformer further comprises time-aligning the first microphone and the second microphone such that, when the first audio signal and the second audio signal are added, the audio source is added coherently and other audio sources are added incoherently.