Adaptive noise cancellation
View Patent ↗Systems and methods for controlling adaptivity of noise cancellation are presented. One or more audio signals are received by one or more corresponding microphones. The one or more signals may be decomposed into frequency sub-bands. Noise cancellation consistent with identified adaptation constraints is performed on the one or more audio signals. The one or more audio signals may then be reconstructed from the frequency sub-bands and outputted via an output device.
1. A method for controlling adaptivity of noise cancellation, the method comprising:
receiving an audio signal from a first microphone and another audio signal from a second microphone:
determining a pitch salience of the audio signal, the audio signal and the another audio signal both comprising a speech component and a noise component; and
determining a coefficient that represents a cross-correlation between the audio signal and the another audio signal of one of the speech component and the noise component that exists in both the audio signal and the another audio signal;
generating a modified audio signal for the audio signal based on the another audio signal and the coefficient; and
adapting the coefficient when the pitch salience satisfies a threshold.
2. The method of claim 1 , further comprising adapting the coefficient for each frequency sub-band of the audio signal.
3. The method of claim 1 , wherein adapting the coefficient includes:
determining a pitch salience of the audio signal or the another audio signal, wherein the audio signal is received from a first microphone and the another audio signal is received from a second microphone; and
adapting the coefficient based on the pitch salience.
4. The method of claim 1 , further comprising converting the audio signal from the time-domain to the frequency-domain.
5. The method of claim 1 , further comprising:
adapting the coefficient to suppress the speech component of the audio signal to form a residual audio signal; and
suppressing the noise component of the audio signal based on the residual audio signal to generate a modified primary audio signal.
6. The method of claim 1 , wherein determining the coefficient includes determining a reference value of the coefficient by a calibration procedure using the first and second microphones.
7. The method of claim 1 , wherein the coefficient is used to substantially remove the speech component from the audio signal to obtain the modified audio signal, the modified audio signal being further combined with the another audio signal to obtain a modified another audio signal, the modified another audio signal being used to remove the noise component from the audio signal.
8. A method for controlling adaptivity of noise cancellation, the method comprising:
receiving a primary audio signal at a first microphone and a secondary audio signal at a second microphone, the primary audio signal and the secondary audio signal both comprising a speech component;
determining an energy estimate from the primary audio signal or the secondary audio signal, the primary audio signal and the secondary audio signal both comprising a speech component, the primary audio signal and the secondary audio signal each representing at least one respective captured sound; and
determining a coefficient that represents a cross-correlation between the primary audio signal and the secondary audio signal of the speech component that exists in both the primary audio signal and the secondary audio signal
generating a modified primary audio signal for the primary audio signal based on the secondary audio signal and the coefficient; and
adapting the coefficient based on the energy estimate.
9. The method of claim 8 , wherein adapting the coefficient is determined by an energy threshold applied to the primary or secondary energy estimate, the method further comprising:
adapting the coefficient to suppress the speech component of the primary audio signal to form a residual audio signal, the coefficient being adapted based on the primary energy estimate or the secondary energy estimate; and
suppressing the noise component of the primary audio signal based on the residual audio signal to generate the modified primary audio signal.
10. The method of claim 9 , wherein the energy threshold is determined by a training or calibration procedure.
11. The method of claim 9 , wherein the energy threshold is determined by a stationary noise energy estimate of the primary or secondary audio signals.
12. The method of claim 8 , wherein adapting the coefficient comprises determining an amplitude difference and a phase difference between the primary audio signal and the secondary audio signal.
13. The method of claim 12 , wherein the coefficient is adapted when the amplitude difference is within a first predefined range and the phase difference is within a second predefined range.
14. The method of claim 12 , wherein determining the amplitude difference and the phase difference is performed on individual frequency sub-bands of the audio signal.
15. The method of claim 8 , wherein determining the coefficient includes determining a reference value of the coefficient by a calibration procedure using the first and second microphones.
16. A non-transitory computer-readable storage medium having a program embodied thereon, the program executable by a processor to perform a method for controlling adaptivity of noise cancellation, the method comprising:
receiving a primary audio signal from a first microphone and a secondary audio signal from a second microphone, the primary audio signal and the secondary audio signal both comprising a speech component;
determining a coefficient that represents a cross-correlation between the primary audio signal and the secondary audio signal of the speech component that exists in both the primary audio signal and the secondary audio signal
generating a modified primary audio signal for the primary audio signal based on the secondary audio signal and the coefficient; and
halting wherein adaptation of the coefficient is halted based on an echo component within the primary audio signal,
wherein the coefficient is faded to zero when a noise energy estimate is less than a threshold,
and wherein the threshold is determined by an estimate of microphone self-noise in the primary or secondary audio signal.
17. The non-transitory computer-readable storage medium of claim 16 , wherein the echo component is determined based on an estimate of far-end activity in the primary audio signal.
18. The non-transitory computer-readable storage medium of claim 16 , wherein adaptation of the coefficient is halted when the estimate of far-end activity exceeds a threshold.
19. The non-transitory computer-readable storage medium of claim 16 , wherein the echo component is determined based on a comparison of an amplitude of the speech component of the primary audio signal and an amplitude of the speech component of the secondary audio signal.
20. The non-transitory computer-readable storage medium of claim 16 , further comprising:
adapting the coefficient based on the echo component within the primary audio signal to suppress the speech component of the primary audio signal to form a residual audio signal;
suppressing the noise component of the primary audio signal based on the residual audio signal to generate a modified primary audio signal; and
halting adaptation of the coefficient applied to the primary audio signal when the amplitude of the primary audio signal speech component is less than the amplitude of the secondary audio signal speech component.