Echo reduction system
View Patent ↗A system for reducing an echo and/or a residual echo in a microphone output signal includes an echo compensation filter configured to receive audio input signals and generate an estimated echo signal. A speech activity detector is configured to detect speech of a local speaker, and a combining circuit is configured to generate an echo compensated signal by subtracting the estimated echo signal from the microphone output signal. A residual echo reduction circuit is configured to suppress the residual echo in the echo compensated signal based on the detected speech activity, and output an echo suppressed output signal. The echo reduction system may reduce local background noise and residual echoes in a microphone output signal so that local speech may be transmitted free from undesirable signals.
1. A method for reducing an echo and/or a residual echo in a microphone output signal, the method comprising:
generating an estimated echo signal based on received audio input signals;
subtracting the estimated echo signal from the microphone output signal to generate an echo compensated signal;
detecting speech activity of a local speaker based on the microphone output signal and the estimated echo signal; and
suppressing the residual echo in the echo compensated signal based on the detected speech activity to obtain an echo suppressed output signal;
wherein detecting the speech activity of the local speaker comprises:
smoothing sub-band microphone signals derived from the microphone output signal in frequency to generate respective smoothed sub-band microphone signals;
smoothing estimated sub-band echo signals derived from the estimated echo signal in frequency to generate respective smoothed estimated sub-band echo signals; and
determining for the respective sub-bands, a distance between the smoothed sub-band microphone signals and the smoothed estimated sub-band echo signals.
2. The method according to claim 1 , comprising: separating the microphone output signal into a plurality of sub-band microphone signals, and separating the audio input signal into a plurality of estimated sub-band echo signals.
3. The method according to claim 2 , where generating the echo compensated signal, detecting speech activity, and suppressing the residual echo are performed for the respective sub-band ranges.
4. The method according to claim 1 , where suppressing the residual echo is based on the determined distance between the smoothed sub-band microphone signals and the smoothed estimated sub-band echo signals for the respective sub-bands.
5. The method according to claim 1 , where smoothing the estimated sub-band echo signals is performed using a first order recursive filter.
6. The method according to claim 1 , further comprising:
estimating a power density spectrum of background noise present in the microphone output signal; where smoothing the sub-band microphone signals includes recursively filtering a power density spectrum of the respective sub-band microphone signals to generate a smoothed power density spectrum of the respective sub-band microphone signals; and
where smoothing the estimated sub-band echo signals includes recursively filtering a power density spectrum of the respective estimated sub-band echo signals to obtain a smoothed power density spectrum of the respective estimated sub-band echo signals.
7. The method according to claim 1 , further comprising:
estimating a power density of the echo compensated signal; and
estimating a power density of the residual echo, where suppressing the residual echo in the echo compensated signal is based on the estimated power density of the echo compensated signal and the estimated power density of the residual echo.
8. The method according to claim 1 , further comprising:
determining a power density of the echo-suppressed output signal;
determining a power density of background noise present in the microphone output signal;
comparing the power density of the echo-suppressed output signal with the power density of the background noise;
transmitting the echo-suppressed output signal to a remote party if the power density of the echo-suppressed output signal exceeds the power density of the background noise; and
transmitting artificial noise to the remote party if the power density of the echo suppressed output signal does not exceed the power density of the background noise.
9. A method for reducing an echo and/or a residual echo in a microphone output signal, the method comprising:
separating the microphone output signal into a plurality of sub-band microphone signals;
separating an audio input signal into a plurality of sub-band audio input signals;
for each sub-band:
estimating a power density spectrum of background noise present in the microphone output signal;
generating an estimated echo signal of the audio input signal based on the audio input signal;
subtracting the estimated echo signal from the microphone output signal to generate an echo compensated signal;
detecting speech activity of a local speaker based on the microphone output signal and the estimated echo signal; and
suppressing residual echo in the echo compensated signal based on the detected speech activity to obtain an echo suppressed output signal;
where detecting the speech activity of the local speaker comprises:
smoothing the sub-band microphone signals in frequency to generate respective smoothed sub-band microphone signals;
smoothing the estimated sub-band echo signals in frequency to generate respective smoothed estimated sub-band echo signals; and
determining for the respective sub-bands, a distance between the smoothed sub-band microphone signals and the smoothed estimated sub-band echo signals; and
where smoothing the sub-band microphone signals includes recursively filtering a power density spectrum of the respective sub-band microphone signals to generate a smoothed power density spectrum of the respective sub-band microphone signals; and where smoothing the estimated sub-band echo signals includes recursively filtering a power density spectrum of the respective estimated sub-band echo signals to obtain a smoothed power density spectrum of the respective estimated sub-band echo signals where determining the distance between the smoothed sub-band microphone signals and the smoothed estimated sub-band echo signals further comprises:
determining in each sub-band a maximum of the smoothed power density spectrum of the sub-band microphone signals and the estimated power density spectrum of the background noise enhanced by a first predetermined noise overestimate factor, to obtain a modified microphone power density spectrum;
determining in each sub-band the maximum of the smoothed power density spectrum of the estimated sub-band echo signals and the estimated power density spectrum of the background noise enhanced by a second predetermined noise overestimate factor, to obtain a modified echo power density spectrum;
comparing the modified microphone power density spectrum and the modified echo power density spectrum to obtain a spectrum distance measure; and
suppressing the residual echo in the respective echo compensated sub-band signals based on the spectrum distance measure.
10. A method for reducing an echo and/or a residual echo in a microphone output signal, the method comprising:
generating an estimated echo signal based on received audio input signals;
subtracting the estimated echo signal from the microphone output signal to generate an echo compensated signal;
estimating a power density of the echo compensated signal;
detecting speech activity of a local speaker based on the microphone output signal and the estimated echo signal; and
suppressing the residual echo in the echo compensated signal based on the detected speech activity to obtain an echo suppressed output signal estimating a power density of the residual echo, where suppressing the residual echo in the echo compensated signal is based on the estimated power density of the echo compensated signal and the estimated power density of the residual echo where suppressing the residual echo in the echo compensated signal further comprises filtering the echo compensated signal with a filter having a frequency response of:
G
(
ⅇ
jΩ
u
,
n
)
=
1
-
β
(
n
)
S
^
ɛɛ
(
Ω
μ
,
n
)
S
^
ee
(
Ω
μ
,
n
)
where a mid-frequency of the sub-band μ is denoted by Ω μ Ŝ εε (Ω μ ,n) and Ŝ ee (Ω μ ,n) are the estimated power density of the echo compensated signal and the estimated power density of the residual echo, respectively, n is the discrete time index, and β(n) is a filter parameter depending on the detected speech activity.
11. A method for reducing an echo and/or a residual echo in a microphone output signal, the method comprising:
generating an estimated echo signal based on received audio input signals;
subtracting the estimated echo signal from the microphone output signal to generate an echo compensated signal;
estimating a power density of the echo compensated signal;
detecting speech activity of a local speaker based on the microphone output signal and the estimated echo signal; and
suppressing the residual echo in the echo compensated signal based on the detected speech activity to obtain an echo suppressed output signal estimating a power density of the residual echo, where suppressing the residual echo in the echo compensated signal is based on the estimated power density of the echo compensated signal and the estimated power density of the residual echo;
wherein suppressing the residual echo in the echo compensated signal further comprises filtering the echo compensated signal with a filter having a frequency response of:
G
(
ⅇ
j
Ω
μ
,
n
)
=
{
1
-
β
(
n
)
S
^
ɛɛ
(
Ω
μ
,
n
)
S
^
ee
(
Ω
μ
,
n
)
,
if
C
_
(
n
)
>
C
thres
1
-
β
(
n
)
max
{
S
^
ɛɛ
(
Ω
μ
,
n
)
,
D
^
(
ⅇ
j
Ω
u
,
n
)
2
}
S
^
ee
(
Ω
μ
,
n
)
,
else
or
G
(
ⅇ
j
Ω
μ
,
n
)
=
{
1
-
β
(
n
)
S
^
ɛɛ
(
Ω
μ
,
n
)
S
^
ee
(
Ω
μ
,
n
)
,
if
C
_
(
n
)
>
C
thres
1
-
β
(
n
)
D
^
(
ⅇ
j
Ω
u
,
n
)
2
S
^
ee
(
Ω
μ
,
n
)
,
else
where C (n) is a measure of the detected speech activity; and
C thres is a predetermined threshold.
12. A non-transitory computer-readable storage medium having processor executable instructions to reduce an echo and/or a residual echo in a microphone output signal, by performing the acts of: generating an estimated echo signal; subtracting the estimated echo signal from the microphone output signal to generate an echo compensated signal; detecting speech activity of a local speaker based on the microphone output signal and the estimated echo signal; and suppressing the residual echo in the echo compensated signal based on the detected speech activity to obtain an echo suppressed output signal wherein detecting the speech activity of the local speakers comprises: smoothing sub-band microphone signals derived from the microphone output signal in frequency to generate respective smoothed sub-band microphone signals; smoothing the estimated sub-band echo signals derived from the estimated echo signal in frequency to generate respective smoothed estimated sub band echo signals; and determining for the respective sub-bands, a distance between the smoothed sub-band microphone signals and the smoothed estimated sub-band echo signals.
13. The non-transitory computer-readable storage medium of claim 12 , further comprising processor executable instructions to cause a processor to perform the acts of separating the microphone output signal into a plurality of sub-band microphone signals, and separating the estimated echo signal into a plurality of estimated sub-band echo signals.
14. The non-transitory computer-readable storage medium of claim 13 , further comprising processor executable instructions to cause a processor to perform the acts of generating the echo compensated signal, detecting speech activity and suppressing the residual echo, all in the respective sub-band ranges.
15. A system for reducing an echo and/or a residual echo in a microphone output signal, the microphone receiving audio input signals, the system comprising:
an echo compensation filter configured to receive the audio input signals and generate an estimated echo signal;
a speech activity detector configured to detect speech of a local speaker;
a combining circuit configured to generate an echo compensated signal by subtracting the estimated echo signal from the microphone output signal; and
a residual echo reduction circuit configured to suppress the residual echo in the echo compensated signal based on the detected speech activity, and output an echo suppressed output signal
wherein the speech activity detector further comprises:
a first smoothing circuit configured to smooth sub-band microphone signals derived from the microphone output signal in frequency to generate respective smoothed sub-band microphone signals;
a second smoothing circuit configured to smooth estimated sub-band echo signals derived from the estimated echo signal in frequency to generate respective smoothed estimated sub-band echo signals;
and
a distance detection circuit configured to determine for the respective sub-bands, a distance between the smoothed sub-band microphone signals and the smoothed estimated sub-band echo signals.
16. The system according to claim 15 , comprising:
a microphone output filter bank configured to separate the microphone output signal into a plurality of sub-band microphone signals; and
an audio input filter bank configured to separate the audio input signals into a plurality of sub-band audio signals to facilitate generation of a plurality of sub-band estimated echo signals.
17. The system according to claim 16 , where the estimated echo signal, the echo compensated signal, the detected speech of the local speaker and suppression of the residual echo are processed for the respective sub-band ranges.
18. The system according to claim 15 , where the residual echo is suppressed based on the determined distance between the smoothed sub-band microphone signals and the smoothed estimated sub-band echo signals for the respective sub-bands.
19. The system according to claim 15 , further comprising a first order recursive filter configured to smooth the estimated sub-band echo signals.
20. The system according to claim 15 , further comprising:
logic configured to estimate a power density of the echo compensated signal; and
logic configured to estimate a power density of the residual echo, where the residual echo in the echo compensated signal is suppressed based on the estimated power density of the echo compensated signal and the estimated power density of the residual echo.
21. The system according to claim 15 , further comprising:
logic configured to determine a power density of the echo-suppressed output signal;
logic configured to determine a power density of background noise present in the microphone output signal;
a noise generator configured to generate artificial noise;
comparing logic configured to compare the power density of the echo-suppressed output signal with the power density of the background noise; and where the echo-suppressed output signal is transmitted to a remote party if the power density of the echo-suppressed output signal exceeds the power density of the background noise, and artificial noise is transmitted to the remote party if the power density of the echo-suppressed output signal does not exceed the power density of the background noise.
22. A system for reducing an echo and/or a residual echo in a microphone output signal, the microphone receiving audio input signals, the system comprising:
an echo compensation filter configured to receive the audio input signals and generate an estimated echo signal;
a speech activity detector configured to detect speech of a local speaker;
a combining circuit configured to generate an echo compensated signal by subtracting the estimated echo signal from the microphone output signal;
a residual echo reduction circuit configured to suppress the residual echo in the echo compensated signal based on the detected speech activity, and output an echo suppressed output signal;
logic configured to estimate a power density of the echo compensated signal; and
logic configured to estimate a power density of the residual echo, where the residual echo in the echo compensated signal is suppressed based on the estimated power density of the echo compensated signal and the estimated power density of the residual echo where the residual echo reduction circuit includes a filter configured to suppress the residual echo in the echo compensated signal by filtering the echo compensated signal, the filter having a frequency response of:
G
(
ⅇ
jΩ
u
,
n
)
=
1
-
β
(
n
)
S
^
ɛɛ
(
Ω
μ
,
n
)
S
^
ee
(
Ω
μ
,
n
)
where a mid-frequency of the sub-band μ is denoted by Ω μ Ŝ εε (Ω μ ,n) and Ŝ ee (Ω μ ,n) are the estimated power density of the echo compensated signal and the estimated power density of the residual echo, respectively, n is the discrete time index, and β(n) is a filter parameter depending on the detected speech activity.