Echo filtering method, electronic device, and computer-readable storage medium
An echo filtering method, an electronic device, a computer-readable storage medium, and an echo filtering apparatus are disclosed. The electronic device includes M microphones and N speakers. M and N are integers greater than 1. The method includes: obtaining N speaker signals corresponding to the N speakers; obtaining M microphone signals corresponding to the M microphones; and performing at least direct sound filtering on the N speaker signals and the M microphone signals to obtain a target signal. By using this method, better echo filtering effect can be obtained.
1 . An echo filtering method, wherein the method is applied to an electronic device, the electronic device comprises M microphones and N speakers, both M and N are integers greater than 1, and the method comprises:
obtaining N speaker signals corresponding to the N speakers;
obtaining M microphone signals corresponding to the M microphones; and
performing at least direct sound filtering on the N speaker signals and the M microphone signals to obtain a target signal, wherein the direct sound filtering comprises filtering an audio component directly output from the N speakers to the M microphones without environmental reflection,
wherein the method further comprises:
enabling a display of the electronic device to display a customized direct sound filtering interface;
receiving user input of a user in the customized direct sound filtering interface;
in response to the user input, obtaining N speaker test signals and enabling the N speakers to play the N speaker test signals;
obtaining M microphone test signals corresponding to the M microphones; and
storing a customized direct sound filtering model, wherein the customized direct sound filtering model is obtained based on the N speaker test signals and the M microphone test signals, wherein the customized direct sound filtering model is used for the direct sound filtering.
2 . The method according to claim 1 , wherein the target signal is provided to a wakeup engine to wake up an intelligent voice assistant or is transmitted to another electronic device for a voice call.
3 . The method according to claim 1 , wherein the target signal comprises fewer echo components than the M microphone signals, and the echo components are used to represent echo of sound propagated in space that is of the N speaker signals and that is captured by the M microphones.
4 . The method according to claim 1 , wherein the customized direct sound filtering interface displays an indicator for indicating to keep an environment quiet.
5 . The method according to claim 1 , wherein the direct sound filtering further comprises default direct sound filtering, the default direct sound filtering comprises filtering based at least on a model relationship between N speaker signals played by the N speakers and M microphone signals directly captured by the M microphones in a fully muted environment.
6 . The method according to claim 1 , further comprising:
generating reverse speaker signals based on the N speaker signals; and
enabling a reverse speaker close to the M microphones to play reverse audio based on the reverse speaker signals to cancel echo of audio output played by the N speakers corresponding to the N speaker signals, wherein the reverse speaker is different from the N speakers.
7 . The method according to claim 1 , further comprising:
generating an echo estimation signal based on the N speaker signals;
filtering the echo estimation signal from M microphone signals to generate a residual signal; and
obtaining the target signal,
wherein the obtaining the target signal comprises performing the direct sound filtering on the residual signal to obtain the target signal.
8 . The method according to claim 7 , wherein the generating an echo estimation signal comprises:
performing non-interleaved preprocessing on the N speaker signals to generate at least one preprocessed signal; and
performing adaptive filtering on the at least one preprocessed signal to generate the echo estimation signal.
9 . An echo filtering method, wherein the method is applied to an electronic device, the electronic device comprises M microphones, N speakers, and at least one reverse speaker, both M and N are integers greater than 1, and the method comprises:
obtaining N speaker signals corresponding to the N speakers;
generating reverse speaker signals based on the N speaker signals; and
enabling at least one reverse speaker close to at least one of the M microphones to play reverse audio based on the reverse speaker signals to cancel echo of audio output played by the N speakers corresponding to the N speaker signals, wherein the at least one reverse speaker is different from the N speakers.
10 . The method according to claim 9 , further comprising:
obtaining M microphone signals corresponding to the M microphones; and
performing at least direct sound filtering on the N speaker signals and the M microphone signals to obtain a target signal, wherein the direct sound filtering comprises filtering an audio component directly output from the N speakers to the M microphones without environmental reflection.
11 . The method according to claim 10 , wherein the target signal is provided to a wakeup engine to wake up an intelligent voice assistant or is transmitted to another electronic device for a voice call.
12 . The method according to claim 10 , wherein the target signal comprises fewer echo components than the M microphone signals, and the echo components are used to represent echo of audio output propagated in space that is of the N speaker signals and that is captured by the M microphones.
13 . The method according to claim 10 , further comprising:
enabling a display of the electronic device to display a customized direct sound filtering interface;
receiving user input of a user in the customized direct sound filtering interface;
in response to the user input, obtaining N speaker test signals and enabling the N speakers to play the N speaker test signals;
obtaining M microphone test signals corresponding to the M microphones; and
storing a customized direct sound filtering model, wherein the customized direct sound filtering model is obtained based on the N speaker test signals and the M microphone test signals, wherein the customized direct sound filtering model is used for the direct sound filtering.
14 . The method according to claim 13 , wherein the customized direct sound filtering interface displays an indicator for indicating to keep an environment quiet.
15 . The method according to claim 10 , wherein the direct sound filtering comprises default direct sound filtering, the default direct sound filtering indicates filtering based at least on a model relationship between N speaker signals played by the N speakers and M microphone signals directly captured by the M microphones in a fully muted environment.
16 . The method according to claim 10 , further comprising:
generating an echo estimation signal based on the N speaker signals;
filtering the echo estimation signal from M microphone signals to generate a residual signal; and
obtaining the target signal, wherein the obtaining the target signal comprises: performing the direct sound filtering on the residual signal to obtain the target signal.
17 . The method according to claim 16 , wherein the generating an echo estimation signal comprises:
performing non-interleaved preprocessing on the N speaker signals to generate at least one preprocessed signal; and
performing adaptive filtering on the at least one preprocessed signal to generate the echo estimation signal.
18 . An electronic device, comprising:
N speakers, wherein Nis an integer greater than 1;
M microphones, wherein M is an integer greater than 1;
one or more processors, configured to obtain N speaker signals corresponding to the N speakers and M microphone signals corresponding to the M microphones; and
a memory, storing one or more programs, wherein the one or more programs are configured to be executed by the one or more processors, and the one or more programs comprise instructions used to perform operations comprising:
obtaining N speaker signals corresponding to the N speakers;
obtaining M microphone signals corresponding to the M microphones; and
performing at least direct sound filtering on the N speaker signals and the M microphone signals to obtain a target signal, wherein the direct sound filtering comprises filtering an audio component directly output from the N speakers to the M microphones without environmental reflections,
wherein the method further comprises:
enabling a display of the electronic device to display a customized direct sound filtering interface;
receiving user input of a user in the customized direct sound filtering interface;
in response to the user input, obtaining N speaker test signals and enabling the N speakers to play the N speaker test signals;
obtaining M microphone test signals corresponding to the M microphones; and
storing a customized direct sound filtering model, wherein the customized direct sound filtering model is obtained based on the N speaker test signals and the M microphone test signals, wherein the customized direct sound filtering model is used for the direct sound filtering.
19 . An electronic device, comprising:
N speakers, wherein Nis an integer greater than 1;
M microphones, wherein M is an integer greater than 1;
at least one reverse speaker;
one or more processors, configured to obtain N speaker signals corresponding to the N speakers and M microphone signals corresponding to the M microphones, and enable the at least one reverse speaker to play reverse audio; and
a memory, storing one or more programs, wherein the one or more programs are configured to be executed by the one or more processors, and the one or more programs comprise instructions used to perform the method comprising:
obtaining N speaker signals corresponding to the N speakers;
generating reverse speaker signals based on the N speaker signals; and
enabling at least one reverse speaker close to at least one of the M microphones to play reverse audio based on the reverse speaker signals to cancel echo of audio output played by the N speakers corresponding to the N speaker signals, wherein the at least one reverse speaker is different from the N speakers.