Granted Patent B2

US 12,260,873 · App. 17/850,936 · Granted Mar 25, 2025

Inventor: Li Kang (Chongqing, CN)

Assignee: UNISOC (CHONGQING) TECHNOLOGIES CO., LTD.

G10L21/0232G10L2021/02165G10L2021/02166

Abstract

Claims (90)

1. A method of noise reduction, wherein the method is applied to an electronic device, the electronic device comprises a first sound collector and a second sound collector, and installation positions of the first sound collector and the second sound collector are different, the method comprises:

acquiring a first sound signal collected by the first sound collector and a second sound signal collected by the second sound collector;

determining a desired sound signal and an interference sound signal based on the first sound signal and the second sound signal;

obtain a third sound signal by performing coherent noise elimination processing on the desired sound signal based on the interference sound signal; and

obtain a target sound signal by performing incoherent noise suppression processing on the third sound signal based on a probability of existence of a speech in the third sound signal;

wherein obtaining the third sound signal by performing the coherent noise elimination processing on the desired sound signal based on the interference sound signal comprises:

obtaining the third sound signal by calculating a difference between the desired sound signal and a product of the interfering sound signal and an adaptive filter coefficient;

wherein the (n+1)-th adaptive filter coefficient is obtained based on the n-th adaptive filter coefficient, an update step size, a variable update step size, a preset parameter and a conjugate correlation between the interference sound signal and the third sound signal, and the variable update step size changes with a change of a power ratio of the desired sound signal and the interference sound signal.

2. The method according to claim 1 , wherein determining the desired sound signal and the interference sound signal based on the first sound signal and the second sound signal comprises:

determining a first frequency domain signal of the first sound signal in a frequency domain, and a second frequency domain signal of the second sound signal in the frequency domain; and

obtain the desired sound signal and the interference sound signal by performing spatial filtering on the first frequency domain signal and the second frequency domain signal.

3. The method according to claim 2 , wherein obtaining the desired sound signal and the interference sound signal by performing spatial filtering on the first frequency domain signal and the second frequency domain signal comprises:

determining a delay duration between a collection moment of the first sound signal and a collection moment of the second sound signal; and

obtaining the desired sound signal by performing spatial filtering on the first frequency domain signal and the second frequency domain signal by using a fixed beamforming filter, and obtaining the interference sound signal by performing spatial filtering on the first frequency domain signal and the second frequency domain signal by using a blocking matrix filter based on the delay duration.

4. The method according to claim 3 , wherein obtaining the desired sound signal by performing spatial filtering on the first frequency domain signal and the second frequency domain signal by using the fixed beamforming filter, and obtaining the interference sound signal by performing spatial filtering on the first frequency domain signal and the second frequency domain signal by using the blocking matrix filter based on the delay duration, comprises:

calculating the desired sound signal based on a difference between the first frequency domain signal and a product of the second frequency domain signal and an exponential function related to the delay duration;

calculating the interfering sound signal based on a difference between the second frequency domain signal and a product of the first frequency domain signal and the exponential function related to the delay duration;

or,

calculating the desired sound signal based on a difference between the second frequency domain signal and a product of the first frequency domain signal and an exponential function related to the delay duration;

calculating the interfering sound signal based on a difference between the first frequency domain signal and a product of the second frequency domain signal and the exponential function related to the delay duration.

5. The method according to claim 1 , wherein determining the desired sound signal and the interference sound signal based on the first sound signal and the second sound signal comprises:

determining a first frequency domain signal of the first sound signal in a frequency domain and a second frequency domain signal of the second sound signal in the frequency domain; and

determining the first frequency domain signal as the desired sound signal, and determining the second frequency domain signal as the interference sound signal; or, determining the second frequency domain signal as the desired sound signal, and determining the first frequency domain signal as the interference sound signal.

6. The method according to claim 1 , wherein obtaining the target sound signal by performing the incoherent noise suppression processing on the third sound signal based on the probability of existence of the speech in the third sound signal comprises:

determining a smoothed power spectrum corresponding to the third sound signal;

determining a probability of absence of a priori speech corresponding to the third sound signal based on the smoothed power spectrum;

determining a probability of existence of a posteriori speech corresponding to the third sound signal based on the probability of absence of the priori speech;

determining an incoherent noise signal existing in the third sound signal by using the probability of existence of the posteriori speech, and determining an effective gain function corresponding to the third sound signal based on the incoherent noise signal; and

performing the incoherent noise suppression processing on the third sound signal by using the effective gain function.

7. An apparatus of noise reduction, wherein the apparatus is applied to an electronic device, the electronic device comprises a first sound collector and a second sound collector, installation positions of the first sound collector and the first sound collector are different; the apparatus comprises:

at least one processor; and

a memory communicatively connected with the at least one processor;

the at least one processor executes computer-executable instructions stored in the memory to cause the at least one processor to:

acquire a first sound signal collected by the first sound collector and a second sound signal collected by the second sound collector;

determine a desired sound signal and an interference sound signal based on the first sound signal and the second sound signal;

obtain a third sound signal by performing coherent noise elimination processing on the desired sound signal based on the interfering sound signal; and

obtain a target sound signal by performing incoherent noise suppression processing on the third sound signal based on a probability of existence of a speech in the third sound signal;

wherein the at least one processor is configured to:

obtain the third sound signal by calculating a difference between the desired sound signal and a product of the interfering sound signal and an adaptive filter coefficient;

wherein the (n+1)-th adaptive filter coefficient is obtained based on the n-th adaptive filter coefficient, an update step size, a variable update step size, a preset parameter and a conjugate correlation between the interference sound signal and the third sound signal, and the variable update step size changes with a change of a power ratio of the desired sound signal and the interference sound signal.

8. The apparatus according to claim 7 , wherein the at least one processor is further configured to:

determine a first frequency domain signal of the first sound signal in a frequency domain, and a second frequency domain signal of the second sound signal in the frequency domain; and

obtain the desired sound signal and the interference sound signal by performing spatial filtering on the first frequency domain signal and the second frequency domain signal.

9. The apparatus according to claim 8 , wherein the at least one processor is further configured to:

determine a delay duration between a collection moment of the first sound signal and a collection moment of the second sound signal; and

obtain the desired sound signal by performing spatial filtering on the first frequency domain signal and the second frequency domain signal by using a fixed beamforming filter, and obtain the interference sound signal by performing spatial filtering on the first frequency domain signal and the second frequency domain signal by using a blocking matrix filter based on the delay duration.

10. The apparatus according to claim 9 , wherein the at least one processor is further configured to:

calculate the desired sound signal based on a difference between the first frequency domain signal and a product of the second frequency domain signal and an exponential function related to the delay duration;

calculate the interfering sound signal based on a difference between the second frequency domain signal and a product of the first frequency domain signal and the exponential function related to the delay duration;

or,

calculate the desired sound signal based on a difference between the second frequency domain signal and a product of the first frequency domain signal and an exponential function related to the delay duration;

calculate the interfering sound signal based on a difference between the first frequency domain signal and a product of the second frequency domain signal and the exponential function related to the delay duration.

11. The apparatus according to claim 7 , wherein the at least one processor is further configured to:

determine a first frequency domain signal of the first sound signal in a frequency domain and a second frequency domain signal of the second sound signal in the frequency domain; and

determine the first frequency domain signal as the desired sound signal, and determine the second frequency domain signal as the interference sound signal; or, determine the second frequency domain signal as the desired sound signal, and determine the first frequency domain signal as the interference sound signal.

12. The apparatus according to claim 7 , wherein the at least one processor is further configured to:

determine a smoothed power spectrum corresponding to the third sound signal;

determine a probability of absence of a priori speech corresponding to the third sound signal based on the smoothed power spectrum;

determine a probability of existence of a posteriori speech corresponding to the third sound signal based on the probability of absence of the priori speech;

determine an incoherent noise signal existing in the third sound signal by using the probability of existence of the posteriori speech, and determine an effective gain function corresponding to the third sound signal based on the incoherent noise signal; and

perform the incoherent noise suppression processing on the third sound signal by using the effective gain function.

13. A non-transitory computer-readable storage medium, wherein computer-executed instructions are stored in the computer-readable storage medium, and when a processor executes the computer-executed instructions, the processor is enabled to:

acquire a first sound signal collected by a first sound collector and a second sound signal collected by a second sound collector;

determine a desired sound signal and an interference sound signal based on the first sound signal and the second sound signal;

obtain a third sound signal by performing coherent noise elimination processing on the desired sound signal based on the interference sound signal; and

obtain a target sound signal by performing incoherent noise suppression processing on the third sound signal based on a probability of existence of a speech in the third sound signal;

wherein when the processor executes the computer-executed instructions, the processor is enabled to:

obtain the third sound signal by calculating a difference between the desired sound signal and a product of the interfering sound signal and an adaptive filter coefficient;

wherein the (n+1)-th adaptive filter coefficient is obtained based on the n-th adaptive filter coefficient, an update step size, a variable update step size, a preset parameter and a conjugate correlation between the interference sound signal and the third sound signal, and the variable update step size changes with a change of a power ratio of the desired sound signal and the interference sound signal.

14. The non-transitory computer-readable storage medium according to claim 13 , wherein when the processor executes the computer-executed instructions, the processor is further enabled to:

determine a first frequency domain signal of the first sound signal in a frequency domain, and a second frequency domain signal of the second sound signal in the frequency domain; and

obtain the desired sound signal and the interference sound signal by performing spatial filtering on the first frequency domain signal and the second frequency domain signal.

15. The non-transitory computer-readable storage medium according to claim 14 , wherein when the processor executes the computer-executed instructions, the processor is further enabled to:

determine a delay duration between a collection moment of the first sound signal and a collection moment of the second sound signal; and

obtain the desired sound signal by performing spatial filtering on the first frequency domain signal and the second frequency domain signal by using a fixed beamforming filter, and obtain the interference sound signal by performing spatial filtering on the first frequency domain signal and the second frequency domain signal by using a blocking matrix filter based on the delay duration.

16. The non-transitory computer-readable storage medium according to claim 15 , wherein when the processor executes the computer-executed instructions, the processor is further enabled to:

calculate the desired sound signal based on a difference between the first frequency domain signal and a product of the second frequency domain signal and an exponential function related to the delay duration;

calculate the interfering sound signal based on a difference between the second frequency domain signal and a product of the first frequency domain signal and the exponential function related to the delay duration;

or,

calculate the desired sound signal based on a difference between the second frequency domain signal and a product of the first frequency domain signal and an exponential function related to the delay duration;

calculate the interfering sound signal based on a difference between the first frequency domain signal and a product of the second frequency domain signal and the exponential function related to the delay duration.

17. The non-transitory computer-readable storage medium according to claim 13 , wherein when the processor executes the computer-executed instructions, the processor is further enabled to:

determine a first frequency domain signal of the first sound signal in a frequency domain and a second frequency domain signal of the second sound signal in the frequency domain; and

determine the first frequency domain signal as the desired sound signal, and determine the second frequency domain signal as the interference sound signal; or, determine the second frequency domain signal as the desired sound signal, and determine the first frequency domain signal as the interference sound signal.

18. The non-transitory computer-readable storage medium according to claim 13 , wherein when the processor executes the computer-executed instructions, the processor is further enabled to:

determine a smoothed power spectrum corresponding to the third sound signal;

determine a probability of absence of a priori speech corresponding to the third sound signal based on the smoothed power spectrum;

determine a probability of existence of a posteriori speech corresponding to the third sound signal based on the probability of absence of the priori speech;

determine an incoherent noise signal existing in the third sound signal by using the probability of existence of the posteriori speech, and determine an effective gain function corresponding to the third sound signal based on the incoherent noise signal; and

perform the incoherent noise suppression processing on the third sound signal by using the effective gain function.

Assignments (1)

Priority Claims (1)

Continuity (2)

References Cited (22)