IP Library Granted Patent US 8,275,611
Granted Patent B2
US 8,275,611 · App. 12/009,601 · Granted Sep 25, 2012

Adaptive noise suppression for digital speech signals

View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 8,275,611
App. No.
12/009,601
Granted
Sep 25, 2012
Kind
B2
Abstract

An apparatus for adaptively suppressing noise in an input signal frequency spectrum derived from overlapping input frames is provided. The system includes a psychoacoustic power computation module configured to compute a noisy signal power in psychoacoustic bands, a voice activity scoring module configured to compute a probabilistic score for a presence of a speech, and a noise estimation module configured to estimate a noise power in the psychoacoustic bands based on information of past frames, the probabilistic score, and the computed noisy signal power. The system also includes a gain computation module configured to compute a gain for each frequency, based on a probabilistic heuristic, the probabilistic score and the information on the past frames, and a gain post-processing module configured to perform a gain time smoothing, a gain frequency smoothing, and a gain regulation for the computed gain.

Claims (57)

1. An apparatus for adaptively suppressing noise in an input signal frequency spectrum derived from overlapping input frames, the system comprising:

a psychoacoustic power computation module configured to compute a noisy signal power in psychoacoustic bands;

a voice activity scoring module configured to compute a probabilistic score for a presence of a speech;

a noise estimation module configured to estimate a noise power in the psychoacoustic bands based on information of past frames, the probabilistic score, and the computed noisy signal power;

a gain computation module configured to compute a gain for each frequency, based on a probabilistic heuristic, the probabilistic score and the information on the past frames; and

a gain post-processing module configured to perform a gain time smoothing, a gain frequency smoothing, and a gain regulation for the computed gain.

2. The apparatus of claim 1 , further comprising

a windowing module configured to segment input speech signals into the overlapping input frames, wherein an overlapping ratio of 50 percent is used;

a frequency analysis module configured to convert the input frames into the input signal frequency spectrum;

a data store configured to store the information on the past frames;

a mode switching module configured to switch into one of a plurality of operation modes based on a noise level, wherein the operation modes include a normal mode and a noisy mode;

a noisy spectrum adjustment module configured to adjust the input signal frequency spectrum by attenuating a noise in the input signal frequency spectrum based on the post-processed gain from the gain post-processing module;

a frequency synthesis module configured to convert the adjusted input signal frequency spectrum to a time domain; and

an overlap-and-add module configured to create a final output signal based on the adjusted input signal frequency spectrum.

3. The apparatus of claim 2 , wherein first two or three formants of the input signal frequency spectrum are considered speech bands.

4. The apparatus of claim 1 , wherein the input speech signals are mono speech signals sampled at a frequency equal or less than 16 KHz.

5. The apparatus of claim 1 , wherein the noisy signal power of the psychoacoustic bands is based on a summation of squared frequency magnitudes of each of the psychoacoustic bands.

6. The apparatus of claim 1 , wherein the probabilistic score is based on a weighted sum of a first score and a second score, wherein the first score is based on a relative power of a speech band of a current frame and a power of an estimated noise in a previous frame, and the second score is based on a total power of the current frame and a total power of the estimated noise in the previous frame.

7. The apparatus of claim 1 , further comprising a signal classification module configured to classify each of the input frames into one of a noise-only frame, a non-noise frame, a noise-like frame, a speech-like frame, and a speech-dominant frame, according to the probabilistic score.

8. The apparatus of claim 1 , wherein the noisy spectrum adjustment module is further configured to suppress the noise by adjusting the input signal frequency spectrum via multiplying the post-processed gain with respective frequency components.

9. A method for adaptively suppressing a noise in an input signal frequency spectrum derived from overlapping input frames, the method comprising:

computing a noisy signal power in psychoacoustic bands;

computing a probabilistic score for a presence of a speech;

estimating a noise power in the psychoacoustic bands based on information of past frames, the probabilistic score, and the computed noisy signal power;

computing a gain for each frequency, based on a probabilistic heuristic, the probabilistic score and the information on the past frames; and

post-processing the computed gain by performing a gain time smoothing, a gain frequency smoothing, and a gain regulation on the computed gain.

10. The method of claim 9 , further comprising

segmenting input speech signals into the overlapping input frames;

converting the overlapping input frames into the input signal frequency spectrum;

storing the information on the past frames into a datastore;

classifying each of the input frames into one of a noise-only frame, a non-noise frame, a noise-like frame, a speech-like frame, and a speech-dominant frame, according to the probabilistic score;

deciding on one of a plurality of operation modes based on a noise level, wherein the operation modes include a normal mode and a noisy mode;

adjusting the input signal frequency spectrum by attenuating a noise in the input signal frequency spectrum based on the post-processed gain;

converting the adjusted input signal frequency spectrum to a time domain; and

creating a final output signal based on the adjusted input signal frequency spectrum.

11. The method of claim 10 , wherein for the speech-like frame, the noise power of a psychoacoustic band is based on an average of M smallest noisy signal powers in the that psychoacoustic band of previous N frames with M<N.

12. The method of claim 9 , wherein for the noise-like frame, the noise power of a psychoacoustic band is based on the signal power of the psychoacoustic band.

13. The method of claim 9 , wherein computing the gain further comprises computing the gain for each frequency based on a threshold, assigning the gain for every frequency a one if a signal power of the frequency is above the threshold, and assigning the gain for each frequency a same value assigned to other frequencies of the same psychoacoustic band if the current frame is a noise-only frame.

14. The method of claim 13 , wherein the threshold is based on a frequency-dependent constant, a variable scaling factor, and the estimated noise power of the frequency, wherein the variable scaling factor is proportional to a ratio of a total power of the current frame to a total power of estimated noise of a previous frame.

15. The method of claim 9 , wherein the estimated noise power of the frequency is based on an averaged estimated noise of powers of all frequencies of the psychoacoustic band.

16. The method of claim 13 , wherein the gain time smoothing comprises smoothing the computed gain with a second computed gain of a previous frame.

17. The method of claim 13 , wherein the gain frequency smoothing comprises applying a linear-phase filter to the computed gain.

18. The method of claim 13 , wherein the gain regulation comprises keeping the computed gain for a non-speech band smaller than a maximum gain in the speech band and keeping the computed gain above a minimum threshold.

19. A computer program stored on a machine readable storage medium such that when executed by a processor is operable to:

convert overlapping input frames into an input signal frequency spectrum;

compute a noisy signal power in psychoacoustic bands;

compute a probabilistic score for a presence of a speech;

estimate a noise power in the psychoacoustic bands based on information of past frames, the probabilistic score, and the computed noisy signal power;

compute a gain for each frequency, based on a probabilistic heuristic, the probabilistic score and the information on the past frames; and

post-process the computed gain by performing a gain time smoothing, a gain frequency smoothing, and a gain regulation on the computed gain.

20. The computer program of claim 19 , wherein the computer program when executed by a processor is further operable to:

segment input speech signals into overlapping input frames;

store the information on the past frames into a datastore;

decide on one of a plurality of operation modes based on a noise level, wherein the operation modes include a normal mode and a noisy mode;

adjust the input signal frequency spectrum by attenuating a noise in the input signal frequency spectrum based on the post-processed gain;

convert the adjusted input signal frequency spectrum to a time domain; and

create a final output signal based on the adjusted input signal frequency spectrum.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 18, 2024
From: STMICROELECTRONICS ASIA PACIFIC PTE LTD
To: STMICROELECTRONICS INTERNATIONAL N.V.
Reel/Frame 068434/0215 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 14, 2008
From: ZONG, WENBO; WU, YUAN; GEORGE, SAPNA
To: STMICROELECTRONICS ASIA PACIFIC PTE., LTD.
Reel/Frame 020814/0053 →