IP Library Granted Patent US 8,364,479
Granted Patent B2
US 8,364,479 · App. 12/202,147 · Granted Jan 29, 2013

System for speech signal enhancement in a noisy environment through corrective adjustment of spectral noise power density estimations

View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 8,364,479
App. No.
12/202,147
Granted
Jan 29, 2013
Kind
B2
Abstract

A system estimates the spectral noise power density of an audio signal includes a spectral noise power density estimation unit, a correction term processor, and a combination processor. The spectral noise power density estimation unit may provide a first estimate of the spectral noise power density of the audio signal. The correction term processor may provide a time dependent correction term based, at least in part, on a spectral noise power density estimation error of the actual spectral noise power density. The correction term may be determined so that the spectral noise power density estimation error is reduced. The combination processor may combine the first estimate with the correction term to obtain a second estimate of the spectral noise power density that may be used for subsequent signal processing to enhance a desired signal component of the audio signal.

Claims (74)

1. A method for providing an estimate of a spectral noise power density of an audio signal, comprising:

providing a first estimate of the spectral noise power density of the audio signal {tilde over (S)} bb ;

determining a time dependent correction term based, at least in part, on a spectral noise power density estimation error of the spectral noise power density E n ;

summing the first estimate {tilde over (S)} bb and the correction term to obtain a second estimate of the spectral noise power density of the audio signal Ŝ bb ;

where the correction term is determined so that the spectral noise power density estimation error E n is reduced, and where E n is determined by at least one of E n =S bb −{tilde over (S)} bb and E n =S bb −Ŝ bb ,where S bb corresponds to the spectral noise power density of the audio signal,

where the audio signal comprises a wanted signal component and a noise component, and

where the correction term is based on:

an expectation value of the squared difference of the spectral noise power density and the first estimate of the spectral noise power density of the audio signal Ŝ bb , and

an expectation value of the squared spectral power density of the wanted signal component.

2. The method of claim 1 , where the correction term comprises a product of a correction factor K and a spectral power density estimation error E p .

3. The method of claim 1 , where the correction term is based, at least in part, on values comprising:

a variance of a relative spectral noise power density estimation error σ E nrel 2 ;

the first estimate of the spectral noise power density of the audio signal {tilde over (S)} bb ; and

the spectral signal power density of the audio signal S yy .

4. The method of claim 3 , where the audio signal comprises a wanted signal component and a noise component, and where the relative spectral noise power density estimation error is determined when the wanted signal component is not present in the audio signal.

5. The method of claim 1 , where the first estimate of the spectral noise power density {tilde over (S)} bb is a mean noise power density.

6. The method of claim 1 , where the first estimate of the spectral noise power density {tilde over (S)} bb is determined based, at least in part, on a minimum statistics method or a minimum tracking method.

7. The method of claim 1 , further comprising:

providing the second estimate Ŝ bb for use by a filter; and

filtering the audio signal based on the second estimate of the spectral noise power density Ŝ bb .

8. The method of claim 7 , where the filtering is performed using a Wiener filter having a filter characteristic based on the second estimate of the spectral noise power density of the audio signal Ŝ bb .

9. The method of claim 7 , where the filtering is performed using a minimal subtraction filter having a filter characteristic based on the second estimate of the spectral noise power density of the audio signal Ŝ bb .

10. A non-transitory computer readable medium including computer executable code for executing a method providing an estimate of a spectral noise power density of an audio signal, the method comprising:

providing a first estimate of the spectral noise power density of the audio signal {tilde over (S)} bb ;

determining a time dependent correction term based, at least in part, on a spectral noise power density estimation error of the spectral noise power density E n ;

summing the first estimate {tilde over (S)} bb and the correction term to obtain a second estimate of the spectral noise power density of the audio signal Ŝ bb ;

where the correction term is determined so that the spectral noise power density estimation error E n is reduced, and where E n is determined by at least one of E n =S bb −{tilde over (S)} bb and E bb−Ŝ bb , where S bb corresponds to the spectral noise power density of the audio signal,

where the audio signal comprises a wanted signal component and a noise component, and

where the correction term is based on:

an expectation value of the squared difference of the spectral noise power density and the first estimate of the spectral noise power density of the audio signal Ŝ bb , and

an expectation value of the squared spectral power density of the wanted signal component.

11. The computer readable medium of claim 10 , where the correction term comprises a product of a correction factor K and a spectral power density estimation errorE p .

12. The computer readable medium of claim 10 , where the correction term is based, at least in part, on values comprising:

a variance of a relative spectral noise power density estimation error σ E nrel 2 ;

the first estimate of the spectral noise power density of the audio signal{tilde over (S)} bb; and

and a spectral signal power density of the audio signal S yy .

13. The computer readable medium of claim 12 , where the audio signal comprises a wanted signal component and a noise component, and where the relative spectral noise power density estimation error is determined when the wanted signal component is not present in the audio signal.

14. The computer readable medium of claim 10 , where the first estimate of the spectral noise power density {tilde over (S)} bb is a mean noise power density.

15. The computer readable medium of claim 10 , where the first estimate of the spectral noise power density {tilde over (S)} bb is determined based, at least in part, on a minimum statistics method or a minimum tracking method.

16. The computer readable medium of claim 10 , where the method further comprises:

providing the second estimate {tilde over (S)} bb for use by a filter; and

filtering the audio signal based on the second estimate of the spectral noise power density Ŝ bb .

17. The computer readable medium of claim 16 , where the filtering is performed using a Wiener filter having a filter characteristic based on the second estimate of the spectral noise power density of the audio signal Ŝ bb .

18. The computer readable medium of claim 16 , where the filtering is performed using a minimal subtraction filter having a filter characteristic based on the second estimate of the spectral noise power density of the audio signal Ŝ bb .

19. An apparatus for providing an estimate of a spectral noise power density of an audio signal comprising:

a spectral noise power density estimation unit adapted to provide a first estimate of the spectral noise power density of the audio signal {tilde over (S)} bb ;

a correction term processor adapted to provide a time dependent correction term based, at least in part, on a spectral noise power density estimation error of the spectral noise power density E n ;

a combination processor for summing the first estimate {tilde over (S)} bb and the correction term to obtain a second estimate of the spectral noise power density of the audio signal Ŝ bb ;

where the correction term processor is adapted to determine the correction term so that the spectral noise power density estimation error E n is reduced, and where E n is determined by at least one of E n =S bb {tilde over (S)} bb and E n =S bb −Ŝ bb , where S bb corresponds to the spectral noise power density of the audio signal,

where the audio signal comprises a wanted signal component and a noise component, and

where the correction term is based on:

an expectation value of the squared difference of the spectral noise power density and the first estimate of the spectral noise power density of the audio signal Ŝ bb , and

an expectation value of the squared spectral power density of the wanted signal component.

20. The apparatus of claim 19 , further comprising a short-term frequency analysis unit adapted to provide an estimate of the current spectral power density of the audio signal.

21. A non-transitory computer readable medium including computer executable code for executing a method providing an estimate of a spectral noise power density of an audio signal having a wanted signal component and a noise component, the method comprising:

providing a first estimate of the spectral noise power density of the audio signal {tilde over (S)} bb ;

determining a time dependent correction term that is a product of a correction factor K and a spectral power density estimation error E p , wherein

K =( E{E n 2 })/(( E{E n 2 })+ E{S xx 2 }),

where E{ } corresponds to an operation of determining expection,

where E n corresponds to a spectral noise power density estimation error of the spectral noise power density E n=S bb −{tilde over (S)} bb ,

where S bb corresponds to spectral noise power density, and

where S xx corresponds to a spectral power density of the wanted signal component; and

combining the first estimate {tilde over (S)} bb and the correction term to obtain a second estimate of the spectral noise power density of the audio signal Ŝ bb :

Ŝ bb ={tilde over (S)} bb +KE p ,

wherein the correction term is determined so that the spectral noise power density estimation error E n is reduced.

22. A non-transitory computer readable medium including computer executable code for executing a method providing an estimate of a spectral noise power density of an audio signal, the method comprising:

providing a first estimate of the spectral noise power density of the audio signal {tilde over (S)} bb ;

determining a time dependent correction term that is a product of a correction factor K and a spectral power density estimation error E p , wherein

K =(σ E nrel 2 ×{tilde over (S)} bb 2 )/( S yy −{tilde over (S)} bb ),

where σ E nrel 2 corresponds to a variance of a relative spectral noise power density estimation error, and

where S yy corresponds to a spectral signal power density of the audio signal;

combining the first estimate {tilde over (S)} bb and the correction term to obtain a second estimate of the spectral noise power density of the audio signal Ŝ bb :

Ŝ bb ={tilde over (S)} bb +KE p ,

wherein the correction term is determined so that the spectral noise power density estimation error E n is reduced.

Assignments (7)
RELEASE (REEL 052935 / FRAME 0584) Recorded Jan 2, 2025
From: WELLS FARGO BANK, NATIONAL ASSOCIATION
To: CERENCE OPERATING COMPANY
Reel/Frame 069797/0818 →
CORRECTIVE ASSIGNMENT TO CORRECT THE REPLACE THE CONVEYANCE DOCUMENT WITH THE NEW ASSIGNMENT PREVIOUSLY RECORDED AT REEL: 050836 FRAME: 0191. ASSIGNOR(S) HEREBY CONFIRMS THE ASSIGNMENT. Recorded Apr 19, 2022
From: NUANCE COMMUNICATIONS, INC.
To: CERENCE OPERATING COMPANY
Reel/Frame 059804/0186 →
SECURITY AGREEMENT Recorded Jun 15, 2020
From: CERENCE OPERATING COMPANY
To: WELLS FARGO BANK, N.A.
Reel/Frame 052935/0584 →
RELEASE OF SECURITY INTEREST Recorded Jun 12, 2020
From: BARCLAYS BANK PLC
To: CERENCE OPERATING COMPANY
Reel/Frame 052927/0335 →
SECURITY AGREEMENT Recorded Nov 7, 2019
From: CERENCE OPERATING COMPANY
To: BARCLAYS BANK PLC
Reel/Frame 050953/0133 →
CORRECTIVE ASSIGNMENT TO CORRECT THE ASSIGNEE NAME PREVIOUSLY RECORDED AT REEL: 050836 FRAME: 0191. ASSIGNOR(S) HEREBY CONFIRMS THE INTELLECTUAL PROPERTY AGREEMENT. Recorded Oct 29, 2019
From: NUANCE COMMUNICATIONS, INC.
To: CERENCE OPERATING COMPANY
Reel/Frame 050871/0001 →
INTELLECTUAL PROPERTY AGREEMENT Recorded Oct 23, 2019
From: NUANCE COMMUNICATIONS, INC.
To: CERENCE INC.
Reel/Frame 050836/0191 →