IP Library Granted Patent US 9,026,435
Granted Patent B2
US 9,026,435 · App. 12/772,562 · Granted May 5, 2015

Method for estimating a fundamental frequency of a speech signal

View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,026,435
App. No.
12/772,562
Granted
May 5, 2015
Kind
B2
Abstract

The invention provides a method for estimating a fundamental frequency of a speech signal comprising the steps of receiving a signal spectrum of the speech signal, filtering the signal spectrum to obtain a refined signal spectrum, determining a cross-power spectral density using the refined signal spectrum and the signal spectrum, transforming the cross-power spectral density into the time domain to obtain a cross-correlation function, and estimating the fundamental frequency of the speech signal based on the cross-correlation function.

Claims (42)

1. A computer implemented method for estimating a fundamental frequency of a speech signal comprising:

receiving within a processor a signal spectrum of the speech signal;

filtering the signal spectrum within the processor to obtain a refined signal spectrum with an increased spectral resolution;

computing a cross-power spectral density from an equation including a product of a first element as the refined signal spectrum and a second element as the unrefined signal spectrum;

transforming the cross-power spectral density into the time domain to obtain a cross-correlation function; and

estimating the fundamental frequency of the speech signal based on the cross-correlation function.

2. The computer implemented method according to claim 1 , wherein estimating the fundamental frequency comprises determining a maximum of the cross-correlation function.

3. The computer implemented method according to claim 2 , wherein estimating the fundamental frequency comprises determining a lag of the cross-correlation function corresponding to the determined maximum of the cross-correlation function.

4. The computer implemented method according claim 1 , wherein estimating the fundamental frequency comprises determining a weight function for the cross-correlation function and weighting the cross-correlation function with the determined weight function.

5. The computer implemented method according to claim 4 , wherein the weight function comprises a bias term, wherein the bias term compensates for a bias of the estimation of the fundamental frequency.

6. The computer implemented method according to claim 5 , wherein determining the bias term of the weight function is based on one or more cross-correlation functions of correlated white noise.

7. The computer implemented method according to claim 2 , wherein the speech signal comprises a sequence of frames, and wherein the signal spectrum is a signal spectrum of a frame of the speech signal.

8. The computer implemented method according to claim 7 , wherein the weight function comprises a mean fundamental frequency term, wherein determining the mean fundamental frequency term is based on a mean fundamental frequency, and/or a current fundamental frequency term, wherein determining the current fundamental frequency term is based on a predetermined fundamental frequency, wherein the predetermined fundamental frequency corresponds to a fundamental frequency estimate of a previous frame of the speech signal.

9. The computer implemented method according to claim 7 , wherein determining the weight function comprises determining a combination of at least two terms of the group of terms comprising a current fundamental frequency term, a mean fundamental frequency term and a bias term.

10. The computer implemented method according to claim 1 , wherein estimating the fundamental frequency comprises compensating the cross-correlation function for a shift or delay introduced by filtering the signal spectrum.

11. The computer implemented method according to claim 1 , wherein estimating the fundamental frequency comprises determining a confidence measure for the estimated fundamental frequency.

12. The computer implemented method according to claim 1 , wherein filtering the signal spectrum comprises augmenting the number of frequency nodes of the signal spectrum such that the number of frequency nodes of the refined signal spectrum is greater than the number of frequency nodes of the signal spectrum.

13. The computer implemented method according to claim 1 , wherein the speech signal comprises a sequence of frames, and wherein the steps of the method are performed for the signal spectrum of each frame of the speech signal or for the signal spectrum of a plurality of frames of the speech signal.

14. A computer program product having a non-transitory computer readable storage medium having computer code thereon for estimating a fundamental frequency of a speech signal, the computer code comprising:

computer code for receiving a signal spectrum of the speech signal;

computer code for filtering the signal spectrum to obtain a refined signal spectrum with an increased spectral resolution;

computer code for computing a cross-power spectral density from an equation including a product of a first element as the refined signal spectrum and a second element as the unrefined signal spectrum;

computer code for transforming the cross-power spectral density into the time domain to obtain a cross-correlation function; and

computer code for estimating the fundamental frequency of the speech signal based on the cross-correlation function.

15. The computer program product according to claim 14 , wherein the computer code for estimating the fundamental frequency comprises computer code for determining a maximum of the cross-correlation function.

16. The computer program product according to claim 15 , wherein the computer code for estimating the fundamental frequency comprises computer code for determining a lag of the cross-correlation function corresponding to the determined maximum of the cross-correlation function.

17. The computer program product according claim 14 , wherein the computer code for estimating the fundamental frequency comprises computer code for determining a weight function for the cross-correlation function and weighting the cross-correlation function with the determined weight function.

18. The computer program product according to claim 17 , wherein the weight function comprises a bias term, wherein the bias term compensates for a bias of the estimation of the fundamental frequency.

19. The computer program product according to claim 18 , wherein the computer code for determining the bias term of the weight function is based on one or more cross-correlation functions of correlated white noise.

20. The computer program product according to claim 15 , wherein the speech signal comprises a sequence of frames, and wherein the signal spectrum is a signal spectrum of a frame of the speech signal.

21. The computer program product according to claim 20 , wherein the weight function comprises a mean fundamental frequency term, wherein determining the mean fundamental frequency term is based on a mean fundamental frequency, and/or a current fundamental frequency term, wherein determining the current fundamental frequency term is based on a predetermined fundamental frequency, wherein the predetermined fundamental frequency corresponds to a fundamental frequency estimate of a previous frame of the speech signal.

22. The computer program product according to claim 20 , wherein the computer code for determining the weight function comprises computer code for determining a combination of at least two terms of the group of terms comprising a current fundamental frequency term, a mean fundamental frequency term and a bias term.

23. The computer program product according to claim 14 , wherein estimating the fundamental frequency comprises compensating the cross-correlation function for a shift or delay introduced by filtering the signal spectrum.

24. The computer program product according to claim 14 , wherein the computer code for estimating the fundamental frequency comprises computer code for determining a confidence measure for the estimated fundamental frequency.

25. The computer program product according to claim 14 , wherein the computer code for filtering the signal spectrum comprises computer code for augmenting the number of frequency nodes of the signal spectrum such that the number of frequency nodes of the refined signal spectrum is greater than the number of frequency nodes of the signal spectrum.

26. The computer program product according to claim 14 , wherein the speech signal comprises a sequence of frames, and wherein the steps of the method are performed for the signal spectrum of each frame of the speech signal or for the signal spectrum of a plurality of frames of the speech signal.

27. An apparatus for estimating a fundamental frequency of a speech signal comprising:

receiving module configured to receive a signal spectrum of the speech signal;

a filtering module comprising a processor configured to filter the signal spectrum to obtain a refined signal spectrum;

a determining module configured to compute a cross-power spectral density from an equation including a product of a first element as the refined signal spectrum and a second element as the unrefined signal spectrum;

a transforming module configured to transform the cross-power spectral density into the time domain to obtain a cross-correlation function; and

an estimating module configured to estimate the fundamental frequency of the speech signal based on the cross-correlation function.

Assignments (8)
RELEASE (REEL 052935 / FRAME 0584) Recorded Jan 2, 2025
From: WELLS FARGO BANK, NATIONAL ASSOCIATION
To: CERENCE OPERATING COMPANY
Reel/Frame 069797/0818 →
CORRECTIVE ASSIGNMENT TO CORRECT THE REPLACE THE CONVEYANCE DOCUMENT WITH THE NEW ASSIGNMENT PREVIOUSLY RECORDED AT REEL: 050836 FRAME: 0191. ASSIGNOR(S) HEREBY CONFIRMS THE ASSIGNMENT. Recorded Apr 19, 2022
From: NUANCE COMMUNICATIONS, INC.
To: CERENCE OPERATING COMPANY
Reel/Frame 059804/0186 →
SECURITY AGREEMENT Recorded Jun 15, 2020
From: CERENCE OPERATING COMPANY
To: WELLS FARGO BANK, N.A.
Reel/Frame 052935/0584 →
RELEASE OF SECURITY INTEREST Recorded Jun 12, 2020
From: BARCLAYS BANK PLC
To: CERENCE OPERATING COMPANY
Reel/Frame 052927/0335 →
SECURITY AGREEMENT Recorded Nov 7, 2019
From: CERENCE OPERATING COMPANY
To: BARCLAYS BANK PLC
Reel/Frame 050953/0133 →
CORRECTIVE ASSIGNMENT TO CORRECT THE ASSIGNEE NAME PREVIOUSLY RECORDED AT REEL: 050836 FRAME: 0191. ASSIGNOR(S) HEREBY CONFIRMS THE INTELLECTUAL PROPERTY AGREEMENT. Recorded Oct 29, 2019
From: NUANCE COMMUNICATIONS, INC.
To: CERENCE OPERATING COMPANY
Reel/Frame 050871/0001 →
INTELLECTUAL PROPERTY AGREEMENT Recorded Oct 23, 2019
From: NUANCE COMMUNICATIONS, INC.
To: CERENCE INC.
Reel/Frame 050836/0191 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 13, 2010
From: KRINI, MOHAMED; SCHMIDT, GERHARD
To: NUANCE COMMUNICATIONS, INC.
Reel/Frame 024671/0346 →