Modifications in the multi-band excitation (MBE) model for generating high quality speech at low bit rates
View Patent ↗The invention relates to improving parameter estimation and speech synthesis. Pursuant to one aspect of the invention, a path of pitch candidates having low errors is tracked to determine a pitch estimate. Pursuant to another aspect of the invention, a number of parameters are used to classify speech segments. Pursuant to another aspect of the invention, a voicing parameter is determined using a threshold value and bands are marked voiced or unvoiced depending on two error functions that compare synthesized voiced and unvoiced spectra to an original speech spectrum. Pursuant to another aspect of the invention a voicing parameter is used to facilitate lower bits for transmitting voicing decisions. Last, pursuant to other aspects of the invention, unvoiced speech is synthesized by incorporating a random generator, and harmonics phases are initialized with a fixed set of values.
1. A method for processing a signal, the method comprising the steps of:
dividing the signal into frames, each frame having a corresponding spectrum;
selecting a plurality of pitch candidates from a first frame;
selecting a plurality of pitch candidates from a second frame;
selecting a plurality of pitch candidates from a third frame: calculating a cumulative error function for a plurality of paths, each path including a pitch candidate from the first frame, a pitch candidate from the second frame, and a pitch candidate from the third frame;
selecting a path corresponding to a low cumulative error function;
basing a pitch estimate for a current frame on the selected path;
using the pitch estimate for the current frame to process the signal.
2. The method of claim 1 wherein the first frame is a previous frame and the second frame is a current frame.
3. The method of claim 1 wherein the first frame is a current frame and the second frame is a future frame.
4. The method of claim 1 wherein the first frame is a previous frame, the second frame is a current frame and the third frame is a future frame.
5. The method of claim 1 wherein the plurality of pitch candidates for the first frame is no more than five pitch candidates and the plurality of pitch candidates for the second frame is no more than five pitch candidates.
6. The method of claim 5 wherein a cumulative error function is calculated for all possible paths.
7. The method of claim 1 wherein the selected pitch candidates for the first and second frames have low error functions.
8. The method of claim 7 wherein the error function is a measure of the spectral error between original and synthesized spectra.
9. The method of claim 1 wherein the plurality of pitch candidates for the first frame is no more than five pitch candidates, the plurality of pitch candidates for the second frame is no more than five pitch candidates and the plurality of pitch candidates for the third frame is no more than five pitch candidates.
10. The method of claim 9 wherein a cumulative error function is calculated for all possible paths.
11. The method of claim 1 wherein the selected pitch candidates for the first, second and third frames have low error functions.
12. The method of claim 11 wherein the error function is a measure of the spectral error between original and synthesized spectra.
13. The method of claim 12 wherein a cumulative error function for each path is defined by the equation:
CF=k *( E −1 +E −2 )+log( P −1 /P −2 )+ k *( E −2 +E −3 )+log( P −2 /P −3 )
wherein P −1 is a selected pitch candidate for the first frame, P −2 is a selected pitch candidate for the second frame, P −3 is a selected pitch estimate for the third frame, E −1 is an error for P −1 , E −2 is an error for P −2 , E −3 is an error for P −3 , and k is a penalising factor.
14. The method of claim 1 wherein the basing a pitch estimate for a current frame on the selected path step further comprises calculating a backward pitch estimate along the selected path, wherein the pitch estimate for a current frame is based on the selected path and the backward pitch estimate.
15. The method of claim 14 wherein the backward pitch estimate is calculated by calculating backward sub-multiples of a pitch candidate for the second frame in the selected path, determining whether the backward submultiples satisfy backward constraint equations, and selecting a low backward sub-multiple as the backward pitch estimate wherein the pitch candidate for the second frame in the selected path is selected as the backward pitch estimate if a backward sub-multiple does not satisfy the backward constraint equations.
16. The method of claim 15 wherein the basing a pitch estimate for a current frame on the selected path step further includes determining a backward cumulative error based on the backward pitch estimate.
17. The method of claim 16 , wherein the backward cumulative error is defined by:
CE B ( P B )= E ( P B )+ E −1 ( P −1 )
wherein E(P B ) is an error of the backward pitch estimate and E −1 (P −1 ) is an error of the first pitch candidate.
18. The method of claim 1 wherein the basing a pitch estimate for a current frame on the selected path step further comprises calculating a forward pitch estimate along the selected path, wherein the pitch estimate for a current frame is based on the selected path and the forward pitch estimate.
19. The method of claim 18 wherein the basing a pitch estimate for a current frame on the selected path step further comprises calculating a backward pitch estimate along the selected path, wherein the pitch estimate for a current frame is based on the selected path, the forward pitch estimate and the backward pitch estimate.
20. The method of claim 18 wherein the forward pitch estimate is calculated by calculating forward sub-multiples of a pitch candidate for the second frame in the selected path, determining whether the forward sub-multiples satisfy forward constraint equations, and selecting a low forward sub-multiple as the forward pitch estimate wherein the pitch candidate for the second frame in the selected path is selected as the forward pitch estimate if a forward sub-multiple does not satisfy the forward constraint equations.
21. The method of claim 20 wherein the forward constraint equation is selected from the group consisting of:
CE F ( P 0 /n )≦0.85 and ( CE F ( P 0 /n ))/( CE F ( P 0 ))≦1.7;
CE F ( P 0 /n )≦0.4 and ( CE F ( P 0 /n ))/( CE F ( P 0 ))≦3.5; and
CE F ( P 0 /n )≦0.5
where P 0 /n refers to forward sub-multiples, P 0 refers to the pitch candidate for the second frame in the selected path, and CE F (P) is an error function.
22. The method of claim 20 wherein the basing a pitch estimate for a current frame on the selected path step further includes determining a forward cumulative error based on the forward pitch estimate.
23. The method of claim 22 , wherein the forward cumulative error is defined by:
CE F ( P F )= E ( P F )+ E −1 ( P −1 )
wherein E(P F ) is an error for the forward pitch estimate and E −1 (P −1 ) is an error of the first pitch candidate.
24. The method of claim 23 wherein the basing a pitch estimate for a current frame on the selected path step further comprises calculating a backward pitch estimate along the selected path, wherein the backward pitch estimate is used to calculate a backward cumulative error, the pitch estimate being based on the selected path, the forward cumulative error and the backward cumulative error.
25. The method of claim 24 , wherein the basing a pitch estimate for a current frame on the selected path step further comprises comparing the forward and backward cumulative errors with one another, selecting the pitch estimate as the forward pitch estimate if the forward cumulative error is less than the backward cumulative error, and selecting the pitch estimate as the backward pitch estimate if the backward cumulative error is less than the forward cumulative error.
26. A method for processing a signal comprising the steps of:
dividing the signal into frames;
obtaining a pitch estimate for a current frame;
refining the obtained pitch estimate comprising the sub-step of:
computing backward and forward sub-multiples of the obtained pitch estimate for the current frame;
determining whether the backward sub-multiples satisfy at least one backward constraint equation;
determining whether the forward sub-multiples satisfy at least one forward constraint equation;
selecting a low backward sub-multiple that satisfies the at least one backward constraint equation as the backward pitch estimate, wherein the obtained pitch estimate of the current frame is selected as the backward pitch estimate if a backward sub-multiple does not satisfy the at least one backward constraint equation;
selecting a low forward sub-multiple that satisfies the at least one forward constraint equation as the forward pitch estimate, wherein the obtained pitch estimate of the current frame is selected as the forward pitch estimate if a forward sub-multiple does not satisfy the at least one forward constraint equation;
using the backward pitch estimate to compute a backward cumulative error;
using the forward pitch estimate to compute a forward cumulative error;
comparing the forward cumulative error to the backward cumulative error;
refining the chosen pitch estimate for the current frame based on the comparison; and
using the refined pitch estimate for the current frame to process the signal.