Speech synthesis from acoustic units with default values of concatenation cost
View Patent ↗A speech synthesis system can select recorded speech fragments, or acoustic units, from a very large database of acoustic units to produce artificial speech. When a pair of acoustic units in the database does not have an associated concatenation cost, the system assigns a default concatenation cost. The system then synthesizes speech, identifies the acoustic unit sequential pairs generated and their respective concatenation costs, and stores those concatenation costs likely to occur.
1. A method comprising:
when, while synthesizing speech via a processor, an acoustic unit sequential pair does not have an associated concatenation cost in a concatenation cost database:
assigning a default value as the associated concatenation cost; and
updating the concatenation cost database by synthesizing, via the processor, a body of speech, identifying the acoustic unit sequential pair in the body of speech, and recording a respective concatenation cost in the concatenation cost database.
2. The method of claim 1 , further comprising synthesizing the speech using the respective concatenation cost.
3. The method of claim 1 , wherein recording the respective concatenation cost comprises deriving an actual concatenation cost.
4. The method of claim 1 , wherein the concatenation cost database contains a portion of all possible concatenation costs associated with a list of acoustic units.
5. The method of claim 1 , wherein the respective concatenation cost comprises a weighted sum of subcosts across phones.
6. The method of claim 1 , wherein the concatenation cost database is generated using statistical techniques which predict which of the acoustic unit sequential pairs are most likely to occur in common speech.
7. The method of claim 1 , wherein the concatenation cost database stores acoustic units in linear predictive coding parameters.
8. A system comprising:
a processor; and
a computer-readable storage medium having instructions stored which, when executed by the processor, cause the processor to perform operations comprising:
when, while synthesizing speech, an acoustic unit sequential pair does not have an associated concatenation cost in a concatenation cost database:
assigning a default value as the associated concatenation cost; and
updating the concatenation cost database by synthesizing a body of speech, identifying the acoustic unit sequential pair in the body of speech, and recording a respective concatenation cost in the concatenation cost database.
9. The system of claim 8 , the computer-readable storage medium having additional instructions stored which result in the operations comprising synthesizing the speech using the respective concatenation cost.
10. The system of claim 8 , wherein recording the respective concatenation cost comprises deriving an actual concatenation cost.
11. The system of claim 8 , wherein the concatenation cost database contains a portion of all possible concatenation costs associated with a list of acoustic units.
12. The system of claim 8 , wherein the respective concatenation cost comprises a weighted sum of subcosts across phones.
13. The system of claim 8 , wherein the concatenation cost database is generated using statistical techniques which predict which of the acoustic unit sequential pairs are most likely to occur in common speech.
14. The system of claim 8 , wherein the concatenation cost database stores acoustic units in linear predictive coding parameters.
15. A computer-readable storage device having instructions stored which, when executed by a computing device, cause the computing device to perform operations comprising:
when, while synthesizing speech, an acoustic unit sequential pair does not have an associated concatenation cost in a concatenation cost database:
assigning a default value as the associated concatenation cost; and
updating the concatenation cost database by synthesizing a body of speech, identifying the acoustic unit sequential pair in the body of speech, and recording a respective concatenation cost in the concatenation cost database.
16. The computer-readable storage device of claim 15 , the computer-readable storage device having additional instructions stored which result in operations comprising synthesizing the speech using the respective concatenation cost.
17. The computer-readable storage device of claim 15 , wherein recording the respective concatenation cost comprises deriving an actual concatenation cost.
18. The computer-readable storage device of claim 15 , wherein the concatenation cost database contains a portion of all possible concatenation costs associated with a list of acoustic units.
19. The computer-readable storage device of claim 15 , wherein the respective concatenation cost comprises a weighted sum of subcosts across phones.
20. The computer-readable storage device of claim 15 , wherein the concatenation cost database is generated using statistical techniques which predict which of the acoustic unit sequential pairs are most likely to occur in common speech.