Method for building language model, speech recognition method and electronic apparatus
A method for building a language model, a speech recognition method and an electronic apparatus are provided. The speech recognition method includes the following steps. Phonetic transcriptions of a speech signal are obtained from an acoustic model. Phonetic spellings matching the phonetic transcriptions are obtained according to the phonetic transcriptions and a syllable acoustic lexicon. According to the phonetic spellings, a plurality of text sequences and a plurality of text sequence probabilities are obtained from a language model. Each phonetic spelling is matched to a candidate sentence table; a word probability of each phonetic spelling matching a word in a sentence of the sentence table are obtained; and the word probabilities of the phonetic spellings are calculated so as to obtain the text sequence probabilities. The text sequence corresponding to a largest one of the sequence probabilities is selected as a recognition result of the speech signal.
1. A speech recognition method, adapted to an electronic apparatus, comprising:
obtaining a phonetic transcription sequence of a speech signal according to an acoustic model, and the phonetic transcription sequence including a plurality of phones;
obtaining a plurality of phonetic spellings matching the phonetic transcription sequence according to the phonetic transcription sequence and a syllable acoustic lexicon;
obtaining a plurality of text sequences and a plurality of text sequence probabilities from a language model according to the phonetic spellings, and
matching each of the phonetic spellings with a candidate sentence table, so as to obtain a word probability of each of the phonetic spellings corresponding to each of the words in the candidate sentences; and
calculating the word probabilities of the phonetic spellings, so as to obtain the text sequence probabilities, wherein the candidate sentences corresponding to the text sequence probabilities are the text sequences; and
selecting the text sequence corresponding to a largest one among the text sequence probabilities as a recognition result of the speech signal.
2. The speech recognition method of claim 1 , further comprising:
obtaining the acoustic model through training with the speech signals based on different languages, dialects or different pronunciation habits.
3. The speech recognition method of claim 2 , wherein the step of obtaining the acoustic model through training with the speech signals based on different languages, dialects or different pronunciation habits comprises:
receiving the phonetic transcription sequences matching pronunciations in the speech signals; and
obtaining data of the phones corresponding to the phonetic transcription sequences in the acoustic model by training according to the speech signals and the phonetic transcription sequences.
4. The speech recognition method of claim 1 , wherein the step of obtaining the phonetic transcription sequence of the speech signal according to the acoustic model comprises:
selecting a training data from the acoustic model according to a predetermined setting, wherein the training data is one of training results of different languages, dialects or different pronunciation habits;
calculating a phonetic transcription matching probability of the phonetic transcription sequences matching the phones according to the selected training data and each of the phones of the speech signal; and
selecting the phonetic transcription sequence corresponding to a largest one among the phonetic transcription matching probabilities to be used as the phonetic transcription sequence of the speech signal.
5. The speech recognition method of claim 1 , wherein the step of obtaining the phonetic spellings matching the phonetic transcription sequence according to the phonetic transcription sequence and the syllable acoustic lexicon comprises:
obtaining an intonation information corresponding to each of the phonetic spellings according to a tone of the phonetic transcription sequence.
6. The speech recognition method of claim 1 , wherein the step of obtaining the phonetic spellings matching the phonetic transcription sequence according to the phonetic transcription sequence and the syllable acoustic lexicon further comprises:
obtaining the phonetic spellings matching the phonetic transcription sequence and obtaining a phonetic spelling matching probability of the phonetic transcription sequence matching each of the phonetic spellings according to the phonetic transcription sequence and the syllable acoustic lexicon; and
selecting the phonetic spelling corresponding to a largest one among the phonetic spelling matching probabilities to be used as the phonetic spelling matching each of the phonetic transcription sequences.
7. The speech recognition method of claim 6 , further comprising:
selecting the text sequence corresponding to the largest one among associated probabilities including the phonetic spelling matching probabilities and the text sequence probabilities, to be used as the recognition result of the speech signal.
8. The speech recognition method of claim 1 , further comprising:
receiving a plurality of candidate sentences; and
obtaining a plurality of phonetic spellings matching each of words in each of candidate sentences and a plurality of word probabilities according to a text corpus, so as to obtain the candidate sentence table corresponding to the candidate sentences.
9. The speech recognition method of claim 8 , further comprising:
obtaining the text corpus through training with a plurality of speech signals based on the speech signals of different languages, dialects or different pronunciation habits.
10. The speech recognition method of claim 9 , wherein the step of obtaining the text corpus through training with the speech signals based on different languages, dialects or different pronunciation habits comprises:
receiving the phonetic spellings matching pronunciations of each of the words according to the corresponding words in the speech signals; and
obtaining the word probabilities of each of the words corresponding to each of the phonetic spellings in the text corpus by training according to each of the words and the phonetic spellings.
11. The speech recognition method of claim 9 , wherein the step of obtaining the text sequences and the text sequence probabilities from the language model according to the phonetic spellings comprises:
selecting the candidate sentence table according to a predetermined setting, wherein the candidate sentence table is corresponding to the text corpus obtained by training with one of the speech signals based on different languages, dialects or different pronunciation habits.
12. An electronic apparatus, comprising:
an input unit, receiving a speech signal;
a storage unit, storing a plurality of program code segments; and
a processing unit, coupled to the input unit and the storage unit, the processing unit executing a plurality of commands through the program code segments, and the commands comprising:
obtaining a phonetic transcription sequence of the speech signal according to an acoustic model, and the phonetic transcription sequence including a plurality of phones;
obtaining a plurality of phonetic spellings matching the phonetic transcription sequence according to the phonetic transcription sequence and a syllable acoustic lexicon;
obtaining a plurality of text sequences and a plurality of text sequence probabilities from a language model according to the phonetic spellings, and
matching each of the phonetic spellings with a candidate sentence table, so as to obtain a word probability of each of the phonetic spellings corresponding to each of the words in the candidate sentences; and
calculating the word probabilities of the phonetic spellings, so as to obtain the text sequence probabilities, wherein the candidate sentences corresponding to the text sequence probabilities are the text sequences; and
selecting the text sequence corresponding to a largest one among the text sequence probabilities as a recognition result of the speech signal.
13. The electronic apparatus of claim 12 , wherein the commands further comprise:
obtaining the acoustic model through training with the speech signals based on different languages, dialects or different pronunciation habits.
14. The electronic apparatus of claim 13 , wherein the command of obtaining the acoustic model through training with the speech signals based on different languages, dialects or different pronunciation habits comprises:
receiving the phonetic transcription sequences matching pronunciations in the speech signals; and
obtaining data of the phones corresponding to the phonetic transcription sequences in the acoustic model by training according to the speech signals and the phonetic transcription sequences.
15. The electronic apparatus of claim 12 , wherein the command of obtaining the phonetic transcription sequences of the speech signal according to the acoustic model comprises:
selecting a training data from the acoustic model according to a predetermined setting, wherein the training data is one of training results of different languages, dialects or different pronunciation habits;
calculating a phonetic transcription matching probability of the phonetic transcription sequences matching the phones according to the selected training data and each of the phones of the speech signal; and
selecting the phonetic transcription sequence corresponding to a largest one among the phonetic transcription matching probabilities to be used as the phonetic transcription sequence of the speech signal.
16. The electronic apparatus of claim 12 , wherein the command of obtaining the phonetic spellings matching the phonetic transcription sequence according to the phonetic transcription sequence and the syllable acoustic lexicon comprises:
obtaining an intonation information corresponding to each of the phonetic spellings according to a tone of the phonetic transcription sequence.
17. The electronic apparatus of claim 12 , wherein the command of obtaining the phonetic spellings matching the phonetic transcription sequence according to the phonetic transcription sequence and the syllable acoustic lexicon further comprises:
obtaining the phonetic spellings matching the phonetic transcription sequence and obtaining a phonetic spelling matching probability of the phonetic transcription sequence matching each of the phonetic spellings according to the phonetic transcription sequence and the syllable acoustic lexicon; and
selecting the phonetic spelling corresponding to a largest one among the phonetic spelling matching probabilities to be used as the phonetic spelling matching each of the phonetic transcription sequences.
18. The electronic apparatus of claim 17 , wherein the commands further comprise:
selecting the text sequence corresponding to the largest one among associated probabilities including the phonetic spelling matching probabilities and the text sequence probabilities, to be used as the recognition result of the speech signal.
19. The electronic apparatus of claim 12 , wherein the commands further comprise:
receiving a plurality of candidate sentences; and
obtaining a plurality of phonetic spellings matching each of words in each of candidate sentences and a plurality of word probabilities according to a text corpus, so as to obtain the candidate sentence table corresponding to the candidate sentences.
20. The electronic apparatus of claim 19 , wherein the commands further comprise:
obtaining the text corpus through training with a plurality of speech signals based on the speech signals of different languages, dialects or different pronunciation habits.
21. The electronic apparatus of claim 20 , wherein the command of obtaining the text corpus through training with the speech signals based on different languages, dialects or different pronunciation habits comprises:
receiving the phonetic spellings matching pronunciations of each of the words according to the corresponding words in the speech signals; and
obtaining the word probabilities of each of the words corresponding to each of the phonetic spellings in the text corpus by training according to each of the words and the phonetic spellings.
22. The electronic apparatus of claim 20 , wherein the command of obtaining the text sequences and the text sequence probabilities from the language model according to the phonetic spellings comprises:
selecting the candidate sentence table according to a predetermined setting, wherein the candidate sentence table is corresponding to the text corpus obtained by training with one of the speech signals based on different languages, dialects or different pronunciation habits.