System and method of using neural transforms of robust audio features for speech processing
A system and method for processing speech includes receiving a first information stream associated with speech, the first information stream comprising micro-modulation features and receiving a second information stream associated with the speech, the second information stream comprising features. The method includes combining, via a non-linear multilayer perceptron, the first information stream and the second information stream to yield a third information stream. The system performs automatic speech recognition on the third information stream. The third information stream can also be used for training HMMs.
1. A method comprising:
receiving, via a communication network, a first information stream associated with speech, wherein the first information stream comprises features modeled according to a first time scale;
receiving, via the communication network, a second information stream associated with the speech;
performing, via at least one hardware processor, automatic speech recognition on a third information stream formed by combining the first information stream and the second information stream, to yield a recognition result; and
outputting, via the communication network, the recognition result comprising text representing the speech.
2. The method of claim 1 , wherein the second information stream comprises cepstral features modeled in a second time scale.
3. The method of claim 2 , wherein the first time scale is distinct from the second time scale.
4. The method of claim 1 , further comprising filtering out noise from the third information stream prior to performing automatic speech recognition.
5. The method of claim 1 , wherein the third information stream comprises less features than raw features in the first information stream and the second information stream.
6. The method of claim 1 , further comprising training a Hidden Markov model using the third information stream.
7. A system comprising:
a processor; and
a non-transitory computer-readable storage medium storing instructions which, when executed by the processor, cause the processor to perform operations comprising:
receiving, via a communication network, a first information stream associated with speech, wherein the first information stream comprises features modeled according to a first time scale;
receiving, via the communication network, a second information stream associated with the speech;
performing automatic speech recognition on a third information stream formed by combining the first information stream and the second information stream, to yield a recognition result; and
outputting, via the communication network, the recognition result comprising text representing the speech.
8. The system of claim 7 , wherein the second information stream comprises cepstral features modeled in a second time scale.
9. The system of claim 8 , wherein the first time scale is distinct from the second time scale.
10. The system of claim 7 , wherein the non-transitory computer-readable storage medium stores additional instructions which, when executed by the processor, cause the processor to perform operations further comprising:
filtering out noise from the third information stream prior to performing automatic speech recognition.
11. The system of claim 7 , wherein the third information stream comprises less features than raw features in the first information stream and the second information stream.
12. The system of claim 7 , wherein the non-transitory computer-readable storage medium stores additional instructions which, when executed by the processor, cause the processor to perform operations further comprising:
training a Hidden Markov model using the third information stream.
13. A non-transitory computer-readable storage device storing instructions, which, when executed by a processor, cause the processor to perform operations comprising:
receiving, via a communication network, a first information stream associated with speech, wherein the first information stream comprises features modeled according to a first time scale;
receiving, via the communication network, a second information stream associated with the speech;
performing automatic speech recognition on a third information stream formed by combining the first information stream and the second information stream, to yield a recognition result; and
outputting, via the communication network, the recognition result comprising text representing the speech.
14. The non-transitory computer-readable storage device of claim 13 , wherein the second information stream comprises cepstral features modeled in a second time scale.
15. The non-transitory computer-readable storage device of claim 14 , wherein the first time scale is distinct from the second time scale.
16. The non-transitory computer-readable storage device of claim 13 , wherein the non-transitory computer-readable storage device stores additional instructions, which, when executed by the processor, cause the processor to perform operations further comprising:
filtering out noise from the third information stream prior to performing automatic speech recognition.
17. The non-transitory computer-readable storage device of claim 13 , wherein the third information stream comprises less features than raw features in the first information stream and the second information stream.
18. The non-transitory computer-readable storage device of claim 13 , wherein the non-transitory computer-readable storage device stores additional instructions, which, when executed by the processor, cause the processor to perform operations further comprising:
training a Hidden Markov model using the third information stream.