Augmented generalized deep learning with special vocabulary
Systems and methods are disclosed for customizing a neural network for a custom dataset, when the neural network has been trained on data from a general dataset. The neural network may comprise an output layer including one or more nodes corresponding to candidate outputs. The values of the nodes in the output layer may correspond to a probability that the candidate output is the correct output for an input. The values of the nodes in the output layer may be adjusted for higher performance when the neural network is used to process data from a custom dataset.
1. A method for customizing a neural network trained on a general dataset to a custom dataset, the method comprising:
providing a trained speech recognition neural network, the trained speech recognition neural network including a plurality of layers each having a plurality of nodes, the trained speech recognition neural network including an output layer with nodes corresponding to words of a vocabulary, the nodes of the output layer outputting values, wherein the values output by the nodes in the output layer correspond to a probability of the corresponding word in the vocabulary being a correct transcription of an input;
for a plurality of words in the vocabulary, determining the frequency of occurrence of the word in a general training set and the frequency of occurrence of the word in a custom dataset;
during inference using the trained speech recognition neural network, for each word in the plurality of words, multiplying the value output by the output node for the word by the frequency of occurrence of the word in the custom dataset divided by the frequency of occurrence of the word in the general training set to obtain a custom model probability; and
generating a transcription of a spoken input based on the custom model probability.
2. The method of claim 1 , wherein the plurality of words comprises all of the words in the vocabulary.
3. The method of claim 1 , wherein the frequency of occurrence of the word in the general training set is set to a threshold minimum value if the word does not appear in the general training set.
4. The method of claim 1 , wherein one or more nodes of the trained speech recognition neural network include a sigmoid activation function.
5. The method of claim 1 , wherein the trained speech recognition neural network includes one or more locally connected neural network layers.
6. The method of claim 5 , wherein the trained speech recognition neural network includes one or more recurrent neural network layers.
7. The method of claim 6 , wherein the trained speech recognition neural network has been trained in an end-to-end training process including backpropagation through each of its layers.
8. A non-transitory computer-readable medium comprising instructions for:
providing a trained speech recognition neural network, the trained speech recognition neural network including a plurality of layers each having a plurality of nodes, the trained speech recognition neural network including an output layer with nodes corresponding to words of a vocabulary, the nodes of the output layer outputting values, wherein the values output by the nodes in the output layer correspond to a probability of the corresponding word in the vocabulary being a correct transcription of an input;
for a plurality of words in the vocabulary, determining the frequency of occurrence of the word in a general training set and the frequency of occurrence of the word in a custom dataset;
during inference using the trained speech recognition neural network, for each word in the plurality of words, multiplying the value output by the output node for the word by the frequency of occurrence of the word in the custom dataset divided by the frequency of occurrence of the word in the general training set to obtain a custom model probability; and
generating a transcription of a spoken input based on the custom model probability.
9. The non-transitory computer-readable medium of claim 8 , wherein the plurality of words comprises all of the words in the vocabulary.
10. The non-transitory computer-readable medium of claim 8 , wherein the frequency of occurrence of the word in the general training set is set to a threshold minimum value if the word does not appear in the general training set.
11. The non-transitory computer-readable medium of claim 8 , wherein one or more nodes of the trained speech recognition neural network include a sigmoid activation function.
12. The non-transitory computer-readable medium of claim 8 , wherein the trained speech recognition neural network includes one or more locally connected neural network layers.
13. The non-transitory computer-readable medium of claim 12 , wherein the trained speech recognition neural network includes one or more recurrent neural network layers.
14. The non-transitory computer-readable medium of claim 13 , wherein the trained speech recognition neural network has been trained in an end-to-end training process including backpropagation through each of its layers.
15. A system comprising:
a processor;
a non-transitory computer-readable medium comprising instructions for:
providing a trained speech recognition neural network, the trained speech recognition neural network including a plurality of layers each having a plurality of nodes, the trained speech recognition neural network including an output layer with nodes corresponding to words of a vocabulary, the nodes of the output layer outputting values, wherein the values output by the nodes in the output layer correspond to a probability of the corresponding word in the vocabulary being a correct transcription of an input;
for a plurality of words in the vocabulary, determining the frequency of occurrence of the word in a general training set and the frequency of occurrence of the word in a custom dataset;
during inference using the trained speech recognition neural network, for each word in the plurality of words, multiplying the value output by the output node for the word by the frequency of occurrence of the word in the custom dataset divided by the frequency of occurrence of the word in the general training set to obtain a custom model probability; and
generating a transcription of a spoken input based on the custom model probability.
16. The system of claim 15 , wherein the plurality of words comprises all of the words in the vocabulary.
17. The system of claim 15 , wherein the frequency of occurrence of the word in the general training set is set to a threshold minimum value if the word does not appear in the general training set.
18. The system of claim 15 , wherein one or more nodes of the trained speech recognition neural network include a sigmoid activation function.
19. The system of claim 15 , wherein the trained speech recognition neural network includes one or more locally connected neural network layers.
20. The system of claim 19 , wherein the trained speech recognition neural network has been trained in an end-to-end training process including backpropagation through each of its layers.