Language model biasing system
Methods, systems, and apparatus for receiving audio data corresponding to a user utterance and context data, identifying an initial set of one or more n-grams from the context data, generating an expanded set of one or more n-grams based on the initial set of n-grams, adjusting a language model based at least on the expanded set of n-grams, determining one or more speech recognition candidates for at least a portion of the user utterance using the adjusted language model, adjusting a score for a particular speech recognition candidate determined to be included in the expanded set of n-grams, determining a transcription of user utterance that includes at least one of the one or more speech recognition candidates, and providing the transcription of the user utterance for output.
1. A computer-implemented method when executed on data processing hardware causes the data processing hardware to perform operations comprising:
receiving context data for a user device associated with a user:
identifying an initial set of n-grams from the context data;
receiving audio data corresponding to an utterance detected by the user device;
processing, using a speech recognizer, the audio data to generate speech recognition candidates for the utterance spoken by the user, each speech recognition candidate associated with a respective speech recognition score;
adjusting, using the initial set of n-grams, one or more of the speech recognition scores associated with the speech recognition candidates; and
after adjusting the one or more speech recognition scores, determining a transcription of the utterance by selecting the speech recognition candidate that is associated with the highest respective speech recognition score.
2. The computer-implemented method of claim 1 , wherein the initial set of n-grams are identified before the user speaks the utterance.
3. The computer-implemented method of claim 1 , wherein:
the context data comprises an application identifier or dialog state identifier; and
identifying the initial set of n-grams comprises retrieving data indicating one or more words or phrases corresponding to the application identifier or dialog state identifier.
4. The computer-implemented method of claim 1 , wherein identifying the initial set of n-grams from the context data comprises:
identifying a first set of one or more n-grams from the context data; and
generating an expanded set of one or more n-grams based at least on the first set of n-grams, the expanded set of n-grams comprising one or more n-grams that are different from the n-grams in the first set of n-grams.
5. The computer-implemented method of claim 1 , wherein:
the utterance is detected by the user device providing an interface to the user; and
the context data comprises data that indicates a topic corresponding to the interface.
6. The computer-implemented method of claim 1 , wherein:
the utterance is detected by the user device providing an interface to the user; and
the context data comprises data indicating a task to be performed using the interface.
7. The computer-implemented method of claim 1 , wherein the context data indicates one or more phrases included in a graphical user interface of the user device.
8. The computer-implemented method of claim 1 , wherein the initial set of n-grams comprises one or more words or phrases displayed on a screen of the user device.
9. The computer-implemented method of claim 1 , wherein the initial set of n-grams are provided by an application running on the user device.
10. The computer-implemented method of claim 1 , wherein:
the data processing hardware resides on the user device; or
the data processing hardware resides on a server system in communication with the user device over a communication network.
11. A system comprising:
data processing hardware; and
memory hardware in communication with the data processing hardware and storing instructions that when executed on the data processing hardware causes the data processing hardware to perform operations comprising:
receiving context data for a user device associated with a user:
identifying an initial set of n-grams from the context data;
receiving audio data corresponding to an utterance detected by the user device;
processing, using a speech recognizer, the audio data to generate speech recognition candidates for the utterance spoken by the user, each speech recognition candidate associated with a respective speech recognition score;
adjusting, using the initial set of n-grams, one or more of the speech recognition scores associated with the speech recognition candidates; and
after adjusting the one or more speech recognition scores, determining a transcription of the utterance by selecting the speech recognition candidate that is associated with the highest respective speech recognition score.
12. The system of claim 11 , wherein the initial set of n-grams are identified before the user speaks the utterance.
13. The system of claim 11 , wherein:
the context data comprises an application identifier or dialog state identifier; and
identifying the initial set of n-grams comprises retrieving data indicating one or more words or phrases corresponding to the application identifier or dialog state identifier.
14. The system of claim 11 , wherein identifying the initial set of n-grams from the context data comprises:
identifying a first set of one or more n-grams from the context data; and
generating an expanded set of one or more n-grams based at least on the first set of n-grams, the expanded set of n-grams comprising one or more n-grams that are different from the n-grams in the first set of n-grams.
15. The system of claim 11 , wherein:
the utterance is detected by the user device providing an interface to the user; and
the context data comprises data that indicates a topic corresponding to the interface.
16. The system of claim 11 , wherein:
the utterance is detected by the user device providing an interface to the user; and
the context data comprises data indicating a task to be performed using the interface.
17. The system of claim 11 , wherein the context data indicates one or more phrases included in a graphical user interface of the user device.
18. The system of claim 11 , wherein the initial set of n-grams comprises one or more words or phrases displayed on a screen of the user device.
19. The system of claim 11 , wherein the initial set of n-grams are provided by an application running on the user device.
20. The system of claim 11 , wherein:
the data processing hardware resides on the user device; or
the data processing hardware resides on a server system in communication with the user device over a communication network.