IP Library Granted Patent US 11,682,383
Granted Patent B2
US 11,682,383 · App. 17/337,400 · Granted Jun 20, 2023

Language model biasing system

Inventors: Petar Aleksic (Jersey City, NJ); Pedro J. Moreno Mengibar (Jersey City, NJ)
Assignee: Google LLC
G10L15/07G10L15/187G10L15/1815G10L15/197G10L15/01G10L15/30
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,682,383
App. No.
17/337,400
Granted
Jun 20, 2023
Kind
B2
Abstract

Methods, systems, and apparatus for receiving audio data corresponding to a user utterance and context data, identifying an initial set of one or more n-grams from the context data, generating an expanded set of one or more n-grams based on the initial set of n-grams, adjusting a language model based at least on the expanded set of n-grams, determining one or more speech recognition candidates for at least a portion of the user utterance using the adjusted language model, adjusting a score for a particular speech recognition candidate determined to be included in the expanded set of n-grams, determining a transcription of user utterance that includes at least one of the one or more speech recognition candidates, and providing the transcription of the user utterance for output.

Claims (54)

1. A computer-implemented method when executed on data processing hardware causes the data processing hardware to perform operations comprising:

receiving context data for a user device associated with a user:

identifying an initial set of n-grams from the context data;

receiving audio data corresponding to an utterance detected by the user device;

processing, using a speech recognizer, the audio data to generate speech recognition candidates for the utterance spoken by the user, each speech recognition candidate associated with a respective speech recognition score;

adjusting, using the initial set of n-grams, one or more of the speech recognition scores associated with the speech recognition candidates; and

after adjusting the one or more speech recognition scores, determining a transcription of the utterance by selecting the speech recognition candidate that is associated with the highest respective speech recognition score.

2. The computer-implemented method of claim 1 , wherein the initial set of n-grams are identified before the user speaks the utterance.

3. The computer-implemented method of claim 1 , wherein:

the context data comprises an application identifier or dialog state identifier; and

identifying the initial set of n-grams comprises retrieving data indicating one or more words or phrases corresponding to the application identifier or dialog state identifier.

4. The computer-implemented method of claim 1 , wherein identifying the initial set of n-grams from the context data comprises:

identifying a first set of one or more n-grams from the context data; and

generating an expanded set of one or more n-grams based at least on the first set of n-grams, the expanded set of n-grams comprising one or more n-grams that are different from the n-grams in the first set of n-grams.

5. The computer-implemented method of claim 1 , wherein:

the utterance is detected by the user device providing an interface to the user; and

the context data comprises data that indicates a topic corresponding to the interface.

6. The computer-implemented method of claim 1 , wherein:

the utterance is detected by the user device providing an interface to the user; and

the context data comprises data indicating a task to be performed using the interface.

7. The computer-implemented method of claim 1 , wherein the context data indicates one or more phrases included in a graphical user interface of the user device.

8. The computer-implemented method of claim 1 , wherein the initial set of n-grams comprises one or more words or phrases displayed on a screen of the user device.

9. The computer-implemented method of claim 1 , wherein the initial set of n-grams are provided by an application running on the user device.

10. The computer-implemented method of claim 1 , wherein:

the data processing hardware resides on the user device; or

the data processing hardware resides on a server system in communication with the user device over a communication network.

11. A system comprising:

data processing hardware; and

memory hardware in communication with the data processing hardware and storing instructions that when executed on the data processing hardware causes the data processing hardware to perform operations comprising:

receiving context data for a user device associated with a user:

identifying an initial set of n-grams from the context data;

receiving audio data corresponding to an utterance detected by the user device;

processing, using a speech recognizer, the audio data to generate speech recognition candidates for the utterance spoken by the user, each speech recognition candidate associated with a respective speech recognition score;

adjusting, using the initial set of n-grams, one or more of the speech recognition scores associated with the speech recognition candidates; and

after adjusting the one or more speech recognition scores, determining a transcription of the utterance by selecting the speech recognition candidate that is associated with the highest respective speech recognition score.

12. The system of claim 11 , wherein the initial set of n-grams are identified before the user speaks the utterance.

13. The system of claim 11 , wherein:

the context data comprises an application identifier or dialog state identifier; and

identifying the initial set of n-grams comprises retrieving data indicating one or more words or phrases corresponding to the application identifier or dialog state identifier.

14. The system of claim 11 , wherein identifying the initial set of n-grams from the context data comprises:

identifying a first set of one or more n-grams from the context data; and

generating an expanded set of one or more n-grams based at least on the first set of n-grams, the expanded set of n-grams comprising one or more n-grams that are different from the n-grams in the first set of n-grams.

15. The system of claim 11 , wherein:

the utterance is detected by the user device providing an interface to the user; and

the context data comprises data that indicates a topic corresponding to the interface.

16. The system of claim 11 , wherein:

the utterance is detected by the user device providing an interface to the user; and

the context data comprises data indicating a task to be performed using the interface.

17. The system of claim 11 , wherein the context data indicates one or more phrases included in a graphical user interface of the user device.

18. The system of claim 11 , wherein the initial set of n-grams comprises one or more words or phrases displayed on a screen of the user device.

19. The system of claim 11 , wherein the initial set of n-grams are provided by an application running on the user device.

20. The system of claim 11 , wherein:

the data processing hardware resides on the user device; or

the data processing hardware resides on a server system in communication with the user device over a communication network.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 3, 2021
From: ALEKSIC, PETAR; MENGIBAR, PEDRO J. MORENO
To: GOOGLE INC.
Reel/Frame 056425/0094 →
CONVERSION Recorded Jun 3, 2021
From: GOOGLE INC.
To: GOOGLE LLC
Reel/Frame 056463/0073 →
Continuity (3)
Continuation 16417714 · May 21, 2019
Continuation 15432620 · Feb 14, 2017
Related Publication 20210358479A1 · Nov 18, 2021