IP Library Granted Patent US 10,714,075
Granted Patent B2
US 10,714,075 · App. 16/381,167 · Granted Jul 14, 2020

Language model biasing modulation

Inventors: Pedro J. Moreno Mengibar (Jersey City, NJ); Petar Aleksic (Jersey City, NJ)
Assignee: Google LLC
G10L15/07G10L15/183G10L15/197G10L15/24
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,714,075
App. No.
16/381,167
Granted
Jul 14, 2020
Kind
B2
Abstract

Methods, systems, and apparatus, including computer programs encoded on a computer storage medium, for modulating language model biasing. In some implementations, context data is received. A likely context associated with a user is determined based on at least a portion of the context data. One or more language model biasing parameters based at least on the likely context associated with the user is selected. A context confidence score associated with the likely context based on at least a portion of the context data is determined. One or more language model biasing parameters based at least on the context confidence score is adjusted. A baseline language model based at least on the one or more of the adjusted language model biasing parameters is biased. The baseline language model is provided for use by an automated speech recognizer (ASR).

Claims (39)

1. A computer-implemented method comprising:

receiving, by an automated speech recognizer (ASR) that is configured to use a language model that has previously been biased for use in transcribing utterances, audio data corresponding to an utterance;

determining that, when the audio data was received, a particular context that is associated with biasing the language model was still applicable;

in response to determining that the particular context that is associated with biasing the language mode was still applicable when the audio data was received, generating, by the ASR, a transcription of the utterance using the language model that has previously been biased for use in transcribing utterances; and

providing a representation of the transcription for output.

2. The method of claim 1 , wherein generating, by the ASR, a transcription of the utterance using the language model that has previously been biased for use in transcribing utterances comprises:

not returning the biased language model to a baseline state, or reducing an effect of the previous biasing of the language model.

3. The method of claim 1 , wherein determining that the particular context that is associated with biasing the language model was still applicable comprises determining that a predetermined period of time has not elapsed.

4. The method of claim 1 , wherein determining that the particular context that is associated with biasing the language model was still applicable comprises determining that a user that spoke the utterance is likely in a same context.

5. The method of claim 1 , wherein determining that the particular context that is associated with biasing the language model was still applicable comprises determining that a confidence score associated with the particular context does satisfy a threshold.

6. The method of claim 1 , wherein determining that the particular context that is associated with biasing the language model was still applicable comprises determining that a user that spoke the utterance is likely associated with another context that is consistent with the particular context.

7. The method of claim 1 , wherein determining that, when the audio data was received, a particular context that is associated with biasing the language model was still applicable comprises:

determining that interactions from a user indicate a change in behavior since the language model was biased where the change is within a threshold amount.

8. A computer storage medium storing instructions that, when executed by data processing apparatus, cause one or more computers to perform operations comprising:

receiving, by an automated speech recognizer (ASR) that is configured to use a language model that has previously been biased for use in transcribing utterances, audio data corresponding to an utterance;

determining that, when the audio data was received, a particular context that is associated with biasing the language model was still applicable;

in response to determining that the particular context that is associated with biasing the language mode was still applicable when the audio data was received, generating, by the ASR, a transcription of the utterance using the language model that has previously been biased for use in transcribing utterances; and

providing a representation of the transcription for output.

9. The medium of claim 8 , wherein generating, by the ASR, a transcription of the utterance using the language model that has previously been biased for use in transcribing utterances comprises:

not returning the biased language model to a baseline state, or reducing an effect of the previous biasing of the language model.

10. The medium of claim 8 , wherein determining that the particular context that is associated with biasing the language model was still applicable comprises determining that a predetermined period of time has not elapsed.

11. The medium of claim 8 , wherein determining that the particular context that is associated with biasing the language model was still applicable comprises determining that a user that spoke the utterance is likely in a same context.

12. The medium of claim 8 , wherein determining that the particular context that is associated with biasing the language model was still applicable comprises determining that a confidence score associated with the particular context does satisfy a threshold.

13. The medium of claim 8 , wherein determining that the particular context that is associated with biasing the language model was still applicable comprises determining that a user that spoke the utterance is likely associated with another context that is consistent with the particular context.

14. The medium of claim 8 , wherein determining that, when the audio data was received, a particular context that is associated with biasing the language model was still applicable comprises:

determining that interactions from a user indicate a change in behavior since the language model was biased where the change is within a threshold amount.

15. A system comprising:

one or more computers including one or more storage devices storing instructions that when executed by the one or more computers cause the one or more computers to perform operations comprising:

receiving, by an automated speech recognizer (ASR) that is configured to use a language model that has previously been biased for use in transcribing utterances, audio data corresponding to an utterance;

determining that, when the audio data was received, a particular context that is associated with biasing the language model was still applicable;

in response to determining that the particular context that is associated with biasing the language mode was still applicable when the audio data was received,

generating, by the ASR, a transcription of the utterance using the language model that has previously been biased for use in transcribing utterances; and

providing a representation of the transcription for output.

16. The system of claim 15 , wherein generating, by the ASR, a transcription of the utterance using the language model that has previously been biased for use in transcribing utterances comprises:

not returning the biased language model to a baseline state, or reducing an effect of the previous biasing of the language model.

17. The system of claim 15 , wherein determining that the particular context that is associated with biasing the language model was still applicable comprises determining that a predetermined period of time has not elapsed.

18. The system of claim 15 , wherein determining that the particular context that is associated with biasing the language model was still applicable comprises determining that a user that spoke the utterance is likely in a same context.

19. The system of claim 15 , wherein determining that the particular context that is associated with biasing the language model was still applicable comprises determining that a confidence score associated with the particular context does satisfy a threshold.

20. The system of claim 15 , wherein determining that the particular context that is associated with biasing the language model was still applicable comprises determining that a user that spoke the utterance is likely associated with another context that is consistent with the particular context.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 11, 2019
From: MORENO MENGIBAR, PEDRO J.; ALEKSIC, PETAR
To: GOOGLE INC.
Reel/Frame 048862/0992 →
ENTITY CONVERSION Recorded Apr 11, 2019
From: GOOGLE INC.
To: GOOGLE LLC
Reel/Frame 048875/0035 →
Continuity (4)
Continuation 15874075 · Jan 18, 2018
Continuation 15263714 · Sep 13, 2016
Continuation 14673731 · Mar 30, 2015
Related Publication 20190237063A1 · Aug 1, 2019