Background audio identification for speech disambiguation
Implementations relate to techniques for providing context-dependent search results. A computer-implemented method includes receiving an audio stream at a computing device during a time interval, the audio stream comprising user speech data and background audio, separating the audio stream into a first substream that includes the user speech data and a second substream that includes the background audio, identifying concepts related to the background audio, generating a set of terms related to the identified concepts, influencing a speech recognizer based on at least one of the terms related to the background audio, and obtaining a recognized version of the user speech data using the speech recognizer.
1. A computer-implemented method executed on data processing hardware that causes the data processing hardware to perform operations comprising:
receiving first audio data and second audio data captured by a computing device associated with a user;
processing the first audio data to identify an entity associated with the first audio data;
retrieving a set of terms related to the identified entity;
influencing, using the retrieved set of terms related to the identified entity, a speech recognition language model; and
generating, using the influenced speech recognition language model, a transcription of the second audio data.
2. The method of claim 1 , wherein the computing device captures the first audio data before capturing the second audio data.
3. The method of claim 1 , wherein influencing the speech recognition model using the set of terms related to the identified entity comprises adjusting a probability or relevance score associated with the speech recognition language model recognizing at least one term in the set of terms related to the identified entity.
4. The method of claim 1 , wherein the second audio data corresponds to an utterance spoken by the user of the computing device.
5. The method of claim 1 , wherein processing the first audio data to identify the entity.
6. The method of claim 1 , wherein the data processing hardware resides on the computing device.
7. The method of claim 1 , wherein the speech recognition language model executes on the computing device.
8. The method of claim 1 , wherein the retrieved list of terms comprises a list of songs.
9. The method of claim 1 , wherein the retrieved list of terms comprises a list of music performers.
10. The method of claim 1 , wherein the computing device comprises a speaker.
11. A system comprising:
data processing hardware; and
memory hardware in communication with the data processing hardware and storing instructions, that when executed by the data processing hardware, cause the data processing hardware to perform operations comprising:
receiving first audio data and second audio data captured by a computing device associated with a user;
processing the first audio data to identify an entity associated with the first audio data;
retrieving a set of terms related to the identified entity;
influencing, using the retrieved set of terms related to the identified entity, a speech recognition language model; and
generating, using the influenced speech recognition language model, a transcription of the second audio data.
12. The system of claim 11 , wherein the computing device captures the first audio data before capturing the second audio data.
13. The system of claim 11 , wherein influencing the speech recognition model using the set of terms related to the identified entity comprises adjusting a probability or relevance score associated with the speech recognition language model recognizing at least one term in the set of terms related to the identified entity.
14. The system of claim 11 , wherein the second audio data corresponds to an utterance spoken by the user of the computing device.
15. The system of claim 11 , wherein processing the first audio data to identify the entity.
16. The system of claim 11 , wherein the data processing hardware resides on the computing device.
17. The system of claim 11 , wherein the speech recognition language model executes on the computing device.
18. The system of claim 11 , wherein the retrieved list of terms comprises a list of songs.
19. The system of claim 11 , wherein the retrieved list of terms comprises a list of music performers.
20. The system of claim 11 , wherein the computing device comprises a speaker.