Rendering responses to a spoken utterance of a user utilizing a local text-response map
Implementations disclosed herein relate to generating and/or utilizing, by a client device, a text-response map that is stored locally on the client device. The text-response map can include a plurality of mappings, where each of the mappings define a corresponding direct relationship between corresponding text and a corresponding response. Each of the mappings is defined in the text-response map based on the corresponding text being previously generated from previous audio data captured by the client device and based on the corresponding response being previously received from a remote system in response to transmitting, to the remote system, at least one of the previous audio data and the corresponding text.
1 . A method implemented by one or more processors of a client device, the method comprising:
capturing, via at least one microphone of the client device, audio data that captures a spoken utterance of a user;
processing the audio data to generate current text that corresponds to the spoken utterance, wherein processing the audio data to generate the current text utilizes a voice-to-text model stored locally on the client device;
accessing a text-response map stored locally on the client device, wherein the text-response map includes a plurality of mappings, each of the mappings defining a corresponding direct relationship between corresponding text and a corresponding response based on the corresponding text being previously generated from previous audio data captured by the client device and based on the corresponding response being previously received from a remote system in response to transmitting, to the remote system, at least one of the previous audio data and the corresponding text;
determining, by the client device, that the corresponding texts of the text-response map fail to match the current text;
in response to determining that the corresponding texts of the text-response map fail to match the current text, transmitting, to a remote system and based on determining that the corresponding texts of the text-response map fail to match the current text, the audio data or the current text;
receiving, from the remote system in response to transmitting the audio data or the current text, a response and an indication that the response is static only until an expiration event occurs, wherein the expiration event comprises determining that the user is no longer present at a particular location;
updating, in response to the indication that is received from the remote system indicating that the response is static, the text-response map by adding a given text mapping and including an indication of the expiration event with the given text mapping, the given text mapping defining a direct relationship between the current text and the response;
capturing, subsequent to updating the text-response map, second audio data;
processing the second audio data to generate a second text utilizing the voice-to-text model stored locally on the client device;
determining, based on the text-response map, that the current text matches the second text;
in response to determining that the current text matches the second text, and based on the text-response map including the given text mapping that defines the direct relationship between the current text and the response:
causing the response, from the text-response map, to be implemented; and
removing the given text mapping from the text-response map when the expiration event occurs.
2 . The method of claim 1 , wherein the spoken utterance comprise a query or command and the response comprises a response to the query or command.
3 . The method of claim 2 , wherein the response comprises information indicated to be of interest in the query or command.
4 . The method of claim 1 , wherein updating the text-response map includes removing one or more mappings from the text-response map.
5 . The method of claim 1 , wherein causing the response to be implemented comprises causing the client device to render the response.
6 . The method of claim 1 , wherein the response comprises a command and wherein causing the response to be implemented comprises causing the command to be provided to a smart device to alter a state of the smart device.
7 . A client device comprising:
one or more processors;
microphones; and
memory storing computer-executable instructions which, when executed by the one or more processors, causes the one or more processors to:
capture, via at least one of the microphones, audio data that captures a spoken utterance of a user;
process the audio data to generate current text that corresponds to the spoken utterance, wherein processing the audio data to generate the current text utilizes a voice-to-text model stored locally on the client device;
access a text-response map stored locally on the client device, wherein the text-response map includes a plurality of mappings, each of the mappings defining a corresponding direct relationship between corresponding text and a corresponding response based on the corresponding text being previously generated from previous audio data captured by the client device and based on the corresponding response being previously received from a remote system in response to transmitting, to the remote system, at least one of the previous audio data and the corresponding text;
determine, by the client device, that the corresponding texts of the text-response map fail to match the current text;
in response to determining that the corresponding texts of the text-response map fail to match the current text, transmit, to a remote system and based on determining that the corresponding texts of the text-response map fail to match the current text, the audio data or the current text;
receive, from the remote system in response to transmitting the audio data or the current text, a response and an indication that the response is static only until an expiration event occurs, wherein the expiration event comprises determining that the user is no longer present at a particular location;
update, in response to the indication that is received from the remote system indicating that the response is static, the text-response map by adding a given text mapping and including an indication of the expiration event with the given text mapping, the given text mapping defining a direct relationship between the current text and the response;
capture, subsequent to updating the text-response map, second audio data;
process the second audio data to generate a second text utilizing the voice-to-text model stored locally on the client device;
determine, based on the text-response map, that the current text matches the second text;
in response to determining that the current text matches the second text, and based on the text-response map including the given text mapping that defines the direct relationship between the current text and the response:
cause the response, from the text-response map, to be implemented; and
remove the given text mapping from the text-response map when the expiration event occurs.
8 . The client device of claim 7 , wherein the spoken utterance comprises a query or command and the response comprises a response to the query or command.
9 . The client device of claim 8 , wherein the response comprises information indicated to be of interest in the query or command.
10 . The client device of claim 7 , wherein in updating the text-response map, one or more of the processors are to remove one or more mappings from the text- response map.
11 . The client device of claim 7 , wherein in causing the response to be implemented, one or more of the processors are to cause the client device to render the response.
12 . The client device of claim 7 , wherein the response comprises a command and wherein in causing the response to be implemented, one or more of the processors are to cause the command to be provided to a smart device to alter a state of the smart device.
13 . A non-transitory computer readable storage medium configured to store instructions that, when executed by one or more processors, cause one or more of the processors to:
capture, via at least one microphone of a client device, audio data that captures a spoken utterance of a user;
process the audio data to generate current text that corresponds to the spoken utterance, wherein processing the audio data to generate the current text utilizes a voice-to-text model stored locally on the client device;
access a text-response map stored locally on the client device, wherein the text-response map includes a plurality of mappings, each of the mappings defining a corresponding direct relationship between corresponding text and a corresponding response based on the corresponding text being previously generated from previous audio data captured by the client device and based on the corresponding response being previously received from a remote system in response to transmitting, to the remote system, at least one of the previous audio data and the corresponding text;
determine, by the client device, that the corresponding texts of the text-response map fail to match the current text;
in response to determining that the corresponding texts of the text-response map fail to match the current text, transmit, to a remote system and based on determining that the corresponding texts of the text-response map fail to match the current text, the audio data or the current text;
receive, from the remote system in response to transmitting the audio data or the current text, a response and an indication that the response is static only until an expiration event occurs, wherein the expiration event comprises determining that the user is no longer present at a particular location;
update, in response to the indication that is received from the remote system indicating that the response is static, the text-response map by adding a given text mapping and including an indication of the expiration event with the given text mapping, the given text mapping defining a direct relationship between the current text and the response;
capture, subsequent to updating the text-response map, second audio data;
process the second audio data to generate a second text utilizing the voice-to-text model stored locally on the client device;
determine, based on the text-response map, that the current text matches the second text;
in response to determining that the current text matches the second text, and based on the text-response map including the given text mapping that defines the direct relationship between the current text and the response:
cause the response, from the text-response map, to be implemented; and
remove the given text mapping from the text-response map when the expiration event occurs.
14 . The non-transitory computer readable storage medium of claim 13 , wherein the spoken utterance comprises a query or command and the response comprises a response to the query or command.
15 . The non-transitory computer readable storage medium of claim 14 , wherein the response comprises information indicated to be of interest in the query or command.
16 . The non-transitory computer readable storage medium of claim 13 , wherein in updating the text-response map, one or more of the processors are to remove one or more mappings from the text-response map.
17 . The non-transitory computer readable storage medium of claim 13 , wherein in causing the response to be implemented, one or more of the processors are to cause the client device to render the response.
18 . The non-transitory computer readable storage medium of claim 13 , wherein the response comprises a command and wherein in causing the response to be implemented, one or more of the processors are to cause the command to be provided to a smart device to alter a state of the smart device.