Digital Signal Processor-Based Continued Conversation

1 . A computer-implemented method when executed on data processing hardware causes the data processing hardware to perform operations comprising:

based on providing a response to an initial query for output from an assistant-enabled device, instructing an always-on first processor of the data processing hardware to operate in a follow-on query detection mode and an active second processor of the data processing hardware to return to a sleep state; and

while the always-on first processor operates in the follow-on query detection mode:

receiving follow-on audio data captured by the assistant-enabled device;

performing, using a speaker identification (SID) model executing on the always-on first processor, speaker verification on the follow-on audio data to determine the follow-on audio data comprises an utterance spoken by a same user that submitted the initial query to a digital assistant; and

based on the follow-on audio data comprising the utterance spoken by the same user that spoke the initial query, initiating a wake-up process on the second processor to determine whether the utterance comprises a follow-on query directed toward the digital assistant.

2 . The method of claim 1 , wherein the follow-on audio data does not include a hotword.

3 . The method of claim 1 , wherein the data processing hardware resides on the assistant-enabled device.

4 . The method of claim 1 , wherein instructing the always-on first processor of the data processing hardware to operate in the follow-on query detection mode causes the always-on first processor to initiate execution of the SID model on the always-on first processor during operation in the follow-on query detection model.

5 . The method of claim 1 , wherein instructing the always-on first processor of the data processing hardware to operate in the follow-on query detection mode causes the always-on first processor to disable a hotword detection model during operation in the follow-on query detection mode.

6 . The method of claim 1 , wherein initiating the wake-up process on the second processor causes the second processor to perform operations comprising:

processing the follow-on audio data to generate a transcription of the utterance spoken by the same user that submitted the initial query; and

performing query interpretation on the transcription to determine whether or not the utterance comprises the follow-on query directed toward the digital assistant.

7 . The method of claim 6 , wherein the operations further comprise, when the utterance comprises the follow-on query directed toward the digital assistant:

instructing the digital assistant to perform an operation specified by the follow-on query;

receiving, from the digital assistant, a follow-on response indicating performance of the operation specified by the follow-on query; and

presenting, for output from the assistant-enabled device, the follow-on response.

8 . The method of claim 1 , wherein initiating the wake-up process on the second processor causes the second processor to transmit the follow-on audio data to a remote server via a network, the follow-on audio data when received by the remote server causing the remote server to perform operations comprising:

processing the follow-on audio data to generate a transcription of the utterance spoken by the same user that submitted the initial query;

performing query interpretation on the transcription to determine whether or not the utterance comprises the follow-on query directed toward the digital assistant; and

when the utterance comprises the follow-on query directed toward the digital assistant, instructing the digital assistant to perform an operation specified by the follow-on query.

9 . The method of claim 8 , wherein the operations further comprise, after instructing the digital assistant to perform the operation specified by the follow-on query:

receiving, from the digital assistant, a follow-on response indicating performance of the operation specified by the follow-on query; and

presenting, for output from the assistant-enabled device, the follow-on response.

10 . The method of claim 1 , wherein:

the always-on first processor comprises a digital signal processor (DSP); and

the second processor comprises an application processor.

11 . A system comprising:

data processing hardware; and

memory hardware in communication with the data processing hardware and storing instructions that when executed on the data processing hardware cause the data processing hardware to perform operations comprising:

based on providing a response to an initial query for output from an assistant-enabled device, instructing an always-on first processor of the data processing hardware to operate in a follow-on query detection mode and an active second processor of the data processing hardware to return to a sleep state; and

while the always-on first processor operates in the follow-on query detection mode:

receiving follow-on audio data captured by the assistant-enabled device;

performing, using a speaker identification (SID) model executing on the always-on first processor, speaker verification on the follow-on audio data to determine the follow-on audio data comprises an utterance spoken by a same user that submitted the initial query to a digital assistant; and

based on the follow-on audio data comprising the utterance spoken by the same user that spoke the initial query, initiating a wake-up process on the second processor to determine whether the utterance comprises a follow-on query directed toward the digital assistant.

12 . The system of claim 11 , wherein the follow-on audio data does not include a hotword.

13 . The system of claim 11 , wherein the data processing hardware resides on the assistant-enabled device.

14 . The system of claim 11 , wherein instructing the always-on first processor of the data processing hardware to operate in the follow-on query detection mode causes the always-on first processor to initiate execution of the SID model on the always-on first processor during operation in the follow-on query detection model.

15 . The system of claim 11 , wherein instructing the always-on first processor of the data processing hardware to operate in the follow-on query detection mode causes the always-on first processor to disable a hotword detection model during operation in the follow-on query detection mode.

16 . The system of claim 11 , wherein initiating the wake-up process on the second processor causes the second processor to perform operations comprising:

processing the follow-on audio data to generate a transcription of the utterance spoken by the same user that submitted the initial query; and

performing query interpretation on the transcription to determine whether or not the utterance comprises the follow-on query directed toward the digital assistant.

17 . The system of claim 16 , wherein the operations further comprise, when the utterance comprises the follow-on query directed toward the digital assistant:

instructing the digital assistant to perform an operation specified by the follow-on query;

receiving, from the digital assistant, a follow-on response indicating performance of the operation specified by the follow-on query; and

presenting, for output from the assistant-enabled device, the follow-on response.

18 . The system of claim 11 , wherein initiating the wake-up process on the second processor causes the second processor to transmit the follow-on audio data to a remote server via a network, the follow-on audio data when received by the remote server causing the remote server to perform operations comprising:

processing the follow-on audio data to generate a transcription of the utterance spoken by the same user that submitted the initial query;

performing query interpretation on the transcription to determine whether or not the utterance comprises the follow-on query directed toward the digital assistant; and

when the utterance comprises the follow-on query directed toward the digital assistant, instructing the digital assistant to perform an operation specified by the follow-on query.

19 . The system of claim 18 , wherein the operations further comprise, after instructing the digital assistant to perform the operation specified by the follow-on query:

receiving, from the digital assistant, a follow-on response indicating performance of the operation specified by the follow-on query; and

presenting, for output from the assistant-enabled device, the follow-on response.

20 . The system of claim 11 , wherein:

the always-on first processor comprises a digital signal processor (DSP); and

the second processor comprises an application processor.