Adaptive management of casting requests and/or user inputs at a rechargeable device
Implementations set forth herein relate to management of casting requests and user inputs at a rechargeable device, which provides access to an automated assistant and is capable of rendering data that is cast from a separate device. Casting requests can be handled by the rechargeable device despite a device SoC of the rechargeable device operating in a sleep mode. Furthermore, spoken utterances provided by a user for invoking the automated assistant can also be adaptively managed by the rechargeable device in order mitigate idle power consumption by the device SoC. Such spoken utterances can be initially processed by a digital signal processor (DSP), and, based on one or more features (e.g., voice characteristic, conformity to a particular invocation phrase, etc.) of the spoken utterance, the device SoC can be initialized for an amount of time that is selected based on the features of the spoken utterance.
1. A method, comprising:
determining, by a processor of a computing device, that an input to a microphone of the computing device at least partially corresponds to an invocation phrase for invoking an automated assistant that is accessible via the computing device;
causing, by the processor and based on the input to the microphone, another processor of the computing device to transition from a sleep mode into an operating mode;
subsequent to the other processor transitioning from the sleep mode into the operating mode:
generating, by the other processor, first data that characterizes an audio output provided by the computing device via one or more speakers that are in communication with the computing device,
wherein the first data includes first time data that characterizes a time at which the other processor generated the first data;
determining, by the processor, that another input has been provided to the microphone of the computing device;
generating, by the processor, second data that characterizes the other input to the microphone of the computing device,
wherein the second data includes second time data that characterizes another time at which the processor generated the second data;
determining, by the other processor, a time offset between the time at which the other processor generated the first data and the other time at which the processor generated the second data;
processing, by the other processor, the second data using the time offset in furtherance of removing one or more features of the audio output provided by the one or more speakers;
determining, by the other processor and based on processing the second data using the time offset, whether the other input to the microphone corresponds to a spoken utterance to invoke the automated assistant that is accessible via the computing device; and
when the other input to the microphone is determined to correspond to the spoken utterance to invoke the automated assistant:
causing, by the other processor, the automated assistant to provide responsive output via an interface that is in communication with the computing device.
2. The method of claim 1 , wherein processing the second data using the time offset in furtherance of removing one or more features of the audio output includes performing an acoustic echo cancellation (AEC) process using the second data and the audio data.
3. The method of claim 1 , wherein the time offset corresponds to a difference in clock operating characteristics of a clock of the processor and another clock of the other processor.
4. The method of claim 3 , wherein the time offset is based on a difference between:
a first clock value determined using the clock, and
a second clock value determined using the other clock.
5. The method of claim 4 , wherein the first clock value and the second clock value are determined when the other processor is in the operating mode.
6. The method of claim 4 , wherein the time offset is determined by multiplying a ratio of differences between clock values by a time value corresponding to the other time.
7. The method of claim 1 , wherein the computing device includes one or more batteries that provide power to the processor and to the other processor when the other processor is operating according to the operating mode.
8. The method of claim 1 , wherein the processor is a digital signal processor (DSP) and the other processor is a device system on a chip (SoC).
9. A portable computing device, comprising:
one or more speakers;
a microphone;
a first processor operable to:
determine that an input to the microphone of the computing device at least partially corresponds to an invocation phrase for invoking an automated assistant that is accessible via the computing device;
cause, based on the input to the microphone, a second processor of the computing device to transition from a sleep mode into an operating mode;
a second processor operable to, subsequent to transitioning from the sleep mode into the operating mode:
generate first data that characterizes an audio output provided by the computing device via one or more speakers that are in communication with the computing device,
wherein the first data includes first time data that characterizes a time at which the other processor generated the first data;
the first processor further operable to:
determine that another input has been provided to the microphone of the computing device;
generate second data that characterizes the other input to the microphone of the computing device,
wherein the second data includes second time data that characterizes another time at which the processor generated the second data;
the second processor further operable to, subsequent to transitioning from the sleep mode into the operating mode:
determine a time offset between the time at which the second processor generated the first data and the other time at which the first processor generated the second data;
process the second data using the time offset in furtherance of removing one or more features of the audio output provided by the one or more speakers;
determine, based on processing the second data using the time offset, whether the other input to the microphone corresponds to a spoken utterance to invoke the automated assistant that is accessible via the computing device; and
when the other input to the microphone is determined to correspond to the spoken utterance to invoke the automated assistant:
cause the automated assistant to provide responsive output via an interface that is in communication with the computing device.
10. The portable computing device of claim 9 , wherein in processing the second data using the time offset in furtherance of removing one or more features of the audio output the second processor is to perform an acoustic echo cancellation (AEC) process using the second data and the audio data.
11. The portable computing device of claim 9 , wherein the time offset corresponds to a difference in clock operating characteristics of a first clock of the first processor and a second clock of the second processor.
12. The portable computing device of claim 11 , wherein the time offset is based on a difference between:
a first clock value determined using the first clock, and
a second clock value determined using the second clock.
13. The portable computing device of claim 12 , wherein the first clock value and the second clock value are determined when the second processor is in the operating mode.
14. The portable computing device of claim 12 , wherein the time offset is determined by multiplying a ratio of differences between clock values by a time value corresponding to the other time.
15. The portable computing device of claim 9 , further comprising one or more batteries that provide power to the first processor and to the second processor when the second processor is operating according to the operating mode.
16. The portable computing device of claim 9 , wherein the first processor is a digital signal processor (DSP) and the second processor is a device system on a chip (SoC).
17. One or more non-transitory computer-readable storage media comprising instructions, which, when executed cause:
determining, by a processor of a computing device, that an input to a microphone of the computing device at least partially corresponds to an invocation phrase for invoking an automated assistant that is accessible via the computing device;
causing, by the processor and based on the input to the microphone, another processor of the computing device to transition from a sleep mode into an operating mode;
subsequent to the other processor transitioning from the sleep mode into the operating mode:
generating, by the other processor, first data that characterizes an audio output provided by the computing device via one or more speakers that are in communication with the computing device,
wherein the first data includes first time data that characterizes a time at which the other processor generated the first data;
determining, by the processor, that another input has been provided to the microphone of the computing device;
generating, by the processor, second data that characterizes the other input to the microphone of the computing device,
wherein the second data includes second time data that characterizes another time at which the processor generated the second data;
determining, by the other processor, a time offset between the time at which the other processor generated the first data and the other time at which the processor generated the second data;
processing, by the other processor, the second data using the time offset in furtherance of removing one or more features of the audio output provided by the one or more speakers;
determining, by the other processor and based on processing the second data using the time offset, whether the other input to the microphone corresponds to a spoken utterance to invoke the automated assistant that is accessible via the computing device;
and when the other input to the microphone is determined to correspond to the spoken utterance to invoke the automated assistant:
causing, by the other processor, the automated assistant to provide responsive output via an interface that is in communication with the computing device.