Voice control user interface during low power mode
A method include placing a first processor in a sleep operating mode and running a second processor that is operative to wake the first processor from the sleep operating mode in response to a speech command phrase. The method includes identifying, by the second processor, a speech command phrase segment and performing a control operation in response to detecting the segment in detected speech. The control operation is performed while the first processor is maintained in the sleep operating mode.
1. A computer-implemented method comprising:
during operation of a mobile device in an awake mode providing full functionality of a voice recognition system of the mobile device:
determining, by data processing hardware of the mobile device, to operate the mobile device in a low-power mode;
in response to determining to operate the mobile device in the low-power mode and before entering the low-power mode, storing, in a frame buffer of the mobile device, a graphical user interface; and
operating, by the data processing hardware, the mobile device in the low-power mode by turning off a display of the mobile device and reducing the functionality of the voice recognition system of the mobile device; and
during operation of the mobile device in the low-power mode in which functionality of the voice recognition engine of the mobile device is reduced:
receiving, at the data processing hardware, an utterance of at least an initial portion of a predetermined command phrase, the predetermined command phrase comprising a series of multiple words configured to cause the mobile device to wake-up from the low-power mode in response to detecting each word of the series of multiple words in the utterance;
detecting, by the data processing hardware, the initial portion of the predetermined command phrase in the utterance; and
in response to detecting the initial portion of the predetermined command phrase in the utterance:
determining, by the data processing hardware, whether a remaining portion of the predetermined command phrase is detected in the utterance within a first predetermined period of time after detecting the initial portion of the predetermined command phrase in the utterance;
turning on, by the data processing hardware, the display of the mobile device; and
displaying, by the data processing hardware for output on the display, at least a portion of the graphical user interface that was stored in the frame buffer before the mobile device entered the low-power mode.
2. The method of claim 1 , further comprising, when the remaining portion of the predetermined command phrase is not detected in the utterance within the first predetermined period of time, automatically deactivating, by the data processing hardware, the display of the mobile device a second predetermined period of time after displaying the at least the portion of the graphical user interface for output on the display.
3. The method of claim 1 , wherein the low-power mode maintains applications running on the mobile device in an inactive state.
4. The method of claim 2 , further comprising, after deactivating the display:
receiving, at the data processing hardware, an additional utterance of the initial portion of the predetermined command phrase; and
in response to receiving the additional utterance of the initial portion of the predetermined command phrase:
turning on, by the data processing hardware, the display of the mobile device; and
displaying, by the data processing hardware for output on the display, the at least the portion of the graphical user interface that was stored in the frame buffer before the mobile device entered the low-power mode.
5. The method of claim 1 , wherein the graphical user interface stored in the frame buffer includes a user-selected background, a current time, and a battery level indicator.
6. The method of claim 5 , further comprising:
determining, by the data processing hardware, that an amount of power remaining in a battery of the mobile device is below a predetermined power level,
wherein the battery level indicator of the graphical user interface indicates that the amount of power remaining in the battery of the mobile device is below the predetermined power level.
7. A system comprising:
one or more computers of a mobile device and one or more storage devices of the mobile device storing instructions that are operable, when executed by the one or more computers, to cause the one or more computers to perform operations comprising:
during operation of the mobile device in an awake mode providing full functionality of a voice recognition system of the mobile device:
determining to operate the mobile device in a low-power mode;
in response to determining to operate the mobile device in the low-power mode and before entering the low-power mode, storing, in a frame buffer of the mobile device, a graphical user interface; and
operating the mobile device in the low-power mode by turning off a display of the mobile device and reducing the functionality of the voice recognition system of the mobile device; and
during operation of the mobile device in the low-power mode in which functionality of the voice recognition engine of the mobile device is reduced:
receiving an utterance of at least an initial portion of a predetermined command phrase, the predetermined command phrase comprising a series of multiple words configured to cause the mobile device to wake-up from the low-power mode in response to detecting each word of the series of multiple words in the utterance;
detecting the initial portion of the predetermined command phrase in the utterance; and
in response to detecting the initial portion of the predetermined command phrase in the utterance:
determining, by the data processing hardware, whether a remaining portion of the predetermined command phrase is detected in the utterance within a first predetermined period of time after detecting the initial portion of the predetermined command phrase in the utterance;
turning on the display of the mobile device; and
displaying, for output on the display, at least a portion of the graphical user interface that was stored in the frame buffer before the mobile device entered the low-power mode.
8. The system of claim 7 , wherein the operations further comprise, when the remaining portion of the predetermined command phrase is not detected in the utterance within the first predetermined period of time, automatically deactivating the display of the mobile device a second predetermined period of time after displaying the at least the portion of the graphical user interface for output on the display.
9. The system of claim 7 , wherein the low-power mode maintains applications running on the mobile device in an inactive state.
10. The system of claim 7 , wherein the operations further comprise, after deactivating the display:
receiving an additional utterance of the initial portion of the predetermined command phrase; and
in response to receiving the additional utterance of the initial portion of the predetermined command phrase:
turning on the display of the mobile device; and
displaying, for output on the display, the at least the portion of the graphical user interface that was stored in the frame buffer before the mobile device entered the low-power mode.
11. The system of claim 7 , wherein the graphical user interface stored in the frame buffer includes a user-selected background, a current time, and a battery level indicator.
12. The system of claim 11 , wherein the operations further comprise:
determining that an amount of power remaining in a battery of the mobile device is below a predetermined power level,
wherein the battery level indicator of the graphical user interface indicates that the amount of power remaining in the battery of the mobile device is below the predetermined power level.
13. A non-transitory computer-readable medium storing software comprising instructions executable by one or more computers which, upon such execution, cause the one or more computers to perform operations comprising:
during operation of a mobile device in an awake mode providing full functionality of a voice recognition system of the mobile device:
determining to operate the mobile device in a low-power mode;
in response to determining to operate the mobile device in the low-power mode and before entering the low-power mode, storing, in a frame buffer of the mobile device, a graphical user interface; and
operating the mobile device in the low-power mode by turning off a display of the mobile device and reducing the functionality of the voice recognition system of the mobile device; and
during operation of the mobile device in the low-power mode in which functionality of the voice recognition engine of the mobile device is reduced:
receiving an utterance of at least an initial portion of a predetermined command phrase, the predetermined command phrase comprising a series of multiple words configured to cause the mobile device to wake-up from the low-power mode in response to detecting each word of the series of multiple words in the utterance;
detecting the initial portion of the predetermined command phrase in the utterance; and
in response to detecting the initial portion of the predetermined command phrase in the utterance:
determining, by the data processing hardware, whether a remaining portion of the predetermined command phrase is detected in the utterance within a first predetermined period of time after detecting the initial portion of the predetermined command phrase in the utterance;
turning on the display of the mobile device; and
displaying, for output on the display, at least a portion of the graphical user interface that was stored in the frame buffer before the mobile device entered the low-power mode.
14. The non-transitory computer-readable medium of claim 13 , wherein the operations further comprise, when the remaining portion of the predetermined command phrase is not detected in the utterance within the first predetermined period of time, automatically deactivating the display of the mobile device a second predetermined period of time after displaying the at least the portion of the graphical user interface for output on the display.
15. The non-transitory computer-readable medium of claim 13 , wherein the low-power mode maintains applications running on the mobile device in an inactive state.
16. The non-transitory computer-readable medium of claim 13 , wherein the operations further comprise, after deactivating the display:
receiving an additional utterance of the initial portion of the predetermined command phrase; and
in response to receiving the additional utterance of the initial portion of the predetermined command phrase:
turning on the display of the mobile device; and
displaying, for output on the display, the at least the portion of the graphical user interface that was stored in the frame buffer before the mobile device entered the low-power mode.
17. The non-transitory computer-readable medium of claim 13 , wherein the graphical user interface stored in the frame buffer includes a user-selected background, a current time, and a battery level indicator.
18. The non-transitory computer-readable of claim 13 , wherein the operations further comprise:
determining that an amount of power remaining in a battery of the mobile device is below a predetermined power level,
wherein the battery level indicator of the graphical user interface indicates that the amount of power remaining in the battery of the mobile device is below the predetermined power level.