Visual and audio wake commands
A gesture-based wake process for an AR system is described herein. The AR system places a hand-tracking input pipeline of the AR system in a suspended mode. A camera component of the hand-tracking input pipeline detects a possible visual wake command being made by a user of the AR system. On the basis of detecting the possible visual wake command, the AR system wakes the hand-tracking input pipeline and places the camera component in a fully operational mode. If the AR system, using the hand-tracking input pipeline, verifies the possible visual wake command as an actual wake command, the AR system initiates execution of an AR application.
1 . A computer-implemented method comprising:
detecting, by one or more processors using a microphone component of an Augmented Reality (AR) system, a possible audio wake command by a user while the AR system is in a low power state;
waking, by the one or more processors, the AR system from the low power state to a fully powered mode in response to detecting the possible audio wake command;
verifying, by the one or more processors using a machine learning model, the possible audio wake command is an audio wake command; and
initiating, by the one or more processors, an interactive AR application in response to verifying the possible audio wake command is the audio wake command.
2 . The computer-implemented method of claim 1 , wherein the low power state comprises a suspended mode in which the one or more processors operate at a specified clock frequency.
3 . The computer-implemented method of claim 1 , wherein detecting the possible audio wake command further comprises:
recognizing the possible audio wake command using a neural network of the microphone component.
4 . The computer-implemented method of claim 1 , wherein the low power state comprises:
one or more components of the AR system being in a suspended mode; and
a camera component being in a limited operational mode.
5 . The method of claim 4 , wherein the limited operational mode of the camera component includes a limited frame rate.
6 . The method of claim 1 , further comprising:
performing, by the one or more processors, based on failing to verify the possible audio wake command, operations comprising:
placing one or more components of the AR system in a suspended mode; and
placing a camera component in a limited operational mode.
7 . The method of claim 1 , wherein the AR system comprises a head-worn device.
8 . A machine comprising:
at least one processor; and
at least one memory storing instructions that, when executed by the at least one processor, cause the machine to perform operations comprising:
detecting, by one or more processors using a microphone component of an Augmented Reality (AR) system, a possible audio wake command by a user while the AR system is in a low power state;
waking, by the one or more processors, the AR system from the low power state to a fully powered mode in response to detecting the possible audio wake command;
verifying, by the one or more processors using a machine learning model, the possible audio wake command is an audio wake command; and
initiating, by the one or more processors, an interactive AR application in response to verifying the possible audio wake command is the audio wake command.
9 . The machine of claim 8 , wherein the low power state comprises a suspended mode in which the one or more processors operate at a specified clock frequency.
10 . The machine of claim 8 , wherein detecting the possible audio wake command further comprises:
recognizing the possible audio wake command using a neural network of the microphone component.
11 . The machine of claim 8 , wherein the low power state comprises:
one or more components of the AR system being in a suspended mode; and
a camera component being in a limited operational mode.
12 . The machine of claim 11 , wherein the limited operational mode of the camera component includes a limited frame rate.
13 . The machine of claim 8 , wherein the operations further comprise:
performing, by the one or more processors, based on failing to verify the possible audio wake command, operations comprising:
placing one or more components of the AR system in a suspended mode; and
placing a camera component in a limited operational mode.
14 . The machine of claim 8 , wherein the AR system comprises a head-worn device.
15 . A machine-storage medium including instructions that, when executed by a machine, cause the machine to perform operations comprising:
detecting, by one or more processors using a microphone component of an Augmented Reality (AR) system, a possible audio wake command by a user while the AR system is in a low power state;
waking, by the one or more processors, the AR system from the low power state to a fully powered mode in response to detecting the possible audio wake command;
verifying, by the one or more processors using a machine learning model, the possible audio wake command is an audio wake command; and
initiating, by the one or more processors, an interactive AR application in response to verifying the possible audio wake command is the audio wake command.
16 . The machine-storage medium of claim 15 , wherein the low power state comprises a suspended mode in which the one or more processors operate at a specified clock frequency.
17 . The machine-storage medium of claim 15 , wherein detecting the possible audio wake command further comprises:
recognizing the possible audio wake command using a neural network of the microphone component.
18 . The machine-storage medium of claim 15 , wherein the low power state comprises:
one or more components of the AR system being in a suspended mode; and
a camera component being in a limited operational mode.
19 . The machine-storage medium of claim 18 , wherein the limited operational mode of the camera component includes a limited frame rate.
20 . The machine-storage medium of claim 15 , wherein the AR system comprises a head-worn device.