Visual and audio wake commands
A gesture-based wake process for an AR system is described herein. The AR system places a hand-tracking input pipeline of the AR system in a suspended mode. A camera component of the hand-tracking input pipeline detects a possible visual wake command being made by a user of the AR system. On the basis of detecting the possible visual wake command, the AR system wakes the hand-tracking input pipeline and places the camera component in a fully operational mode. If the AR system, using the hand-tracking input pipeline, verifies the possible visual wake command as an actual wake command, the AR system initiates execution of an AR application.
1. A computer-implemented method comprising:
detecting, by one or more processors using a camera component of an Augmented Reality (AR) system, a possible wake gesture performed by a user while the AR system is in a low power state;
waking, by the one or more processors, the AR system from the low power state to an active state in response to detecting the possible wake gesture;
analyzing, by the one or more processors, the possible wake gesture using a machine learning model to verify the possible wake gesture is a predefined wake gesture; and
initiating, by the one or more processors, an interactive AR application in response to verifying the possible wake gesture is the predefined wake gesture.
2. The computer-implemented method of claim 1 , wherein the low power state comprises a suspended mode in which the one or more processors operate at a specified clock frequency.
3. The computer-implemented method of claim 1 , wherein detecting the possible wake gesture further comprises:
recognizing the possible wake gesture using a neural network of the camera component.
4. The computer-implemented method of claim 1 , wherein the low power state comprises:
one or more components of the AR system being in a suspended mode; and
the camera component being in a limited operational mode.
5. The method of claim 4 , wherein the limited operational mode of the camera component includes a limited frame rate.
6. The method of claim 1 , further comprising:
performing, by the one or more processors, on the basis of failing to verify the possible wake gesture, operations comprising:
placing one or more components of the AR system in a suspended mode; and
placing the camera component in a limited operational mode.
7. The method of claim 1 , wherein the AR system comprises a head-worn device.
8. A machine comprising:
one or more processors; and
a memory storing instructions that, when executed by the one or more processors, cause the machine to perform operations comprising:
detecting, using a camera component of an Augmented Reality (AR) system, a possible wake gesture performed by a user while the AR system is in a low power state;
waking the AR system from the low power state to an active state in response to detecting the possible wake gesture;
analyzing the possible wake gesture using a machine learning model to verify the possible wake gesture is a predefined wake gesture; and
initiating an interactive AR application in response to verifying the possible wake gesture is the predefined wake gesture.
9. The machine of claim 8 , wherein the low power state comprises a suspended mode in which one or more processors of the AR system operate at a specified clock frequency.
10. The machine of claim 8 , wherein detecting the possible wake gesture further comprises:
recognizing the possible wake gesture using a neural network of the camera component.
11. The machine of claim 8 , wherein the low power state comprises:
one or more components of the AR system being in a suspended mode; and
the camera component being in a limited operational mode.
12. The machine of claim 11 , wherein the limited operational mode of the camera component includes a limited frame rate.
13. The machine of claim 8 , wherein the operations further comprise:
performing on the basis of failing to verify the possible visual wake gesture, operations comprising:
placing one or more components of the AR system in a suspended mode; and
placing the camera component in a limited operational mode.
14. The machine of claim 8 , wherein the AR system comprises a head-worn device.
15. A machine-storage medium storing instructions that when executed by a machine, cause the machine to perform operations comprising:
detecting, using a camera component of an Augmented Reality (AR) system, a possible wake gesture performed by a user while the AR system is in a low power state;
waking the AR system from the low power state to an active state in response to detecting the possible wake gesture;
analyzing the possible wake gesture using a machine learning model to verify the possible wake gesture is a predefined wake gesture; and
initiating an interactive AR application in response to verifying the possible wake gesture is the predefined wake gesture.
16. The machine-storage medium of claim 15 , wherein the low power state comprises a suspended mode in which one or more processors of the AR system operate at a specified clock frequency.
17. The machine-storage medium of claim 15 , wherein detecting the possible wake gesture further comprises:
recognizing the possible wake gesture using a neural network of the camera component.
18. The machine-storage medium of claim 15 , wherein the low power state comprises:
one or more components of the AR system being in a suspended mode; and
the camera component being in a limited operational mode.
19. The machine-storage medium of claim 18 , wherein the limited operational mode of the camera component includes a limited frame rate.
20. The machine-storage medium of claim 15 , wherein the AR system comprises a head-worn device.