Visual and audio wake commands
A gesture-based wake process for an AR system is described herein. The AR system places a hand-tracking input pipeline of the AR system in a suspended mode. A camera component of the hand-tracking input pipeline detects a possible visual wake command being made by a user of the AR system. On the basis of detecting the possible visual wake command, the AR system wakes the hand-tracking input pipeline and places the camera component in a fully operational mode. If the AR system, using the hand-tracking input pipeline, verifies the possible visual wake command as an actual wake command, the AR system initiates execution of an AR application.
1. A computer-implemented method comprising:
placing, by one or more processors of an Augmented Reality (AR) system, a hand-tracking input pipeline of the AR system in a suspended mode;
detecting, using a camera component of the hand-tracking input pipeline, a possible visual wake command being made by a user of the AR system;
performing, by the one or more processors, on the basis of detecting the possible visual wake command, operations comprising:
waking the hand-tracking input pipeline; and
placing the camera component in a fully operational mode;
verifying, by the one or more processors, using the hand-tracking input pipeline, the possible visual wake command as a visual wake command; and
initiating, by the one or more processors, on the basis of verifying the possible visual wake command, an AR application of the AR system.
2. The method of claim 1 , wherein the possible visual wake command and the visual wake command are a same gesture being made by the user.
3. The method of claim 1 , wherein detecting the possible visual wake command further comprises:
recognizing the possible visual wake command using a neural network of the camera component.
4. The method of claim 1 , wherein placing the hand-tracking input pipeline in the suspended mode further comprises:
placing, by the one or more processors, one or more components of the hand-tracking input pipeline in a suspended mode; and
placing, by the one or more processors, the camera component in a limited operational mode.
5. The method of claim 4 , wherein the limited operational mode of the camera component includes a limited frame rate.
6. The method of claim 1 , further comprising:
performing, by the one or more processors, on the basis of failing to verify the possible visual wake command is the visual wake command, operations comprising:
placing one or more components of the hand-tracking input pipeline in the suspended mode; and
placing the camera component in a limited operational mode.
7. The method of claim 1 , wherein the AR system comprises a head-worn device.
8. A computing apparatus comprising:
one or more processors; and
a memory storing instructions that, when executed by the one or more processors, cause the computing apparatus to perform operations comprising:
placing a hand-tracking input pipeline of an AR system in a suspended mode;
detecting, using a camera component of the hand-tracking input pipeline, a possible visual wake command being made by a user of the AR system;
performing, on the basis of detecting the possible visual wake command, operations comprising:
waking the hand-tracking input pipeline; and
placing the camera component in a fully operational mode;
verifying, using the hand-tracking input pipeline, the possible visual wake command as a visual wake command; and
initiating, on the basis of verifying the possible visual wake command, an AR application of the AR system.
9. The computing apparatus of claim 8 , wherein the possible visual wake command and the visual wake command are a same gesture being made by the user.
10. The computing apparatus of claim 8 , wherein the camera component recognizes the possible visual wake command using a neural network of the camera component.
11. The computing apparatus of claim 8 , wherein the instructions further causing the computing apparatus to perform operations of placing the hand-tracking input pipeline in the suspended mode further cause the computing apparatus to perform operations comprising:
placing one or more components of the hand-tracking input pipeline in a suspended mode; and
placing the camera component in a limited operational mode.
12. The computing apparatus of claim 11 , wherein the limited operational mode of the camera component includes a limited frame rate.
13. The computing apparatus of claim 8 , wherein the instructions further cause the computing apparatus to perform, on the basis of failing to verify the possible visual wake command is the visual wake command, operations comprising:
placing one or more components of the hand-tracking input pipeline in the suspended mode; and
placing the camera component in a limited operational mode.
14. The computing apparatus of claim 8 , wherein the AR system comprises a head-worn device.
15. A non-transitory computer-readable storage medium, the computer-readable storage medium including instructions that when executed by a computer, cause the computer to perform operations comprising:
placing, by one or more processors of an AR system, a hand-tracking input pipeline of the AR system in a suspended mode;
detecting, by a camera component of the hand-tracking input pipeline, a possible visual wake command being made by a user of the AR system;
performing, by the one or more processors, on the basis of detecting the possible visual wake command, operations comprising:
waking the hand-tracking input pipeline; and
placing the camera component in a fully operational mode;
verifying, by the one or more processors, using the hand-tracking input pipeline, the possible visual wake command as a visual wake command; and
initiating, by the one or more processors, on the basis of verifying the possible visual wake command, an AR application of the AR system.
16. The non-transitory computer-readable storage medium of claim 15 , wherein the possible visual wake command and the visual wake command are a same gesture being made by the user.
17. The non-transitory computer-readable storage medium of claim 15 , wherein detecting the possible visual wake command further comprises:
recognizing the possible visual wake command using a neural network of the camera component.
18. The non-transitory computer-readable storage medium of claim 15 , wherein placing the hand-tracking input pipeline in the suspended mode further comprises:
placing, by the one or more processors, one or more components of the hand-tracking input pipeline in a suspended mode; and
placing, by the one or more processors, the camera component in a limited operational mode.
19. The non-transitory computer-readable storage medium of claim 18 , wherein the limited operational mode of the camera component includes a limited frame rate.
20. The non-transitory computer-readable storage medium of claim 15 , wherein the instructions further configure the computer to perform operations comprising:
performing, by the one or more processors, on the basis of failing to verify the possible visual wake command is the visual wake command, operations comprising:
placing one or more components of the hand-tracking input pipeline in the suspended mode; and
placing the camera component in a limited operational mode.
21. The non-transitory computer-readable storage medium of claim 15 , wherein the AR system comprises a head-worn device.