Pausing device operation based on facial movement
Systems and methods herein describe pausing operation of an augmented reality device based on user facial movement by monitoring user eye movement of a user of a head-wearable apparatus, determining that the user eye movement is directionally facing away from a display device coupled to the head-wearable apparatus, based on the determination, pausing operation of one or more sensors of the head-wearable apparatus.
1 . A method comprising:
monitoring, by a processor, user eye movement of a user of a head-wearable apparatus;
determining that the user eye movement is directionally facing away from a display device coupled to the head-wearable apparatus using a backwards facing camera coupled to the head-wearable apparatus;
based on the determination by the backwards facing camera that the user eye movement is directionally facing away from the display device, automatically pausing operation of a graphics processing unit (GPU) and a front-facing camera coupled to the head-wearable apparatus;
while the GPU and the front-facing camera are paused, continuing the monitoring of the user eye movement using the backwards facing camera;
detecting that the user eye movement has returned to directionally face towards the display device; and
in response to detecting that the user eye movement has returned to directionally face towards the display device, automatically resuming operation of the GPU and the front-facing camera.
2 . The method of claim 1 , wherein monitoring the user eye movement comprises:
capturing the user eye movement using the backwards facing camera coupled to the head-wearable apparatus.
3 . The method of claim 1 , wherein monitoring the eye movement comprises:
detecting a reflection of infrared light from the user's eye using the backwards facing camera, the backwards facing camera being an infrared camera coupled to the head-wearable apparatus.
4 . The method of claim 1 , further comprising:
pausing operation of one or more sensors of the head-wearable apparatus, wherein the one or more sensors comprise a motion sensor, a rotation sensor, an orientation sensor, a position sensor, or any combination thereof.
5 . The method of claim 1 , wherein the front-facing camera is facing away from the user of the head-wearable apparatus, the front-facing camera coupled to the head-wearable apparatus.
6 . The method of claim 1 , wherein determining the user eye movement is directionally facing away from the display device further comprises:
receiving data from the backwards facing camera facing the user of the head-wearable apparatus, the data comprising an indication that the user is not facing the display device.
7 . The method of claim 1 , further comprising:
causing display of an augmented reality content item on the display device;
determining that the user eye movement is directionally facing towards the display device; and
modifying the augmented reality content item being displayed on the display device.
8 . A computing system comprising:
a processor; and
a memory storing instructions that, when executed by the processor, configure the system to perform operations comprising:
monitoring user eye movement of a user of a head-wearable apparatus;
determining that the user eye movement is directionally facing away from a display device coupled to the head-wearable apparatus using a backwards facing camera coupled to the head-wearable apparatus;
based on the determination by the backwards facing camera that the user eye movement is directionally facing away from the display device, automatically pausing operation of a graphics processing unit (GPU) and a front-facing camera coupled to the head-wearable apparatus;
while the GPU and the front-facing camera are paused, continuing to the monitoring of the user eye movement using the backwards facing camera;
detecting that the user eye movement has returned to directionally face towards the display device; and
in response to detecting that the user eye movement has returned to directionally face towards the display device, automatically resuming operation of the GPU and the front-facing camera.
9 . The computing system of claim 8 , wherein monitoring the user eye movement comprises:
capturing the user eye movement using the backwards facing camera coupled to the head-wearable apparatus.
10 . The computing system of claim 8 , wherein monitoring the eye movement comprises:
detecting a reflection of infrared light from the user's eye using the backwards facing camera, the backwards facing camera being an infrared camera coupled to the head-wearable apparatus.
11 . The computing system of claim 8 , the operations further comprising:
pausing operation of one or more sensors of the head-wearable apparatus, wherein the one or more sensors comprise a motion sensor, a rotation sensor, an orientation sensor, a position sensor, or any combination thereof.
12 . The computing system of claim 8 , wherein the front-facing camera is facing away from the user of the head-wearable apparatus, the front-facing camera coupled to the head-wearable apparatus.
13 . The computing system of claim 8 , wherein determining the user eye movement is directionally facing away from the display device further comprises:
receiving data from the backwards facing camera facing the user of the head-wearable apparatus, the data comprising an indication that the user is not facing the display device.
14 . The computing system of claim 8 , further comprising:
causing display of an augmented reality content item on the display device;
determining that the user eye movement is directionally facing towards the display device; and
modifying the augmented reality content item being displayed on the display device.
15 . A non-transitory computer-readable storage medium, the computer-readable storage medium including instructions that when executed by a computer, cause the computer to perform operations comprising:
monitoring user eye movement of a user of a head-wearable apparatus;
determining that the user eye movement is directionally facing away from a display device coupled to the head-wearable apparatus using a backwards facing camera coupled to the head-wearable apparatus;
based on the determination by the backwards facing camera that the user eye movement is directionally facing away from the display device, automatically pausing operation of a graphics processing unit (GPU) and a front-facing camera coupled to the head-wearable apparatus;
while the GPU and the front-facing camera are paused, continuing to the monitoring of the user eye movement using the backwards facing camera;
detecting that the user eye movement has returned to directionally face towards the display device; and
in response to detecting that the user eye movement has returned to directionally face towards the display device, automatically resuming operation of the GPU and the front-facing camera.
16 . The computer-readable storage medium of claim 15 , wherein monitoring the user eye movement comprises:
capturing the user eye movement using the backwards facing camera coupled to the head-wearable apparatus.
17 . The computer-readable storage medium of claim 15 , wherein monitoring the eye movement comprises:
detecting a reflection of infrared light from the user's eye using the backwards facing camera, the backwards facing camera being an infrared camera coupled to the head-wearable apparatus.
18 . The computer-readable storage medium of claim 15 , the operations further comprising:
pausing operation of one or more sensors of the head-wearable apparatus, wherein the one or more sensors comprise a motion sensor, a rotation sensor, an orientation sensor, a position sensor, or any combination thereof.
19 . The computer-readable storage medium of claim 15 , wherein the front-facing camera is facing away from the user of the head-wearable apparatus, the front-facing camera coupled to the head-wearable apparatus.
20 . The computer-readable storage medium of claim 15 , wherein determining the user eye movement is directionally facing away from the display device further comprises:
receiving data from the backwards facing camera facing the user of the head-wearable apparatus, the data comprising an indication that the user is not facing the display device.