Low-power architecture for augmented reality device

1. A method comprising:

configuring a low-power mode to run on a low-power processor of an AR device using a first set of sensor data from a first set of sensors of the AR device, and a high-power mode to run on a high-power processor of the AR device using a second set of sensor data from a second set of sensors of the AR device;

operating, using the low-power processor, a low-power application in the low-power mode based on the first set of sensor data, wherein the low-power application is configured to: receive a notification of a new virtual content item based on a geographic location of the AR device, retrieve the new virtual content item, and store the new virtual content item in a memory of the AR device;

detecting a request to operate a high-power application at the AR device;

in response to detecting the request, activating the second set of sensors of the AR device corresponding to the high-power mode;

accessing the second set of sensor data from the second set of sensors with the high-power processor; and

operating, using the high-power processor, a high-power application in the high-power mode based on the second set of sensor data.

2. The method of claim 1 , wherein the low-power application comprises a low-power head up display (HUD) application configured to display virtual content items in a display of the AR device based on the first set of sensor data, the first set of sensor data being independent of a pose of the AR device,

wherein the high-power application comprises an AR application configured to display virtual content items in the display of the AR device based on the second set of sensor data, the second set of sensor data indicating the pose of the AR device based on tracking data from a six-degrees-of-freedom tracking system of the AR device.

3. The method of claim 1 , wherein the low-power application comprises a low-power navigation application configured to identify a tracking device that Title: LOW-POWER ARCHITECTURE FOR AUGMENTED REALITY DEVICE generates a beacon signal and to display a visual indicator based on the beacon signal in a display of the AR device using the low-power processor based on a magnetometer sensor at the AR device.

4. The method of claim 1 ,

wherein the high-power application is configured to: detect the new virtual content item based on the geographic location of the AR device using the second set of sensor data; and access the new virtual content item from a server or from the memory of the AR device.

5. The method of claim 1 , wherein the low-power application comprises a low-power gesture-based wakeup application using camera data from a low resolution camera of the AR device, wherein the low-power gesture-based wakeup application is configured to detect a hand gesture of a user of the AR device, wherein the low-power processor is configured to process the camera data and to operate a neural network to recognize a first set of hand gestures, and

wherein the high-power application comprises a high-power gesture-based application configured to recognize a second set of hand gestures using camera data from a higher resolution camera of the AR device using the high-power processor, the second set of hand gestures being larger than the first set of hand gestures.

6. The method of claim 1 , wherein the low-power application comprises a low-power audio application that is configured to generate audio based on audio data from a mobile device paired with the AR device; to record audio data from a microphone of the AR device; to detect a local voice command based on the audio data; to offload remote service voice command based on the audio data to the mobile device, and

wherein the high-power application comprises a high-power audio application that is configured to operate a local speech recognition engine with the high-power processor.

7. The method of claim 1 , wherein the low-power application comprises a low-power persistent application that is configured to maintain a wireless connection with a mobile device paired with the AR device and to provide data for processing using the mobile device, and

wherein the high-power application comprises a high-power non-persistent application that is configured to disconnect the AR device from the mobile device and to process data locally on the AR device.

8. The method of claim 1 , wherein further comprising:

detecting, with the low-power processor, a pre-defined trigger event corresponding to a high-power application; and

generating, with the low-power processor, the request to operate the high-power application to the high-power processor.

9. The method of claim 1 , wherein the low-power processor includes a MCU processor and the high-power processor includes a SoC processor.

10. The method of claim 1 , wherein the AR device is a head-wearable device.

11. A computing apparatus comprising:

a processor; and

a memory storing instructions that, when executed by the processor, configure the apparatus to:

configure a low-power mode to run on a low-power processor of an AR device using a first set of sensor data from a first set of sensors of the AR device, and a high-power mode to run on a high-power processor of the AR device using a second set of sensor data from a second set of sensors of the AR device;

operate, using the low-power processor, a low-power application in the low-power mode based on the first set of sensor data, wherein the low-power application is configured to: receive a notification of a new virtual content item based on a geographic location of the AR device, retrieve the new virtual content item, and store the new virtual content item in a memory of the AR device;

detect a request to operate a high-power application at the AR device;

in response to detecting the request, activate the second set of sensors of the AR device corresponding to the high-power mode;

access the second set of sensor data from the second set of sensors with the high-power processor; and

operate, using the high-power processor, a high-power application in the high-power mode based on the second set of sensor data.

12. The computing apparatus of claim 11 , wherein the low-power application comprises a low-power head up display (HUD) application configured to display virtual content items in a display of the AR device based on the first set of sensor data, the first set of sensor data being independent of a pose of the AR device,

wherein the high-power application comprises an AR application configured to display virtual content items in the display of the AR device based on the second set of sensor data, the second set of sensor data indicate the pose of the AR device based on tracking data from a six-degrees of freedom tracking system of the AR device.

13. The computing apparatus of claim 11 , wherein the low-power application comprises a low-power navigation application configured to identify a tracking device that generates a beacon signal and to display a visual indicator based on the beacon signal in a display of the AR device using the low-power processor based on a magnetometer sensor at the AR device.

14. The computing apparatus of claim 11 ,

wherein the high-power application comprises a high-power virtual object application that is configured to: detect the new virtual content item based on the geographic location of the AR device using the second set of sensor data; and access the new virtual content item from a server or from the memory of the AR device.

15. The computing apparatus of claim 11 , wherein the low-power application comprises a low-power gesture-based wakeup application using camera data from a low resolution camera of the AR device, wherein the low-power gesture-based wakeup application is configured to detect a hand gesture of a user of the AR device, wherein the low-power processor is configured to process the camera data and to operate a neural network to recognize a first set of hand gestures, and

wherein the high-power application comprises a high-power gesture-based application configured to recognize a second set of hand gestures using camera data from a higher resolution camera of the AR device using the high-power processor, the second set of hand gestures being larger than the first set of hand gestures.

16. The computing apparatus of claim 11 , wherein the low-power application comprises a low-power audio application that is configured to generate audio based on audio data from a mobile device paired with the AR device; to record audio data from a microphone of the AR device; to detect a local voice command based on the audio data; to offload remote service voice command based on the audio data to the mobile device, and

wherein the high-power application comprises a high-power audio application that is configured to operate a local speech recognition engine with the high-power processor.

17. The computing apparatus of claim 11 , wherein the low-power application comprises a low-power persistent application that is configured to maintain a wireless connection with a mobile device paired with the AR device and to provide data for processing using the mobile device, and

wherein the high-power application comprises a high-power non-persistent application that is configured to disconnect the AR device from the mobile device and to process data locally on the AR device.

18. The computing apparatus of claim 11 , wherein the instructions further configure the apparatus to:

detect, with the low-power processor, a pre-defined trigger event corresponding to a high-power application; and

generate, with the low-power processor, the request to operate the high-power application to the high-power processor.

19. The computing apparatus of claim 11 , wherein the low-power processor includes a MCU processor and the high-power processor includes a SoC processor.

20. A non-transitory computer-readable storage medium, the computer-readable storage medium including instructions that when executed by a computer, cause the computer to:

configure a low-power mode to run on a low-power processor of an AR device using a first set of sensor data from a first set of sensors of the AR device, and a high-power mode to run on a high-power processor of the AR device using a second set of sensor data from a second set of sensors of the AR device;

operate, using the low-power processor, a low-power application in the low-power mode based on the first set of sensor data, wherein the low-power application is configured to: receive a notification of a new virtual content item based on a geographic location of the AR device, retrieve the new virtual content item, and store the new virtual content item in a memory of the AR device;

detect a request to operate a high-power application at the AR device;

in response to detecting the request, activate the second set of sensors of the AR device corresponding to the high-power mode;

access the second set of sensor data from the second set of sensors with the high-power processor; and

operate, using the high-power processor, a high-power application in the high-power mode based on the second set of sensor data.