Enhanced reading with AR glasses
Systems, methods, and computer readable media for enhanced augmented reality (AR) reading are provided, where the methods include entering a reading mode, capturing an image of a section of reading materials such as a page of a book, identifying a code within the image, and identifying a code module corresponding to the code. The methods further include executing the code module, the code module providing an augmented reality object or virtual reality object related to an object depicted on the section or page, entering a sleep mode for a sleep duration based on an estimated reading time duration of a section or page, awaking after the sleep duration, and capturing a next image. The sleep duration is adjusted based on times when identifiers of the sections of the reading materials such as numbers are captured. The user may manually wake the AR reading device using an external user interface.
1. A method performed on a augmented reality (AR) wearable electronic device, the method comprising:
entering a reading mode;
capturing a first image of a section of reading material;
identifying a code within the first image;
identifying a code module corresponding to the code, the code module comprising content corresponding to the section of the reading material;
executing the code module, the code module providing an augmented reality object related to an object depicted on the section of the reading material;
entering a sleep mode for a sleep duration, the sleep duration based on an estimated reading time duration of the section of the reading material;
reentering the reading mode after the sleep duration; and
capturing a second image.
2. The method of claim 1 wherein the section is a page and the reading material is a book.
3. The method of claim 1 wherein entering the sleep mode comprises:
causing wireless communication processing circuitry of the AR wearable electronic device to enter a low-energy consumption mode;
causing camera hardware of the AR wearable electronic device to enter a low-energy consumption mode; and
causing display hardware of the AR wearable electronic device to enter a low-energy consumption mode.
4. The method of claim 1 wherein entering the book reading mode comprises:
refraining from turning on display hardware unless the code is identified or a physical user interface item is selected.
5. The method of claim 1 wherein the section is a first page and wherein the method further comprises:
identifying a second page within the second image; and
reentering the sleep mode when the first page and the second page are a same page.
6. The method of claim 1 further comprising:
retrieving the code module from a backend server via a low-energy wireless communications protocol.
7. The method of claim 1 further comprising:
in response to the code identifying the reading material, retrieving a plurality of code modules including the code module from a backend server via wireless communication processing circuitry, the plurality of code modules corresponding to a plurality of codes contained within the reading material;
powering down the wireless communication processing circuitry; and
in response to leaving the reading mode or detecting a new reading material, powering up the wireless communication processing circuitry.
8. The method of claim 1 wherein the sleep duration is from one second to one-hundred and twenty seconds.
9. The method of claim 1 wherein the page is a first page and wherein the method further comprises:
identifying a second page within the second image;
increasing the sleep duration when the first page and the second page are a same page; and
decreasing the sleep duration when the first page and the second page are different pages.
10. The method of claim 8 wherein the sleep duration is increased or decreased by a fraction of a second.
11. The method of claim 1 further comprising:
storing a number of the section with a time in a user data storage on the VR wearable electronic device; and
adjusting the sleep duration based on a plurality of numbers of sections of the reading material associated with a plurality of times.
12. The method of claim 1 further comprising:
determining the second image is of a different piece of reading material; and
exiting the reading mode.
13. The method of claim 1 wherein entering the sleep mode further comprises:
in response to a hand gesture by a wearer of the AR wearable electronic device, entering the sleep mode for the sleep duration, the sleep duration based on a reading time duration of the page of the book.
14. The method of claim 1 further comprising:
refraining from displaying user interface items for invoking functions of the AR wearable electronic device outside of the reading mode, during the executing the code module.
15. The method of claim 1 wherein the AR wearable electronic device is a mixed reality wearable electronic device.
16. An augmented reality (AR) wearable electronic device comprising:
one or more processors; and
one or more memories storing instructions that, when executed by the one or more processors, configure the VR wearable electronic device to perform operations comprising:
entering a reading mode;
capturing a first image of a section of reading material;
identifying a code within the first image;
identifying a code module corresponding to the code, the code module comprising content corresponding to the section of the reading material;
executing the code module, the code module providing an augmented reality object related to an object depicted on the section of the reading material;
entering a sleep mode for a sleep duration, the sleep duration based on an estimated reading time duration of the section of the reading material;
reentering the reading mode after the sleep duration; and
capturing a second image.
17. The AR wearable electronic device of claim 16 wherein the section is a page and the reading material is a book.
18. The AR wearable electronic device of claim 16 wherein entering the sleep mode comprises:
causing wireless communication processing circuitry of the AR wearable electronic device to enter a low-energy consumption mode;
causing camera hardware of the AR wearable electronic device to enter a low-energy consumption mode; and
causing display hardware of the AR wearable electronic device to enter a low-energy consumption mode.
19. A non-transitory computer-readable storage medium, the computer-readable storage medium including instructions that when executed by a virtual reality (VR) or augmented reality (AR) wearable electronic device, cause the VR wearable electronic device to perform operations comprising:
entering a reading mode;
capturing a first image of a section of reading material;
identifying a code within the first image;
identifying a code module corresponding to the code, the code module comprising content corresponding to the section of the reading material;
executing the code module, the code module providing a virtual reality or augmented reality object related to an object depicted on the section of the reading material;
entering a sleep mode for a sleep duration, the sleep duration based on an estimated reading time duration of the section of the reading material;
reentering the reading mode after the sleep duration; and
capturing a second image.
20. The non-transitory computer-readable storage medium of claim 1 wherein the section is a page and the reading material is a book, and wherein wherein entering the sleep mode comprises:
causing wireless communication processing circuitry of the AR wearable electronic device to enter a low-energy consumption mode;
causing camera hardware of the AR wearable electronic device to enter a low-energy consumption mode; and
causing display hardware of the AR wearable electronic device to enter a low-energy consumption mode.