Systems and methods for augmented reality
Methods and systems for triggering presentation of virtual content based on sensor information. The display system may be an augmented reality display system configured to provide virtual content on a plurality of depth planes using different wavefront divergences. The system may monitor information detected via the sensors, and based on the monitored information, trigger access to virtual content identified in the sensor information. Virtual content can be obtained, and presented as augmented reality content via the display system. The system may monitor information detected via the sensors to identify a QR code, or a presence of a wireless beacon. The QR code or wireless beacon can trigger the display system to obtain virtual content for presentation.
1. A display system comprising:
a head-mounted augmented reality display device configured to be worn by a user, and configured to present virtual content to the user;
one or more sensors; and
one or more processors, and computer storage media storing instructions that when executed by the display system, cause the display system to perform operations comprising:
obtaining information, detected via the sensors of the system, identifying an optical code within a field of view of the display system or a wireless transmitter proximate to the display system, wherein the optical code indicates an address of a server from which virtual content to be presented via the system can be obtained, a trigger for presenting the virtual content, and a specific depth from the user at which the virtual content is to be presented in focus;
accessing user profile information associated with the user, the user profile information including customized settings associated with presentation of virtual content;
obtaining, based on the address of the server indicated by the optical code and wireless transmitter, the virtual content to be presented via the system, the virtual content being presented as augmented reality content visible within an ambient environment wherein the virtual content is indicated as being allowable for presentation based on the customized settings;
identifying satisfaction of the trigger indicated by the optical code by identifying that a particular visual feature is within a field of view of the display system, wherein the particular visual feature is different from the user; and
in response to the identifying satisfaction of the trigger, presenting, via the head-mounted augmented reality display device, the virtual content in focus at the specific depth from the user indicated by the optical code in accordance with the customized settings.
2. The display system of claim 1 , wherein the optical code or wireless transmitter is associated with access to virtual content.
3. The display system of claim 2 , wherein the virtual content is obtained from a server system or from internal storage.
4. The display system of claim 1 , wherein the display system is configured to present virtual content on a plurality of depth planes.
5. The display system of claim 4 , wherein a particular depth plane is selected based on a distance associated with the optical code or wireless transmitter.
6. The display system of claim 1 , wherein the optical code is a QR code, wherein the QR code triggers access to virtual content, and wherein operations further comprise:
identifying, based on images obtained via a camera, the QR code; and
determining identifications of one or more network locations encoded in the QR code, wherein the network locations store the virtual content.
7. The display system of claim 1 , wherein the head-mounted augmented reality display device comprises:
a plurality of stacked waveguides forming a display area and providing a view of an ambient environment through the display area, wherein at least some waveguides of the plurality of stacked waveguides are configured to output light with different wavefront divergence than other waveguides, each waveguide being associated with a depth plane at which virtual content appears in focus.
8. The display system of claim 1 , wherein the customized settings are set by the user.
9. The display system of claim 1 , wherein the ambient environment includes a real-world object which is detectable by the processors via the sensors and is associated with the virtual content.
10. The display system of claim 9 , wherein the real-world object is configured as an input device.
11. The display system of claim 1 , wherein the particular visual feature is a portion of a room or a particular object.
12. A method implemented by a display system configured to be worn by a user, and configured to present virtual content to the user, wherein the method comprises:
obtaining sensor information identifying an optical code within a field of view of the display system or a wireless transmitter proximate to the display system, wherein the optical code indicates an address of a server from which virtual content to be presented via the system can be obtained, a trigger for presenting the virtual content, and a specific depth from the user at which the virtual content is to be presented in focus;
accessing user profile information associated with the user, the user profile information including customized settings associated with presentation of virtual content;
obtaining, based on the address of the server indicated by the optical code and wireless transmitter, the virtual content to be presented via the system, the virtual content being presented as augmented reality content visible within an ambient environment wherein the virtual content is indicated as being allowable for presentation based on the customized settings;
identifying satisfaction of the trigger indicated by the optical code by identifying that a particular visual feature is within a field of view of the display system, wherein the particular visual feature is different from the user; and
in response to the identifying satisfaction of the trigger, presenting the virtual content in focus at the specific depth from the user indicated by the optical code in accordance with the customized settings.
13. The method of claim 12 , wherein the customized settings are set by the user.
14. The method of claim 12 , wherein the ambient environment includes a real-world object which is detectable by the display system and is associated with the virtual content, and wherein the real-world object is configured as an input device.
15. The method of claim 12 , wherein the particular visual feature is a portion of a room or a particular object.
16. Non-transitory computer storage media storing instructions configured for execution by a display system of one or more processors, wherein the display system is configured to be worn by a user and configured to present virtual content to the user, and wherein the instructions, when executed by the display system, cause the display system to perform operations comprising:
obtaining information, detected via sensors of the display system, identifying an optical code within a field of view of the display system or a wireless transmitter proximate to the display system, wherein the optical code indicates an address of a server from which virtual content to be presented via the system can be obtained, a trigger for presenting the virtual content, and a specific depth from the user at which the virtual content is to be presented in focus;
accessing user profile information associated with the user, the user profile information including customized settings associated with presentation of virtual content;
obtaining, based on the address of the server indicated by the optical code and wireless transmitter, the virtual content to be presented via the system, the virtual content being presented as augmented reality content visible within an ambient environment wherein the virtual content is indicated as being allowable for presentation based on the customized settings; and
identifying satisfaction of the trigger indicated by the optical code by identifying that a particular visual feature is within a field of view of the display system, wherein the particular visual feature is different from the user; and
in response to the identifying satisfaction of the trigger, presenting, via the display system, the virtual content in focus at the specific depth from the user indicated by the optical code in accordance with the customized settings.
17. The computer storage media of claim 16 , wherein the customized settings are set by the user.
18. The computer storage media of claim 16 , wherein the ambient environment includes a real-world object which is detectable by the processors via the sensors and is associated with the virtual content, and wherein the real-world object is configured as an input device.
19. The computer storage media of claim 16 , wherein the particular visual feature is a portion of a room or a particular object.