Augmented reality z-stack prioritization
A system, method and computer program products for prioritizing the stacking order of virtualized objects within a z-index of an augmented reality system by presenting the most valuable, relevant or important information more prominently. Prioritization of the virtualized object may occur dynamically, as a function of the user's primary focus. As the user's primary focus changes from one physical object to another, the stacking order may change in response to the shift in focus. Embodiments may use one or more techniques to identify the primary focus such as the direction of the user's gaze, the focal point of one or more visual recording systems (i.e. cameras) or the user may manually highlight one or more objects via the HUD or interface of the augmented display system. The disclosed embodiments allow for the more predominate or relevant virtualized objects within the augmented display to receive priority, unobscured viewing by the user.
1. A method for displaying an augmented reality (AR) scene to a user by using an AR system, the AR scene including a plurality of objects, the plurality of objects including one or more real objects and/or one or more virtual objects, the method comprising:
identifying, from among the plurality of objects in the AR scene, a first object as a primary object based at least in part on information indicative that the first object is focused on by the user;
determining a stacking order for a plurality of virtual overlays including a first virtual overlay corresponding to the primary object and a second virtual overlay corresponding to a second object of the plurality of objects, wherein determining the stacking order comprises positioning the first virtual overlay higher in the stacking order than the second virtual overlay; and
displaying the plurality of virtual overlays using the AR system in accordance with the determined stacking order.
2. The method of claim 1 , wherein determining the stacking order comprises positioning at least one of the plurality of virtual overlays in the stacking order based at least in part on at least one factor selected from the group consisting of relevance to the user, social relationship, purchase history, environment, cognitive state and value.
3. The method of claim 1 , wherein determining the stacking order comprises positioning at least one of the plurality of virtual overlays in the stacking order based at least in part on information indicative of a promotional value of one or more of the plurality of objects and/or information indicative of the user's brand preference.
4. The method of claim 1 ,
wherein the method further comprises recording video and/or images of the first object and/or the second object using a camera of a visual recording system, and
wherein the displaying further comprises displaying the recorded video and/or images as virtual representations on a display device.
5. The method of claim 1 , further comprising providing at least one support service for at least one process selected from the group consisting of creating, integrating, hosting, maintaining, and deploying computer-readable program code in a computer system, wherein the computer-readable program code in the computer system is configured to implement the steps of identifying, determining, and displaying.
6. A computer system, comprising:
at least one processor; and
at least one computer readable storage medium coupled to the processor and storing instructions that, when executed by the at least one processor, cause the at least one processor to perform a method for displaying an augmented reality (AR) scene to a user, the AR scene including a plurality of objects, the plurality of objects including one or more real objects and/or one or more virtual objects, the method comprising:
identifying, from among the plurality of objects in the AR scene, a first object as a primary object based at least in part on information indicative that the first object is focused on by the user;
determining a stacking order for a plurality of virtual overlays including a first virtual overlay corresponding to the primary object and a second virtual overlay corresponding to a second object of the plurality of objects, wherein determining the stacking order comprises positioning the first virtual overlay higher in the stacking order than the second virtual overlay; and
displaying the plurality of virtual overlays in accordance with the determined stacking order.
7. The computer system of claim 6 , wherein determining the stacking order comprises positioning at least one of the plurality of virtual overlays in the stacking order based at least in part on at least one factor selected from the group consisting of relevance to the user, social relationship, purchase history, environment, cognitive state and value.
8. The computer system of claim 6 , wherein determining the stacking order comprises positioning at least one of the plurality of virtual overlays in the stacking order based at least in part on information indicative of a promotional value of one or more of the plurality of objects and/or information indicative of the user's brand preference.
9. The computer system of claim 6 ,
wherein the method further comprises recording video and/or images of the first object and/or the second object, and
wherein the displaying further comprises displaying the recorded video and/or images as virtual representations on a display device.
10. The computer system of claim 6 , wherein the method further comprises, in response to information indicative that the second object is focused on by the user, identifying the second object as the primary object, and positioning the second virtual overlay higher in the stacking order than the first virtual overlay.
11. At least one computer readable storage medium storing instructions that, when executed by at least one processor, cause the at least one processor to perform a method for displaying an augmented reality (AR) scene to a user, the AR scene including a plurality of objects, the plurality of objects including one or more real objects and/or one or more virtual objects, the method comprising:
identifying, from among the plurality of objects in the AR scene, a first object as a primary object based at least in part on information indicative that the first object is focused on by the user;
determining a stacking order for a plurality of virtual overlays including a first virtual overlay corresponding to the primary object and a second virtual overlay corresponding to a second object of the plurality of objects, wherein determining the stacking order comprises positioning the first virtual overlay higher in the stacking order than the second virtual overlay; and
displaying the plurality of virtual overlays in accordance with the determined stacking order.
12. The at least one computer readable storage medium of claim 11 ,
wherein the method further comprises recording video and/or images of the first object and/or the second object, and
wherein the displaying further comprises displaying the recorded video and/or images as virtual representations on a display device.
13. The at least one computer readable storage medium of claim 11 , wherein determining the stacking order comprises positioning at least one of the plurality of virtual overlays in the stacking order based at least in part on information indicative of a promotional value of one or more of the plurality of objects.
14. The at least one computer readable storage medium of claim 11 , wherein determining the stacking order comprises positioning at least one of the plurality of virtual overlays in the stacking order based at least in part on information indicative of the user's brand preference.
15. The at least one computer readable storage medium of claim 11 , wherein determining the stacking order comprises positioning at least one of the plurality of virtual overlays in the stacking order based at least in part on information indicative of an environment of the user.
16. The at least one computer readable storage medium of claim 11 , wherein the information indicative that the first object is focused on comprises information indicative of a direction of the user's gaze.
17. The at least one computer readable storage medium of claim 11 , wherein the information indicative that the first object is focused on comprises information indicative of a focal point of one or more visual recording systems.
18. The at least one computer readable storage medium of claim 11 , wherein the information indicative that the first object is focused on comprises information indicative that the first object is highlighted by the user manually.
19. The at least one computer readable storage medium of claim 11 , wherein the method comprises displaying the plurality of virtual overlays on a heads-up display (HUD).
20. The at least one computer readable storage medium of claim 11 , wherein displaying the plurality of virtual overlays further comprises displaying the first virtual overlay adjacent to the primary object in the AR scene.
21. The at least one computer readable storage medium of claim 11 , wherein the method further comprises:
identifying the second object as a secondary object based at least in part on information indicative that the primary object is more closely related to the second object than to a third object of the plurality of objects; and
positioning the second virtual overlay higher in the stacking order than a third virtual overlay corresponding to the third object.