Smart augmented reality selector
Disclosed herein are system, method, and computer program product embodiments for determining an object of interest in an augmented reality environment, displaying an augmented reality selector containing pertinent actions in a reachable area, and causing a selected action to be executed. The augmented reality application may determine an augmented reality object of interest in an augmented reality experience and determine a reachable area of screen from the determined object to a reachable area. The augmented reality application may then display an augmented reality selector in the reachable area that includes interaction options determined based on the augmented reality object being focused on. In a mobile embodiment, this enhancement allows users to interact with the object without repositioning their hands or losing site of the object in the augmented reality experience. For an AR headset, by displaying the augmented reality selector in a reachable area, a user's field of vision remains unimpeded, and the user may interact with the object via simple gestures such as clicks.
1. A computer-implemented method, comprising:
displaying, by one or more processors, an augmented reality experience to a user;
determining, by the one or more processors, an object of interest in the augmented reality experience;
calculating, by the one or more processors, a reachable area based on a screen length, a screen width, and dimensional settings stored in a user profile associated with the user, wherein the dimensional settings comprise an X dimension, a Y dimension, and a Z dimension, and wherein the X dimension, the Y dimension, and the Z dimension are percentages of the screen length and the screen width;
displaying, by the one or more processors, a line from the object of interest to the reachable area in the augmented reality experience; and
displaying, by the one or more processors, a selector in the reachable area, wherein the selector displays one or more interaction options applicable to the object of interest, and wherein the selector receives a user input that indicates an action to perform from the one or more interaction options.
2. The method of claim 1 , further comprising:
receiving, by the one or more processors, a request from the user to change the object of interest;
determining, by the one or more processors, a second object of interest in the augmented reality experience; and
displaying, by the one or more processors, a second selector in the reachable area, wherein the second selector displays second one or more interaction options applicable to the second object of interest, and wherein the second selector receives a user input that indicates a second action to perform from the second one or more interaction options.
3. The method of claim 1 , further comprising:
determining, by the one or more processors, that the object of interest is a real-world object that provides an application program interface (API); and
sending, by the one or more processors, an API call to the API to cause the action to be performed by the real-world object.
4. The method of claim 1 , further comprising:
causing, by the one or more processors, the action to be performed on a mobile device presenting the augmented reality experience, wherein the one or more interaction options are functions performable on the mobile device.
5. The method of claim 1 , further comprising:
determining, by the one or more processors, a second object of interest in the augmented reality experience;
drawing, by the one or more processors, a line from the second object of interest to a second reachable area in the augmented reality experience; and
simultaneously displaying, by the one or more processors, with the selector, a second selector in the second reachable area, wherein the second selector displays a second one or more interaction options applicable to the second object of interest.
6. The method of claim 1 , wherein the object of interest is a virtual object inserted into the augmented reality experience.
7. A system, comprising:
a memory; and
at least one processor coupled to the memory and configured to:
display an augmented reality experience to a user;
determine an object of interest in the augmented reality experience;
generate one or more interaction options applicable to the object of interest;
calculate a reachable area based on a screen length, a screen width, and dimensional settings stored in a user profile associated with the user, wherein the dimensional settings comprise an X dimension, a Y dimension, and a Z dimension, and wherein the X dimension, the Y dimension, and the Z dimension are percentages of the screen length and the screen width;
display a line from the object of interest to the reachable area in the augmented reality experience; and
display an augmented reality selector in the reachable area, wherein the augmented reality selector displays the one or more interaction options, wherein the augmented reality selector receives a user input that indicates an action to perform from the one or more interaction options.
8. The system of claim 7 , the at least one processor further configured to:
receive a request from the user to change the object of interest;
determine a second object of interest in the augmented reality experience; and
display a second selector in the reachable area, wherein the second selector displays second one or more interaction options applicable to the second object of interest, and wherein the second selector receives a user input that indicates a second action to perform from the second one or more interaction options.
9. The system of claim 7 , the at least one processor further configured to:
determine that the object of interest is a real-world object that provides an application program interface (API); and
send an API call to the API to cause the action to be performed by the real-world object.
10. The system of claim 7 , the at least one processor further configured to:
cause the action to be performed on a mobile device presenting the augmented reality experience, wherein the one or more interaction options are functions performable on the mobile device.
11. The system of claim 7 , the at least one processor further configured to:
determine a second object of interest in the augmented reality experience;
draw a second line from the second object of interest to a second reachable area in the augmented reality experience; and
simultaneously display with the selector, a second selector in the second reachable area, wherein the second selector displays a second one or more interaction options applicable to the second object of interest.
12. The system of claim 7 , wherein the object of interest is a virtual object inserted into the augmented reality experience.
13. A non-transitory computer-readable device having instructions stored thereon that, when executed by at least one computing device, cause the at least one computing device to perform operations comprising:
displaying an augmented reality experience to a user;
determining an object of interest in the augmented reality experience;
calculating a reachable area based on a screen length, a screen width, and dimensional settings stored in a user profile associated with the user, wherein the dimensional settings comprise an X dimension, a Y dimension, and a Z dimension, and wherein the X dimension, the Y dimension, and the Z dimension are percentages of the screen length and the screen width;
displaying a line from the object of interest to a reachable area in the augmented reality experience;
displaying a selector in the reachable area, wherein the selector displays one or more interaction options applicable to the object of interest, and wherein the selector receives a user input that indicates an action to perform from the one or more interaction options.
14. The non-transitory computer-readable device of claim 13 , the operations further comprising:
receiving a request from the user to change the object of interest;
determining a second object of interest in the augmented reality experience; and
displaying a second selector in the reachable area, wherein the second selector displays second one or more interaction options applicable to the second object of interest, and wherein the second selector receives a user input that indicates a second action to perform from the second one or more interaction options.
15. The non-transitory computer-readable device of claim 13 , the operations further comprising:
causing the second action to be performed on a mobile device presenting the augmented reality experience, wherein the one or more interaction options are functions performable on the mobile device.
16. The non-transitory computer-readable device of claim 13 , the operations further comprising:
determining a second object of interest in the augmented reality experience;
drawing a second line from the second object of interest to a second reachable area in the augmented reality experience; and
simultaneously displaying with the selector, a second selector in the second reachable area, wherein the second selector displays a second one or more interaction options applicable to the second object of interest.
17. The non-transitory computer-readable device of claim 13 , wherein the second object of interest is a virtual object inserted into the augmented reality experience.
18. The non-transitory computer-readable device of claim 13 , the operations further comprising:
determining that the object of interest is a real-world object that provides an application program interface (API); and
sending an API call to the API to cause the action to be performed by the real-world object.