Predictive augmented reality assistance system
A predictive augmented reality assistance system is described. A device generates and renders augmented reality content in a display of the device. The device tracks user interactions with the augmented reality content of a user of the device. A context of the user interactions with the augmented reality content is determined based on the user interactions. A behavioral analysis of a user of the device is generated based on the context of the user interaction. A predictive model of the user of the device is generated based on the behavioral analysis. The augmented reality content is modified based on the predictive model of the user of the device.
1. A device comprising:
a display;
one or more hardware processors; and
a memory storing instructions that, when executed by the one or more hardware processors, configure the device to perform operations comprising:
generating and displaying augmented reality (AR) content in the display of the device;
tracking user interactions by a user of the device with the AR content;
determining a context of the user interactions with the AR content based on the user interactions;
generating a behavioral analysis of the user of the device based on the context of the user interactions, the behavioral analysis of the user being generated based on the context that is determined based on the tracking user interactions by the user with the AR content;
generating a predictive model of the user of the device based on the behavioral analysis;
modifying the AR content based on the predictive model of the user of the device; and
filtering the AR content by removing one or more items having the least amount of user interactions from the user of the device, removing redundant items in the AR content, and removing one or more items in the AR content with the least relevance to a task being performed by the user of the device.
2. The device of claim 1 , further comprising:
a sensor,
wherein the operations further comprise:
detecting and identifying a physical object using the sensor;
generating the AR content in the display as an overlay of the physical object, the AR content including a three-dimensional model of a virtual object associated with the identified physical object; and
adjusting a display of the AR content based on a relative position between the device and the physical object.
3. The device of claim 2 , wherein the context includes a user-based context, an ambient-based context, and an AR application-based context.
4. The device of claim 3 , wherein the user-based context includes a profile of the user and biometrics data of the user.
5. The device of claim 3 , wherein the ambient-based context includes an identification of a task of the user of the device, ambient data from sensors detecting an ambient environment of the device, and an identification of a location and a position of the device.
6. The device of claim 3 , wherein the AR application-based context includes an identification of a feature of an AR application in the device, the feature being utilized by the user of the device.
7. The device of claim 1 , wherein modifying the AR content includes:
generating a suggested AR item based on the predictive model of the user.
8. The device of claim 1 , wherein the operations further comprises:
generating and rendering the modified AR content in the display of the device; and
recursively modifying the AR content based on a profile of the user and the user interactions with items of the modified AR content.
9. A method comprising:
generating and rendering an augmented reality (AR) content in a display of a device;
tracking user interactions with the AR content of a user of the device;
determining a context of the user interactions with the AR content based on the user interactions;
generating a behavioral analysis of the user of the device based on the context of the user interactions, the behavioral analysis of the user being generated based on the context that is determined based on the tracking user interactions by the user with the AR content;
generating a predictive model of the user of the device based on the behavioral analysis;
modifying the AR content based on the predictive model of the user of the device; and
filtering the AR content by removing one or more items having the least amount of user interactions from the user of the device, removing redundant items in the AR content, and removing one or more items in the AR content with the least relevance to a task being performed by the user of the device.
10. The method of claim 9 , further comprising:
detecting and identifying a physical object using a sensor of the device;
generating the AR content in the display as an overlay of the physical object, the AR content including a three-dimensional model of a virtual object associated with the identified physical object; and
adjusting a display of the AR content based on a relative position between the device and the physical object.
11. The method of claim 10 , wherein the context includes a user-based context, an ambient-based context, and an AR application-based context.
12. The method of claim 11 , wherein the user-based context includes a profile of the user and biometrics data of the user.
13. The method of claim 11 , wherein the ambient-based context includes an identification of a task of the user of the device, ambient data from sensors detecting an ambient environment of the device, and an identification of a location and a position of the device.
14. The method of claim 11 , wherein the AR application-based context includes an identification of a feature of an AR application in the device, the feature being utilized by the user of the device.
15. The method of claim 9 , wherein modifying the AR content includes:
generating a suggested AR item based on the predictive model of the user.
16. A non-transitory machine-readable medium comprising instructions that, when executed by one or more processors of a machine, cause the machine to perform operations comprising:
generating and displaying augmented reality (AR) content in the display of the device;
tracking user interactions by a user of the device with the AR content;
determining a context of the user interactions with the AR content based on the user interactions;
generating a behavioral analysis of the user of the device based on the context of the user interactions, the behavioral analysis of the user being generated based on the context that is determined based on the tracking user interactions by the user with the AR content;
generating a predictive model of the user of the device based on the behavioral analysis;
modifying the AR content based on the predictive model of the user of the device; and
filtering the AR content by removing one or more items having the least amount of user interactions from the user of the device, removing redundant items in the AR content, and removing one or more items in the AR content with the least relevance to a task being performed by the user of the device.