Augmented and virtual reality bot infrastructure
Representative embodiments disclose mechanisms for presenting content into a virtual reality or augmented reality (VR/AR) system in a manner that does not distract the user from their primary workflow in the VR/AR system. The system monitors a user's workflow in a virtual reality or augmented reality (VR/AR) system. Based on the user's workflow, the user's emotional state, and other data, the system selects one or more bots to inject into the user's workflow. The bots provide content and functional extensibility for the system and/or the VR/AR system. Content from the selected bot(s) is identified and placed in a location that is in the periphery of the user at a low rendering fidelity. If the user shows interest in the content, the fidelity of the content is increased until the user can interact with the content, using the functionality provided by the bot.
1. A computer implemented method for presenting content in a virtual or augmented reality environment, comprising:
selecting one or more bots to provide augmented content to be placed into an augmented reality or virtual reality (AR/VR) environment;
receiving augmented content from the selected bots;
selecting a location to place the augmented content within the AR/VR environment based on the AR/VR environment, the location being within a peripheral view of a user of the AR/VR environment;
identifying a first rendering fidelity based one or more of the location and the AR/VR environment;
sending the augmented content to a rendering service along with the first rendering fidelity;
monitoring user interest in the augmented content;
identifying a second rendering fidelity based on a change in user interest in the augmented content; and
sending the second rendering fidelity to the rendering service to change the rendering fidelity of the augmented based on user interest.
2. The method of claim 1 wherein selecting one or more bots is based on an emotional state of the user.
3. The method of claim 2 further comprising:
classifying the emotional state to one of a plurality of emotional state classes;
responsive to the emotional state falling within a designated class, terminating the method without placing content into the AR/VR environment.
4. The method of claim 1 wherein selecting one or more bots further comprises:
for each domain of a plurality of domains, querying a bot registry to identify known bots;
calculating a score for each identified bot;
selecting a subset of identified bots based on the calculated score.
5. The method of claim 4 wherein the calculated score is based on an emotional state of the user.
6. The method of claim 1 wherein the selected bots a plurality of bots.
7. The method of claim 1 wherein the selected bots comprise a single bot that provides multiple pieces of augmented content.
8. The method of claim 1 wherein selecting the location further comprises:
identifying a plurality of candidate locations within the AR/VR environment;
calculating a location score for each candidate location based on the candidate location within the user's field of view and the focus of the user;
selecting the location as the candidate location with the highest score.
9. The method of claim 1 wherein the first rendering fidelity and the second rendering fidelity comprise one or more of:
amount of augmented content;
color of the content;
resolution of the content; and
transparency of the content.
10. A system comprising a processor and computer executable instructions, that when executed by the processor, cause the system to perform acts comprising:
select one or more bots to provide content to be placed into an augmented reality or virtual reality (AR/VR) environment
receive content from the selected bots and deriving augmented content from the content;
select a location to place the augmented content within the AR/VR environment based on the AR/VR environment, the location being within a peripheral view of a user of the AR/VR environment;
identify a first rendering fidelity based one or more of the location and the AR/VR environment;
send the augmented content to a rendering service along with the first rendering fidelity;
monitor user interest in the augmented content;
identify a second rendering fidelity based on a change in user interest in the augmented content; and
send the second rendering fidelity to the rendering service to change the rendering fidelity of the augmented content based on user interest.
11. The system of claim 10 wherein select one or more bots is based on an emotional state of the user.
12. The system of claim 11 further comprising:
classifying the emotional state to one of a plurality of emotional state classes;
responsive to the emotional state falling within a designated class, terminating the method without placing content into the AR/VR environment.
13. The system of claim 10 wherein selecting one or more bots further comprises:
for each domain of a plurality of domains, query a bot registry to identify known bots;
calculate a score for each identified bot;
select a subset of identified bots based on the calculated score.
14. The system of claim 13 wherein the calculated score is based on an emotional state of the user.
15. The system of claim 10 wherein the selected bots comprises a broker bot and wherein the broker bot provides the content.
16. The system of claim 10 wherein the selected bots comprise a single bot that provides multiple pieces of augmented content.
17. The system of claim 10 wherein select the location further comprises:
identify a plurality of candidate locations within the AR/VR environment;
calculate a location score for each candidate location based on the candidate location within the user's field of view and the focus of the user;
select the location as the candidate location with the highest score.
18. The system of claim 10 wherein the first rendering fidelity and the second rendering fidelity comprise one or more of:
amount of augmented content;
color of the content;
resolution of the content; and
transparency of the content.
19. A computer storage medium comprising executable instructions that, when executed by a processor of a machine, cause the machine to perform acts comprising:
select one or more bots to provide content to be placed into an augmented reality or virtual reality (AR/VR) environment based on an emotional state of a user;
receive content from the selected bots and deriving augmented content from the content;
select a location to place the augmented content within the AR/VR environment based on the AR/VR environment, the location being within a peripheral view of the user of the AR/VR environment;
identify a first rendering fidelity based one or more of the location and the AR/VR environment;
send the augmented content to a rendering service along with the first rendering fidelity;
monitor user interest in the augmented content;
identify a second rendering fidelity based on a change in user interest in the augmented content; and
send the second rendering fidelity to the rendering service to change the rendering fidelity of the augmented content based on user interest.
20. The medium of claim 19 further wherein the first rendering fidelity and the second rendering fidelity comprise one or more of:
amount of augmented content;
color of the content;
resolution of the content; and
transparency of the content.