Augmented and virtual reality bot infrastructure
Representative embodiments disclose mechanisms for presenting content into a virtual reality or augmented reality (VR/AR) system in a manner that does not distract the user from their primary workflow in the VR/AR system. The system monitors a user's workflow in a virtual reality or augmented reality (VR/AR) system. Based on the user's workflow, the user's emotional state, and other data, the system selects one or more bots to inject into the user's workflow. The bots provide content and functional extensibility for the system and/or the VR/AR system. Content from the selected bot(s) is identified and placed in a location that is in the periphery of the user at a low rendering fidelity. If the user shows interest in the content, the fidelity of the content is increased until the user can interact with the content, using the functionality provided by the bot.
1. A computer implemented method for presenting content in a virtual or augmented reality environment, comprising:
receiving augmented content to be placed into an augmented reality or virtual reality (AR/VR) environment;
selecting a location to place the augmented content within the AR/VR environment based on the AR/VR environment, the location being within a peripheral view of a user of the AR/VR environment;
identifying a first rendering fidelity based one or more of the location and the AR/VR environment;
sending the augmented content to a rendering service along with the first rendering fidelity;
monitoring user interest in the augmented content;
identifying a second rendering fidelity based on a change in user interest in the augmented content; and
sending the second rendering fidelity to the rendering service to change the rendering fidelity of the augmented based on user interest.
2. The method of claim 1 wherein monitoring user interest in the augmented content is performed responsive to the augmented content being in a field of view of a user.
3. The method of claim 1 wherein when the change in user interest shows increased user interest, the second rendering fidelity is greater than the first rendering fidelity.
4. The method of claim 1 wherein when the change in user interest shows decreased user interest, the second rendering fidelity is less than the first rendering fidelity.
5. The method of claim 4 further comprising removing the augmented content when the rendering fidelity reaches a threshold level of fidelity.
6. The method of claim 1 wherein further comprising:
decreasing a rendering fidelity of the augmented content proportional to a time delay during which no change in user interest is detected.
7. The method of claim 1 further comprising adding a time delay before changing from the first rendering fidelity to the second rendering fidelity.
8. The method of claim 1 wherein selecting the location further comprises:
identifying a plurality of candidate locations within the AR/VR environment;
calculating a location score for each candidate location based on the candidate location within a user's field of view and a focus of the user;
selecting the location as the candidate location with the highest score.
9. The method of claim 1 wherein the first rendering fidelity and the second rendering fidelity comprise one or more of:
amount of augmented content;
color of the content;
resolution of the content; and
transparency of the content.
10. A system comprising a processor and computer executable instructions, that when executed by the processor, cause the system to perform acts comprising:
identifying augmented content to be placed into an augmented reality or virtual reality (AR/VR) environment;
select a location within a peripheral view of a user to place the augmented content within the AR/VR environment;
identify a first rendering fidelity based one or more of the location and the AR/VR environment;
send the augmented content to a rendering service along with the first rendering fidelity;
while the augmented content is within a field of view of the user, monitor user interest in the augmented content;
responsive to the user showing increased level of interest in the augmented content:
identify a second rendering fidelity higher than the first rendering fidelity; and
send the second rendering fidelity to the rendering service to change the rendering fidelity of the augmented content.
11. The system of claim 10 further comprising:
responsive to the user showing a same level of interest:
decrease the rendering fidelity in proportion to a time that the user has shown a same level of interest.
12. The system of claim 11 further comprising:
removing the augmented content when the rendering fidelity reaches a threshold level of fidelity.
13. The system of claim 10 further comprising:
responsive to the user showing a same level of interest:
maintaining the first rendering fidelity.
14. The system of claim 10 further comprising:
responsive to the user showing a decreased level of interest:
decrease the rendering fidelity in proportion to a time that the user has shown a same level of interest.
15. The system of claim 14 further comprising:
removing the augmented content when the rendering fidelity reaches a threshold level of fidelity.
16. The system of claim 10 further comprising adding a time delay before changing from the first rendering fidelity to the second rendering fidelity.
17. The system of claim 10 wherein select the location further comprises:
identify a plurality of candidate locations within the AR/VR environment;
calculate a location score for each candidate location based on the candidate location within a user's field of view and a focus of the user;
select the location as the candidate location with the highest score.
18. The system of claim 10 wherein the first rendering fidelity and the second rendering fidelity comprise one or more of:
amount of augmented content;
color of the content;
resolution of the content; and
transparency of the content.
19. A computer storage medium comprising executable instructions that, when executed by a processor of a machine, cause the machine to perform acts comprising:
identifying augmented content to be placed into an augmented reality or virtual reality (AR/VR) environment;
select a location within a peripheral view of a user to place the augmented content within the AR/VR environment;
identify a first rendering fidelity based one or more of the location and the AR/VR environment;
send the augmented content to a rendering service along with the first rendering fidelity;
while the augmented content is within a field of view of the user, monitor user interest in the augmented content;
responsive to the user showing increased level of interest in the augmented content:
identify a second rendering fidelity higher than the first rendering fidelity; and
send the second rendering fidelity to the rendering service to change the rendering fidelity of the augmented content.
20. The medium of claim 19 further wherein the first rendering fidelity and the second rendering fidelity comprise one or more of:
amount of augmented content;
color of the content;
resolution of the content; and
transparency of the content.