Virtual anchoring systems and methods for extended reality
Implementations of the subject technology provide virtual anchoring for extended reality (XR) display devices. A device may generate an XR environment that includes computer-generated (CG) content for display relative to various physical objects in a physical environment. In order to position the CG content, an XR application may request a physical anchor object to which the CG content can be anchored. In circumstances in which the physical anchor object is not available in the physical environment, a virtual anchor and/or a virtual anchor object corresponding to the physical anchor object can be provided to which the CG content can be anchored.
1. A device comprising:
a processor; and
a computer-readable medium storing instructions thereon, which when executed cause the processor to:
obtain, by a system process of an electronic device, environment information for a physical environment of the electronic device;
receive, by the system process, a request for a physical anchor object in the physical environment;
generate, by the system process, a virtual anchor having a location in the physical environment; and
render, by the system process of the electronic device, virtual content for display at the location in the physical environment using the virtual anchor.
2. The device of claim 1 , wherein the instructions further cause the processor to:
update, by the system process, a position or orientation of the virtual content based on information from an application running on the electronic device.
3. The device of claim 1 , wherein the system process includes a mapping engine, wherein the environment information for the physical environment is obtained at least in part by the mapping engine based on one or more sensors of the electronic device.
4. The device of claim 1 , wherein the physical anchor object comprises a general physical object or a specific physical object, wherein the general physical object comprises a planar surface.
5. The device of claim 2 , wherein the instructions further cause the processor to:
receive a virtual object generated by the application, the virtual object corresponding to the physical anchor object, wherein the rendering of the virtual content comprises rendering the virtual object for display relative to the virtual anchor.
6. The device of claim 5 , wherein the virtual object is a first virtual object, wherein the instructions further cause the processor to:
generate a second virtual object; and
render the second virtual object relative to the virtual anchor, wherein a portion of the first virtual object separates a position of the second virtual object from the virtual anchor.
7. The device of claim 1 , wherein the instructions further cause the processor to:
define the virtual anchor relative to at least one physical object in the physical environment.
8. The device of claim 1 , wherein the instructions further cause the processor to:
provide, for display, one or more highlighted locations in the physical environment corresponding to potential locations in the physical environment with sufficient room to display the virtual content.
9. The device of claim 8 , where the one or more highlighted locations are displayed automatically based at least in part on a detected field of view, gaze location, or velocity of movement.
10. The device of claim 1 , wherein the instructions further cause the processor to:
render a virtual portal for display over a portion of the physical environment, wherein rendering the virtual content comprises rendering the virtual content for display in the virtual portal.
11. The device of claim 1 , wherein the instructions further cause the processor to:
determine, by the system process and based on the environment information, that the physical anchor object is not available in the physical environment.
12. A method comprising:
obtaining, by a system process of an electronic device, environment information for a physical environment of the electronic device;
receiving, by the system process, a request for a physical anchor object in the physical environment;
generating, by the system process, a virtual anchor having a location in the physical environment; and
rendering, by the system process of the electronic device, virtual content for display at the location in the physical environment using the virtual anchor.
13. The method of claim 12 , further comprising:
updating, by the system process, a position or orientation of the virtual content based on information from an application running on the electronic device.
14. The method of claim 13 , further comprising:
receiving a virtual object generated by the application, the virtual object corresponding to the physical anchor object, wherein the rendering of the virtual content comprises rendering the virtual object for display relative to the virtual anchor.
15. The method of claim 12 , further comprising:
determining, by the system process and based on the environment information, that the physical anchor object is not available in the physical environment.
16. A non-transitory computer-readable medium comprising instructions, which when executed by a computing device, cause the computing device to:
obtain, by a system process of an electronic device, environment information for a physical environment of the electronic device;
receive, by the system process, a request for a physical anchor object in the physical environment;
generate, by the system process, a virtual anchor having a location in the physical environment; and
render, by the system process of the electronic device, virtual content for display at the location in the physical environment using the virtual anchor.
17. The non-transitory computer-readable medium of claim 16 , wherein the system process includes a mapping engine, wherein the environment information for the physical environment is obtained at least in part by the mapping engine based on one or more sensors of the electronic device.
18. The non-transitory computer-readable medium of claim 16 , wherein the instructions further cause the computing device to:
update, by the system process, a position or orientation of the virtual content based on information from an application running on the electronic device.
19. The non-transitory computer-readable medium of claim 18 , wherein the instructions further cause the computing device to:
receive a virtual object generated by the application, the virtual object corresponding to the physical anchor object, wherein the rendering of the virtual content comprises rendering the virtual object for display relative to the virtual anchor.
20. The non-transitory computer-readable medium of claim 16 , wherein the instructions further cause the computing device to:
determine, by the system process and based on the environment information, that the physical anchor object is not available in the physical environment.