Rendering location specific virtual content in any location
Augmented reality systems and methods for creating, saving and rendering designs comprising multiple items of virtual content in a three-dimensional (3D) environment of a user. The designs may be saved as a scene, which is built by a user from pre-built sub-components, built components, and/or previously saved scenes. Location information, expressed as a saved scene anchor and position relative to the saved scene anchor for each item of virtual content, may also be saved. Upon opening the scene, the saved scene anchor node may be correlated to a location within the mixed reality environment of the user for whom the scene is opened. The virtual items of the scene may be positioned with the same relationship to that location as they have to the saved scene anchor node. That location may be selected automatically and/or by user input.
1. A method of operating a mixed reality system configured to display virtual content that is rendered to appear in a physical world, the method comprising:
using at least one processor of the mixed reality system to perform:
receiving user input specifying a plurality of subcomponents of one or more virtual objects and relative positions of the plurality of subcomponents;
rendering, to the user, the plurality of subcomponents with the specified relative positions;
receiving user input specifying a boundary of a region of the physical world in which a subset of the plurality of subcomponents of the one or more virtual objects are located;
selecting the subset of the plurality of subcomponents for storage based on the boundary specified by the user input; and
storing, in memory as a saved scene, only the subset of the plurality of subcomponents of the one or more virtual objects within the specified boundary of the region, the storing comprising storing a representation of the subset of the plurality of subcomponents, a node, and position information indicating a position of the subset of the plurality of subcomponents relative to the node.
2. The method of claim 1 , further comprising obtaining the representation of the plurality of subcomponents by:
placing a virtual render camera in the scene; and
obtaining the representation of the subset of the plurality of subcomponents using the virtual render camera.
3. The method of claim 2 , wherein obtaining the representation of the subset of the plurality of subcomponents using the virtual render camera comprises:
converting, using the virtual render camera, 3D scene data representing the subset of the plurality of subcomponents to a 2D image storing the 3D scene data representing the subset of the plurality of subcomponents.
4. The method of claim 1 , further comprising generating the position information at least in part by:
determining a coordinate frame for the scene based on one or more features in an environment of the mixed reality system; and
determining the position of the subset of the plurality of subcomponents relative to the node in the coordinate frame.
5. The method of claim 4 , wherein determining the coordinate frame for the scene based on the one or more features in the environment of the mixed reality system comprises:
selecting the coordinate frame from among a plurality of coordinate frames, each of the plurality of coordinate frames associated with a respective location in the physical world.
6. The method of claim 5 , wherein selecting the coordinate frame from among the plurality of coordinate frames comprises:
identifying, based on the one or more features in the environment of the mixed reality system, a first one of the plurality of coordinate frames that is associated with the first location; and
selecting the first coordinate frame as the coordinate frame.
7. The method of claim 1 further comprising:
in response to storing the scene in memory as the saved scene, adding a graphical icon associated with the saved scene to a user menu, wherein the graphical icon allows a user to access the saved scene.
8. A non-transitory computer-readable storage medium storing instructions that, when executed by at least one processor, cause the at least one processor to perform a method of operating a mixed reality system configured to display virtual content that is rendered to appear in a physical world, the method comprising:
receiving user input specifying a plurality of subcomponents of one or more virtual objects and relative positions of the plurality of subcomponents;
rendering, to the user, the plurality of subcomponents with the specified relative positions;
receiving user input specifying a boundary of a region of the physical world in which a subset of the plurality of subcomponents are located;
selecting the subset of the plurality of subcomponents for storage based on the boundary specified by the user input; and
storing, in memory as a saved scene, only the subset of the plurality of subcomponents of the one or more virtual objects within the specified boundary of the region, the storing comprising storing a representation of the subset of the plurality of subcomponents, a node, and position information indicating a position of the subset of the plurality of subcomponents relative to the node.
9. The non-transitory computer-readable storage medium of claim 8 , wherein the method further comprises:
loading the saved scene from the memory, the loading comprising rendering, to the user, the subset of the plurality of subcomponents of the one or more virtual objects at relative positions based on the position information.
10. The non-transitory computer-readable storage medium of claim 8 , wherein the method further comprises:
receiving user input adding one or more subcomponents to the plurality of subcomponents and relative positions of the one or more subcomponents to obtain an updated plurality of subcomponents; and
storing in the memory as an updated saved scene the updated plurality of subcomponents, a node, and updated position information indicating a position of the updated plurality of subcomponents relative to the node.