Platformization of mixed reality objects in virtual reality environments
In one embodiment, a method includes receiving an instruction to transition to a first virtual reality (VR) environment of a first VR application, accessing attribute information of one or more real-world objects in a real-world environment proximate to a VR display device, determining, for each of the one or more real-world objects, one or more first mixed reality (MR) functionalities applicable to the real-world object based on its attribute information, and rendering, for one or more displays of the VR display device, the first VR environment with one or more MR objects corresponding to the one or more real-world objects, wherein each MR object comprises one of the first MR functionalities applicable to the corresponding real-world object.
1 . A method, by one or more computing systems, the method comprising:
accessing attribute information for a plurality of real-world objects in a real-world environment, wherein the attribute information specifies a first real-world function of at least one first real-world object of the plurality of real-world objects;
generating a first mixed reality (MR) object, corresponding to the at least one first real-world object of the plurality of real-world objects, wherein the first MR object has a first MR function corresponding to the first real-world function of the at least one first real-world object;
generating a second MR object, corresponding to at least one second real-world object of the plurality of real-world objects;
determining one or more requirements of a virtual reality environment, wherein the determined one or more requirements specify that the first MR function is needed for the virtual reality environment;
based on the determined one or more requirements of the virtual reality environment, rendering, on a head-mounted display, the virtual reality environment with the first MR object corresponding to the at least one first real-world object and omitting, from the virtual reality environment, the second MR object; and
making the at least one second real-world object visible via the head-mounted display, wherein the making the at least one second real-world object visible includes not rendering a portion of the first MR object based on determined contours of the second real-world object, while the remainder of the first MR object continues to be displayed in the virtual reality environment, making the not rendered portion of the first MR object appear occluded by the second real-world object.
2 . The method of claim 1 , wherein the omitting the second MR object is further based on the attribute information indicating the at least one second real-world object is within a threshold distance of the one or more computing systems.
3 . The method of claim 1 , wherein the omitting the second MR object is further based on a trigger switch activation for a passthrough view for the second MR object.
4 . The method of claim 1 , wherein the attribute information, associated with the at least one second real-world object, comprises one or more spatial dimensions.
5 . The method of claim 1 , wherein the attribute information, associated with the at least one second real-world object, comprises one or more volumetric shapes.
6 . The method of claim 1 , further comprising:
rendering an avatar corresponding to a user within the virtual reality environment, wherein rendering the avatar comprises placing the avatar, within the virtual reality environment relative to the first MR object, based on the first MR function of the first MR object.
7 . The method of claim 1 , wherein the first MR function of the first MR object is customized based on the virtual reality environment.
8 . The method of claim 1 , wherein the first MR function of the first MR object is customized to a functionality that is applied by an artificial reality application and appropriate to the virtual reality environment.
9 . The method of claim 1 , wherein the first MR function of the first MR object is suggested based on available functionalities within the virtual reality environment that are suitable for the first MR object.
10 . A non-transitory computer-readable storage medium storing instructions that, when executed by a computing system, cause the computing system to:
access attribute information for a plurality of real-world objects in a real-world environment, wherein the attribute information specifies a first real-world function of at least one first real-world object of the plurality of real-world objects;
generate a first mixed reality (MR) object, corresponding to at least one first real-world object of the plurality of real-world objects, wherein the first MR object has a first MR function corresponding to the first real-world function of the at least one first real-world object;
generate a second MR object, corresponding to at least one second real-world object of the plurality of real-world objects;
determine one or more requirements of a virtual reality environment, wherein the determined one or more requirements specify that the first MR function is needed for the virtual reality environment;
based on the determined one or more requirements of the virtual reality environment, render, on a head-mounted display, the virtual reality environment with the first MR object corresponding to the at least one first real-world object and omit, from the virtual reality environment, the second MR object; and
make the at least one second real-world object visible via the head-mounted display, wherein the making the at least one second real-world object visible includes not rendering a portion of the first MR object based on determined contours of the second real-world object, while the remainder of the first MR object continues to be displayed in the virtual reality environment, making the not rendered portion of the first MR object appear occluded by the second real-world object.
11 . The non-transitory computer-readable storage medium of claim 10 , wherein the omitting the second MR object is further based on the attribute information indicating the at least one second real-world object is within a threshold distance of the one or more computing systems.
12 . The non-transitory computer-readable storage medium of claim 10 , wherein the omitting the second MR object is further based on a trigger switch activation for a passthrough view for the second MR object.
13 . The non-transitory computer-readable storage medium of claim 10 , wherein the attribute information, associated with the at least one second real-world object, comprises one or more spatial dimensions.
14 . The non-transitory computer-readable storage medium of claim 10 , wherein the attribute information, associated with the at least one second real-world object, comprises one or more volumetric shapes.
15 . The non-transitory computer-readable storage medium of claim 10 , wherein the instructions, when executed, further cause the computing system to:
render an avatar corresponding to a user within the virtual reality environment, wherein rendering the avatar comprises placing the avatar, within the virtual reality environment relative to the first MR object, based on the first MR function of the first MR object.
16 . A computing system comprising:
one or more processors; and
one or more memories storing instructions that, when executed by the one or more processors, cause the computing system to:
access attribute information for a plurality of real-world objects in a real-world environment, wherein the attribute information specifies a first real-world function of at least one first real-world object of the plurality of real-world objects;
generate a first mixed reality (MR) object, corresponding to at least one first real-world object of the plurality of real-world objects, wherein the first MR object has a first MR function corresponding to the first real-world function of the at least one first real-world object;
generate a second MR object, corresponding to at least one second real-world object of the plurality of real-world objects;
determine one or more requirements of a virtual reality environment, wherein the determined one or more requirements specify that the first MR function is needed for the virtual reality environment;
based on the determined one or more requirements of the virtual reality environment, render, on a head-mounted display, an environment with the first MR object corresponding to the at least one first real-world object and omit, from the virtual reality environment, the second MR object; and
make the at least one second real-world object visible via the head-mounted display, wherein the making the at least one second real-world object visible includes not rendering a portion of the first MR object based on determined contours of the second real-world object, while the remainder of the first MR object continues to be displayed in the virtual reality environment, making the not rendered portion of the first MR object appear occluded by the second real-world object.
17 . The computing system of claim 16 , wherein the omitting the second MR object is further based on the attribute information indicating the at least one second real-world object is within a threshold distance of the one or more computing systems.
18 . The computing system of claim 16 , wherein the omitting the second MR object is further based on a trigger switch activation for a passthrough view for the second MR object.
19 . The computing system of claim 16 , wherein the instructions, when executed, further cause the computing system to:
render an avatar corresponding to a user within the virtual reality environment, wherein rendering the avatar comprises placing the avatar, within the virtual reality environment relative to the first MR object, based on of the first MR function of the first MR object.