Presentation of collaboration environments for a networked remote collaboration session
Various implementations of the present application set forth a method comprising generating a host extended reality (XR) environment representing a physical space that includes a real-world asset, generating, based on sensor data captured by a depth sensor on a mobile device, three-dimensional data representing the physical space, generating, based on sensor data captured by an image sensor on the mobile device, two-dimensional data representing the physical space, generating, based on the three-dimensional data and the two-dimensional data, an adaptable three-dimensional (3D) representation of the physical space, transforming the adaptable 3D representation into geometry data comprising a set of vertices, a set of faces comprising edges between pairs of vertices, and texture data, transmitting the geometry data to a set of one or more remote devices for at least a partial reconstruction of the adaptable 3D representation of the physical space in a set of one or more remote environments.
1. A method comprising:
generating a host extended reality (XR) environment representing a physical space that includes a real-world asset;
generating, based on first sensor data captured by a depth sensor on a mobile device, three-dimensional data representing the physical space;
generating, based on second sensor data captured by an image sensor on the mobile device, two-dimensional data representing the physical space;
generating, based on the three-dimensional data and the two-dimensional data, an adaptable three-dimensional (3D) representation of the physical space;
transforming the adaptable 3D representation into geometry data comprising (i) a set of vertices, (ii) a set of faces comprising edges between pairs of vertices, and (iii) texture data;
transmitting the geometry data to a set of one or more remote devices for at least a partial reconstruction of the adaptable 3D representation of the physical space in a set of one or more remote environments, wherein at least one dimension of the partial reconstruction is modifiable responsive to user manipulation of the partial reconstruction.
2. The method of claim 1 , wherein the geometry data is transmitted to the set of one or more remote devices via a secure websocket connection.
3. The method of claim 1 , wherein the set of one or more remote environments includes an augmented reality (AR) environment, a mixed reality (MR) environment, a virtual reality (VR) environment, or a web browser window.
4. The method of claim 1 , wherein a first remote device in the set of one or more remote devices applies a portion of the texture data as a texture on a corresponding face included in the geometry data to produce the partial reconstruction of the adaptable 3D representation.
5. The method of claim 1 , wherein:
the geometry data stores portions of the adaptable 3D representation as a plurality of coordinates representing different positions in a 3D coordinate space corresponding to the physical space, and
the plurality of coordinates encapsulates a digital representation of the real-world asset.
6. The method of claim 1 , wherein the remote environment further comprises a map of the partial reconstruction of the adaptable 3D representation.
7. The method of claim 1 , wherein
a first remote device in the set of one or more remote devices receives an input representing an interaction with a first section of the adaptable 3D representation, and
the interaction modifies at least one visual characteristic of the first section of the adaptable 3D representation.
8. The method of claim 1 , wherein the remote environment includes:
a digital representation of the real-world asset; and
a digital representation of one surface that is included in the physical space.
9. One or more non-transitory computer-readable media storing instructions that, when executed by one or more processors, cause the one or more processors to perform the steps of:
generating a host extended reality (XR) environment representing a physical space that includes a real-world asset;
generating, based on first sensor data captured by a depth sensor on a mobile device, three-dimensional data representing the physical space;
generating, based on second sensor data captured by an image sensor on the mobile device, two-dimensional data representing the physical space;
generating, based on the three-dimensional data and the two-dimensional data, an adaptable three-dimensional (3D) representation of the physical space;
transforming the adaptable 3D representation into geometry data comprising (i) a set of vertices, (ii) a set of faces comprising edges between pairs of vertices, and (iii) texture data;
transmitting the geometry data to a set of one or more remote devices for at least a partial reconstruction of the adaptable 3D representation of the physical space in a set of one or more remote environments, wherein at least one dimension of the partial reconstruction is modifiable responsive to user manipulation of the partial reconstruction.
10. The one or more non-transitory computer-readable media of claim 9 , wherein the set of one or more remote environments includes an augmented reality (AR) environment, a mixed reality (MR) environment, a virtual reality (VR) environment, or a web browser window.
11. The one or more non-transitory computer-readable media of claim 9 , wherein:
the geometry data stores portions of the adaptable 3D representation as a plurality of coordinates representing different positions in a 3D coordinate space corresponding to the physical space, and
the plurality of coordinates encapsulates a digital representation of the real-world asset.
12. The one or more non-transitory computer-readable media of claim 9 , wherein the remote environment further comprises a map of the partial reconstruction of the adaptable 3D representation.
13. The one or more non-transitory computer-readable media of claim 9 , wherein:
a first remote device in the set of one or more remote devices receives an input representing an interaction with a first section of the adaptable 3D representation, and
the interaction modifies at least one visual characteristic of the first section of the adaptable 3D representation.
14. The one or more non-transitory computer-readable media of claim 9 , wherein the remote environment includes:
a digital representation of the real-world asset; and
a digital representation of one surface that is included in the physical space.
15. A system comprising:
a memory storing an extended reality application; and
a processor, coupled to the memory, that executes the extended reality application by performing the steps of:
generating a host extended reality (XR) environment representing a physical space that includes a real-world asset;
generating, based on first sensor data captured by a depth sensor on a mobile device, three-dimensional data representing the physical space;
generating, based on second sensor data captured by an image sensor on the mobile device, two-dimensional data representing the physical space;
generating, based on the three-dimensional data and the two-dimensional data, an adaptable three-dimensional (3D) representation of the physical space;
transforming the adaptable 3D representation into geometry data comprising (i) a set of vertices, (ii) a set of faces comprising edges between pairs of vertices, and (iii) texture data;
transmitting the geometry data to a set of one or more remote devices for at least a partial reconstruction of the adaptable 3D representation of the physical space in a set of one or more remote environments, wherein at least one dimension of the partial reconstruction is modifiable responsive to user manipulation of the partial reconstruction.
16. The system of claim 15 , wherein the set of one or more remote environments includes an augmented reality (AR) environment, a mixed reality (MR) environment, a virtual reality (VR) environment, or a web browser window.
17. The system of claim 15 , wherein a first device remote device in the set of one or more remote devices comprises one of a mobile phone, a mobile tablet, a hololens, a virtual reality (VR) console, or a web browser.
18. The system of claim 15 , wherein:
the geometry data stores portions of the adaptable 3D representation as a plurality of coordinates representing different positions in a 3D coordinate space corresponding to the physical space, and
the plurality of coordinates encapsulates a digital representation of the real-world asset.
19. The system of claim 15 , wherein the remote environment further comprises a map of the partial reconstruction of the adaptable 3D representation.
20. The system of claim 15 , wherein
a first remote device in the set of one or more remote devices receives an input representing an interaction with a first section of the adaptable 3D representation, and
the interaction modifies at least one visual characteristic of the first section of the adaptable 3D representation.