IP Library › Granted Patent US 11,727,643
Granted Patent B1
US 11,727,643 · App. 17/086,325 · Granted Aug 15, 2023

Multi-environment networked remote collaboration system

Inventors: Devin Bhushan (San Jose, CA); Seunghee Han (San Jose, CA); Caelin Thomas Jackson-King (Gormley, CA); Jamie Kuppel (Sunnyvale, CA); Sammy Lee (San Jose, CA); Derek Sykes (East Palo Alto, CA); Stanislav Yazhenskikh (Santa Clara, CA); Jim Jiaming Zhu (Scarborough, CA)
Assignee: SPLUNK INC.
G06T19/003G06T17/10G06T17/20G06T19/20H04L65/4053H04L67/131
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,727,643
App. No.
17/086,325
Filed
Oct 30, 2020
Granted
Aug 15, 2023
Kind
B1
Art Unit
2616
USPC
345/420
Abstract

Various implementations of the present application set forth a method comprising receiving, by a remote device from a host device, geometry data representing a physical space that is remote to a location of the remote device, where the geometry data comprises a set of vertices, a set of faces comprising edges between pairs of vertices, and texture data, constructing, based on the geometry data, an adaptable three-dimensional (3D) representation of the physical space for display at the location of the remote device, receiving, by the remote device, an input representing an interaction with at least one portion of the adaptable 3D representation, and transmitting, to the host device, data corresponding to the interaction.

Claims (47)

1. A method comprising:

receiving, by a remote device from a host device, geometry data representing a physical space including a real-world asset that is remote to a location of the remote device, wherein the geometry data comprises (i) a set of vertices, (ii) a set of faces comprising edges between pairs of vertices, and (iii) texture data;

constructing, based on the geometry data, an adaptable three-dimensional (3D) representation of the physical space for display at the location of the remote device, wherein the adaptable 3D representation is not displayed at a location of the host device;

displaying, at the location of the remote device, an avatar representation of the host device, wherein a position of the avatar representation of the host device relative to the adaptable 3D representation corresponds to a position of the host device relative to the physical space;

receiving, by the remote device, an input representing an interaction with a representation of the real-world asset in the adaptable 3D representation; and

transmitting, to the host device, data corresponding to the interaction, wherein the host device, based on the data, displays the interaction with the representation of the real-world asset in a host extendable reality (XR) environment representing the physical space at a corresponding position relative to the real-world asset.

2. The method of claim 1 , further comprising:

transmitting, to the host device, data indicating a position of the remote device relative to the representation of the real-world asset in the adaptable 3D representation,

wherein the host device displays, an avatar representation of the remote device, wherein a position of the avatar representation of the remote device in the host XR environment reflects the position of the remote device relative to the real-world asset.

3. The method of claim 1 , further comprising generating, for display at the location of the remote device, a graphical pointer that highlights a portion of the adaptable 3D representation being displayed at the location of the remote device.

4. The method of claim 1 , further comprising generating, for display at the location of the remote device, a set of one or more collaboration tools that modify an appearance of at least a portion of the adaptable 3D representation being displayed at the location of the remote device.

5. The method of claim 4 , wherein the set of one or more collaboration tools includes at least one display pin placed on a face included in the set of faces.

6. The method of claim 4 , wherein the set of one or more collaboration tools includes a map of the adaptable 3D representation.

7. The method of claim 4 , wherein the set of one or more collaboration tools includes a color palette that provides a set of colors that changes a section of the adaptable 3D representation to a specific color.

8. The method of claim 4 , wherein the set of one or more collaboration tools includes a display panel that provides an annotation at a specific position relative to the adaptable 3D representation.

9. The method of claim 1 , further comprising:

generating, for display at the location of the remote device, a display panel that is at a position relative to a portion of the adaptable 3D representation,

wherein the display panel displays data associated with the real-world asset.

10. One or more non-transitory computer-readable media storing instructions that, when executed by one or more processors, cause the one or more processors to perform the steps of:

receiving, by a remote device from a host device, geometry data representing a physical space including a real-world asset that is remote to a location of the remote device, wherein the geometry data comprises (i) a set of vertices, (ii) a set of faces comprising edges between pairs of vertices, and (iii) texture data;

constructing, based on the geometry data, an adaptable three-dimensional (3D) representation of the physical space for display at the location of the remote device, wherein the adaptable 3D representation is not displayed at a location of the host device;

displaying, at the location of the remote device, an avatar representation of the host device, wherein a position of the avatar representation of the host device relative to the adaptable 3D representation corresponds to a position of the host device relative to the physical space;

receiving, by the remote device, an input representing an interaction with a representation of the real-world asset in the adaptable 3D representation; and

transmitting, to the host device, data corresponding to the interaction, wherein the host device, based on the data, displays the interaction with the representation of the real-world asset in a host extendable reality (XR) environment representing the physical space at a corresponding position relative to the real-world asset.

11. The one or more non-transitory computer-readable media of claim 10 , further storing instructions that, when executed by the one or more processors, cause the one or more processors to perform the steps of:

transmitting, to the host device, data indicating a position of the remote device relative to the representation of the real-world asset in the adaptable 3D representation,

wherein the host device displays, an avatar representation of the remote device, wherein a position of the avatar representation of the remote device in the host XR environment reflects the position of the remote device relative to the real-world asset.

12. The one or more non-transitory computer-readable media of claim 10 , further storing instructions that, when executed by the one or more processors, cause the one or more processors to perform the step of generating, for display at the location of the remote device, a graphical pointer that highlights a portion of the adaptable 3D representation being displayed at the location of the remote device.

13. The one or more non-transitory computer-readable media of claim 10 , further storing instructions that, when executed by the one or more processors, cause the one or more processors to perform the step of generating, for display at the location of the remote device, a set of one or more collaboration tools that modify an appearance of at least a portion of the adaptable 3D representation being displayed at the location of the remote device.

14. The one or more non-transitory computer-readable media of claim 10 , further storing instructions that, when executed by the one or more processors, cause the one or more processors to perform the steps of:

receiving updated geometry data representing the physical space, wherein the geometry data comprises (i) an updated set of vertices, (ii) an updated set of faces comprising edges between pairs of vertices, or (iii) updated texture data; and

updating, based on the updated geometry data, the adaptable 3D representation.

15. The one or more non-transitory computer-readable media of claim 10 , further storing instructions that, when executed by the one or more processors, cause the one or more processors to perform the steps of:

receiving, from a data source, a set of values associated with the real-world asset; and

generating, for display in a display panel, a visualization based on the set of values.

16. A system comprising:

a memory storing at least one or more of an extended reality application or a mobile operations application; and

a processor, coupled to the memory, that executes at least one of the extended reality application or the mobile operations application to perform the steps of:

receiving, from a host device, geometry data representing a physical space including a real-world asset that is remote to a location of a remote device, wherein the geometry data comprises (i) a set of vertices, (ii) a set of faces comprising edges between pairs of vertices, and (iii) texture data;

constructing, based on the geometry data, an adaptable three-dimensional (3D) representation of the physical space for display at the location of the remote device, wherein the adaptable 3D representation is not displayed at a location of the host device;

displaying, at the location of the remote device, an avatar representation of the host device, wherein a position of the avatar representation of the host device relative to the adaptable 3D representation corresponds to a position of the host device relative to the physical space;

receiving, by the remote device, an input representing an interaction with a representation of the real-world asset in the adaptable 3D representation; and

transmitting, to the host device, data corresponding to the interaction, wherein the host device, based on the data, displays the interaction with the representation of the real-world asset in a host extendable reality (XR) environment representing the physical space at a corresponding position relative to the real-world asset.

17. The system of claim 16 , wherein the processor further performs the steps of:

transmitting, to the host device, data indicating a position of the remote device relative to the representation of the real-world asset in the adaptable 3D representation,

wherein the host device displays, an avatar representation of the remote device, wherein a position of the avatar representation of the remote device in the host XR environment reflects the position of the remote device relative to the real-world asset.

18. The system of claim 16 , wherein the processor further performs the step of generating, for display at the location of the remote device, a set of one or more collaboration tools that modify an appearance of at least a portion of the adaptable 3D representation being displayed at the location of the remote device.

Assignments (3)
CHANGE OF NAME Recorded Jul 22, 2025
From: SPLUNK INC.
To: SPLUNK LLC
Reel/Frame 072170/0599 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 22, 2025
From: SPLUNK LLC
To: CISCO TECHNOLOGY, INC.
Reel/Frame 072173/0058 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 15, 2022
From: BHUSHAN, DEVIN; HAN, SEUNGHEE; JACKSON-KING, CAELIN THOMAS; KUPPEL, JAMIE; LEE, SAMMY; SYKES, DEREK; YAZHENSKIKH, STANISLAV; ZHU, JIM JIAMING
To: SPLUNK INC.
Reel/Frame 061105/0038 →
Continuity (3)
Provisional Application 63093123 · Oct 16, 2020
Provisional Application 63093143 · Oct 16, 2020
Provisional Application 63093111 · Oct 16, 2020
Cited By (3)
US 12,437,268 US 12,493,615 US 12,608,370