IP Library Granted Patent US 12,277,659
Granted Patent B1
US 12,277,659 · App. 18/479,688 · Granted Apr 15, 2025

Networked remote collaboration system

Inventors: Devin Bhushan (San Jose, CA); Seunghee Han (San Jose, CA); Caelin Thomas Jackson-King (Santa Clara, CA); Jamie Kuppel (Sunnyvale, CA); Sammy Lee (San Jose, CA); Derek Sykes (East Palo Alto, CA); Stanislav Yazhenskikh (Santa Clara, CA); Jim Jiaming Zhu (Scarborough, CA)
Assignee: SPLUNK INC.
G06T19/006G06T7/521G06T15/205H04L67/131H04L65/4053
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,277,659
App. No.
18/479,688
Filed
Oct 2, 2023
Granted
Apr 15, 2025
Kind
B1
Art Unit
2616
USPC
345/632
Abstract

Various implementations of the present application set forth a method comprising generating, based on first sensor data captured by a depth sensor on a mobile device, three-dimensional data representing a physical space that includes a real-world asset, generating, based on second sensor data captured by an image sensor on the mobile device, two-dimensional data representing the physical space, combining, based on a correlation the three-dimensional data and the two-dimensional data, the two-dimensional data and the three-dimensional data into an extended reality (XR) stream, where the XR stream includes a digital representation of the real-world asset, and transmitting, to a remote device, the XR stream for rendering at least a portion of the digital representation of the real-world asset in a remote XR environment.

Claims (35)

1. A method comprising:

capturing, using a first sensor of a mobile device, three-dimensional data representing a physical space and a real-world asset in the physical space;

capturing, using a second sensor of the mobile device, two-dimensional data representing the physical space and the real-world asset;

retrieving raw machine data based on a mapping between an asset identifier and the real-world asset, wherein the raw machine data is produced by the real-world asset and linked to the asset identifier;

combining the two-dimensional data and the three-dimensional data into an extended reality (XR) stream, wherein the XR stream includes one or more visualizations based on the raw machine data; and

transmitting the XR stream to one or more recipients.

2. The method of claim 1 , further comprising determining whether a scan of the physical space is successful for a plurality of specific regions of the physical space.

3. The method of claim 1 , further comprising generating, on a display of the mobile device, instructions to rescan at least a portion of the physical space.

4. The method of claim 1 , further comprising determining, based on related sets of coordinate data, a correlation between a portion of the two-dimensional data and a portion of the three-dimensional data.

5. The method of claim 1 , wherein the XR stream comprises a discrete set of data corresponding to a scene associated with a particular time.

6. The method of claim 1 , wherein the one or more recipients include at least one of: a recipient device or a storage device of a remote service.

7. The method of claim 1 , wherein the XR stream comprises a set of serialized chunks.

8. The method of claim 1 , further comprising receiving, from at least a subset of the one or more recipients, a status code indicating that at least a portion of the XR stream is successfully received.

9. The method of claim 1 , wherein the first sensor comprises a light detection and ranging (LiDAR) scanner, and the second sensor comprises a camera that captures polychromatic images.

10. The method of claim 1 , wherein combining the two-dimensional data and the three-dimensional data comprises applying a portion of the two-dimensional data as a texture on a corresponding surface of a portion of the three-dimensional data.

11. One or more non-transitory computer-readable media storing instructions that, when executed by one or more processors, cause the one or more processors to perform the steps of:

capturing, using a first sensor of a host device, three-dimensional data representing a physical space and a real-world asset in the physical space;

capturing, using a second sensor of the host device, two-dimensional data representing the physical space and the real-world asset;

retrieving raw machine data based on a mapping between an asset identifier and the real-world asset, wherein the raw machine data is produced by the real-world asset and linked to the asset identifier;

combining the two-dimensional data and the three-dimensional data into an extended reality (XR) stream, wherein the XR stream includes one or more visualizations based on the raw machine data; and

transmitting the XR stream to one or more recipients.

12. The one or more non-transitory computer-readable media of claim 11 , wherein the XR stream further includes a digital representation of the real-world asset, and a digital representation of a background surface in the physical space.

13. The one or more non-transitory computer-readable media of claim 11 , wherein when executed by one or more processors, the instructions further cause the one or more processors to perform the steps of re-scanning, using the host device, the physical space based on a change in the location of host device.

14. The one or more non-transitory computer-readable media of claim 11 , wherein when executed by one or more processors, the instructions further cause the one or more processors to perform the steps of:

receiving, using the host device, a message requesting a re-scan of at least a portion of the physical space; and

re-scanning, using the host device, at least the portion of the physical space based on the message.

15. A method, comprising:

receiving an extended reality (XR) stream containing three-dimensional data captured using a first sensor of a mobile device, the three-dimensional data being combined with two-dimensional data captured using a second sensor of the mobile device, wherein a respective one of the three-dimensional data and the two-dimensional data represents a physical space that includes a real-world asset;

retrieving raw machine data based on a mapping between an asset identifier and the real-world asset, wherein the raw machine data is produced by the real-world asset and linked to the asset identifier; and

rendering at least a portion of the XR stream for display, wherein the at least the portion of the XR stream includes one or more visualizations based on the raw machine data.

16. The method of claim 15 , wherein the XR stream comprises a discrete set of data corresponding to a scene associated with a particular time.

17. The method of claim 15 , wherein the XR stream corresponds to a set of serialized chunks.

18. The method of claim 15 , further comprising transmitting a status code indicating that at least a portion of the XR stream is successfully received.

19. The method of claim 15 , wherein the three-dimensional data is depth data.

20. The method of claim 15 , wherein the two-dimensional data is image data.

Assignments (3)
CHANGE OF NAME Recorded Jul 22, 2025
From: SPLUNK INC.
To: SPLUNK LLC
Reel/Frame 072170/0599 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 22, 2025
From: SPLUNK LLC
To: CISCO TECHNOLOGY, INC.
Reel/Frame 072173/0058 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 12, 2024
From: BHUSHAN, DEVIN; HAN, SEUNGHEE; JACKSON-KING, CAELIN THOMAS; KUPPEL, JAMIE; LEE, SAMMY; SYKES, DEREK; YAZHENSKIKH, STANISLAV; ZHU, JIM JIAMING
To: SPLUNK INC.
Reel/Frame 067920/0457 →
Continuity (4)
Continuation 17086318 · Oct 30, 2020
Provisional Application 63093111 · Oct 16, 2020
Provisional Application 63093123 · Oct 16, 2020
Provisional Application 63093143 · Oct 16, 2020
References Cited (56)
US 7937344B2 · Baum et al. · 2011 [cited by applicant]
US 8112425B2 · Baum et al. · 2012 [cited by applicant]
US 8751529B2 · Zhang et al. · 2014 [cited by applicant]
US 8788525B2 · Neels et al. · 2014 [cited by applicant]
US 9215240B2 · Merza et al. · 2015 [cited by applicant]
US 9286413B1 · Coates et al. · 2016 [cited by applicant]
US 10127258B2 · Lamas et al. · 2018 [cited by applicant]
US 10282898B1 · Kuntsevich et al. · 2019 [cited by applicant]
US 20090303507A1 · Abeloe · 2009 [cited by applicant]
US 20130038633A1 · Maggiore · 2013 [cited by applicant]
US 20130314410A1 · Gravois et al. · 2013 [cited by applicant]
US 20160148417A1 · Kim et al. · 2016 [cited by applicant]
US 20170083572A1 · Tankersley et al. · 2017 [cited by applicant]
US 20170243403A1 · Daniels et al. · 2017 [cited by applicant]
US 20170344674A1 · McCloskey et al. · 2017 [cited by applicant]
US 20180107876A1 · Lee · 2018 [cited by applicant]
US 20180136815A1 · Tomizuka et al. · 2018 [cited by applicant]
US 20180225880A1 · Yasutake · 2018 [cited by applicant]
US 20180322674A1 · Du · 2018 [cited by applicant]
US 20190042832A1 · Venshtain · 2019 [cited by applicant]
US 20190046276A1 · Inglese et al. · 2019 [cited by applicant]
US 20190065027A1 · Hauenstein et al. · 2019 [cited by applicant]
US 20190098106A1 · Mungel et al. · 2019 [cited by applicant]
US 20190313059A1 · Agarawala et al. · 2019 [cited by applicant]
US 20190342541A1 · Bai et al. · 2019 [cited by applicant]
US 20190371060A1 · Energin et al. · 2019 [cited by applicant]
US 20190394103A1 · Korkin et al. · 2019 [cited by applicant]
US 20200005538A1 · Neeter · 2020 [cited by applicant]
US 20200043237A1 · Desai et al. · 2020 [cited by applicant]
US 20200105013A1 · Chen · 2020 [cited by applicant]
US 20200133618A1 · Kim · 2020 [cited by applicant]
US 20200134911A1 · Van Hoff et al. · 2020 [cited by applicant]
US 20200221070A1 · Godar · 2020 [cited by applicant]
US 20200241647A1 · Kanda · 2020 [cited by applicant]
US 20200329214A1 · Ahn et al. · 2020 [cited by applicant]
US 20200342673A1 · Lohr et al. · 2020 [cited by applicant]
US 20200349751A1 · Bentovim et al. · 2020 [cited by applicant]
US 20200371665A1 · Clausen et al. · 2020 [cited by applicant]
US 20200410752A1 · Jiang et al. · 2020 [cited by applicant]
US 20210104090A1 · Hur et al. · 2021 [cited by applicant]
US 20210142561A1 · Aigerman · 2021 [cited by applicant]
US 20220044016A1 · Pan · 2022 [cited by examiner]
US 20220237865A1 · Ohashi et al. · 2022 [cited by applicant]
CA 2294538A1 · 1998 [cited by applicant]
Splunk Enterprise 8.0.0 Overview, available online, retrieved on May 20, 2020 from docs.splunk.com, 17 pages. [cited by applicant]
Splunk Cloud 8.0.2004 User Manual, available online, retrieved on May 20, 2020 from docs.splunk.com, 66 pages. [cited by applicant]
Splunk Quick Reference Guide, updated 2019, available online at https://www.splunk.com/pdfs/solution-guides/splunk-quick-reference-guide.pdf, retrieved on May 20, 2020, 6 pages. [cited by applicant]
Carraso, David, “Exploring Splunk,” published by CITO Research, New York, NY, Apr. 2012, 156 pages. [cited by applicant]
Bitincka et al., “Optimizing Data Analysis with a Semi-structured Time Series Database,” self-published, first presented at “Workshop on Managing Systems via Log Analysis and Machine Learning Techniques (SLAML)”, Vancou… [cited by applicant]
Dong et al., “Real-Time Re-Textured Geometry Modeling Using Microsoft Hololens”, IEEE, Mar. 18-22, 2018, pp. 231-237. [cited by applicant]
3GPP TR 26.928, “3rd Generation Partnership Project; Technical Specification Group Services and System Aspects; Extended Reality (XR) in 5G (Release 16)”, URL:ftp://ftp.3gpp.org/Specs/archive/26_series/26.928/26928-123.… [cited by applicant]
Non Final Office Action received for U.S. Appl. No. 18/089,416 dated Nov. 6, 2023, 35 pages. [cited by applicant]
Final Office Action received for U.S. Appl. No. 18/089,416 dated Apr. 4, 2024, 10 pages. [cited by applicant]
Notice of Allowance received for U.S. Appl. No. 18/089,416 dated Jun. 11, 2024, 5 pages. [cited by applicant]
Non Final Office Action received for U.S. Appl. No. 18/068,471 dated Oct. 30, 2024, 48 pages. [cited by applicant]
Non Final Office Action received for U.S. Appl. No. 18/493,723 dated Oct. 31, 2024, 29 pages. [cited by applicant]