IP Library › Granted Patent US 12,536,744
Granted Patent B2
US 12,536,744 · App. 18/541,700 · Granted Jan 27, 2026

Methods and systems for collaboratively scanning an environment

Inventors: Charles Dasher (Lawrenceville, GA); Reda Harb (Tampa, FL)
Assignee: Adeia Guides Inc.
G06T17/05G01C21/3635G06T7/11G06V10/44G06V10/764G06V2201/07
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,536,744
App. No.
18/541,700
Granted
Jan 27, 2026
Kind
B2
Abstract

There are provided systems and methods for scanning objects in a virtual environment. In particular, the present disclosure pertains to the domain of three-dimensional (3D) object capturing in extended reality (XR) environments and to an optimized system and method for passively capturing 3D objects within Extended Reality (XR) environments. A selection of an object from within an XR environment by a user via a user device is detected. A 3D capture session is initiated based on the detection. Scan data corresponding to the selected object is captured during the 3D capture session, where the capturing is performed as a background process on the user device. A 3D representation or model of the object is generated in the XR environment and provided to the user via the user device.

Claims (68)

1 . A method for collaboratively scanning an environment, the method comprising:

receiving first geometric and texture scan data of an environment captured from a first user device associated with a first user profile as a background operation of the first user device;

receiving second geometric and texture scan data of the environment captured from a second user device associated with a second user profile as a background operation of the second user device;

storing the first and second scan data in a database;

generating a 3D map of the environment by extracting one or more features from the first and second scan data;

determining a portion of the 3D map created with the features extracted from the first user device and rewarding the first user profile a portion of a reward based on the portion of the 3D map created with the features extracted from the first user device; and

determining a portion of the 3D map created with the features extracted from the second user device and rewarding the second user profile a portion of a reward quantitatively calculated based on the portion of the 3D map created with the features extracted from the second user device.

2 . The method of claim 1 , further comprising:

detecting one or more objects from the scan data based on a frequency of occurrence of the one or more objects in the scan data;

generating a priority for scanning the one or more objects based on the frequency of occurrence; and

wherein the portion of the reward is further based on the priority of the one or more objects.

3 . The method of claim 2 , further comprising:

instructing the first and second user devices to capture scan data as a background operation corresponding to the priority of the one or more objects, while the one or more objects are within a viewport of the user device.

4 . The method of claim 1 , further comprising:

displaying an assistive user interface element around one or more objects within the viewport of the first or second user device to aid in the capture of additional scan data of the one or more objects.

5 . The method of claim 1 , further comprising:

determining completion status data for the generation of the 3D map;

generating an overlay comprising the 3D map on the environment; and

displaying the overlay within the viewport of the user device.

6 . The method of claim 1 , further comprising, generating a digital twin of the physical environment based on the 3D map and scan data.

7 . The method of claim 6 , further comprising:

receiving a request for navigation from a first point of interest to a second point of interest in the environment;

generating a navigation route in the digital twin of the physical environment; and

providing navigation instructions to a user device from the first point of interest to the second point of interest.

8 . The method of claim 7 , further comprising:

updating the real-time navigation instruction to the user device based on the movement of the user device through the digital twin environment.

9 . The method of claim 1 , further comprising:

applying spatial segmentation on the scan data corresponding to the environment;

identifying a portion of the environment based on the spatial segmentation of the environment; and

receiving scan data corresponding to the portion of the environment;

wherein the 3D map of the environment is updated based on the scan data corresponding to the portion.

10 . The method of claim 1 , further comprising:

creating at least one classifier algorithm based on the scan data of the environment; and using the classifier algorithm to detect a presence of a physical object in the environment.

11 . A system for collaboratively scanning an environment, the system comprising control circuitry configured to:

receive first geometric and texture scan data of an environment captured from a first user device as a background operation of the first user device;

receive second geometric and texture scan data of the environment captured from a second user device as a background operation of the second user device;

store the first and second scan data in a database;

generate a 3D map of the environment by extracting one or more features from the first and second scan data;

determine a portion of the 3D map created with the features extracted from the first user device and rewarding the first user device a portion of a reward based on the portion of the 3D map created with the features extracted from the first user device; and

determine a portion of the 3D map created with the features extracted from the second user device and rewarding the second user device a portion of a reward quantitatively calculated based on the portion of the 3D map created with the features extracted from the second user device.

12 . The system of claim 11 , the control circuitry configured to:

determine one or more objects from the scan data based on a frequency of occurrence of the one or more objects in the scan data;

generate a priority for scanning the one or more objects based on the frequency of occurrence; and

wherein the portion of the reward is further based on the priority of the one or more objects.

13 . The system of claim 12 , the control circuitry configured to:

instruct the first and second user devices to capture scan data as a background operation corresponding to the priority of the one or more objects, while the one or more objects are within a viewport of the user device.

14 . The system of claim 11 , the control circuitry configured to:

display an assistive user interface element around one or more objects on the viewport of the first or second user device to aid in the capture of additional scan data of the one or more objects.

15 . The system of claim 11 , the control circuitry configured to:

determine completion status data for the generation of the 3D map;

generate an overlay comprising the 3D map on the environment; and

display the overlay on the viewport of the user device.

16 . The system of claim 11 , the control circuitry configured to:

generate a digital twin of the physical environment based on the 3D map and scan data.

17 . The system of claim 16 , the control circuitry configured to:

receive a request for navigation from a first point of interest to a second point of interest in the environment;

generate a navigation route in the digital twin of the physical environment; and

provide navigation instructions to a user device from the first point of interest to the second point of interest.

18 . The system of claim 17 , the control circuitry configured to:

update the real-time navigation instruction to the user device based on the movement of the user device through the digital twin environment.

19 . The system of claim 11 , the control circuitry configured to:

apply spatial segmentation on the scan data corresponding to the environment;

identify a portion of the environment based on the spatial segmentation of the environment; and

receive scan data corresponding to the portion of the environment;

wherein the 3D map of the environment is updated based on the scan data corresponding to the portion.

20 . The system of claim 11 , the control circuitry configured to:

create at least one classifier algorithm based on the scan data of the environment; and

use the classifier algorithm to detect a presence of a physical object in the environment.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 9, 2024
From: DASHER, CHARLES; HARB, REDA
To: ADEIA GUIDES INC.
Reel/Frame 067050/0553 →
Continuity (1)
Related Publication 20250200885A1 · Jun 19, 2025
References Cited (54)
US 8818768B1 · Fan et al. · 2014 [cited by applicant]
US 9536352B2 · Anderson · 2017 [cited by examiner]
US 11436808B2 · Wang · 2022 [cited by examiner]
US 11922368B1 · Wozniak et al. · 2024 [cited by applicant]
US 12039735B2 · Feng · 2024 [cited by examiner]
US 12112435B1 · Bhushan et al. · 2024 [cited by applicant]
US 20090237396A1 · Venezia et al. · 2009 [cited by applicant]
US 20130083064A1 · Geisner et al. · 2013 [cited by applicant]
US 20130242113A1 · Tanaka · 2013 [cited by examiner]
US 20140198096A1 · Mitchell · 2014 [cited by examiner]
US 20140226858A1 · Kang et al. · 2014 [cited by applicant]
US 20170154204A1 · Ryu et al. · 2017 [cited by applicant]
US 20170169619A1 · Mullins · 2017 [cited by applicant]
US 20180114363A1 · Rosenbaum · 2018 [cited by examiner]
US 20200035025A1 · Crocker et al. · 2020 [cited by applicant]
US 20200053253A1 · Kavallierou · 2020 [cited by applicant]
US 20200080853A1 · Tam · 2020 [cited by examiner]
US 20210209339A1 · You · 2021 [cited by examiner]
US 20210326777A1 · Stevens · 2021 [cited by examiner]
US 20220277543A1 · Saklatvala · 2022 [cited by applicant]
US 20230368458A1 · Dryer et al. · 2023 [cited by applicant]
US 20230419616A1 · Dudovitch et al. · 2023 [cited by applicant]
US 20240104132A1 · Banfield et al. · 2024 [cited by applicant]
US 20240265654A1 · Tomizuka et al. · 2024 [cited by applicant]
US 20240290049A1 · Prideaux-Ghee et al. · 2024 [cited by applicant]
US 20250005867A1 · Reynolds et al. · 2025 [cited by applicant]
US 20250078401A1 · Biswas et al. · 2025 [cited by applicant]
US 20250200875A1 · Dasher · 2025 [cited by examiner]
US 20250200885A1 · Dasher · 2025 [cited by examiner]
U.S. Appl. No. 18/541,711, filed Dec. 15, 2023, Charles Dasher. [cited by applicant]
Abou-Chakra, J., “Scene Understanding, Semantic SLAM, Implicit Representations”, In Conference on Robot Learning, available online at: <https://nikosuenderhauf.github.io/projects/sceneunderstanding/>, retrieved on Nov. … [cited by applicant]
Anonymous, “Are Online Trade Schools Worth It?,” (https://www.onlineschoolscenter.com/are-online-trade-schools-worth-it/) (downloaded Aug. 14, 2023; undated) (18 pages). [cited by applicant]
Anonymous, “Room scan visualization,” Microsoft, Sep. 21, 2022 (https://learn.microsoft.com/en-us/windows/mixed-reality/design/room-scan-visualization) (3 pages). [cited by applicant]
Anonymous, “Scanning and detecting 3D objects,” Sample Code, (https://developer.apple.com/documentation/arkit/arkit_in_ios/content_anchors/scanning_and_detecting_3d_objects) (downloaded Aug. 14, 2023; undated) (7 pages). [cited by applicant]
Apple Developer, “Augmented Reality—Object Capture”, Apple Developer, “Augmented Reality—Object Capture” (Downloaded Mar. 15, 2024) Retrieved from https://developer.apple.com/augmented-reality/object-capture/ (2 pages). [cited by applicant]
Burgess, “Tour the British Museum on Google Street View,” Wired (Dec. 11, 2015) (https://www.wired.co.uk/article/british-museum-google-street-view) (7 pages). [cited by applicant]
Chen et al., “An Overview on Visual SLAM: From Tradition to Semantic,” Remote Sensing, MDPI, 14:3010 (May 29, 2022) (47 pages). [cited by applicant]
Chen, Zhiqin, et al., “MobileNeRF: Exploiting the Polygon Rasterization Pipeline for Efficient Neural Field Rendering on Mobile Architectures”, Chen, “MobileNeRF: Exploiting the Polygon Rasterization Pipeline for Effici… [cited by applicant]
Crawford, How to host a real estate virtual open house in 7 steps, Next (Jul. 9, 2020) (13 pages) (https://www.nextinsurance.com/blog/how-host-a-real-estate-virtual-open-house-in-7-steps). [cited by applicant]
Deci.AI, “The Ultimate Guide to Deep Learning Model Quantization and Quantization-Aware Training”, Deci.AI, “The Ultimate Guide to Deep Learning Model Quantization and Quantization-Aware Training” (Downloaded Mar. 15, 2… [cited by applicant]
Edwards, Benj , “New AI model can “cut out” any object within an image-and Meta is sharing the code”, Edwards, “New AI model can “cut out” any object within an image-and Meta is sharing the code” (2023), Retrieved from … [cited by applicant]
Kiri Engine, “Kiri Engine App”, Kiri Engine, “Kiri Engine App”, (Downloaded Mar. 15, 2024) Retrieved from https://www.kiriengine.app (7 Pages). [cited by applicant]
Lancial, Braxton , “The Basics: Niantic Lightship”, https://lightship.dev/guides/lightship-basics/, 2022. [cited by applicant]
Mars Gadgets , “Free 3D Scanner Apps (Photogrammetry) 2022”, Mars Gadgets, “Free 30 Scanner Apps (Photogrammetry) 2022” (Sep. 26, 2021) Retrieved from https://www.youtube.com/watch?v=K3PyUMOPI1M (12 Pages). [cited by applicant]
Matterport, “Get a 2D floor plan from a 3D tour.,” (downloaded Sep. 13, 2023, https://matterport.com/how-it-works/schematic-floor-plans). [cited by applicant]
Neta Zmora et al., “Achieving FP32 Accuracy for INT8 Inference Using Quantization Aware Training with NVIDIA TensorRT”, (Jul. 20, 2021), (https://deci.ai/quantization-and-quantization-aware-training/), 8 pages. [cited by applicant]
Niantic , “Lightship VPS: Building Our 30 Map From Crowdsourced Scans”, Niantic “Lightship VPS: Building Our 30 Map From Crowdsourced Scans” (Nov. 10, 2022) Retrieved from https://nianticlabs.com/news/vps-part-2?hl=en (… [cited by applicant]
NVIDIA Game Developer, “NVIDIA's Photogrammetry ‘Live Visualizer’ using Reality Capture and Unity”, NVIDIA Game Developer, “NVIDIA's Photogrammetry ‘Live Visualizer’ using Reality Capture and Unity” (Mar. 9, 2017) Retri… [cited by applicant]
Papers With Code , “3D Semantic Segmentation”, Papers With Code, “3D Semantic Segmentation” (Downloaded Mar. 15, 24), Retrieved from https://paperswithcode.com/task/3d-semantic-segmentation (17 Pages). [cited by applicant]
Perez, “Apple Acquires Flyby Media, Makers Of Tech That “Sees” The World Around You,” Join TechCrunch (Jan. 29, 2016) (9 pages) (Apple Acquires Flyby Media, Makers Of Tech That “Sees” The World Around You | TechCrunch). [cited by applicant]
Photogrammetry as defined by Wikipedia, https://en.wikipedia.org/wiki/Photogrammetry, retrieved from internet Oct. 3, 2023. [cited by applicant]
Roomvo, “Where imagination meets results,” (downloaded Sep. 13, 2023; https://get.roomvo.com/product-room-visualizer-flooring/) (7 pages). [cited by applicant]
Weinmann et al., “Efficient 3D Mapping and Modelling of Indoor Scenes with the Microsoft HoloLens: A Survey,” PFG, 89:319-333 (2021). [cited by applicant]
U.S. Appl. No. 18/214,776, filed Jun. 27, 2023, Jennifer Reynolds. [cited by applicant]