IP Library Granted Patent US 10,586,386
Granted Patent B2
US 10,586,386 · App. 16/007,566 · Granted Mar 10, 2020

Processing and/or transmitting 3D data associated with a 3D model of an interior environment

Inventors: Matthew Tschudy Bell (Palo Alto, CA); David Alan Gausebeck (Mountain View, CA); Gregory William Coombe (Mountain View, CA); Daniel Ford (Mountain View, CA)
Assignee: Matterport, Inc.
G06T17/20G06T3/40G06T2210/04G06T2210/08G06T2210/36H04N21/2362
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,586,386
App. No.
16/007,566
Granted
Mar 10, 2020
Kind
B2
Abstract

Systems and techniques for processing and/or transmitting three-dimensional (3D) data are presented. A partitioning component receives captured 3D data associated with a 3D model of an interior environment and partitions the captured 3D data into at least one data chunk associated with at least a first level of detail and a second level of detail. A data component stores 3D data including at least the first level of detail and the second level of detail for the at least one data chunk. An output component transmits a portion of data from the at least one data chunk that is associated with the first level of detail or the second level of detail to a remote client device based on information associated with the first level of detail and the second level of detail.

Claims (34)

1. A system, comprising:

a memory storing computer executable components; and

a processor configured to execute the following computer executable components stored in the memory:

a partitioning component that receives captured three-dimensional (3D) data associated with a 3D model of an interior environment and partitions the captured 3D data into at least one data chunk; and

an output component that transmits, to a remote device, first 3D data for a data chunk at a first level of detail and subsequently transmits, to the remote device, second 3D data for the data chunk at a second level of detail that is different than the first level of detail in response to a determination that a viewpoint associated with a rendering of the 3D model on the remote device satisfies a defined criterion.

2. The system of claim 1 , wherein the output component transmits, to the remote device, the second 3D data for the at least one data chunk at the second level of detail based on a position of the viewpoint associated with the rendering of the 3D model on the remote device.

3. The system of claim 1 , further comprising a selection component that selects the second 3D data in response to the determination that the viewpoint satisfies the defined criterion.

4. The system of claim 3 , wherein the selection component is implemented on the remote device.

5. The system of claim 3 , wherein the selection component selects the second 3D data for transmission, to the remote device, based on position data associated with the rendering of the 3D model on the remote device.

6. The system of claim 3 , wherein the selection component selects the second 3D data for transmission, to the remote device, based on a view frustum associated with a rendering of the 3D model on the remote device.

7. The system of claim 3 , wherein the selection component selects the second 3D data for transmission, to the remote device, based on a history of position data associated with a rendering of the 3D model on the remote device.

8. The system of claim 3 , wherein the selection component selects the second 3D data for transmission, to the remote device, based on a visibility-based culling technique.

9. The system of claim 1 , wherein the output component transmits, to the remote device, first texture data for the at least one data chunk at a first resolution and subsequently transmits, to the remote device, second texture data for the at least one data chunk at a second resolution in response to the determination that the viewpoint associated with the rendering of the 3D model on the remote device satisfies the defined criterion.

10. The system of claim 1 , wherein the output component transmits, to the remote device, first mesh data for the at least one data chunk at a first resolution and subsequently transmits, to the remote device, second mesh data for the at least one data chunk at a second resolution in response to the determination that the viewpoint associated with the rendering of the 3D model on the remote device satisfies the defined criterion.

11. The system of claim 1 , wherein the partitioning component partitions the captured 3D data into the at least one data chunk based on an architectural element for the 3D model.

12. A method, comprising:

employing a processor that facilitates execution of computer executable instructions stored on a non-transitory computer readable medium to implement operations, comprising:

partitioning captured three-dimensional (3D) data associated with a 3D model of an indoor environment into at least one data segment;

transmitting, to a remote device at a first instance of time, first 3D data for the at least one data segment at a first level of detail; and

transmitting, to the remote device at a second instance of time subsequent to the first instance of time, second 3D data for the at least one data segment at a second level of detail that is different than the first level of detail in response to a determination that a viewpoint position associated with a rendering of the 3D model on the remote device satisfies a defined criterion.

13. The method of claim 12 , wherein the transmitting the second 3D data comprises transmitting, to the remote device, the second 3D data for the at least one data segment at the second level of detail based on position data for the viewpoint position associated with the rendering of the 3D model on the remote device.

14. The method of claim 12 , wherein the transmitting the second 3D data comprises transmitting, to the remote device, the second 3D data for the at least one data segment at the second level of detail based on a view frustum associated with a rendering of the 3D model on the remote device.

15. The method of claim 12 , further comprising:

transmitting, to the remote device at the first instance of time, first texture data for the at least one data segment at a first resolution; and

transmitting, to the remote device at the second instance of time, second texture data for the at least one data segment at a second resolution that is higher than the first resolution in response to the determination that the viewpoint position associated with the rendering of the 3D model on the remote device satisfies the defined criterion.

16. The method of claim 12 , further comprising:

transmitting, to the remote device at the first instance of time, first mesh data for the at least one data segment at a first resolution; and

transmitting, to the remote device at the second instance of time, second mesh data for the at least one data segment at a second resolution that is higher than the first resolution in response to the determination that the viewpoint position associated with the rendering of the 3D model on the remote device satisfies the defined criterion.

17. A hardware server, comprising:

a memory storing computer executable components; and

a processor configured to execute the computer executable components to: partition three-dimensional (3D) data associated with a 3D model of an interior environment into at least one data chunk associated with an architectural element for the 3D model, transmit, to a remote device at a first instance of time, first 3D data for the at least one data chunk at a first level of detail, and transmit, to the remote device at a second instance of time subsequent to the first instance of time, second 3D data for the at least one data chunk at a second level of detail that is different than the first level of detail in response to a determination that a viewpoint associated with a rendering of the 3D model on the remote device satisfies a defined criterion.

18. The hardware server of claim 17 , wherein the processor is configured to transmit the second 3D data to the remote device based on a position of the viewpoint associated with the rendering of the 3D model on the remote device.

19. The hardware server of claim 17 , wherein the processor is further configured to execute the computer executable components to: transmit, to the remote device, texture data for the at least one data chunk.

20. The hardware server of claim 17 , wherein the processor is further configured to execute the computer executable components to: transmit, to the remote device, geometry data for the at least one data chunk.

Assignments (3)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 25, 2025
From: MATTERPORT, LLC
To: COSTAR REALTY INFORMATION, INC.
Reel/Frame 072938/0375 →
MERGER AND CHANGE OF NAME Recorded Sep 10, 2025
From: MATTERPORT, INC.; MATRIX MERGER SUB II LLC
To: MATTERPORT, LLC
Reel/Frame 072827/0337 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 13, 2018
From: BELL, MATTHEW TSCHUDY; GAUSEBECK, DAVID ALAN; COOMBE, GREGORY WILLIAM; FORD, DANIEL
To: MATTERPORT, INC.
Reel/Frame 046077/0061 →
Continuity (3)
Continuation 15187611 · Jun 20, 2016
Continuation 14213531 · Mar 14, 2014
Related Publication 20180293793A1 · Oct 11, 2018
Cited By (2)
US 12,217,311 US 12,243,168