IP Library Granted Patent US 10,803,208
Granted Patent B2
US 10,803,208 · App. 15/923,170 · Granted Oct 13, 2020

Semantic understanding of 3D data

Inventors: Matthew Tschudy Bell (Palo Alto, CA); David Alan Gausebeck (Mountain View, CA); Daniel Ford (Mountain View, CA); Gregory William Coombe (Mountain View, CA)
Assignee: Matterport, Inc.
G06F30/13G06K9/00201G06K9/00624G06T17/00G06T19/00G06T2210/04
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,803,208
App. No.
15/923,170
Granted
Oct 13, 2020
Kind
B2
Abstract

Systems and techniques for processing three-dimensional (3D) data are presented. Captured three-dimensional (3D) data associated with a 3D model of an architectural environment is received and at least a portion of the captured 3D data associated with a flat surface is identified. Furthermore, missing data associated with the portion of the captured 3D data is identified and additional 3D data for the missing data is generated based on other data associated with the portion of the captured 3D data.

Claims (29)

1. A system, comprising:

a memory storing computer executable components; and

a processor configured to execute the following computer executable components stored in the memory:

an identification component that receives captured three-dimensional (3D) data associated with a 3D model of an architectural environment and identifies at least a portion of the captured 3D data associated with a flat surface; and

a data generation component that identifies missing data associated with the portion of the captured 3D data and generates additional 3D data for the missing data based on other data associated with the portion of the captured 3D data.

2. The system of claim 1 , wherein the identification component identifies another portion of the captured 3D data associated with an object.

3. The system of claim 2 , wherein the identification component identifies the missing data associated with the portion of the captured 3D data based on boundary data associated with the other portion of the captured 3D data.

4. The system of claim 2 , wherein the data generation component identifies the other portion of the captured 3D data associated with the object based on proximity data in relation to the portion of the captured 3D data.

5. The system of claim 2 , wherein the identification component generates an object relation identifier for the portion of the captured 3D data associated with the flat surface and the other portion of the captured 3D data associated with the object.

6. The system of claim 2 , further comprising a modification component that modifies position or orientation of the other portion of the captured 3D data associated with the object.

7. The system of claim 6 , wherein the modification component modifies the position or the orientation of the other portion of the captured 3D data associated with the object based on input received via a user interface.

8. The system of claim 1 , wherein the identification component identifies an opening associated with the portion of the captured 3D data.

9. The system of claim 8 , wherein the identification component classifies the opening as a window opening or a door opening based on information associated with the opening.

10. The system of claim 1 , wherein the identification component classifies the portion of the captured 3D data surface as a floor, a wall or a ceiling based on orientation information associated with the portion of the captured 3D data.

11. The system of claim 1 , wherein the identification component defines a boundary associated with the flat surface.

12. The system of claim 1 , further comprising a modification component that modifies geometry data or texture data for the portion of the captured 3D data.

13. The system of claim 12 , wherein the modification component modifies the geometry data or the texture data for the portion of the captured 3D data based on input data received via a user interface.

14. The system of claim 12 , wherein the modification component determines illumination data associated with the texture data that is applied when modifying the texture data.

15. A method, comprising:

employing a processor that facilitates execution of computer executable instructions stored on a non-transitory computer readable medium to implement operations, comprising:

receiving captured three-dimensional (3D) data associated with a 3D model of an architectural environment;

identifying at least a portion of the captured 3D data associated with a flat plane;

identifying omitted data associated with the portion of the captured 3D data; and

generating other 3D data for the omitted data based on the portion of the captured 3D data.

16. The method of claim 15 , further comprising identifying another portion of the captured 3D data associated with an object.

17. The method of claim 16 , wherein the identifying the omitted data comprises identifying the omitted data associated with the portion of the captured 3D data based on at least one border of the other portion of the captured 3D data.

18. The method of claim 16 , wherein the identifying the other portion of the captured 3D data associated with the object comprises identifying the other portion of the captured 3D data associated with the object based on texture data associated with the portion of the captured 3D data and the other portion of the captured 3D data.

19. The method of claim 16 , further comprising generating object relation data associated with the portion of the captured 3D data and the other portion of the captured 3D data.

20. The method of claim 15 , further comprising identifying a rectangular opening associated with the portion of the captured 3D data.

Assignments (3)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 25, 2025
From: MATTERPORT, LLC
To: COSTAR REALTY INFORMATION, INC.
Reel/Frame 072938/0375 →
MERGER AND CHANGE OF NAME Recorded Sep 10, 2025
From: MATTERPORT, INC.; MATRIX MERGER SUB II LLC
To: MATTERPORT, LLC
Reel/Frame 072827/0337 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 16, 2018
From: BELL, MATTHEW TSCHUDY; GAUSEBECK, DAVID ALAN; FORD, DANIEL; COOMBE, GREGORY WILLIAM
To: MATTERPORT, INC.
Reel/Frame 045252/0530 →
Continuity (2)
Continuation 14298370 · Jun 6, 2014
Related Publication 20180203955A1 · Jul 19, 2018
Cited By (1)
US 12,217,311