IP Library Patent Application 19004162
Patent Application
App. No. 19/004,162

SYSTEMS AND METHODS FOR GENERATING PROPERTY LAYOUTS AND ASSOCIATED FUNCTIONALITY

Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US None
App. No.
19/004,162
Abstract

An example method includes receiving 3D data of an interior of a building that has one or more stories and one or more rooms on the one or more stories. The 3D data is classified by receiving multiple 360 degree panoramic images of the interior, applying a trained model to classify the multiple 360 degree panoramic images, and determining, based on applying the trained model to classify the multiple 360 degree panoramic images, one or more room classifications for the 3D data. One or more story identifications of the one or more stories and one or more room identifications of the one or more rooms are generated. A property layout of the building that includes the one or more story identifications and the one or more room classifications is generated. The property layout is provided for display.

Claims (98)

1 . A non-transitory computer-readable medium comprising executable instructions, the executable instructions being executable by one or more processors to perform a method, the method comprising:

receiving 3D data of an interior of a building, the building having one or more stories and one or more rooms on the one or more stories;

classifying the 3D data by:

receiving multiple 360 degree panoramic images of the interior, the multiple 360 degree panoramic images associated with the 3D data;

applying a trained model to classify the multiple 360 degree panoramic images; and

determining, based on applying the trained model to classify the multiple 360 degree panoramic images, one or more room classifications for the 3D data;

generating, based on the 3D data, one or more story identifications of the one or more stories and one or more room identifications of the one or more rooms;

generating, based on the one or more story identifications and the one or more room identifications, a property layout of the building, the property layout including the one or more story identifications and the one or more room classifications; and

providing the property layout for display.

2 . The non-transitory computer-readable medium of claim 1 wherein applying the trained model to classify the multiple 360 degree panoramic images includes:

for each 360 degree panoramic image of the multiple 360 degree panoramic images:

dividing each 360 degree panoramic image into multiple sections; and

applying the trained model to classify each section of the multiple sections, thereby obtaining multiple section classifications,

wherein determining, based on applying the trained model to classify the multiple 360 degree panoramic images, the one or more room classifications for the 3D data includes determining, based on the multiple section classifications for each 360 degree panoramic image, the one or more room classifications for the 3D data.

3 . The non-transitory computer-readable medium of claim 1 wherein generating, based on the 3D data, the one or more story identifications includes:

identifying walkable areas in the 3D data;

clustering the walkable areas into one or more clusters for the one or more stories;

identifying, based on the one or more clusters, one or more floor surfaces;

identifying, for each floor surface of the one or more floor surfaces, one or more walls connected to each floor surface; and

generating, based on the one or more floor surfaces and the one or more walls connected to each floor surface of the one or more floor surfaces, the one or more story identifications.

4 . The non-transitory computer-readable medium of claim 3 wherein identifying the walkable areas in the 3D data includes:

generating, based on the 3D data, a 3D distance map;

determining, for each point of multiple points in the 3D distance map, a distance from each point to a nearest surface of the 3D data; and

identifying, based on the distance from each point to the nearest surface of the 3D data, the walkable areas in the 3D data.

5 . The non-transitory computer-readable medium of claim 4 wherein identifying the walkable areas in the 3D data further includes:

generating an ellipsoid representing a human;

scaling down by a factor in a z-direction the ellipsoid to a sphere; and

scaling down by the factor in the z-direction the 3D data,

wherein identifying, based on the distance from each point to the nearest surface of the 3D data, the walkable areas in the 3D data includes identifying, based on the distance from each point to the nearest surface of the 3D data and a diameter of the sphere, the walkable areas in the 3D data.

6 . The non-transitory computer-readable medium of claim 1 wherein generating, based on the 3D data, the one or more room identifications includes:

determining, based on the 3D data, one or more potential room centers;

determining one or more paths between one or more pairs of two potential room centers of the one or more potential room centers;

determining, based on the one or more paths and the 3D data, one or more doorways;

blocking the one or more doorways to generate one or more blocked doorways; and

generating, based on the one or more potential room centers and the one or more blocked doorways, the one or more room identifications.

7 . The non-transitory computer-readable medium of claim 1 wherein generating, based on the one or more story identifications and the one or more room identifications, the property layout of the building includes:

generating, based on the one or more story identifications, one or more graphs;

for each graph of the one or more graphs, simplifying each graph to generate a simplified graph, thereby generating one or more simplified graphs; and

generating, based on the one or more simplified graphs and the one or more room identifications, the property layout of the building.

8 . The non-transitory computer-readable medium of claim 7 wherein simplifying each graph to generate the simplified graph includes simplifying each graph using at least one of a global nonlinear optimizer and one or more rule-based simplifications.

9 . The non-transitory computer-readable medium of claim 1 , the method further comprising determining, for at least one room of the one or more rooms, at least one of a room area, a room volume, a first room dimension, and a second room dimension, wherein providing the property layout for display includes providing, for the at least one room of the one or more rooms, at least one of the room area, the room volume, the first room dimension, and the second room dimension for display.

10 . The non-transitory computer-readable medium of claim 1 , the method further comprising:

receiving one or more modifications to the property layout;

generating, based on the one or more modifications, a modified property layout; and

providing the modified property layout for display.

11 . A method comprising:

receiving 3D data of an interior of a building, the building having one or more stories and one or more rooms on the one or more stories;

classifying the 3D data by:

receiving multiple 360 degree panoramic images of the interior, the multiple 360 degree panoramic images associated with the 3D data;

applying a trained model to classify the multiple 360 degree panoramic images; and

determining, based on applying the trained model to classify the multiple 360 degree panoramic images, one or more room classifications for the 3D data;

generating, based on the 3D data, one or more story identifications of the one or more stories and one or more room identifications of the one or more rooms;

generating, based on the one or more story identifications and the one or more room identifications, a property layout of the building, the property layout including the one or more story identifications and the one or more room classifications; and

providing the property layout for display.

12 . The method of claim 11 wherein applying the trained model to classify the multiple 360 degree panoramic images includes:

for each 360 degree panoramic image of the multiple 360 degree panoramic images:

dividing each 360 degree panoramic image into multiple sections; and

applying the trained model to classify each section of the multiple sections, thereby obtaining multiple section classifications,

wherein determining, based on applying the trained model to classify the multiple 360 degree panoramic images, the one or more room classifications for the 3D data includes determining, based on the multiple section classifications for each 360 degree panoramic image, the one or more room classifications for the 3D data.

13 . The method of claim 11 wherein generating, based on the 3D data, the one or more story identifications includes:

identifying walkable areas in the 3D data;

clustering the walkable areas into one or more clusters for the one or more stories;

identifying, based on the one or more clusters, one or more floor surfaces;

identifying, for each floor surface of the one or more floor surfaces, one or more walls connected to each floor surface; and

generating, based on the one or more floor surfaces and the one or more walls connected to each floor surface of the one or more floor surfaces, the one or more story identifications.

14 . The method of claim 13 wherein identifying the walkable areas in the 3D data includes:

generating, based on the 3D data, a 3D distance map;

determining, for each point of multiple points in the 3D distance map, a distance from each point to a nearest surface of the 3D data; and

identifying, based on the distance from each point to the nearest surface of the 3D data, the walkable areas in the 3D data.

15 . The method of claim 14 wherein identifying the walkable areas in the 3D data further includes:

generating an ellipsoid representing a human;

scaling down by a factor in a z-direction the ellipsoid to a sphere; and

scaling down by the factor in the z-direction the 3D data, wherein identifying, based on the distance from each point to the nearest surface of the 3D data, the walkable areas in the 3D data includes identifying, based on the distance from each point to the nearest surface of the 3D data and a diameter of the sphere, the walkable areas in the 3D data.

16 . The method of claim 11 wherein generating, based on the 3D data, the one or more room identifications includes:

determining, based on the 3D data, one or more potential room centers;

determining one or more paths between one or more pairs of two potential room centers of the one or more potential room centers;

determining, based on the one or more paths and the 3D data, one or more doorways;

blocking the one or more doorways to generate one or more blocked doorways; and

generating, based on the one or more potential room centers and the one or more blocked doorways, the one or more room identifications.

17 . The method of claim 11 wherein generating, based on the one or more story identifications and the one or more room identifications, the property layout of the building includes:

generating, based on the one or more story identifications, one or more graphs;

for each graph of the one or more graphs, simplifying each graph to generate a simplified graph, thereby generating one or more simplified graphs; and

generating, based on the one or more simplified graphs and the one or more room identifications, the property layout of the building.

18 . The method of claim 17 wherein simplifying each graph to generate the simplified graph includes simplifying each graph using at least one of a global nonlinear optimizer and one or more rule-based simplifications.

19 . The method of claim 11 , further comprising determining, for at least one room of the one or more rooms, at least one of a room area, a room volume, a first room dimension, and a second room dimension, wherein providing the property layout for display includes providing, for the at least one room of the one or more rooms, at least one of the room area, the room volume, the first room dimension, and the second room dimension for display.

20 . The method of claim 11 , further comprising:

receiving one or more modifications to the property layout;

generating, based on the one or more modifications, a modified property layout; and

providing the modified property layout for display.

21 . A system comprising at least one processor and at least one memory including executable instructions that when executed by the at least one processor cause the system to:

receive 3D data of an interior of a building, the building having one or more stories and one or more rooms on the one or more stories;

classify the 3D data by:

receiving multiple 360 degree panoramic images of the interior, the multiple 360 degree panoramic images associated with the 3D data;

applying a trained model to classify the multiple 360 degree panoramic images; and

determining, based on applying the trained model to classify the multiple 360 degree panoramic images, one or more room classifications for the 3D data;

generate, based on the 3D data, one or more story identifications of the one or more stories and one or more room identifications of the one or more rooms;

generate, based on the one or more story identifications and the one or more room identifications, a property layout of the building, the property layout including the one or more story identifications and the one or more room classifications; and

provide the property layout for display.

Assignments (3)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 16, 2025
From: MATTERPORT, LLC
To: COSTAR REALTY INFORMATION, INC.
Reel/Frame 072275/0724 →
MERGER AND CHANGE OF NAME Recorded Sep 10, 2025
From: MATTERPORT, INC.; MATRIX MERGER SUB II LLC
To: MATTERPORT, LLC
Reel/Frame 072212/0401 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 18, 2025
From: BALKOSKI, KEVIN; GAUSEBECK, DAVID ALAN
To: MATTERPORT, INC.
Reel/Frame 070546/0028 →