IP Library Granted Patent US 11,600,046
Granted Patent B2
US 11,600,046 · App. 17/165,830 · Granted Mar 7, 2023

Selecting two-dimensional imagery data for display within a three-dimensional model

Inventors: Matthew Tschudy Bell (Palo Alto, CA); David Alan Gausebeck (Sunnyvale, CA); Gregory William Coombe (Mountain View, CA); Daniel Ford (Mountain View, CA); William John Brown (Redwood City, CA)
Assignee: Matterport, Inc.
G06T19/003G06T13/80G06T15/20
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,600,046
App. No.
17/165,830
Granted
Mar 7, 2023
Kind
B2
Abstract

Systems and methods for generating three-dimensional models with correlated three-dimensional and two dimensional imagery data are provided. In particular, imagery data can be captured in two dimensions and three dimensions. Imagery data can be transformed into models. Two-dimensional data and three-dimensional data can be correlated within models. Two-dimensional data can be selected for display within a three-dimensional model. Modifications can be made to the three-dimensional model and can be displayed within a three-dimensional model or within two-dimensional data. Models can transition between two dimensional imagery data and three dimensional imagery data.

Claims (37)

1. A system, comprising:

a memory that stores computer executable components; and

a processor that executes at least the following computer executable components stored in the memory:

a construction component that generates a three-dimensional model of an environment;

a display control component that receives instructions representing a first user's selection of a region or an object in the three-dimensional model of the environment;

a selection component that selects a sequence of two-dimensional images based on the received instructions and one of a plurality of selection criteria; and

a transitioning component that facilitates transitioning, in response to a trigger, between rendering a three-dimensional view of the three-dimensional model of the environment to a two-dimensional view of the environment, the trigger being based on an occurrence of one of a plurality of trigger events, the plurality of trigger events including navigation to a particular point of the three-dimensional model, based on a history of use, and data representing user input.

2. The system of claim 1 , wherein the one the plurality of selection criteria includes selecting two-dimensional image data with the most detailed view of the first user's selected region or object.

3. The system of claim 1 , wherein the one the plurality of selection criteria includes a scoring process that generates scores based on maximizing visual fidelity in absolute spatial terms.

4. The system of claim 1 , wherein the one the plurality of selection criteria includes a scoring process that generates scores based on maximizing a visual portion of the region or the object as viewed in the three-dimensional model that is also present in two dimensional image data in the two-dimensional view of the environment.

5. The system of claim 1 , wherein the one of the plurality of selection criteria is based on pattern information identifying paths followed by a plurality of second users in association with previous navigation of the three-dimensional model by the plurality of second users.

6. The system of claim 1 , wherein the processor further executes:

a navigational component that facilitates navigating the three-dimensional model as rendered at a device when in a particular mode.

7. The system of claim 6 , wherein the navigation component further facilitates an activation of an automatic navigation mode responsive to passage of a defined window of time without reception of user input in association with the navigation of the three-dimensional model.

8. The system of claim 6 , wherein the particular mode is a floor plan mode.

9. The system of claim 6 , wherein the particular mode is an orbital mode.

10. A method comprising:

generating, by a system, a three-dimensional model of an environment;

receiving, by the system, instructions representing a first user's selection of a region or an object in the three-dimensional model of the environment;

selecting, by the system, a sequence of two-dimensional images based on the received instructions and one of a plurality of selection criteria; and

transitioning, by the system, in response to a trigger, between rendering a three-dimensional view of the three-dimensional model of the environment to a two-dimensional view of the environment, the trigger being based on an occurrence of one of a plurality of trigger events, the plurality of trigger events including navigation to a particular point of the three-dimensional model, based on a history of use, and data representing user input.

11. The method of claim 10 , wherein the one the plurality of selection criteria includes selecting two-dimensional image data with the most detailed view of the first user's selected region or object.

12. The method of claim 10 , wherein the one the plurality of selection criteria includes a scoring process that generates scores based on maximizing visual fidelity in absolute spatial terms.

13. The method of claim 10 , wherein the one the plurality of selection criteria includes a scoring process that generates scores based on maximizing a visual portion of the region or the object as viewed in the three-dimensional model that is also present in two dimensional image data in the two-dimensional view of the environment.

14. The method of claim 10 , wherein the one of the plurality of selection criteria is based on pattern information identifying paths followed by a plurality of second users in association with previous navigation of the three-dimensional model by the plurality of second users.

15. The method of claim 10 , further comprising:

navigating the three-dimensional model as rendered at a device when in a particular mode.

16. The method of claim 10 , further comprising:

activating an automatic navigation mode responsive to passage of a defined window of time without reception of user input in association with the navigation of the three-dimensional model.

17. The method of claim 15 , wherein the particular mode is a floor plan mode.

18. The method of claim 15 , wherein the particular mode is an orbital mode.

19. A non-transitory machine-readable storage medium, comprising executable instructions that, when executed by a processor of a device, facilitate performance of operations, comprising:

generating a three-dimensional model of an environment;

receiving instructions representing a first user's selection of a region or an object in the three-dimensional model of the environment;

selecting a sequence of two-dimensional images based on the received instructions and one of a plurality of selection criteria; and

transitioning, in response to a trigger, between rendering a three-dimensional view of the three-dimensional model of the environment to a two-dimensional view of the environment, the trigger being based on an occurrence of one of a plurality of trigger events, the plurality of trigger events including navigation to a particular point of the three-dimensional model, based on a history of use, and data representing user input.

20. The non-transitory machine-readable storage medium of claim 19 , wherein the one of the plurality of selection criteria is based on pattern information identifying paths followed by a plurality of second users in association with previous navigation of the three-dimensional model by the plurality of second users.

Assignments (3)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 25, 2025
From: MATTERPORT, LLC
To: COSTAR REALTY INFORMATION, INC.
Reel/Frame 072938/0375 →
MERGER AND CHANGE OF NAME Recorded Sep 10, 2025
From: MATTERPORT, INC.; MATRIX MERGER SUB II LLC
To: MATTERPORT, LLC
Reel/Frame 072827/0337 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Feb 2, 2021
From: BELL, MATTHEW TSCHUDY; GAUSEBECK, DAVID ALAN; COOMBE, GREGORY WILLIAM; FORD, DANIEL; BROWN, WILLIAM JOHN
To: MATTERPORT, INC.
Reel/Frame 055120/0079 →
Continuity (3)
Continuation 16155151 · Oct 9, 2018
Continuation 14219906 · Mar 19, 2014
Related Publication 20210158618A1 · May 27, 2021