IP Library Granted Patent US 10,909,758
Granted Patent B2
US 10,909,758 · App. 16/155,151 · Granted Feb 2, 2021

Selecting two-dimensional imagery data for display within a three-dimensional model

Inventors: Matthew Tschudy Bell (Palo Alto, CA); David Alan Gausebeck (Mountain View, CA); Gregory William Coombe (Mountain View, CA); Daniel Ford (Mountain View, CA); William John Brown (Redwood City, CA)
Assignee: Matterport, Inc.
G06T19/003G06T13/80G06T15/20
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,909,758
App. No.
16/155,151
Granted
Feb 2, 2021
Kind
B2
Abstract

Systems and methods for generating three-dimensional models with correlated three-dimensional and two dimensional imagery data are provided. In particular, imagery data can be captured in two dimensions and three dimensions. Imagery data can be transformed into models. Two-dimensional data and three-dimensional data can be correlated within models. Two-dimensional data can be selected for display within a three-dimensional model. Modifications can be made to the three-dimensional model and can be displayed within a three-dimensional model or within two-dimensional data. Models can transition between two dimensional imagery data and three dimensional imagery data.

Claims (34)

1. A system, comprising:

a memory that stores computer executable components; and

a processor that executes at least the following computer executable components stored in the memory:

a construction component that generates a three-dimensional model of an environment, the three-dimensional model including at least one wall separating the environment and an area external to the environment;

a navigation component that facilitates navigating the three-dimensional model as rendered at a device when in a particular mode, wherein the navigation component determines a current position and a viewpoint of a virtual camera within the three-dimensional model and a field of view; and

a selection component that selects between two-dimensional imagery and three-dimensional imagery to display within the viewpoint of the virtual camera within the three-dimensional model, the selection being based on a plurality of selection criteria one of the plurality of selection criteria including at least a presence of a hole at a particular location of the at least one wall, wherein upon satisfaction of the one of the plurality of selection criteria, the selection component provides the two-dimensional imagery corresponding the particular location of the at least one wall to the device for rendering, otherwise enabling the three-dimensional imagery to be rendered by the device.

2. The system of claim 1 , wherein the selection component selects between the two-dimensional imagery or the three-dimensional imagery in the viewpoint of the virtual camera within the three-dimensional model prior to initiation of the navigation of the three-dimensional model.

3. The system of claim 1 , wherein the navigation of the three-dimensional model is associated with a user identity, and wherein the one of the plurality of selection criteria is based on pattern information identifying one or more navigation paths previously followed by the user identity in association with previous navigation of the three-dimensional model.

4. The system of claim 1 , wherein the one of the plurality of selection criteria is based on pattern information identifying paths followed by a plurality of second user identities in association with previous navigation of the three-dimensional model by the second user identities.

5. The system of claim 1 , wherein the navigation component further facilitates navigating the three-dimensional model using a manual navigation mode, wherein the manual navigation mode comprises providing imagery of the three-dimensional model to the device for rendering based on user input indicating a desired perspective for viewing the three-dimensional model in association with the navigation of the three-dimensional model.

6. The system of claim 5 , wherein the one of the plurality of selection criteria is based on pattern information identifying one or more navigation paths followed in association with navigation of the three-dimensional model using the manual navigation mode.

7. The system of claim 5 , wherein the navigation component further facilitates an activation of an automatic navigation mode responsive to user input selecting a transition from the manual navigation mode to the automatic navigation mode.

8. The system of claim 5 , wherein the navigation component transitions to the manual navigation mode in response to reception of user input indicating a desire to deactivate the automatic navigation mode.

9. The system of claim 1 , wherein the navigation component further facilitates an activation of an automatic navigation mode responsive to reception of user input indicating a request to view a predefined location or area of the three-dimensional model.

10. The system of claim 1 , wherein the navigation component further facilitates an activation of an automatic navigation mode responsive to passage of a defined window of time without reception of user input in association with the navigation of the three-dimensional model.

11. A method comprising:

generating, by a system, a three-dimensional model of an environment, the three-dimensional model including at least one wall separating the environment from an area external to the environment;

facilitating, by the system, navigating the three-dimensional model as rendered at a device when in a particular mode, wherein the navigating the three-dimensional model includes determining a current position and viewpoint of a virtual camera within the three-dimensional model and a field of view;

selecting, by the system, between two-dimensional imagery and three-dimensional imagery to display within the viewpoint of the virtual camera within the three-dimensional model, the selection being based on a plurality of selection criteria, one of the plurality of selection criteria including at least a presence of a hole at a particular location of the at least one wall, wherein upon satisfaction of the one of the plurality of selection criteria, providing the two-dimensional imagery corresponding to the particular location of the at least one wall to the device for rendering, otherwise enabling the three-dimensional imagery to be rendered by the device.

12. The method of claim 11 , wherein the selecting comprises selecting between the two-dimensional imagery or the three-dimensional imagery in the viewpoint of the virtual camera within the three-dimensional model prior to initiation of the navigation of the three-dimensional model.

13. The method of claim 11 , wherein the navigation of the three-dimensional model is associated with a user identity, and wherein the one of the plurality of selection criteria is based on pattern information identifying one or more navigation paths previously followed by the user identity in association with previous navigation of the three-dimensional model.

14. The method of claim 11 , wherein the one of the plurality of selection criteria is based on pattern information identifying paths followed by a plurality of second user identities in association with previous navigation of the three-dimensional model by the second user identities.

15. The method of claim 11 , wherein the facilitating further comprises facilitating the navigating of the three-dimensional using a manual navigation mode, wherein the manual navigation mode comprises providing imagery of the three-dimensional model to the device for rendering based on user input indicating a desired perspective for viewing the three-dimensional model in association with the navigation of the three-dimensional model.

16. The method of claim 15 , further comprising:

receiving, by the system, user input selecting a transition from the manual navigation mode to an automatic navigation mode; and

activating, by the system, the automatic navigation mode based on the receiving the user input.

17. The method of claim 11 , further comprising:

receiving, by the system, user input indicating a request to view a predefined location or area of the three-dimensional model; and

activating, by the system, an automatic navigation mode based on the receiving the user input.

18. A non-transitory machine-readable storage medium, comprising executable instructions that, when executed by a processor of a device, facilitate performance of operations, comprising:

generating a three-dimensional model of an environment, the three-dimensional model including at least one wall separating the environment and an area external to the environment;

navigating the three-dimensional model as rendered at a device when in a particular mode, wherein the navigating determines a current position and viewpoint of a virtual camera within the three-dimensional model and a field of view;

selecting between two-dimensional imagery and three-dimensional imagery to display within the viewpoint of the virtual camera within the three-dimensional model, the selecting being based on a plurality of selection criteria, one of the plurality of selection criteria including at least a presence of a hole at a particular location of the at least one wall, wherein upon satisfaction of the one of the plurality of selection criteria, provides two dimensional-imagery corresponding to the particular location of the at least one wall to the device for rendering, otherwise enabling the three-dimensional imagery to be rendered by the device.

19. The non-transitory machine-readable storage medium of claim 18 , wherein the one of the plurality of selection criteria is based on pattern information identifying one or more navigation paths followed in association with past navigation of the three-dimensional model using a manual navigation mode.

Assignments (3)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 25, 2025
From: MATTERPORT, LLC
To: COSTAR REALTY INFORMATION, INC.
Reel/Frame 072938/0375 →
MERGER AND CHANGE OF NAME Recorded Sep 10, 2025
From: MATTERPORT, INC.; MATRIX MERGER SUB II LLC
To: MATTERPORT, LLC
Reel/Frame 072827/0337 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Oct 9, 2018
From: BELL, MATTHEW TSCHUDY; GAUSEBECK, DAVID ALAN; COOMBE, GREGORY WILLIAM; FORD, DANIEL; BROWN, WILLIAM JOHN
To: MATTERPORT, INC.
Reel/Frame 047106/0773 →
Continuity (2)
Continuation 14219906 · Mar 19, 2014
Related Publication 20190051050A1 · Feb 14, 2019
Cited By (5)
US 1,132,332 US 12,217,311 US 12,417,643 US 12,456,262 US 12,633,047