IP Library Granted Patent US 11,113,877
Granted Patent B2
US 11,113,877 · App. 16/990,453 · Granted Sep 7, 2021

Systems and methods for generating three dimensional geometry

Inventors: Shaohui Sun (Mountain View, CA); Ioannis Pavlidis (Redwood City, CA); Adam J. Altman (San Francisco, CA)
Assignee: Hover Inc.
G06T17/05G06F3/14G06K9/00214G06K9/00637G06T15/04G06T15/20G06T17/00G06T19/003G06T19/20G06T2200/08G06T2200/24G06T2207/10028G06T2210/04G06T2210/56G06T2219/2008
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,113,877
App. No.
16/990,453
Granted
Sep 7, 2021
Kind
B2
Abstract

Systems and methods are described for creating three dimensional models of building objects by creating a point cloud from a plurality of input images, defining edges of the building object's surfaces represented by the point cloud, creating simplified geometries of the building object's surfaces and constructing a building model based on the simplified geometries. Input images may include ground, orthographic, or oblique images. The resultant model may be scaled according to correlation with select image types and textured.

Claims (58)

1. A method of generating a building model, the method comprising:

receiving a plurality of initial two-dimensional images, each image comprising at least one surface of a building object;

creating, from the plurality of initial two-dimensional images, a point cloud representing a plurality of surfaces of the building object in a three-dimensional (3D) coordinate system;

defining a plurality of edges within the point cloud for at least one of the plurality of surfaces;

creating a simplified geometry for the at least one of the plurality of surfaces based on an average planar fit of data points within the defined edges of the at least one surface;

constructing a 3D building model of the building object based on the simplified geometry;

correlating at least two vertices of the 3D building model with an orthogonal image of the building object; and

scaling the 3D building model based on the correlated orthogonal image.

2. The method of claim 1 , wherein the plurality of initial two-dimensional images consists of ground-level images.

3. The method of claim 1 , wherein the plurality of initial two-dimensional images consists of oblique images.

4. The method of claim 1 , wherein defining a plurality of edges further comprises determining a plurality of vertices for the at least one of the plurality of surfaces based on the defined edges.

5. The method of claim 1 , further comprising texturing the 3D building model.

6. The method of claim 5 , wherein the texturing is wrapping at least one of the plurality of initial two-dimensional images to a correlated one of the at least one of the plurality of surfaces.

7. The method of claim 1 , wherein the at least one surface is a building façade.

8. A system for generating a model, the system comprising:

an image database storing a plurality of initial two-dimensional images, each image comprising at least one surface of a building object;

an image processor, operative with the image database, configured to:

create, from the plurality of initial two-dimensional images, a point cloud representing a plurality of surfaces of the building object in a three-dimensional (3D) coordinate system;

define a plurality of edges within the point cloud for each of the at least one of the plurality of surfaces;

create a simplified geometry for the at least one of the plurality of surfaces based on an average planar fit of data points within the defined edges of the at least one surface;

construct a 3D building model of the building object based on the simplified geometry;

correlate at least two vertices of the 3D building model with an orthogonal image of the building object; and

scale the 3D building model based on the correlated orthogonal image.

9. The system of claim 8 , wherein the plurality of initial two-dimensional images consists of ground-level images.

10. The system of claim 8 , wherein the plurality of initial two-dimensional images consists of oblique images.

11. The system of claim 8 , wherein to define the plurality of edges the processor is further configured to determine a plurality of vertices for the at least one of the plurality of surfaces based on the defined edges.

12. The system of claim 8 , wherein the image processor is further configured to texture the 3D building model.

13. The system of claim 12 , wherein to texture is to wrap at least one of the plurality of initial two-dimensional images to a correlated one of the at least one of the plurality of surfaces.

14. The system of claim 8 , wherein the at least one surface is a building façade.

15. A method of generating a building model, the method comprising:

receiving a plurality of initial two-dimensional images, each image comprising at least one surface of a building object;

creating, from the plurality of initial two-dimensional images, a point cloud representing a plurality of surfaces of the building object in a three-dimensional (3D) coordinate system;

defining a plurality of edges within the point cloud for at least one of the plurality of surfaces;

creating a simplified geometry for the at least one of the plurality of surfaces based on an average planar fit of data points within the defined edges of the at least one surface;

constructing a 3D building model of the building object based on the simplified geometry;

correlating at least two vertices among the 3D building model with an oblique image of the building object; and

scaling the 3D building model based on the correlated oblique image.

16. The method of claim 15 , wherein the plurality of initial two-dimensional images consists of ground-level images.

17. The method of claim 15 , wherein the plurality of initial two-dimensional images consists of orthogonal images.

18. The method of claim 15 , wherein defining a plurality of edges further comprises determining a plurality of vertices for the at least one of the plurality of surfaces based on the defined edges.

19. The method of claim 15 , further comprising texturing the 3D building model.

20. The method of claim 19 , wherein the texturing is wrapping at least one of the plurality of initial two-dimensional images to a correlated one of the at least one of the plurality of surfaces.

21. The method of claim 15 , wherein the at least one surface is a building façade.

22. A system for generating a model, the system comprising:

an image database storing a plurality of initial two-dimensional images, each image comprising at least one surface of a building object;

an image processor, operative with the image database, configured to:

create, from the plurality of initial two-dimensional images, a point cloud representing a plurality of surfaces of the building object in a three-dimensional (3D) coordinate system;

define a plurality of edges within the point cloud for at least one of the plurality of surfaces;

create a simplified geometry for the at least one of the plurality of surfaces based on an average planar fit of data points within the defined edges of the at least one surface;

construct a 3D building model of the building object based on the simplified geometry;

correlate at least two vertices of the 3D building model with an oblique image of the building object; and

scale the 3D building model based on the correlated oblique image.

23. The system of claim 22 , wherein the plurality of initial two-dimensional images consists of ground-level images.

24. The system of claim 22 , wherein the plurality of initial two-dimensional images consists of orthogonal images.

25. The system of claim 22 , wherein to define the plurality of edges the processor is further configured to determine a plurality of vertices for the at least one of the plurality of surfaces based on the defined edges.

26. The system of claim 22 , wherein the image processor is further configured to texture the 3D building model.

27. The system of claim 26 , wherein to texture is to wrap at least one of the plurality of initial two-dimensional images to a correlated one of the at least one of the plurality of surfaces.

28. The system of claim 22 , wherein the at least one surface is a building facade.

Assignments (5)
TERMINATION OF INTELLECTUAL PROPERTY SECURITY AGREEMENT Recorded Oct 6, 2022
From: SILICON VALLEY BANK
To: HOVER INC.
Reel/Frame 061622/0741 →
TERMINATION OF INTELLECTUAL PROPERTY SECURITY AGREEMENT Recorded Oct 6, 2022
From: SILICON VALLEY BANK, AS AGENT
To: HOVER INC.
Reel/Frame 061622/0761 →
INTELLECTUAL PROPERTY SECURITY AGREEMENT Recorded May 28, 2021
From: HOVER INC.
To: SILICON VALLEY BANK
Reel/Frame 056423/0199 →
INTELLECTUAL PROPERTY SECURITY AGREEMENT Recorded May 28, 2021
From: HOVER INC.
To: SILICON VALLEY BANK, AS ADMINISTRATIVE AGENT
Reel/Frame 056423/0222 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 11, 2020
From: SUN, SHAOHUI; PAVLIDIS, IOANNIS; ALTMAN, ADAM J.
To: HOVER, INC
Reel/Frame 053459/0982 →
Continuity (4)
Continuation 15255807 · Sep 2, 2016
Continuation 14339127 · Jul 23, 2014
Provisional Application 61857302 · Jul 23, 2013
Related Publication 20200372708A1 · Nov 26, 2020
Cited By (2)
US 12,573,217 US 12,657,826