IP Library Granted Patent US 10,861,224
Granted Patent B2
US 10,861,224 · App. 15/411,226 · Granted Dec 8, 2020

3D building analyzer

Inventors: Derek Halliday (Oakland, CA); Antonio Carlos Marques da Silva Junior (Concord, CA); Roberto Klein (Oakland, CA); Adam J. Altman (San Francisco, CA)
Assignee: Hover Inc.
G06T17/00G06K9/00214G06K9/00637G06T15/04G06T17/05G06T19/20G06T2200/08G06T2210/04G06T2210/56G06T2219/004G06T2219/2016
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,861,224
App. No.
15/411,226
Granted
Dec 8, 2020
Kind
B2
Abstract

A system and method is provided for constructing a labeled and dimensioned multi-dimensional (e.g., 3D) building model from building object imagery (e.g., ground-level imagery). The method begins by retrieve building object imagery, the building object imagery collected based on directed capture with a mobile device. The method continues by constructing a scaled multi-dimensional building model, the scale based on sizing of at least one selected architectural feature. The method continues by identifying architectural elements within facades of the multi-dimensional building model. The method continues by determining dimensions of at least one of the architectural elements, the dimensions based on the scale. The method continues by determining dimensions (e.g., area) of at least one of the architectural elements. The method continues by labeling each identified architectural element with at least an identifier and by labeling at least one of the architectural elements with the determined dimensions.

Claims (38)

1. A method of creating a multi-dimensional blueprint comprises:

retrieving building object imagery, the building object imagery collected based on directed capture with a mobile device;

identifying architectural elements within the building object imagery;

determining a scale of a selected architectural element from the architectural elements located within a plane of the building object imagery, the scale based on dimensional comparisons of the selected architectural element to known one or more industry standard architectural element dimensions of the selected architectural element referenced externally to the building object imagery, wherein the dimensional comparisons include selecting dimensions within a first threshold of the selected architectural element closest to one of the known one or more industry standard architectural element dimensions of the selected architectural element;

determining a scaling factor of the building object imagery based on relative error to the determined scale of the selected architectural element for the identified architectural elements within the building object imagery;

constructing and scaling a multi-dimensional building model based on the building object imagery and the scaling factor;

determining dimensions of a plurality of the architectural elements located on one or more planes within the multi-dimensional building model, the dimensions based on the scaling factor;

labeling, on the multi-dimensional building model, each of the plurality of the architectural elements with at least an identifier; and

labeling, on the multi-dimensional building model, the plurality of the architectural elements with the determined dimensions.

2. The method of claim 1 , wherein the labeling is referenced in associated listing tables.

3. The method of claim 2 , wherein the associated listing tables include dimensions and description of one or more of the plurality of the architectural elements.

4. The method of claim 2 , wherein the associated listing tables include area and description of a quantity of building material for one or more of the plurality of the architectural elements.

5. The method of claim 1 , wherein the labeling with the at least an identifier is performed incrementally while constructing the multi-dimensional building model.

6. The method of claim 1 , wherein the labeling with the determined dimensions is performed after the constructing and scaling of the multi-dimensional building model.

7. The method of claim 1 , wherein the identifying of the one or more architectural elements is defined automatically.

8. The method of claim 1 , wherein the architectural elements include any of: brick(s) or window(s).

9. The method of claim 1 , wherein the architectural elements include door(s).

10. The method of claim 1 , wherein the architectural elements include siding elements.

11. The method of claim 1 , wherein the building object imagery includes two or more different architectural elements.

12. The method of claim 1 , wherein the building object imagery includes ground-level imagery.

13. The method of claim 1 , wherein the building object imagery includes drone captured imagery.

14. The method of claim 1 , wherein the building object imagery includes smartphone captured imagery.

15. The method of claim 1 , wherein the dimensional comparisons include dimensional ratios comprise two or more of: width, height, length, depth, radius, diameter, circumference, or perimeter.

16. A system for creating a multi-dimensional building model blueprint comprising:

a multi-dimensional building model database operable to store a multi-dimensional building model; and

a processor communicatively coupled to the multi-dimensional building model database and operable to:

retrieve building object imagery, the building object imagery collected based on directed capture with a mobile device;

construct a multi-dimensional building model based on at least the building object imagery;

identify architectural elements of the building object imagery;

determine a scale of a selected architectural element from the architectural elements located within the building object imagery, the scale based on dimensional comparisons of the selected architectural element to known one or more industry standard architectural element dimensions of the selected architectural element referenced externally to the building object imagery, wherein the dimensional comparisons include selecting dimensions within a first threshold of the selected architectural element closest to the known one or more architectural element dimensions of the selected architectural element;

determine a scaling factor of the building object imagery based on relative error to the determined scale for the identified architectural elements within the building object imagery;

scale the multi-dimensional building model based on the scaling factor;

determine dimensions of a plurality of the architectural elements located on one or more planes within the multi-dimensional building model, the dimensions based on the scaling factor;

label, on the multi-dimensional building model, each of the plurality of architectural elements with at least an identifier; and

label, on the multi-dimensional building model, the plurality of architectural elements with the determined dimensions.

17. The system of claim 16 , wherein the architectural elements include any of: door(s), brick(s), window(s), siding element(s), shingles, gables, eaves, dormers, gutters, chimney structures, pipe stacks, turbine vents, skylights, dormers, solar panels, fans, gutters, fascia boards, or rakes.

18. The system of claim 16 , wherein the architectural elements include roofing elements.

19. The system of claim 16 , wherein the dimensional comparisons include dimensional ratios comprise two or more of: width, height, length, depth, radius, diameter, circumference, or perimeter.

Assignments (9)
TERMINATION OF INTELLECTUAL PROPERTY SECURITY AGREEMENT Recorded Oct 6, 2022
From: SILICON VALLEY BANK
To: HOVER INC.
Reel/Frame 061622/0741 →
TERMINATION OF INTELLECTUAL PROPERTY SECURITY AGREEMENT Recorded Oct 6, 2022
From: SILICON VALLEY BANK, AS AGENT
To: HOVER INC.
Reel/Frame 061622/0761 →
TERMINATION AND RELEASE OF INTELLECTUAL PROPERTY SECURITY AGREEMENT Recorded May 28, 2021
From: SILICON VALLEY BANK, AS AGENT
To: HOVER INC.
Reel/Frame 056423/0189 →
TERMINATION AND RELEASE OF INTELLECTUAL PROPERTY SECURITY AGREEMENT Recorded May 28, 2021
From: SILICON VALLEY BANK
To: HOVER INC.
Reel/Frame 056423/0179 →
INTELLECTUAL PROPERTY SECURITY AGREEMENT Recorded May 28, 2021
From: HOVER INC.
To: SILICON VALLEY BANK
Reel/Frame 056423/0199 →
INTELLECTUAL PROPERTY SECURITY AGREEMENT Recorded May 28, 2021
From: HOVER INC.
To: SILICON VALLEY BANK, AS ADMINISTRATIVE AGENT
Reel/Frame 056423/0222 →
INTELLECTUAL PROPERTY SECURITY AGREEMENT Recorded Mar 25, 2020
From: HOVER INC.
To: SILICON VALLEY BANK, AS ADMINISTRATIVE AGENT
Reel/Frame 052229/0972 →
INTELLECTUAL PROPERTY SECURITY AGREEMENT Recorded Mar 25, 2020
From: HOVER INC.
To: SILICON VALLEY BANK
Reel/Frame 052229/0986 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Feb 14, 2017
From: HALLIDAY, DEREK; MARQUES DA SILVA JUNIOR, ANTONIO CARLOS; KLEIN, ROBERTO; ALTMAN, ADAM J.
To: HOVER INC.
Reel/Frame 041248/0220 →
Continuity (4)
Continuation In Part 15255807 · Sep 2, 2016
Continuation 14339127 · Jul 23, 2014
Provisional Application 61857302 · Jul 23, 2013
Related Publication 20170132835A1 · May 11, 2017
Cited By (1)
US 12,657,826