IP Library Granted Patent US 11,004,259
Granted Patent B2
US 11,004,259 · App. 15/025,132 · Granted May 11, 2021

Estimating dimensions of geo-referenced ground level imagery using orthogonal imagery

Inventors: Bo Hu (Sunnyvale, CA); Sarthak Sahu (San Francisco, CA)
G06T17/00G06T1/0007G06T7/75G06T17/20G06T2207/10004G06T2210/04G06T2219/012
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,004,259
App. No.
15/025,132
Granted
May 11, 2021
Kind
B2
Abstract

A system and method is provided for measurements of building façade elements by combining ground-level ( 201 ) and orthogonal imagery ( 906 ). The measurements of the dimension of building façade elements are based on ground-level imagery that is scaled and geo-referenced using orthogonal imagery ( 209 ). The method continues by creating a tabular dataset ( 1002 ) of measurements for one or more architectural elements such as siding (e.g., aluminum, vinyl, wood, brick and/or paint), windows or doors. The tabular dataset can be part of an estimate report ( 1002 ).

Claims (27)

1. A method of measuring in a three-dimensional building model, comprising:

collecting, using a smartphone, a plurality of ground-level images capturing all sides of a single building;

determining a location for the plurality of ground-level images;

generating an outline of a plurality of façades associated with all sides of the single building shown within the ground-level images to assist in generation of a three-dimensional building model of the single building;

generating the three-dimensional building model based on the outlined plurality of façades associated with all sides of the single building, wherein the generating the three-dimensional building model includes at least correlation and rectification of the outlined plurality of façades and representing points of the single building projected in three-dimensional space;

retrieving a geo-referenced top-view orthogonal image of the single building based on the determined location of at least one of the plurality of ground-level images;

deriving a scale as between all points of the three-dimensional building model by geo-referencing all points of the three-dimensional building model using the geo-referenced top-view orthogonal image by correlating the geo-referenced top-view orthogonal image to include matching at least two points of the three-dimensional building model to corresponding roof pixels in the geo-referenced top-view orthogonal image and identifying those matches as being part of a same feature within the three-dimensional building model of the single building;

measuring, on the scaled three-dimensional building model, between at least one starting geo-referenced point and at least one ending geo-referenced point to determine dimensions of one or more architectural elements, the dimensions including at least width and height of the one or more architectural elements, located within at least a first façade of the geo-referenced three-dimensional building model; and

labeling the architectural element within the scaled three-dimensional building model, the labeling representing the determined dimensions.

2. The method of claim 1 , wherein the one or more architectural elements comprise windows.

3. The method of claim 1 , wherein the one or more architectural elements comprise doors.

4. The method of claim 1 , further comprising creating a tabular dataset of measurements for one or more architectural elements and their respective determined measurements.

5. The method of claim 4 , wherein the tabular dataset comprises one or more of default ones of the architectural elements or selectable ones of the architectural elements.

6. The method of claim 4 , wherein the tabular dataset comprises one or more portions of an estimate report.

7. The method of claim 6 , wherein the one or more portions of an estimate report are modified using product data.

8. The method of claim 4 , wherein the tabular dataset comprises measurements for siding.

9. The method of claim 4 , wherein the tabular dataset comprises measurements for paint.

10. The method of claim 1 , wherein the measuring is conducted interactively by repeated selecting of at least one starting geo-referenced point and at least one ending geo-referenced point.

11. A method of measuring in a three-dimensional building model, comprising:

collecting, using a smartphone, a plurality of ground-level images capturing all sides of a single building;

determining a location for the plurality of ground-level images;

generating an outline of a plurality of façades shown within the ground-level images of all sides of the single building to assist in generation of a three-dimensional building model of the single building;

generating the three-dimensional building model based on the outlined plurality of façades, wherein the generating the three-dimensional building model includes at least correlation and rectification of the outlined plurality of façades and representing points of the single building projected in three-dimensional space;

retrieving a geo-referenced top-view orthogonal image of the single building based on the determined location of at least one of the plurality of ground-level images;

deriving a scale as between all points of the three-dimensional building model by geo-referencing all points within the three-dimensional building model by matching at least two points of the three-dimensional building model associated with at least one outlined façade to corresponding roof pixels in the geo-referenced top-view orthogonal image;

measuring, on the scaled three-dimensional building model, between at least one starting geo-referenced point and at least one ending geo-referenced point to determine dimensions of one or more architectural elements located within the plurality of façades; and

labeling the one or more architectural element with the determined dimensions.

Assignments (9)
TERMINATION OF INTELLECTUAL PROPERTY SECURITY AGREEMENT Recorded Oct 6, 2022
From: SILICON VALLEY BANK
To: HOVER INC.
Reel/Frame 061622/0741 →
TERMINATION OF INTELLECTUAL PROPERTY SECURITY AGREEMENT Recorded Oct 6, 2022
From: SILICON VALLEY BANK, AS AGENT
To: HOVER INC.
Reel/Frame 061622/0761 →
TERMINATION AND RELEASE OF INTELLECTUAL PROPERTY SECURITY AGREEMENT Recorded May 28, 2021
From: SILICON VALLEY BANK, AS AGENT
To: HOVER INC.
Reel/Frame 056423/0189 →
TERMINATION AND RELEASE OF INTELLECTUAL PROPERTY SECURITY AGREEMENT Recorded May 28, 2021
From: SILICON VALLEY BANK
To: HOVER INC.
Reel/Frame 056423/0179 →
INTELLECTUAL PROPERTY SECURITY AGREEMENT Recorded May 28, 2021
From: HOVER INC.
To: SILICON VALLEY BANK
Reel/Frame 056423/0199 →
INTELLECTUAL PROPERTY SECURITY AGREEMENT Recorded May 28, 2021
From: HOVER INC.
To: SILICON VALLEY BANK, AS ADMINISTRATIVE AGENT
Reel/Frame 056423/0222 →
INTELLECTUAL PROPERTY SECURITY AGREEMENT Recorded Mar 25, 2020
From: HOVER INC.
To: SILICON VALLEY BANK, AS ADMINISTRATIVE AGENT
Reel/Frame 052229/0972 →
INTELLECTUAL PROPERTY SECURITY AGREEMENT Recorded Mar 25, 2020
From: HOVER INC.
To: SILICON VALLEY BANK
Reel/Frame 052229/0986 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 25, 2016
From: HU, BO; SAHU, SARTHAK
To: HOVER INC.
Reel/Frame 038105/0900 →
Continuity (2)
Provisional Application 61895819 · Oct 25, 2013
Related Publication 20160292868A1 · Oct 6, 2016
Cited By (3)
US 12,243,163 US 12,374,135 US 12,657,826