IP Library › Granted Patent US 11,922,570
Granted Patent B2
US 11,922,570 · App. 18/164,420 · Granted Mar 5, 2024

Estimating dimensions of geo-referenced ground-level imagery using orthogonal imagery

Inventors: Bo Hu (Sunnyvale, CA); Sarthak Sahu (San Francisco, CA)
Assignee: Hover Inc.
G06T17/00G06T1/0007G06T7/75G06T17/20G06T2207/10004G06T2210/04G06T2219/012
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,922,570
App. No.
18/164,420
Filed
Feb 3, 2023
Granted
Mar 5, 2024
Kind
B2
Art Unit
2614
USPC
382/154
Abstract

A system and method is provided for measurements of building façade elements by combining ground-level and orthogonal imagery. The measurements of the dimension of building façade elements are based on ground-level imagery that is scaled and geo-referenced using orthogonal imagery. The method continues by creating a tabular dataset of measurements for one or more architectural elements such as siding (e.g., aluminum, vinyl, wood, brick and/or paint), windows or doors. The tabular dataset can be part of an estimate report.

Claims (36)

1. One or more non-transitory computer-readable media storing instructions that, when executed by a system comprising one or more processors, cause the one or more processors to perform operations comprising:

collecting, using a smartphone, a plurality of ground-level images capturing all sides of a single building;

determining a location for the plurality of ground-level images;

generating an outline of a plurality of facades associated with all sides of the single building shown within the ground-level images to assist in generation of a three-dimensional building model of the single building;

generating the three-dimensional building model based on the outlined plurality of facades associated with all sides of the single building, wherein the generating the three-dimensional building model includes at least correlation and rectification of the outlined plurality of facades and representing points of the single building projected in three-dimensional space;

retrieving a geo-referenced top-view orthogonal image of the single building based on the determined location of at least one of the plurality of ground-level images;

deriving a scale as between all points of the three-dimensional building model by geo-referencing all points of the three-dimensional building model using the geo-referenced top-view orthogonal image by correlating the geo-referenced top-view orthogonal image to include matching at least two points of the three-dimensional building model to corresponding roof pixels in the geo-referenced top-view orthogonal image and identifying those matches as being part of a same feature within the three-dimensional building model of the single building;

measuring, on the scaled three-dimensional building model, between at least one starting georeferenced point and at least one ending geo-referenced point to determine dimensions of one or more architectural elements, the dimensions including at least width and height of the one or more architectural elements, located within at least a first facade of the geo-referenced three-dimensional building model; and

labeling the architectural element within the scaled three-dimensional building model, the labeling representing the determined dimensions.

2. The one or more non-transitory computer-readable media of claim 1 , wherein the one or more architectural elements comprise windows.

3. The one or more non-transitory computer-readable media of claim 1 , wherein the one or more architectural elements comprise doors.

4. The one or more non-transitory computer-readable media of claim 1 , further comprising creating a tabular dataset of measurements for one or more architectural elements and their respective determined measurements.

5. The one or more non-transitory computer-readable media of claim 4 , wherein the tabular dataset comprises one or more of default ones of the architectural elements or selectable ones of the architectural elements.

6. The one or more non-transitory computer-readable media of claim 4 , wherein the tabular dataset comprises one or more portions of an estimate report.

7. The one or more non-transitory computer-readable media of claim 6 , wherein the one or more portions of an estimate report are modified using product data.

8. The one or more non-transitory computer-readable media of claim 4 , wherein the tabular dataset comprises measurements for siding.

9. The one or more non-transitory computer-readable media of claim 4 , wherein the tabular dataset comprises measurements for paint.

10. The one or more non-transitory computer-readable media of claim 1 , wherein the measuring is conducted interactively by repeated selecting of at least one starting geo-referenced point and at least one ending geo-referenced point.

11. One or more non-transitory computer-readable media storing instructions that, when executed by a system comprising one or more processors, cause the one or more processors to perform operations comprising:

collecting, using a smartphone, a plurality of ground-level images capturing all sides of a single building;

determining a location for the plurality of ground-level images;

generating an outline of a plurality of facade shown within the ground-level images of all sides of the single building to assist in generation of a three-dimensional building model of the single building;

generating the three-dimensional building model based on the outlined plurality of facades, wherein the generating the three-dimensional building model includes at least correlation and rectification of the outlined plurality of facades and representing points of the single building projected in three-dimensional space;

retrieving a geo-referenced top-view orthogonal image of the single building based on the determined location of at least one of the plurality of ground-level images;

deriving a scale as between all points of the three-dimensional building model by geo-referencing all points within the three-dimensional building model by matching at least two points of the three-dimensional building model associated with at least one outlined facade to corresponding roof pixels in the geo-referenced top-view orthogonal image;

measuring, on the scaled three-dimensional building model, between at least one starting georeferenced point and at least one ending geo-referenced point to determine dimensions of one or more architectural elements located within the plurality of facades; and

labeling the one or more architectural element with the determined dimensions.

12. The one or more non-transitory computer-readable media of claim 11 , wherein the one or more architectural elements comprise windows.

13. The one or more non-transitory computer-readable media of claim 11 , wherein the one or more architectural elements comprise doors.

14. The one or more non-transitory computer-readable media of claim 11 , further comprising creating a tabular dataset of measurements for one or more architectural elements and their respective determined measurements.

15. The one or more non-transitory computer-readable media of claim 14 , wherein the tabular dataset comprises one or more of default ones of the architectural elements or selectable ones of the architectural elements.

16. The one or more non-transitory computer-readable media of claim 14 , wherein the tabular dataset comprises one or more portions of an estimate report.

17. The one or more non-transitory computer-readable media of claim 16 , wherein the one or more portions of an estimate report are modified using product data.

18. The one or more non-transitory computer-readable media of claim 14 , wherein the tabular dataset comprises measurements for siding.

19. The one or more non-transitory computer-readable media of claim 14 , wherein the tabular dataset comprises measurements for paint.

20. The one or more non-transitory computer-readable media of claim 11 , wherein the measuring is conducted interactively by repeated selecting of at least one starting geo-referenced point and at least one ending geo-referenced point.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Feb 3, 2023
From: HU, BO; SAHU, SARTHAK
To: HOVER INC.
Reel/Frame 062589/0373 →
Continuity (4)
Continuation 17217959 · Mar 30, 2021
Continuation 15025132
Provisional Application 61895819 · Oct 25, 2013
Related Publication 20230186559A1 · Jun 15, 2023