IP Library Granted Patent US 12,361,641
Granted Patent B2
US 12,361,641 · App. 18/444,186 · Granted Jul 15, 2025

3D building analyzer

Inventors: Derek Halliday (Oakland, CA); Antonio Carlos Marques da Silva Junior (Concord, CA); Roberto Klein (Oakland, CA); Adam J. Altman (San Francisco, CA)
Assignee: Hover Inc.
G06T17/00G06F3/14G06F30/13G06F30/23G06T15/04G06T15/20G06T17/05G06T19/003G06T19/20G06V20/176G06V20/653G06T2200/08G06T2200/24G06T2207/10028G06T2210/04G06T2210/56G06T2219/004G06T2219/2008G06T2219/2016
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,361,641
App. No.
18/444,186
Granted
Jul 15, 2025
Kind
B2
Abstract

A system and method is provided for constructing a labeled and dimensioned multidimensional (e.g., 3D) building model from building object imagery (e.g., ground-level imagery). The method begins by retrieve building object imagery, the building object imagery collected based on directed capture with a mobile device. The method continues by constructing a scaled multi-dimensional building model, the scale based on sizing of at least one selected architectural feature. The method continues by identifying architectural elements within facades of the multi-dimensional building model. The method continues by determining dimensions of at least one of the architectural elements, the dimensions based on the scale. The method continues by determining dimensions (e.g., area) of at least one of the architectural elements. The method continues by labeling each identified architectural element with at least an identifier and by labeling at least one of the architectural elements with the determined dimensions.

Claims (48)

1. A method of creating a multi-dimensional model comprising:

identifying a plurality of architectural elements within building object imagery;

constructing the multi-dimensional model from the building object imagery based on the plurality of architectural elements;

applying an externally referenced architectural element dimension to a first dimension of a first architectural element of the plurality of architectural elements;

validating a scaling factor for the multi-dimensional building model according to a relative error of a second dimension of the first architectural element of the plurality of architectural elements, wherein the second dimension is a standard measurement of a component of the first architectural element and the relative error results from the externally referenced architectural element dimension applied to the first dimension of the first architectural element and the standard measurement of the second dimension;

scaling the multi-dimensional model based on the scaling factor; and

providing dimensions of a plurality of features of the scaled multi-dimensional model.

2. The method of claim 1 , wherein the plurality of architectural elements are within planar surfaces of the building object imagery.

3. The method of claim 1 , wherein the externally referenced architectural element dimension is based on a closest dimension.

4. The method of claim 1 , wherein applying the externally referenced architectural element dimension to the first dimension of the first architectural element comprises matching a dimensional value of the first dimension of the first architectural element to the externally referenced architectural element dimension.

5. The method of claim 4 , wherein matching the dimensional value of the first dimension of the first architectural element to the externally referenced architectural element dimension comprises matching within a threshold.

6. The method of claim 5 , wherein the threshold is ninety-five percent.

7. The method of claim 1 , wherein the externally referenced architectural element dimension is based on a dimensional ratio.

8. The method of claim 1 , wherein validating the scaling factor for the multi-dimensional building model further comprises validating the scaling factor for the multi-dimensional building model according to a relative error of a second architectural element of the plurality of architectural elements.

9. The method of claim 1 , wherein validating the scaling factor for the multi-dimensional building model further comprises validating the scaling factor for the multi-dimensional building model further according to a relative error of a third dimension of the first architectural element of the plurality of architectural elements.

10. The method of claim 1 , wherein the relative error is less than five percent.

11. The method of claim 1 , wherein the first architectural element is a door and the component is a door knob height of the door.

12. A method of creating a multi-dimensional building model comprising:

identifying a door among a plurality of architectural elements within building object imagery;

constructing the multi-dimensional model from the building object imagery based on the plurality of architectural elements;

applying an externally referenced architectural element dimension to a first dimension of the door;

validating a scaling factor for the multi-dimensional building model according to a relative error of a door knob height of the door resulting from the applied externally referenced architectural element dimension to the first dimension of the door and a standard measurement of the door knob height;

scaling the multi-dimensional model based on the scaling factor; and

providing dimensions of a plurality of features of the scaled multi-dimensional model.

13. One or more non-transitory computer-readable medium having instructions stored thereon that, when executed by one or more processors, cause the one or more processors to perform a method of creating a multi-dimensional building model, the method comprising:

identifying a door among a plurality of architectural elements within building object imagery;

constructing the multi-dimensional model from the building object imagery based on the plurality of architectural elements;

applying an externally referenced architectural element dimension to a first dimension of the door;

validating a scaling factor for the multi-dimensional building model according to a relative error of a door knob height of the door resulting from the applied externally referenced architectural element dimension to the first dimension of the door and a standard measurement of the door knob height;

scaling the multi-dimensional model based on the scaling factor; and

providing dimensions of a plurality of features of the scaled multi-dimensional model.

14. One or more non-transitory computer-readable medium having instructions stored thereon that, when executed by one or more processors, cause the one or more processors to perform a method of creating a multi-dimensional model, the method comprising:

identifying a plurality of architectural elements within building object imagery;

constructing the multi-dimensional model from the building object imagery based on the plurality of architectural elements;

applying an externally referenced architectural element dimension to a first dimension of a first architectural element of the plurality of architectural elements;

validating a scaling factor for the multi-dimensional building model according to a relative error of a second dimension of the first architectural element of the plurality of architectural elements, wherein the second dimension is a standard measurement of a component of the first architectural element and the relative error results from the externally referenced architectural element dimension applied to the first dimension of the first architectural element and the standard measurement of the second dimension;

scaling the multi-dimensional model based on the scaling factor; and

providing dimensions of a plurality of features of the scaled multi-dimensional model.

15. The one or more non-transitory computer-readable medium of claim 14 , wherein the plurality of architectural elements are within planar surfaces of the building object imagery.

16. The one or more non-transitory computer-readable medium of claim 14 , wherein the externally referenced architectural element dimension is based on a closest dimension.

17. The one or more non-transitory computer-readable medium of claim 14 , wherein applying the externally referenced architectural element dimension to the first dimension of the first architectural element comprises matching a dimensional value of the first dimension of the first architectural element to the externally referenced architectural element dimension.

18. The one or more non-transitory computer-readable medium of claim 17 , wherein matching the dimensional value of the first dimension of the first architectural element to the externally referenced architectural element dimension comprises matching within a threshold.

19. The one or more non-transitory computer-readable medium of claim 18 , wherein the threshold is ninety-five percent.

20. The one or more non-transitory computer-readable medium of claim 14 , wherein the externally referenced architectural element dimension is based on a dimensional ratio.

21. The one or more non-transitory computer-readable medium of claim 14 , wherein validating the scaling factor for the multi-dimensional building model further comprises validating the scaling factor for the multi-dimensional building model according to a relative error of a second architectural element of the plurality of architectural elements.

22. The one or more non-transitory computer-readable medium of claim 14 , wherein validating the scaling factor for the multi-dimensional building model further comprises validating the scaling factor for the multi-dimensional building model further according to a relative error of a third dimension of the first architectural element of the plurality of architectural elements.

23. The one or more non-transitory computer-readable medium of claim 14 , wherein the relative error is less than five percent.

24. The one or more non-transitory computer-readable medium of claim 14 , wherein the first architectural element is a door and the component is a door knob height of the door.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 24, 2025
From: HALLIDAY, DEREK; MARQUES DA SILVA JUNIOR, ANTONIO CARLOS; KLEIN, ROBERTO; ALTMAN, ADAM J.
To: HOVER INC.
Reel/Frame 070003/0719 →
Continuity (9)
Continuation 18306775 · Apr 25, 2023
Continuation 17583546 · Jan 25, 2022
Continuation 17127994 · Dec 18, 2020
Continuation 16998564 · Aug 20, 2020
Continuation 15411226 · Jan 20, 2017
Continuation In Part 15255807 · Sep 2, 2016
Continuation 14339127 · Jul 23, 2014
Provisional Application 61857302 · Jul 23, 2013
Related Publication 20240193860A1 · Jun 13, 2024
References Cited (46)
US 5189606A · Burns et al. · 1993 [cited by applicant]
US 5973697A · Berry et al. · 1999 [cited by applicant]
US 7218318B2 · Shimazu · 2007 [cited by applicant]
US 7814436B2 · Schrag et al. · 2010 [cited by applicant]
US 7978937B2 · Abernethy et al. · 2011 [cited by applicant]
US 8040343B2 · Kickuchi et al. · 2011 [cited by applicant]
US 8098899B2 · Ohashi · 2012 [cited by applicant]
US 8139111B2 · Oldroyd · 2012 [cited by applicant]
US 8339394B1 · Lininger · 2012 [cited by applicant]
US 8350850B2 · Steedly et al. · 2013 [cited by applicant]
US 8390617B1 · Reinhardt · 2013 [cited by applicant]
US 8666158B2 · Strassenburg-Kleciak · 2014 [cited by applicant]
US 8878877B2 · Bhosale et al. · 2014 [cited by applicant]
US 10026218B1 · Mertens · 2018 [cited by examiner]
US 20030014224A1 · Guo et al. · 2003 [cited by applicant]
US 20040196282A1 · Oh · 2004 [cited by applicant]
US 20070070069A1 · Samarasekera et al. · 2007 [cited by applicant]
US 20070168153A1 · Minor · 2007 [cited by applicant]
US 20080112610A1 · Israelsen et al. · 2008 [cited by applicant]
US 20080221843A1 · Shenkar et al. · 2008 [cited by applicant]
US 20090316951A1 · Soderstrom · 2009 [cited by applicant]
US 20100045869A1 · Basely et al. · 2010 [cited by applicant]
US 20100074532A1 · Gordon et al. · 2010 [cited by applicant]
US 20110029897A1 · Russell · 2011 [cited by applicant]
US 20110181589A1 · Quan et al. · 2011 [cited by applicant]
US 20120051627A1 · Marraud · 2012 [cited by applicant]
US 20130202197A1 · Reeler et al. · 2013 [cited by applicant]
US 20130257856A1 · Hickman et al. · 2013 [cited by applicant]
US 20140023996A1 · Finn et al. · 2014 [cited by applicant]
US 20140193039A1 · Wexler · 2014 [cited by applicant]
WO WO2007147830A1 · 2007 [cited by applicant]
WO WO2011079241A1 · 2011 [cited by applicant]
WO WO2011091552A1 · 2011 [cited by applicant]
Bansal, et al., “Geo-Localization of Street Views with Aerial Image Databases,” Nov. 28-Dec. 1, 2011, pp. 1125-1128. [cited by applicant]
Becker, et al., “Semiautomatic 3-D model extraction from uncalibrated 2-D camera views,” MIT Media Laboratory, 15 pages. [cited by applicant]
Chen, et al., “City-Scale Landmark Identification on Mobile Devices,” pp. 737-744. [cited by applicant]
Fruh and Zakhor, “Constructing 3D City Models by Merging Aerial and Ground Views,” IEEE Computer Graphics and Applications, Nov./Dec. 2003, pp. 52-61, 10 pages. [cited by applicant]
Huang and WU, et al., “Towards 3D City Modeling through Combining Ground Level Panoramic and Orthogonal Aerial Imagery,” 2011 Workshop on Digital Media and Digital Content Management, pp. 66-71, 6 pages. [cited by applicant]
Jaynes, “View Alignment of Aerial and Terrestrial Imagery in Urban Environments,” Springer-Verlag Berlin Heidelber1 1999, pp. 3-19, 17 pages. [cited by applicant]
Kroepfl, et al., “Efficiently Localing Photographs in Many Panoramas,” Nov. 2-5, 2010, ACM GIS'10. [cited by applicant]
Lee, et al., “Automatic Integration of Facade Textures into 3D Building Models with a Projective Geometry Based Line :;lustering,” Eurographics 2002, vol. 2, No. 3, 10 pages. [cited by applicant]
Lee, et al., “Integrating Ground and Aerial Views for Urban Site Modeling,” 2002, 6 pages. [cited by applicant]
Pu et al., “Automatic Extraction of Building Features From Terrestrial Laser Scanning,” International Institute for Geo-Informalion Science and Earth Observation, 5 pages. [cited by applicant]
Wang, et al.; Large-Scale Urban Modeling by Combining Ground Level Panoramic and Aerial Imagery; IEEE Third Intemational Symposium on 3D Data Processing, Visualization, and Transmission; Jun. 14-16, 2006; pp. 806-813. [cited by applicant]
Xiao, et al., “Image-based Facade Modeling,” ACM Transaction on Graphics {TOG), 2008, 10 pages. [cited by applicant]
Murillo, et al. Visual Door Detection Integrating Appearance and Shape Cues, Robotics and Autonomous Systems, vol. 56, Issue 6, Jun. 30, 2008 pp. 512-521. [cited by applicant]