IP Library Granted Patent US 11,538,219
Granted Patent B2
US 11,538,219 · App. 17/012,835 · Granted Dec 27, 2022

Image capture for a multi-dimensional building model

Inventors: Manish Upendran (San Francisco, CA); William Castillo (Belmont, CA); Ajay Mishra (Palo Alto, CA); Adam J. Altman (San Francisco, CA)
Assignee: Hover Inc.
G06T17/05G06T7/55G06T7/60G06T17/00G06T19/20H04N5/23222H04N5/23293G06T2210/04
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,538,219
App. No.
17/012,835
Granted
Dec 27, 2022
Kind
B2
Abstract

A process for creating, responsive to a desired analysis, estimate information from received imagery by determining whether the imagery meets a minimum criterion for creating a multi-dimensional model that can address the desired analysis and building an aggregate set of images meeting the minimum criterion from which a multi-dimensional model is then built and an estimate responsive to the desired analysis is derived. The multi-dimensional model, and the responsive estimate, may be refined as additional images are provided to the aggregate set. Desired analyses may include dimensions such as square footage of a roof for building objects.

Claims (40)

1. A method of processing imagery comprising:

receiving a plurality of input camera images comprising imagery of a building object;

receiving a desired estimate analysis related to the building object within the imagery, wherein the desired estimate analysis comprises a requested dimension of the building object;

determining, for each of the received input cameras images, whether a minimum criterion is met, wherein the minimum criterion indicates applicability for constructing a multi-dimensional building model based on the desired estimate analysis;

aggregating an image set comprising each of the input camera images meeting the minimum criterion;

constructing a base multi-dimensional building model of the building object from the aggregated image set; and

returning a responsive estimate based on the constructed base multi-dimensional building model, wherein the responsive estimate comprises the requested dimension of the building object.

2. The method of claim 1 , wherein the requested dimension is a square footage estimate of a surface of the building object.

3. The method of claim 2 , wherein the square footage estimate of the surface of the building object further includes a replacement materials report comprising replacement costs of a replacement material based on the square footage estimate.

4. The method of claim 2 , wherein the surface of the building object is a roof surface.

5. The method of claim 1 , wherein the minimum criterion comprises detecting at least one specific feature.

6. The method of claim 5 , wherein the detecting the at least one specific feature comprises detecting a corner of the building object.

7. The method of claim 1 , wherein the base multi-dimensional model comprises a multi-dimensional building model constructed from a threshold number of images from the aggregated image set to derive the responsive estimate.

8. The method of claim 1 , wherein the responsive estimate comprises a calculated dimension from at least one measurement of the base multi-dimensional building model.

9. The method of claim 1 , wherein constructing the base multi-dimensional model further comprises applying a scale to the base multi-dimensional model.

10. The method of claim 9 , wherein the responsive estimate comprises a calculated dimension based on at least one scaled measurement of the base multi-dimensional building model.

11. The method of claim 9 , wherein the scale is based on geo-referenced spatial information.

12. The method of claim 9 , wherein the scale is based on architectural features of the base multi-dimensional model.

13. The method of claim 1 , further comprising updating the base multi-dimensional building model with additional ones of input cameras images exceeding a threshold number of images from the aggregated image set to derive the responsive estimate.

14. The method of claim 13 , further comprising calculating a refined responsive estimate based on at least one measurement from the updated base multi-dimensional building model.

15. A non-transitory computer readable medium storing instructions that, upon execution, cause a computing system to perform operations including:

receiving a plurality of input camera images comprising imagery of a building object;

receiving a desired estimate analysis related to the building object within the imagery, wherein the desired estimate analysis comprises a requested dimension of the building object;

determining, for each of the received input cameras images whether a minimum criterion is met, wherein the minimum criterion indicates applicability for constructing a multi-dimensional building model based on the desired estimate analysis;

aggregating an image set comprising each of the input camera images meeting the minimum criterion;

constructing a base multi-dimensional building model of the building object from the aggregated image set; and

returning a responsive estimate based on the constructed base multi-dimensional building model, wherein the responsive estimate comprises the requested dimension of the building object.

16. The non-transitory computer readable medium of claim 15 , wherein the requested dimension is a square footage estimate of a surface of the building object.

17. The non-transitory computer readable medium of claim 16 , wherein the square footage estimate of the surface of the building object further includes a replacement materials report comprising replacement costs of a replacement material based on the square footage estimate.

18. The non-transitory computer readable medium of claim 16 , wherein the surface of the building object is a roof surface.

19. The non-transitory computer readable medium of claim 15 , wherein the minimum criterion comprises detecting at least one specific feature.

20. The non-transitory computer readable medium of claim 19 , wherein the detecting the at least one specific feature comprises detecting a corner of the building object.

21. The non-transitory computer readable medium of claim 15 , wherein the base multidimensional model comprises a multi-dimensional building model constructed from a threshold number of images from the aggregated image set to derive the responsive estimate.

22. The non-transitory computer readable medium of claim 15 , wherein the responsive estimate comprises a calculated dimension from at least one measurement of the base multi-dimensional building model.

23. The non-transitory computer readable medium of claim 15 , wherein constructing the base multi-dimensional model further comprises applying a scale to the base multi-dimensional model.

24. The non-transitory computer readable medium of claim 23 , wherein the responsive estimate comprises a calculated dimension based on at least one scaled measurement of the base multidimensional building model.

25. The non-transitory computer readable medium of claim 23 , wherein the scale is based on geo-referenced spatial information.

26. The non-transitory computer readable medium of claim 23 , wherein the scale is based on architectural features of the base multi-dimensional model.

27. The non-transitory computer readable medium of claim 15 , further comprising updating the base multi-dimensional building model with additional ones of input cameras images exceeding a threshold number of images from the aggregated image set to derive the responsive estimate.

28. The non-transitory computer readable medium of claim 27 , further comprising calculating a refined responsive estimate based on at least one measurement from the updated base multi-dimensional building model.

Assignments (5)
TERMINATION OF INTELLECTUAL PROPERTY SECURITY AGREEMENT Recorded Oct 6, 2022
From: SILICON VALLEY BANK
To: HOVER INC.
Reel/Frame 061622/0741 →
TERMINATION OF INTELLECTUAL PROPERTY SECURITY AGREEMENT Recorded Oct 6, 2022
From: SILICON VALLEY BANK, AS AGENT
To: HOVER INC.
Reel/Frame 061622/0761 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 23, 2022
From: UPENDRAN, MANISH; CASTILLO, WILLIAM; MISHRA, AJAY; ALTMAN, ADAM J.
To: HOVER INC.
Reel/Frame 059382/0157 →
INTELLECTUAL PROPERTY SECURITY AGREEMENT Recorded May 28, 2021
From: HOVER INC.
To: SILICON VALLEY BANK
Reel/Frame 056423/0199 →
INTELLECTUAL PROPERTY SECURITY AGREEMENT Recorded May 28, 2021
From: HOVER INC.
To: SILICON VALLEY BANK, AS ADMINISTRATIVE AGENT
Reel/Frame 056423/0222 →
Continuity (5)
Continuation 16545067 · Aug 20, 2019
Continuation 15942786 · Apr 2, 2018
Continuation In Part 15166587 · May 27, 2016
Provisional Application 62168460 · May 29, 2015
Related Publication 20200402301A1 · Dec 24, 2020
Cited By (2)
US 12,190,446 US 12,657,826