IP Library Granted Patent US 12,406,434
Granted Patent B2
US 12,406,434 · App. 18/586,354 · Granted Sep 2, 2025

Method for generating roof outlines from lateral images

Inventors: Ajay Mishra (Palo Alto, CA); William Castillo (San Carlos, CA); A. J. Altman (San Francisco, CA); Manish Upendran (San Francisco, CA)
Assignee: Hover Inc.
G06T17/00G06T7/12G06T7/174G06T7/62G06T7/97G06T17/20G06V20/176G06T2207/10016G06T2207/20221G06T2207/30184
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,406,434
App. No.
18/586,354
Granted
Sep 2, 2025
Kind
B2
Abstract

A computer system generates an outline of a roof of a structure based on a set of lateral images depicting the structure. For each image in the set of lateral images, one or more rooflines corresponding to the roof of the structure are determined. The computer system determines how the rooflines connect to one another. Based on the determination, the rooflines are connected to generate an outline of the roof.

Claims (45)

1. A method comprising:

determining a plurality of segments depicted in a plurality of photos of a structure, wherein the structure comprises a plurality of walls;

projecting the plurality of segments onto a two-dimensional (2D) plane reflecting a top-down view of the structure; and

generating digital data representing a 2D outline, the digital data being generated via connecting the plurality of projected segments to form the 2D outline.

2. The method of claim 1 , wherein the top-down view of the structure comprises a top down view of the plurality of walls.

3. The method of claim 1 , wherein the 2D outline is associated with a polygon.

4. The method of claim 3 , further comprising at least one of:

extending one or more segments of the plurality of segments to form the polygon; or

adding one or more segments to the plurality of segments to form the polygon.

5. The method of claim 1 , wherein the plurality of photos are lateral photos of the structure and wherein the 2D plane is perpendicular to the lateral photos.

6. The method of claim 1 , wherein determining the plurality of segments comprises:

determining a first segment depicted in a first photo of the plurality of photos;

determining a second segment depicted in a second photo of the plurality of photos; and

combining the first segment and second segment into a single segment.

7. The method of claim 6 , wherein the first photo and second photo depict at least a first wall of the plurality of walls.

8. The method of claim 1 , further comprising:

determining a path of an image capture device, the plurality of photos captured by the image capture device; and

determining, based on the path of the image capture device, two or more related photos of the plurality of photos.

9. The method of claim 1 , further comprising:

determining a plurality of intersection points of the plurality of segments; and

projecting the plurality of intersection points onto the 2D plane.

10. The method of claim 9 , wherein generating the digital data representing the 2D outline is based on the plurality of projected intersection points.

11. The method of claim 9 , wherein generating the digital data representing the 2D outline comprises connecting the plurality of projected intersection points with the plurality of projected segments.

12. One or more non-transitory computer-readable media storing instructions that, when executed by a system comprising one or more processors, cause the one or more processors to perform operations comprising:

determining a plurality of segments depicted in a plurality of photos of a structure, wherein the structure comprises a plurality of walls;

projecting the plurality of segments onto a two-dimensional (2D) plane reflecting a top-down view of the structure; and

generating digital data representing a 2D outline, the digital data being generated via connecting the plurality of projected segments to form the 2D outline.

13. The one or more non-transitory computer-readable media of claim 12 , wherein the top-down view of the structure comprises a top down view of the plurality of walls.

14. The one or more non-transitory computer-readable media of claim 13 , wherein the 2D outline is associated with a polygon.

15. The one or more non-transitory computer-readable media of claim 14 , wherein the instructions further cause the one or more processors to perform operations comprising at least one of:

extending one or more segments of the plurality of segments to form the polygon; or

adding one or more segments to the plurality of segments to form the polygon.

16. The one or more non-transitory computer-readable media of claim 12 , wherein the plurality of photos are lateral photos of the structure and wherein the 2D plane is perpendicular to the lateral photos.

17. The one or more non-transitory computer-readable media of claim 12 , wherein determining the plurality of segments comprises:

determining a first segment depicted in a first photo of the plurality of photos;

determining a second segment depicted in a second photo of the plurality of photos; and

combining the first segment and second segment into a single segment;

wherein the first photo and second photo depict at least a first wall of the plurality of walls.

18. The one or more non-transitory computer-readable media of claim 12 , wherein the instructions further cause the one or more processors to perform operations comprising: S

determining a path of an image capture device, the plurality of photos captured by the image capture device; and

determining, based on the path of the image capture device, two or more related photos of the plurality of photos.

19. The one or more non-transitory computer-readable media of claim 12 , wherein the operations further comprise:

determining a plurality of intersection points of the plurality of segments; and

projecting the plurality of intersection points onto the 2D plane.

20. The one or more non-transitory computer-readable media of claim 19 , wherein generating the digital data representing the 2D outline comprises connecting the plurality of projected intersection points with the plurality of projected segments.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 1, 2025
From: MISHRA, AJAY; CASTILLO, WILLIAM; ALTMAN, A.J.; UPENDRAN, MANISH
To: HOVER INC.
Reel/Frame 071913/0839 →
Continuity (4)
Continuation 17184305 · Feb 24, 2021
Continuation 16510728 · Jul 12, 2019
Continuation 15693347 · Aug 31, 2017
Related Publication 20240193863A1 · Jun 13, 2024
References Cited (29)
US 8558848B2 · Meadow et al. · 2013 [cited by applicant]
US 8610708B2 · Richards · 2013 [cited by applicant]
US 8817018B1 · Fan et al. · 2014 [cited by applicant]
US 8942483B2 · Janky et al. · 2015 [cited by applicant]
US 9098870B2 · Meadow et al. · 2015 [cited by applicant]
US 9317966B1 · Deephanphongs · 2016 [cited by applicant]
US 9437033B2 · Sun et al. · 2016 [cited by applicant]
US 9437044B2 · Ege · 2016 [cited by examiner]
US 10460465B2 · Mishra et al. · 2019 [cited by applicant]
US 10970869B2 · Mishra et al. · 2021 [cited by applicant]
US 11783540B2 · Mishra et al. · 2023 [cited by applicant]
US 11830134B2 · Mishra et al. · 2023 [cited by applicant]
US 20100118116A1 · Tomasz et al. · 2010 [cited by applicant]
US 20130155109A1 · Schultz et al. · 2013 [cited by applicant]
US 20130202197A1 · Reeler et al. · 2013 [cited by applicant]
US 20140125671A1 · Vorobyov et al. · 2014 [cited by applicant]
US 20150029188A1 · Ege · 2015 [cited by applicant]
US 20150213590A1 · Brown et al. · 2015 [cited by applicant]
US 20160239976A1 · Fathi et al. · 2016 [cited by applicant]
US 20190066322A1 · Mishra et al. · 2019 [cited by applicant]
US 20210201524A1 · Mishra et al. · 2021 [cited by applicant]
US 20220284618A1 · Mishra et al. · 2022 [cited by applicant]
US 20240013484A1 · Mishra et al. · 2024 [cited by applicant]
Ding et al., “Refine the 3D building model from ground view images and 2D vectorgraph”, Proc. Of SPIE, vol. 6418, Geoinformatics, 2006 in 8 pages. [cited by applicant]
Hegarty et al., “SAMATS—Triangle Grouping and Structure Recovery for 3D Building Modeling and Visualization”, W2GIS dated 2005, LNCS 3833, pp. 267-280. [cited by applicant]
Lee et al., “Automatic integration of facade textures into 3D building models with a projective geometry based line clustering”, Eurographics, vol. 21, No. 3, 2002 in 10 pages. [cited by applicant]
Jang et al., “Practical modeling technique for large-scale 3D building models from ground images”, Pattern Recognition Letter, vol. 30, 2008, pp. 861-869. [cited by applicant]
Wirtz et al., “Semiautomatic Generation of Semantic Building Models from Image Series”, Proc. SPIE 8290, Three Dimensional Image Processing (3DIP) and Applications II, dated Jan. 30, 2012 in 9 pages. [cited by applicant]
Zhang et al., “Integrating smartphone images and airborne LIDAR data for complete urban building modelling”, The International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences, vol. XLI-B5… [cited by applicant]