IP Library Granted Patent US 10,896,540
Granted Patent B2
US 10,896,540 · App. 16/799,034 · Granted Jan 19, 2021

Systems and methods for rapid three-dimensional modeling with real façade texture

Inventors: Joseph G. Freund (Rishon le-Zion, IL); Ran Gal (Rishon le-Zion, IL)
Assignee: Pictometry International Corp.
G06T17/05G06T11/001G06T15/04
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,896,540
App. No.
16/799,034
Granted
Jan 19, 2021
Kind
B2
Abstract

Computer systems and methods are described for automatically generating a 3D model, including, with computer processor(s), obtaining geo-referenced images representing the geographic location of a structure containing one or more real façade texture of the structure; locating a geographical position of real façade texture(s) of the structure; selecting base oblique image(s) from the images by analyzing image raster content of the real façade texture depicted in the images with selection logic; analyzing the real façade texture to locate a geographical position of at least one occlusion using pixel pattern recognition of the real façade texture; locating oblique image(s) having an unoccluded image characteristic of the occlusion in the real façade texture; applying the real façade texture to wire-frame data of the structure to create a 3D model of the structure; and applying the unoccluded image characteristic to the real façade texture to remove the occlusion from the real façade texture.

Claims (37)

1. A computer system for automatically generating a three-dimensional model, comprising:

one or more computer processor; and,

one or more non-transitory computer readable medium accessible by the one or more computer processor and storing instructions that when executed by the one or more computer processor cause the one or more computer processor to:

obtain, using a geographical location of a structure, multiple geo-referenced images representing the geographic location of a structure within an area of interest and containing one or more real façade texture of the structure;

locate a geographical position of one or more real façcade texture of the structure;

select one or more base oblique image from the multiple geo-referenced images by analyzing image raster content of the real façade texture depicted in the multiple geo-referenced images with selection logic;

analyze the real façade texture depicted within the base oblique image to locate a geographical position of at least one occlusion using pixel pattern recognition of the real façade texture to locate the occlusion;

locate at least one oblique image having an unoccluded image characteristic of the occlusion in the real façade texture from the multiple geo-referenced images;

apply the real façade texture of the one or more base oblique image to wire-frame data of the structure to create a three-dimensional model of the structure; and

apply the unoccluded image characteristic to the real façade texture to remove the occlusion from the real façade texture.

2. The computer system of claim 1 , wherein locating the geographical position of one or more real façade texture of the structure comprises locating the geographical position of at least one real façade texture of the structure utilizing the wire-frame data of the structure.

3. The computer system of claim 1 , wherein the geo-referenced images are geo-referenced solved images.

4. The computer system of claim 1 , further comprising instructions that when executed by the one or more computer processor cause the one or more computer processor to extract the real façade texture from the base oblique image, the real façade texture having geo-referenced information.

5. The computer system of claim 1 , wherein the real façade texture includes overlapping structures having a geometry, and wherein the instructions, when executed by the one or more computer processor cause the one or more computer processor to analyze the geometry of the overlapping structures to determine whether the overlapping structures are occlusions or desirable features of the real façade texture.

6. The computer system of claim 5 , wherein a first overlapping structure of the overlapping structures is a roof structure.

7. The computer system of claim 5 , wherein the one or more non-transitory computer readable medium stores instructions that when executed by the one or more computer processor further causes the one or more computer processor to:

apply the real façade texture of the overlapping structures that are determined to be desirable features to the three-dimensional model.

8. The computer system of claim 1 , wherein analyzing image raster content of the real façade texture depicted in the multiple geo-referenced images further comprises analyzing image characteristics of the real façade texture contained in the image raster content.

9. The computer system of claim 1 , wherein analyzing image raster content of the real façade texture depicted in the multiple geo-referenced images further comprises analyzing multiple characteristics of the real façade texture in the image raster content of multiple geo-referenced images.

10. The computer system of claim 9 , wherein locating a geographical position of one or more real façade texture of the structure comprises locating the geographical position of at least one real façade texture of the structure utilizing the wire-frame data of the structure.

11. A method for automatically generating a three-dimensional model, comprising:

obtaining, with one or more computer processor, using a geographical location of a structure, multiple geo-referenced images representing the geographic location of a structure within an area of interest and containing one or more real façade texture of the structure;

locating, with the one or more computer processor, a geographical position of one or more real façade texture of the structure;

selecting, with the one or more computer processor, one or more base oblique image from the multiple geo-referenced images by analyzing image raster content of the real façade texture depicted in the multiple geo-referenced images with selection logic; and,

analyzing, with the one or more computer processor, the real façade texture depicted within the base oblique image to locate a geographical position of at least one occlusion using pixel pattern recognition of the real façade texture to locate the occlusion;

locating, with the one or more computer processor, at least one oblique image having an unoccluded image characteristic of the occlusion in the real façade texture from the multiple geo-referenced images;

applying, with the one or more computer processor, the real façade texture of the one or more base oblique image to wire-frame data of the structure to create a three-dimensional model; and

applying, with the one or more computer processor, the unoccluded image characteristic to the real façade texture to remove the occlusion from the real façade texture.

12. The method of claim 11 , wherein locating a geographical position of one or more real façade texture of the structure comprises locating the geographical position of at least one real façade texture of the structure utilizing the wire-frame data of the structure.

13. The method of claim 11 , wherein the real façade texture includes overlapping structures having a geometry, and further comprising, analyzing, using the one or more computer processor, the geometry of the overlapping structures to determine whether the overlapping structures are occlusions or desirable features of the real façade texture.

14. The method of claim 13 , further comprising:

applying, using the one or more computer processor, the real façade texture of the overlapping structures that are determined to be desirable features to the three-dimensional model.

15. The method of claim 11 , wherein analyzing image raster content of the real façade texture depicted in the multiple geo-referenced images further comprises analyzing image characteristics of the real façade texture contained in the image raster content.

16. The method of claim 11 , wherein analyzing image raster content of the real façade texture depicted in the multiple geo-referenced images further comprises analyzing the real façade texture formed by the image raster content of multiple geo-referenced images.

17. The method of claim 16 , wherein locating a geographical position of one or more real façade texture of the structure comprises locating the geographical position of at least one real façade texture of the structure utilizing the wire-frame data of the structure.

18. The method of claim 11 , wherein analyzing image raster content of the real façade texture depicted in the multiple geo-referenced images further comprises analyzing multiple characteristics of the real façade texture in the image raster content of multiple geo-referenced images.

19. The method of claim 18 , wherein locating a geographical position of one or more real façade texture of the structure comprises locating the geographical position of at least one real façade texture of the structure utilizing the wire-frame data of the structure.

Assignments (5)
RELEASE OF FIRST LIEN SECURITY INTEREST IN PATENTS Recorded Apr 9, 2025
From: MORGAN STANLEY SENIOR FUNDING, INC.
To: PICTOMETRY INTERNATIONAL CORP.; EAGLE VIEW TECHNOLOGIES, INC.; OMNIEARTH, INC.
Reel/Frame 070786/0022 →
FIRST LIEN SECURITY AGREEMENT Recorded Mar 28, 2025
From: EAGLE VIEW TECHNOLOGIES, INC.; PICTOMETRY INTERNATIONAL CORP.
To: MORGAN STANLEY SENIOR FUNDING, INC.
Reel/Frame 070671/0078 →
FIRST LIEN PATENT SECURITY AGREEMENT SUPPLEMENT Recorded Feb 3, 2025
From: EAGLE VIEW TECHNOLOGIES, INC.; OMNIEARTH, INC.; PICTOMETRY INTERNATIONAL CORP.
To: MORGAN STANLEY SENIOR FUNDING, INC. AS COLLATERAL AGENT
Reel/Frame 070096/0485 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Feb 24, 2020
From: FREUND, JOSEPH G.; GAL, RAN
To: IDAN COMPUTERS ENGINEERING (1979) LTD.
Reel/Frame 051904/0806 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Feb 24, 2020
From: IDAN COMPUTERS ENGINEERING (1979) LTD.
To: PICTOMETRY INTERNATIONAL CORP.
Reel/Frame 051904/0896 →
Continuity (10)
Continuation 16298774 · Mar 11, 2019
Continuation 15977848 · May 11, 2018
Continuation 15830823 · Dec 4, 2017
Continuation 15374358 · Dec 9, 2016
Continuation 15056598 · Feb 29, 2016
Continuation 14633285 · Feb 27, 2015
Continuation 14152638 · Jan 10, 2014
Continuation 13903683 · May 28, 2013
Continuation 11998974 · Dec 3, 2007
Related Publication 20200193702A1 · Jun 18, 2020