IP Library Granted Patent US 9,275,496
Granted Patent B2
US 9,275,496 · App. 14/633,285 · Granted Mar 1, 2016

Systems and methods for rapid three-dimensional modeling with real facade texture

View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,275,496
App. No.
14/633,285
Granted
Mar 1, 2016
Kind
B2
Abstract

A computer system is described for automatically generating a 3D model, including hardware and non-transitory computer readable medium accessible by the hardware and storing instructions that when executed by the hardware cause it to create wire-frame data of structures within a geographic area; identify a geographic location of a structure of the structures; receive multiple oblique images representing the geographic location and containing a real façade texture of the structure; locate a geographical position of a real façade texture of the structure; select one or more base oblique image from the multiple oblique images by analyzing, with selection logic, image raster content of the real façade texture depicted in the multiple oblique images, and, relate the real façade texture of the one or more base oblique image to the wire-frame data of the structure to create a three dimensional model providing a real-life representation of physical characteristics of the structure.

Claims (42)

1. A computer system for automatically generating a three-dimensional model, comprising:

hardware; and

one or more non-transitory computer readable medium accessible by the hardware and storing instructions that when executed by the hardware cause the hardware to:

create wire-frame data of structures within a geographical area;

identify a geographic location of a structure of the structures within the geographical area;

receive multiple oblique images representing the geographic location and containing one or more real façade texture of the structure;

locate a geographical position of one or more real façade texture of the structure;

select one or more base oblique image from the multiple oblique images by analyzing, with selection logic, image raster content of the real façade texture depicted in the multiple oblique images, the selection logic using a factorial analysis of the image raster content, wherein the factorial analysis is a weighted determination based on at least two factors; and,

relate the real façade texture of the one or more base oblique image to the wire-frame data of the structure to create a three-dimensional model providing a real-life representation of physical characteristics of the structure.

2. The computer system of claim 1 , wherein locating a geographical position of one or more real façade texture of the structure comprises locating the geographical position of at least one real façade texture of the structure utilizing the wire-frame data.

3. The computer system of claim 1 , wherein locating a geographical position of one or more real façade texture of the structure comprises locating the geographical position of at least one real façade texture of the structure utilizing terrain data.

4. The computer system of claim 1 , wherein the factors include at least one of resolution of the oblique images, colour depth of the oblique images, proportional size of the real façade texture of the oblique images, contrast in the oblique images, time of day the oblique images were captured, time of year the oblique images were captured, amount of foliage in the oblique images, and contrast in lighting conditions in the oblique images.

5. The computer system of claim 1 , wherein the one or more non-transitory computer readable medium stores instructions that when executed by the hardware further causes the hardware to:

analyze the real façade texture depicted within the base oblique image to locate a geographical position of at least one occlusion;

locate at least one oblique image having an unoccluded image characteristic of the occlusion in the real façade texture from the multiple oblique images; and,

apply the unoccluded image characteristic to the real façade texture forming a mosaic image.

6. The computer system of claim 5 , wherein the instructions are configured to use pixel pattern recognition of the real façade texture to locate the occlusion.

7. The computer system of claim 5 , wherein the oblique images are geo-referenced solved oblique images.

8. The computer system of claim 5 , wherein the instructions are configured to remove the occlusion from the real façade texture.

9. The computer system of claim 1 , further comprising instructions that when executed by the hardware cause the hardware to extract the real façade texture from the base oblique image, the real façade texture having geo-referenced information.

10. The computer system of claim 1 , wherein the real façade texture includes overlapping structures having a geometry, and wherein the instructions, when executed by the hardware cause the hardware to analyze the geometry of the overlapping structures to determine whether the overlapping structures are occlusions or desirable features of the real façade texture.

11. The computer system of claim 10 , wherein a first overlapping structure of the overlapping structures is a roof structure.

12. The computer system of claim 10 , wherein the one or more non-transitory computer readable medium stores instructions that when executed by the hardware further causes the hardware to:

apply the real façade texture of the overlapping structures that are determined to be desirable features to the three-dimensional model.

13. A method for automatically generating a three-dimensional model, comprising:

creating, using one or more computer processor, wire-frame data of at least one structure;

identifying, using the one or more computer processor, a geographic location of the structure;

receiving, using the one or more computer processor, multiple oblique images representing the geographic location and containing one or more real façade texture of the structure;

locating, using the one or more computer processor, a geographical position of one or more real façade texture of the structure;

selecting, using the one or more computer processor, one or more base oblique image from the multiple oblique images by analyzing, with selection logic, image raster content of the real façade texture depicted in the multiple oblique images, the selection logic using a factorial analysis of the image raster content, wherein the factorial analysis is a weighted determination based on at least two factors; and,

relating, using the one or more computer processor, the real façade texture of the one or more base oblique image to the wire-frame data of the structure to create a three-dimensional model providing a real-life representation of physical characteristics of the structure.

14. The method of claim 13 , wherein locating a geographical position of one or more real façade texture of the structure comprises locating the geographical position of at least one real façade texture of the structure utilizing the wire-frame data.

15. The method of claim 13 , wherein locating a geographical position of one or more real façade texture of the structure comprises locating the geographical position of at least one real façade texture of the structure utilizing terrain data.

16. The method of claim 13 , wherein the factors include at least one of resolution of the oblique images, colour depth of the oblique images, proportional size of the real façade texture of the oblique images, contrast in the oblique images, time of day the oblique images were captured, time of year the oblique images were captured, amount of foliage in the oblique images, and contrast in lighting conditions in the oblique images.

17. The method of claim 13 , further comprising:

analyzing, using the one or more computer processor, the real façade texture depicted within the base oblique image to locate a geographical position of at least one occlusion;

locating, using the one or more computer processor, at least one oblique image having an unoccluded image characteristic of the occlusion in the real façade texture from the multiple oblique images; and,

applying, using the one or more computer processor, the unoccluded image characteristic to the real façade texture forming a mosaic image.

18. The method of claim 17 , further comprising removing, using the one or more computer processor, the occlusion from the real façade texture.

19. The method of claim 13 , wherein the real façade texture includes overlapping structures having a geometry, and further comprising, analyzing, using the one or more computer processor, the geometry of the overlapping structures to determine whether the overlapping structures are occlusions or desirable features of the real façade texture.

20. The method of claim 19 , further comprising:

applying, using the one or more computer processor, the real façade texture of the overlapping structures that are determined to be desirable features to the three-dimensional model.

Assignments (11)
RELEASE OF SECURITY INTEREST Recorded Apr 14, 2025
From: HPS INVESTMENT PARTNERS, LLC
To: PICTOMETRY INTERNATIONAL CORP.
Reel/Frame 070828/0266 →
RELEASE OF FIRST LIEN SECURITY INTEREST IN PATENTS Recorded Apr 9, 2025
From: MORGAN STANLEY SENIOR FUNDING, INC.
To: PICTOMETRY INTERNATIONAL CORP.; EAGLE VIEW TECHNOLOGIES, INC.; OMNIEARTH, INC.
Reel/Frame 070786/0022 →
FIRST LIEN SECURITY AGREEMENT Recorded Mar 28, 2025
From: EAGLE VIEW TECHNOLOGIES, INC.; PICTOMETRY INTERNATIONAL CORP.
To: MORGAN STANLEY SENIOR FUNDING, INC.
Reel/Frame 070671/0078 →
RELEASE OF FIRST LIEN SECURITY INTEREST IN PATENTS Recorded Aug 29, 2018
From: MORGAN STANLEY SENIOR FUNDING, INC., AS COLLATERAL AGENT
To: PICTOMETRY INTERNATIONAL CORP.; EAGLE VIEW TECHNOLOGIES, INC.; OMNIEARTH, INC.
Reel/Frame 046970/0875 →
FIRST LIEN PATENT SECURITY AGREEMENT Recorded Aug 23, 2018
From: PICTOMETRY INTERNATIONAL CORP.
To: MORGAN STANLEY SENIOR FUNDING, INC., AS COLLATERAL AGENT
Reel/Frame 046919/0065 →
SECOND LIEN PATENT SECURITY AGREEMENT Recorded Aug 14, 2018
From: PICTOMETRY INTERNATIONAL CORP.
To: HPS INVESTMENT PARTNERS, LLC,
Reel/Frame 046823/0755 →
RELEASE OF SECOND LIEN SECURITY INTEREST Recorded Sep 22, 2017
From: MORGAN STANLEY SENIOR FUNDING, INC.
To: PICTOMETRY INTERNATIONAL CORP.; EAGLE VIEW TECHNOLOGIES, INC.; OMNIEARTH, INC.
Reel/Frame 043955/0128 →
SECOND LIEN PATENT SECURITY AGREEMENT Recorded Jul 20, 2015
From: PICTOMETRY INTERNATIONAL CORP.; EAGLE VIEW TECHNOLOGIES, INC.
To: MORGAN STANLEY SENIOR FUNDING, INC.
Reel/Frame 036130/0873 →
FIRST LIEN PATENT SECURITY AGREEMENT Recorded Jul 20, 2015
From: PICTOMETRY INTERNATIONAL CORP.; EAGLE VIEW TECHNOLOGIES, INC.
To: MORGAN STANLEY SENIOR FUNDING, INC.
Reel/Frame 036130/0899 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 2, 2015
From: FREUND, JOSEPH G.; GAL, RAN
To: IDAN COMPUTERS ENGINEERING (1979) LTD.
Reel/Frame 035972/0179 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 2, 2015
From: IDAN COMPUTERS ENGINEERING (1979) LTD.
To: PICTOMETRY INTERNATIONAL CORPORATION
Reel/Frame 035972/0275 →