IP Library Granted Patent US 10,198,857
Granted Patent B2
US 10,198,857 · App. 15/964,956 · Granted Feb 5, 2019

Method for the automatic material classification and texture simulation for 3D models

Inventor: Stephen Schultz (West Henrietta, NY)
Assignee: Pictometry International Corp.
G06T17/05G06T15/005G06T15/04G09G5/363G06T1/60G06T11/001
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,198,857
App. No.
15/964,956
Filed
Apr 27, 2018
Granted
Feb 5, 2019
Kind
B2
Art Unit
2619
USPC
345/419
Abstract

A method of automatically transforming a computerized 3D model having regions of images utilized as textures on one or more physical objects represented in the 3D model (such as building sides and roofs, walls, landscapes, mountain sides, trees and the like) to include material property information for one or more regions of the textures of the 3D model. In this method, image textures applied to the 3D model are examined by comparing, utilizing a computer, at least a portion of each image texture to entries in a palette of material entries. The material palette entry that best matches the one contained in the image texture is assigned to indicate a physical material of the physical object represented by the 3D model. Then, material property information is stored in the computerized 3D model for the image textures that are assigned a material palette entry.

Claims (40)

1. A method of automatically creating a computerized 3D model to include material property information for one or more regions of image textures of the computerized 3D model, comprising the steps of:

creating a computerized 3D model;

examining, using computer executable code operated on a computer, a portion of a first image texture having unknown material properties, by:

comparing, using computer executable code operated on the computer, the portion of the first image texture to second texture images of material entries in a palette of material entries stored on a non-transitory computer readable medium to determine a best match for the first image texture, the palette of material entries comprising a set of the second texture images, the second texture images associated with material properties of physical materials, the material properties having material property information about the physical materials; and

assigning the material entry in the palette that best matches the portion of the first image texture to the first image texture to indicate a physical material of a physical object represented by the portion of the first image texture;

storing the material property information of a selected material entry; and

associating the material property information with the computerized 3D model.

2. The method of claim 1 , wherein the method comprises the step of modifying an image resolution of at least one of the first image texture and the second texture images of the material entries in the palette of material entries to match, prior to the step of comparing the first image texture to the second texture images of the material entries in the palette of material entries.

3. The method of claim 1 , wherein the material property information is stored in fields in the computerized 3D model.

4. The method of claim 1 , wherein the stored material property information includes a unique identifier for the selected material entry and wherein the method further comprises the step of retrieving the material property information from a list or database of material properties using the unique identifier.

5. The method of claim 1 , wherein the material property information is stored in fields in the computerized 3D model.

6. The method of claim 1 , wherein the material property information stored includes a unique identifier for the selected material entry and, wherein the method further comprises the step of retrieving the material property information from a list or database of material properties using the unique identifier.

7. The method of claim 1 , wherein the first image texture is based at least in part on imagery captured by a camera.

8. The method of claim 7 , wherein the imagery is aerial imagery.

9. The method of claim 7 , wherein the imagery is imagery captured by one or more hand-held camera.

10. The method of claim 7 , wherein the imagery is one or more of nadir imagery and oblique imagery.

11. A method of automatically creating a computerized 3D model, comprising the steps of:

using a computer system to perform the steps of:

creating a computerized 3D model;

locating, with one or more processors executing computer executable instructions stored on one or more non-transitory computer readable medium, representations of predetermined structural roof elements in the 3D model, utilizing an edge detection algorithm on the 3D model;

examining, using computer executable code operated on the computer system, at least a portion of the representations of predetermined structural elements in the 3D model, by:

comparing, with the one or more processors executing computer executable instructions stored on the one or more non-transitory computer readable medium, the representations of predetermined structural roof elements in the 3D model to texture images of entries in a palette of structural element textures representing structural elements stored on the computer system to determine best matches for the representations of predetermined structural elements;

assigning, with the one or more processors executing computer executable instructions stored on the one or more non-transitory computer readable medium, the entries in the palette of structural element textures with the best match to the structural element found in the 3D model; and

associating, with the one or more processors executing computer executable instructions stored on the one or more non-transitory computer readable medium, material property information about the material from the entries in the palette of structural element textures with the best match with the 3D model at the same size and position as the structural elements as found in the 3D model by the edge detection algorithm.

12. The method of claim 11 , further comprising the step of modifying an image resolution of the texture images of entries in the palette of structural element textures to match an image resolution of the 3D model.

13. The method of claim 11 , wherein the step of associating material property information is defined further as storing material property information of the entries in the palette of structural element textures with the best match in a field in the computerized 3D model directly.

14. The method of claim 11 , wherein the step of associating material property information is defined further as the steps of storing a unique identifier for the entries in the palette of structural roof element textures with the best match in the computerized 3D model and subsequently using the unique identifier to retrieve the material property information from at least one of a list and a database of material properties.

15. The method of claim 11 , further comprising the step of using the entries in the palette of structural roof element textures with the best match as simulated textures for the computerized 3D model as indicated by a size and position of the representations of predetermined structural roof elements.

16. The method of claim 15 , wherein the simulated textures have an image resolution greater than an image resolution of the 3D model, and wherein the method further comprises the step of combining the simulated texture with texture of the 3D model of the structural element at the size and position of the structural element as found in the 3D model by the edge detection algorithm.

17. A system for automatically creating a computerized 3D model to include material property information for one or more regions of image textures of the computerized 3D model, the system comprising:

a computer comprising;

a processor; and

a non-transitory computer readable medium storing computer executable code that when executed by the processor causes the computer to:

create a computerized 3D model;

examine at least a portion of a first image texture having material properties, by comparing the first image texture to second texture images of material entries in a palette of material entries stored on the non-transitory computer readable medium, the palette of material entries comprising a set of the second texture images, the second texture images associated with material properties of physical materials, the material properties having material property information about the physical material;

determine a best match for the first image texture; and

assign the material entry in the palette that best matches the first image texture to the first image texture to indicate a physical material represented by the portion of the first image texture, the non-transitory computer readable medium storing the material property information of a selected material entry.

18. The system of claim 17 , wherein the material property information of the selected material entry is stored in fields in the computerized 3D model.

19. The system of claim 17 , wherein the material property information includes a unique identifier for the selected material entry and wherein the non-transitory computer readable medium further storing computer executable code that when executed by the processor causes the computer to retrieve the material property information from a list or database of material properties using the unique identifier.

20. The system of claim 17 , wherein the first image texture is based at least in part on imagery captured by a camera, and wherein the imagery is one or more of oblique imagery, nadir imagery, aerial imagery, and captured by one or more hand-held camera.

Assignments (6)
RELEASE OF SECURITY INTEREST Recorded Apr 14, 2025
From: HPS INVESTMENT PARTNERS, LLC
To: PICTOMETRY INTERNATIONAL CORP.
Reel/Frame 070828/0266 →
RELEASE OF FIRST LIEN SECURITY INTEREST IN PATENTS Recorded Apr 9, 2025
From: MORGAN STANLEY SENIOR FUNDING, INC.
To: PICTOMETRY INTERNATIONAL CORP.; EAGLE VIEW TECHNOLOGIES, INC.; OMNIEARTH, INC.
Reel/Frame 070786/0022 →
FIRST LIEN SECURITY AGREEMENT Recorded Mar 28, 2025
From: EAGLE VIEW TECHNOLOGIES, INC.; PICTOMETRY INTERNATIONAL CORP.
To: MORGAN STANLEY SENIOR FUNDING, INC.
Reel/Frame 070671/0078 →
FIRST LIEN PATENT SECURITY AGREEMENT Recorded Aug 23, 2018
From: PICTOMETRY INTERNATIONAL CORP.
To: MORGAN STANLEY SENIOR FUNDING, INC., AS COLLATERAL AGENT
Reel/Frame 046919/0065 →
SECOND LIEN PATENT SECURITY AGREEMENT Recorded Aug 14, 2018
From: PICTOMETRY INTERNATIONAL CORP.
To: HPS INVESTMENT PARTNERS, LLC,
Reel/Frame 046823/0755 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 27, 2018
From: SCHULTZ, STEPHEN
To: PICTOMETRY INTERNATIONAL CORP.
Reel/Frame 045657/0411 →
Continuity (3)
Continuation 15142361 · Apr 29, 2016
Continuation 12605980 · Oct 26, 2009
Related Publication 20180247448A1 · Aug 30, 2018
Cited By (1)
US 12,205,031