IP Library Granted Patent US 11,263,807
Granted Patent B2
US 11,263,807 · App. 16/994,914 · Granted Mar 1, 2022

Method for the automatic material classification and texture simulation for 3D models

Inventor: Stephen Schultz (West Henrietta, NY)
Assignee: Pictometry International Corp.
G06T17/05G06T15/005G06T15/04G09G5/363G06T1/60G06T11/001
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,263,807
App. No.
16/994,914
Granted
Mar 1, 2022
Kind
B2
Abstract

A method of automatically transforming a computerized 3D model having regions of images utilized as textures on one or more physical objects represented in the 3D model (such as building sides and roofs, walls, landscapes, mountain sides, trees and the like) to include material property information for one or more regions of the textures of the 3D model. In this method, image textures applied to the 3D model are examined by comparing, utilizing a computer, at least a portion of each image texture to entries in a palette of material entries. The material palette entry that best matches the one contained in the image texture is assigned to indicate a physical material of the physical object represented by the 3D model. Then, material property information is stored in the computerized 3D model for the image textures that are assigned a material palette entry.

Claims (31)

1. A non-transitory computer readable medium storing computer executable code that when executed by one or more processors causes the one or more processors to perform the steps of:

creating a computerized 3D model having image texture;

locating image texture representations of structural roof elements in the 3D model, utilizing an edge detection algorithm on the 3D model;

examining at least a portion of the image texture representations of structural roof elements in the 3D model, by:

comparing the image texture representations of structural roof elements in the 3D model to simulated textures of entries in a palette of structural element textures representing structural elements to determine best matches for the examined portion of the image texture representations of the structural roof elements in the 3D model; and

assigning the entries in the palette of structural element textures with the best match to the examined portion of the image texture representations of the structural roof element found in the 3D model;

associating material property information about material of structural roof elements from the entries in the palette of structural element textures with the best match with the 3D model at the same size and position as the examined portion of the image texture representations of the structural roof elements as found in the 3D model by the edge detection algorithm; and

replacing in the 3D model the image texture representation of the structural roof elements with the simulated texture of the entries in the palette of structural element textures with the best match.

2. The non-transitory computer readable medium of claim 1 storing computer executable code that when executed by one or more processors causes the one or more processors further to perform the step of modifying an image resolution of the simulated textures of entries in the palette of structural element textures to match an image resolution of the image texture of the 3D model.

3. The non-transitory computer readable medium of claim 1 , wherein the step of associating material property information is defined further as storing material property information of the entries in the palette of structural element textures with the best match in a field in the computerized 3D model directly.

4. The non-transitory computer readable medium of claim 1 , wherein the step of associating material property information is defined further as the steps of storing a unique identifier for the entries in the palette of structural element textures with the best match in the computerized 3D model and subsequently using the unique identifier to retrieve the material property information from at least one of a list and a database of material properties.

5. The non-transitory computer readable medium of claim 1 , wherein the simulated textures have an image resolution greater than an image resolution of the image texture of the 3D model.

6. A system for automatically creating a computerized 3D model, the system comprising:

one or more processor; and

a non-transitory computer readable medium storing computer executable code that when executed by the one or more processors causes the one or more processors to:

create a computerized 3D model having image texture representations of structural building elements;

compare the image texture representations of structural building elements in the 3D model to simulated textures of entries in a palette of structural element textures representing structural elements to determine best matches for a portion of the image texture representations of the structural building elements in the 3D model;

assign the entries in the palette of structural element textures with the best match to the portion of the image texture representations of the structural building elements found in the 3D model;

associate material property information about material of structural building elements from the entries in the palette of structural element textures with the best match with the 3D model at the same size and position as the portion of the image texture representations of the structural building elements as in the 3D model; and

replace in the 3D model the image texture representation of the structural building elements with the simulated texture of the entries in the palette of structural element textures with the best match.

7. The system of claim 6 , wherein replacing in the 3D model the image texture representation of the structural building elements with the simulated texture of the entries in the palette of structural element textures with the best match, further comprises causing the one or more processors to:

determine a size and position of the image texture representation of the structural building elements within the 3D model; and

modify a size and position of the simulated texture of the entries in the palette of structural element textures with the best match to match the size and position of the image texture representation of the structural building elements within the 3D model.

8. The system of claim 6 , wherein the material property information is stored in fields in the computerized 3D model.

9. The system of claim 8 , wherein the stored material property information includes a unique identifier for the assigned structural element texture.

10. The system of claim 6 , wherein is the material property information is stored with a unique identifier in at least one of a list and a database of material properties, and the unique identifier is used to retrieve the material property information.

11. The system of claim 6 , wherein the image texture representations of structural building elements in the 3D model is based at least in part on imagery captured by a camera.

12. The system of claim 11 , wherein the imagery is aerial imagery.

13. The system of claim 11 , wherein the imagery is imagery captured by one or more hand-held camera.

14. The system of claim 11 , wherein the imagery is one or more of nadir imagery and oblique imagery.

15. The system of claim 11 , wherein the simulated textures have an image resolution greater than an image resolution of the image texture representations of the 3D model.

Assignments (4)
RELEASE OF FIRST LIEN SECURITY INTEREST IN PATENTS Recorded Apr 9, 2025
From: MORGAN STANLEY SENIOR FUNDING, INC.
To: PICTOMETRY INTERNATIONAL CORP.; EAGLE VIEW TECHNOLOGIES, INC.; OMNIEARTH, INC.
Reel/Frame 070786/0022 →
FIRST LIEN SECURITY AGREEMENT Recorded Mar 28, 2025
From: EAGLE VIEW TECHNOLOGIES, INC.; PICTOMETRY INTERNATIONAL CORP.
To: MORGAN STANLEY SENIOR FUNDING, INC.
Reel/Frame 070671/0078 →
FIRST LIEN PATENT SECURITY AGREEMENT SUPPLEMENT Recorded Feb 3, 2025
From: EAGLE VIEW TECHNOLOGIES, INC.; OMNIEARTH, INC.; PICTOMETRY INTERNATIONAL CORP.
To: MORGAN STANLEY SENIOR FUNDING, INC. AS COLLATERAL AGENT
Reel/Frame 070096/0485 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 17, 2020
From: SCHULTZ, STEPHEN
To: PICTOMETRY INTERNATIONAL CORP.
Reel/Frame 053510/0459 →
Continuity (5)
Continuation 16266896 · Feb 4, 2019
Continuation 15964956 · Apr 27, 2018
Continuation 15142361 · Apr 29, 2016
Continuation 12605980 · Oct 26, 2009
Related Publication 20210035360A1 · Feb 4, 2021