IP Library Granted Patent US 10,832,469
Granted Patent B2
US 10,832,469 · App. 16/056,266 · Granted Nov 10, 2020

Optimizing images for three-dimensional model construction

Inventors: Steven M. Chapman (Dos Vientos Ranch, CA); Steven T. Kosakura (Tustin, CA); Joseph M. Popp (Cerritos, CA); Mehul A. Patel (Stevenson Ranch, CA)
Assignee: Disney Enterprises, Inc.
G06T17/05G06K9/00234G06K9/6202G06T17/00G06T2207/10028G06T2207/30184
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,832,469
App. No.
16/056,266
Granted
Nov 10, 2020
Kind
B2
Abstract

Methods, systems, and computer readable media related to generating a three-dimensional model of a target object. A first source image, of a plurality of source images of a target object, is analyzed to identify a first region of the first image, the first region having attributes meeting one or more pre-defined criteria. The first region is marked for exclusion from use in generating a three-dimensional model of the target object. The three-dimensional model of the target object is generated using the plurality of source images. The marked first region is excluded in the generation of the three-dimensional model.

Claims (49)

1. A method of generating a three-dimensional model of a target object, comprising:

analyzing a first source image, of a plurality of source images of a target object, to identify a first region of the first source image, the first region having attributes meeting one or more pre-defined criteria;

marking the first region for exclusion from use in generating a three-dimensional point cloud for the target object and inclusion in generating one or more textures relating to the target object; and

generating a three-dimensional model of the target object using the plurality of source images, comprising:

generating the three-dimensional point cloud for the target object while excluding the first region; and

generating the one or more textures relating to the target object using the first region.

2. The method of claim 1 , wherein the one or more pre-defined criteria comprise a rule associated with excluding image regions from use in generating the three-dimensional point cloud, the method further comprising:

analyzing the first source image using the rule to identify the first region for exclusion.

3. The method of claim 2 , wherein the rule relates to a first color of a first pixel in the first region and one or more colors of one or more pixels surrounding the first pixel.

4. The method of claim 2 , wherein the rule relates to comparing pixels in the first source image with pixels in a second source image, of the plurality of source images.

5. The method of claim 1 , wherein generating the three-dimensional model of the target object using the plurality of source images further comprises:

applying the one or more textures to the three-dimensional point cloud.

6. The method of claim 1 , wherein marking the first region for exclusion from use in generating the three-dimensional point cloud for the target object comprises:

identifying a lookup table associated with the first source image; and

modifying a cell in the lookup table corresponding to the first region to signify that the first region is marked for exclusion.

7. The method of claim 6 , wherein generating the three-dimensional model of the target object using the plurality of source images comprises analyzing the identified lookup table.

8. The method of claim 6 , wherein the lookup table comprises a two-dimensional array with dimensions related to a size of the first source image.

9. A computer program product for generating a three-dimensional model of a target object, the computer program product comprising:

a non-transitory computer-readable storage medium having computer-readable program code embodied therewith, wherein the program code, when executed by a processor, performs an operation, the operation comprising:

analyzing a first source image, of a plurality of source images of a target object, to identify a first region of the first source image, the first region having attributes meeting one or more pre-defined criteria;

marking the first region for exclusion from use in generating a three-dimensional point cloud for the target object and inclusion in generating one or more textures relating to the target object; and

generating a three-dimensional model of the target object using the plurality of source images, comprising:

generating the three-dimensional point cloud for the target object while excluding the first region; and

generating the one or more textures relating to the target object using the first region.

10. The computer program product of claim 9 , wherein the one or more pre-defined criteria comprise a rule associated with excluding image regions from use in generating the three-dimensional point cloud, the operation further comprising:

analyzing the first source image using the rule to identify the first region for exclusion.

11. The computer program product of claim 10 , wherein the rule relates to a first color of a first pixel in the first region and one or more colors of one or more pixels surrounding the first pixel.

12. The computer program product of claim 10 , wherein the rule relates to comparing pixels in the first source image with pixels in a second source image, of the plurality of source images.

13. The computer program product of claim 9 , wherein generating the three-dimensional model of the target object using the plurality of source images further comprises:

applying the one or more textures to the three-dimensional point cloud.

14. The computer program product of claim 9 , wherein marking the first region for exclusion from use in generating the three-dimensional point cloud for the target object comprises:

identifying a lookup table associated with the first source image; and

modifying a cell in the lookup table corresponding to the first region to signify that the first region is marked for exclusion, wherein generating the three-dimensional model of the target object using the plurality of source images comprises analyzing the identified lookup table.

15. A system, comprising:

a processor; and

a memory storing a program, which, when executed on the processor, performs an operation, the operation comprising:

analyzing a first source image, of a plurality of source images of a target object, to identify a first region of the first source image, the first region having attributes meeting one or more pre-defined criteria;

marking the first region for exclusion from use in generating a three-dimensional point cloud for the target object and inclusion in generating one or more textures relating to the target object; and

generating a three-dimensional model of the target object using the plurality of source images, comprising:

generating the three-dimensional point cloud for the target object while excluding the first region; and

generating the one or more textures relating to the target object using the first region.

16. The system of claim 15 , wherein the one or more pre-defined criteria comprise a rule associated with excluding image regions from use in generating the three-dimensional point cloud, the operation further comprising:

analyzing the first source image using the rule to identify the first region for exclusion.

17. The system of claim 16 , wherein the rule relates to a first color of a first pixel in the first region and one more colors of one or more pixels surrounding the first pixel.

18. The system of claim 15 , wherein generating the three-dimensional model of the target object using the plurality of source images further comprises:

applying the one or more textures to the three-dimensional point cloud.

19. The system of claim 15 , wherein marking the first region for exclusion from use in generating a three-dimensional point cloud for the target object comprises:

identifying a lookup table associated with the first source image; and

modifying a cell in the lookup table corresponding to the first region to signify that the first region is marked for exclusion, wherein generating the three-dimensional model of the target object using the plurality of source images comprises analyzing the identified lookup table.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 8, 2026
From: DISNEY ENTERPRISES, INC.
To: ADEIA MEDIA HOLDINGS INC.
Reel/Frame 075817/0438 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 6, 2018
From: CHAPMAN, STEVEN M.; KOSAKURA, STEVEN T.; POPP, JOSEPH M.; PATEL, MEHUL A.
To: DISNEY ENTERPRISES, INC.
Reel/Frame 046565/0870 →
Continuity (1)
Related Publication 20200043227A1 · Feb 6, 2020