IP Library Granted Patent US 10,628,989
Granted Patent B2
US 10,628,989 · App. 16/036,422 · Granted Apr 21, 2020

Photometric image processing

Inventors: Amirhessam Moltaji (Vancouver, CA); Kevin Loken (Surrey, CA); Ryan Hietanen (Vancouver, CA)
Assignee: Electronic Arts Inc.
G06T15/04G06T7/90G06T7/97G06T11/001G06T2207/10024
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,628,989
App. No.
16/036,422
Granted
Apr 21, 2020
Kind
B2
Abstract

An example method of photometric image processing may comprise: receiving a plurality of images of a three-dimensional object, wherein the plurality of images has been acquired by a plurality of cameras using a plurality of illumination and polarization patterns; performing color calibration of the plurality of images to produce a plurality of color-calibrated images; generating, using the plurality of color-calibrated images, a polygonal mesh simulating geometry of the three-dimensional object; producing a plurality of partial UV maps by projecting the plurality of color-calibrated images onto the polygonal mesh; generating a plurality of masks, wherein each mask of the plurality of masks is associated with a camera of the plurality of cameras, wherein the mask defines a UV space region that is covered by a field of view of the camera; blending, using the plurality of masks, the plurality of partial UV maps; and generating one or more texture maps representing the three-dimensional object.

Claims (38)

1. A method, comprising:

receiving a plurality of images of a three-dimensional object, wherein the plurality of images has been acquired by a plurality of cameras using a plurality of illumination and polarization patterns;

performing color calibration of the plurality of images to produce a plurality of color-calibrated images;

generating, using the plurality of color-calibrated images, a polygonal mesh simulating geometry of the three-dimensional object;

producing a plurality of partial UV maps by projecting the plurality of color-calibrated images onto the polygonal mesh;

generating a plurality of combined distortion and image maps, wherein each combined distortion and image map associated with a respective camera of the plurality of cameras comprises a plurality of pixels, such that intensity of each pixel of the plurality of pixels represents a level of distortion introduced by the respective camera for the pixel;

producing, based on the combined distortion and image maps, a plurality of camera rank maps, wherein each camera rank map associated with a respective camera of the plurality of cameras comprises for every pixel, an index of the respective camera in a list of cameras that is sorted by the level of distortion;

generating, based on the camera rank maps, a plurality of masks, wherein each mask of the plurality of masks is associated with a respective camera of the plurality of cameras, wherein the mask defines a UV space region that is covered by a field of view of the camera;

blending, using the plurality of masks, the plurality of partial UV maps; and

generating one or more texture maps representing the three-dimensional object.

2. The method of claim 1 , further comprising:

utilizing the texture maps for creating an interactive video game.

3. The method of claim 1 , further comprising:

undistorting the plurality of color-calibrated images to remove at least one of: radial distortion or tangential distortion.

4. The method of claim 1 , wherein the texture maps comprise a reflectance map illustrating distribution of specular reflectance on a surface of the three-dimensional object.

5. The method of claim 1 , wherein the texture maps comprise an albedo map produced from a plurality of images acquired under full-on illumination with cross-polarized filters.

6. The method of claim 1 , wherein the texture maps comprise a normal map produced from a plurality of images acquired under partial illumination with parallel-polarized filters.

7. The method of claim 1 , wherein the texture maps comprise a displacement map comprising a plurality of elements, each element defining a displacement values for a corresponding texture element.

8. The method of claim 1 , wherein generating the polygonal mesh further comprises:

determining, using a plurality of images acquired under full-on illumination with parallel-polarized filters, positions of a plurality of markers of a pre-defined color within each image.

9. The method of claim 1 , wherein performing color calibration of the plurality of images further comprises:

performing a non-linear tone remapping operation.

10. The method of claim 1 , wherein blending the plurality of partial UV maps further comprises:

producing a background image by blending a plurality of masked images;

blending a next masked image of the plurality of masked images with the background image to produce a new background image;

iteratively repeating the blending operation for all masked image of the plurality of masked images.

11. A computer-readable non-transitory storage medium comprising executable instructions that, when executed by a processor, cause the processor to:

receive a plurality of images of a three-dimensional object, wherein the plurality of images has been acquired by a plurality of cameras using a plurality of illumination and polarization patterns;

perform color calibration of the plurality of images to produce a plurality of color-calibrated images;

generate, using the plurality of color-calibrated images, a polygonal mesh simulating geometry of the three-dimensional object;

produce a plurality of partial UV maps by projecting the plurality of color-calibrated images onto the polygonal mesh;

generate a plurality of combined distortion and image maps, wherein each combined distortion and image map associated with a respective camera of the plurality of cameras comprises a plurality of pixels, such that intensity of each pixel of the plurality of pixels represents a level of distortion introduced by the respective camera for the pixel;

produce, based on the combined distortion and image maps, a plurality of camera rank maps, wherein each camera rank map associated with a respective camera of the plurality of cameras comprises for every pixel, an index of the respective camera in a list of cameras that is sorted by the level of distortion;

generate, based on the camera rank maps, a plurality of masks, wherein each mask of the plurality of masks is associated with a respective camera of the plurality of cameras, wherein the mask defines a UV space region that is covered by a field of view of the camera;

blend, using the plurality of masks, the plurality of partial UV maps; and

generate one or more texture maps representing the three-dimensional object.

12. The computer-readable non-transitory storage medium of claim 11 , further comprising executable instructions causing the processor to:

utilize the texture maps for creating an interactive video game.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 16, 2018
From: MOLTAJI, AMIRHESSAM; LOKEN, KEVIN; HIETANEN, RYAN
To: ELECTRONIC ARTS INC.
Reel/Frame 046361/0571 →
Continuity (1)
Related Publication 20200020149A1 · Jan 16, 2020