IP Library › Granted Patent US 10,403,001
Granted Patent B2
US 10,403,001 · App. 15/642,869 · Granted Sep 3, 2019

Producing three-dimensional representation based on images of an object

Inventors: David Auclair (Orlando, FL); Gianvito Serra (Austin, TX); Caleb Howard (West Vancouver, CA); Robert Jay Reynolds (Vancouver, CA); Gerald Phaneuf (Seattle, WA); Aaron Jeromin (Seattle, WA); Michael Frederich Polak (Elora, CA); Jerome Timothy Bradley (Orlando, FL); Edmond Lo (New Westminster, CA); Thomas Ince (Orlando, FL); Ray Shannon (Vancouver, CA); Timothy King (Orlando, FL)
Assignee: Electronic Arts Inc.
G06T7/75A63F13/00A63F13/655G06T1/20G06T17/20H04N21/00A63F2300/5553H04N13/261
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,403,001
App. No.
15/642,869
Granted
Sep 3, 2019
Kind
B2
Abstract

An example method of generating three-dimensional objects based on two-dimensional images of at least part of the object may include: receiving, from a mobile computing device, a notification indicating that a plurality of images depicting an object have been uploaded to a first storage location; transmitting, to a rendering application, a rendering request specifying the first storage location; receiving, from the rendering application, a rendering response indicating that a polygonal mesh representing the images of the object has been stored at a second storage location; transmitting, to an interactive video gaming device, a notification of comprising an identifier of the third second storage location; and making a file comprising the polygonal mesh available for download by the interactive video gaming device.

Claims (35)

1. A method, comprising:

receiving, from a mobile computing device, a plurality of images of an object;

receiving, by a processing device, a first polygonal mesh representing at least part of the object, wherein the first polygonal mesh is compliant with a target application topology;

producing, using a plurality of image pixels of a predefined color channel from the plurality of images, a second polygonal mesh representing the part of the object;

modifying the first polygonal mesh in view of the second polygonal mesh; and

producing, using the plurality of images, a texture by selecting, for a surface pixel of the first polygonal mesh, a corresponding image pixel pointed to by a normal vector associated with the surface pixel.

2. The method of claim 1 , wherein the object is represented by a human body.

3. The method of claim 1 , wherein modifying the first polygonal mesh in view of the second polygonal mesh is performed using a metric reflecting a difference between the first polygonal mesh and the second polygonal mesh.

4. The method of claim 1 , wherein modifying the first polygonal mesh in view of the second polygonal mesh is performed using a metric reflecting a difference between a first curvature of the first polygonal mesh and a second curvature of the second polygonal mesh.

5. The method of claim 1 , wherein modifying the first polygonal mesh in view of the second polygonal mesh is performed using a metric reflecting a difference between a first point position of the first polygonal mesh and a second point position of the second polygonal mesh.

6. The method of claim 1 , wherein modifying the first polygonal mesh in view of the second polygonal mesh is performed using a metric reflecting a difference between a first point normal orientation of the first polygonal mesh and a second point normal orientation of the second polygonal mesh.

7. The method of claim 1 , wherein modifying the second polygonal mesh comprises modifying a position of a polygonal face of the second polygonal mesh.

8. The method of claim 1 , wherein modifying the second polygonal mesh comprises modifying an orientation of a polygonal face of the second polygonal mesh.

9. The method of claim 1 , wherein modifying the second polygonal mesh comprises modifying a size of a polygonal face of the second polygonal mesh.

10. The method of claim 1 , wherein producing the second polygonal mesh is performed based on comparing luminance values of certain areas of two or more images.

11. The method of claim 1 , wherein producing the second polygonal mesh is performed based on comparing color gradient values of certain areas of two or more images.

12. The method of claim 1 , further comprising:

producing an edge-finding image based on positions of curvatures corresponding to certain anatomical feature points; and

positioning, based on the edge-finding image, the second polygonal mesh in a three-dimensional space.

13. The method of claim 1 , wherein producing the texture is performed based on image metadata reflecting at least one of: a position of an image-acquiring camera relative to the object or an orientation of the image-acquiring camera relative to the object.

14. The method of claim 1 , further comprising:

transforming the first polygonal mesh by blending certain areas of the first polygonal mesh with corresponding areas of the second polygonal mesh.

15. The method of claim 1 , further comprising:

identifying a skin tone having an average color value within a predetermined rage of an average color value of the texture; and

applying the skin tone to the texture.

16. A method, comprising:

receiving, from a mobile computing device, a plurality of images of an object;

receiving, by a processing device, a first polygonal mesh representing at least part of the object, wherein the first polygonal mesh is compliant with a target application topology;

producing, using a plurality of image pixels of a predefined color channel from the plurality of images, a second polygonal mesh representing the part of the object;

modifying the first polygonal mesh to minimize a metric reflecting at least one of: a difference in positions, orientations, or sizes of corresponding anatomical features in the first polygonal mesh and the second polygonal mesh; and

producing, using the plurality of images, a texture by mapping a plurality of image pixels to a surface defined by the first polygonal mesh.

17. The method of claim 16 , wherein the object is represented by a human body.

18. The method of claim 16 , wherein modifying the second polygonal mesh comprises modifying a position of a polygonal face of the second polygonal mesh.

19. The method of claim 16 , wherein modifying the second polygonal mesh comprises modifying an orientation of a polygonal face of the second polygonal mesh.

20. The method of claim 16 , wherein modifying the second polygonal mesh comprises modifying a size of a polygonal face of the second polygonal mesh.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 18, 2019
From: AUCLAIR, DAVID; SERRA, GIANVITO; HOWARD, CALEB; REYNOLDS, ROBERT JAY; PHANEUF, GERALD; JEROMIN, AARON; POLAK, MICHAEL FREDERICH; BRADLEY, JEROME TIMOTHY; LO, EDMOND; INCE, THOMAS; SHANNON, RAY; KING, TIMOTHY
To: ELECTRONIC ARTS INC.
Reel/Frame 049796/0001 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 6, 2017
From: AUCLAIR, DAVID; SERRA, GIANVITO; HOWARD, CALEB; REYNOLDS, ROBERT JAY; PHANEUF, GERALD; JEROMIN, AARON
To: ELECTRONIC ARTS INC.
Reel/Frame 042925/0459 →
Continuity (3)
Continuation 14965481 · Dec 10, 2015
Continuation In Part 14836299 · Aug 26, 2015
Related Publication 20170301110A1 · Oct 19, 2017
Cited By (2)
US 12,551,795 US 12,567,196