IP Library › Granted Patent US 11,138,785
Granted Patent B2
US 11,138,785 · App. 16/691,160 · Granted Oct 5, 2021

Method and system for generating 3D image of character

Inventors: Jin Sung Choi (Daejeon, KR); Seung Wook Lee (Daejeon, KR); Tae-Joon Kim (Sejong-si, KR); Seung Uk Yoon (Daejeon, KR); Seong Jae Lim (Daejeon, KR); Bon Woo Hwang (Daejeon, KR); Chang Joon Park (Daejeon, KR)
Assignee: Electronics and Telecommunications Research Institute
G06T15/205G06N3/04G06N3/08
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,138,785
App. No.
16/691,160
Granted
Oct 5, 2021
Kind
B2
Abstract

A method and a system for generating a 3D image of a character through steps of: receiving an identifier of a template and a two-dimensional (2D) image of the character generated based on the template corresponding to a type of the character; acquiring template information of the template from a template library by using the identifier, and extracting an effective parameter for machine learning to be performed to generate the 3D image based on the template information and the 2D image; and generating the 3D image of the character by performing the machine learning based on the effective parameter and the template information are provided.

Claims (38)

1. A method for generating a three-dimensional (3D) image of a character, the method comprising:

receiving a two-dimensional (2D) image of the character generated based on a template;

performing analysis related to body parts of the character based on template information of the template and analyzing effective parameters on the 2D image for machine learning to be performed to generate the 3D image; and

generating the 3D image of the character by performing the machine learning based on a result of the analysis related to the body parts and a result of the analyzing of the effective parameters.

2. The method of claim 1 , wherein the template information includes a gender of the character or an age of the character, and the 2D image represents a character of the age having the gender.

3. The method of claim 2 , wherein the template information further includes style information of the character, and

wherein generating the 3D image of the character by performing the machine learning based on a result of the analysis related to the body parts and a result of the analyzing of the effective parameters includes

performing the machine learning by using an inference engine that transforms a 3D image according to the style information.

4. The method of claim 1 , wherein the template represents a silhouette, and the 2D image is an image of the character produced based on the silhouette.

5. The method of claim 4 , wherein the effective parameters include a plurality of template images mapped to the body parts.

6. The method of claim 5 , further comprising

determining a correlation between the template and the body parts of the character based on the 2D image,

wherein the generating the 3D image of the character by performing the machine learning based on a result of the analysis related to the body parts and a result of the analyzing of the effective parameters includes

performing the machine learning to synthesize the plurality of template images by using the correlation.

7. A system for generating a three-dimensional (3D) image of a character, the system comprising:

a template library configured to store a plurality of templates representing a silhouette of the character;

a pre-processing unit configured to receive a two-dimensional (2D) image of the character generated based on a template of the plurality of templates, wherein the pre-processing unit includes a first analyzer configured to perform analysis related to body parts of the character based on template information of the template and a second analyzer configured to analyze effective parameters on the 2D image for machine learning to be performed to generate the 3D image; and

a modeling processor configured to generate the 3D image of the character by performing the machine learning based on a result of the analysis related to the body parts and a result of the analyzing of the effective parameters.

8. The system of claim 7 , wherein the template information includes a gender of the character or an age of the character, and the 2D image represents a character of the age having the gender.

9. The system of claim 8 , wherein

the template information further includes style information of the character, and

wherein the modeling processor further configured to perform the machine learning by using an inference engine that transforms the 3D image according to the style information.

10. The system of claim 7 , wherein the 2D image is an image of the character produced based on the silhouette.

11. The system of claim 10 , wherein the effective parameters include a plurality of template images mapped to the body parts.

12. The system of claim 11 , wherein the pre-processing unit further configured to determine a correlation between the template and the body parts of the character based on the 2D image,

wherein the modeling processor further configured to perform the machine learning to synthesize the plurality of template images by using the correlation.

13. An apparatus for pre-processing image information of a character, the apparatus comprising:

a processor, a memory, and a transmission/reception interface, wherein the processor executes a program stored in the memory to perform:

receiving a two-dimensional (2D) image of the character generated on the basis of a template through the transmission/reception interface;

performing analysis related to body parts of the character based on template information of the template and analyzing effective parameters on the 2D image for machine learning to be performed to generate a three-dimensional (3D) image; and

structuralizing a result of the analysis related to the body parts and a result of the analyzing of the effective parameters into a data structure and transmitting the data structure to a modeling processor performing the machine learning through the transmission/reception interface.

14. The apparatus of claim 13 , wherein

the processor executes the program to further perform

determining a correlation between the template and the body parts of the character based on the 2D image, and

the processor, when structuralizing the result of the analysis related to the body parts and the result of the analyzing of the effective parameters into the data structure and transmitting the data structure to the modeling processor performing the machine learning through the transmission/reception interface, performs

structuralizing the correlation into the data structure along with the result of the analysis related to the body parts and the result of the analyzing of the effective parameters.

15. The apparatus of claim 13 , wherein the template information includes style information of the character, the data structure includes instruction information regarding an inference neural network of the modeling processor, and the instruction information indicates an inference neural network corresponding to body parts of the character to the modeling processor.

16. The apparatus of claim 13 , wherein the template information includes style information of the character, the data structure includes instruction information regarding an inference neural network of the modeling processor, and the instruction information indicates an inference neural network corresponding to the style information to the modeling processor.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Nov 21, 2019
From: CHOI, JIN SUNG; LEE, SEUNG WOOK; KIM, TAE-JOON; YOON, SEUNG UK; LIM, SEONG JAE; HWANG, BON WOO; PARK, CHANG JOON
To: ELECTRONICS AND TELECOMMUNICATIONS RESEARCH INSTITUTE
Reel/Frame 051080/0392 →
Priority Claims (2)
KR 10-2018-0157599 · Dec 7, 2018 · national
KR 10-2019-0136782 · Oct 30, 2019 · national
Continuity (1)
Related Publication 20200184711A1 · Jun 11, 2020