IP Library Granted Patent US 10,360,467
Granted Patent B2
US 10,360,467 · App. 14/931,170 · Granted Jul 23, 2019

Device and method to generate image using image learning model

Inventors: Byungin Yoo (Seoul, KR); Jun Ho Yim (Daejeon, KR); Jun Mo Kim (Daejeon, KR); Hee Chul Jung (Daejeon, KR); Chang Kyu Choi (Seongnam-si, KR); Jaejoon Han (Seoul, KR)
Assignees: SAMSUNG ELECTRONICS CO., LTD.; KOREA ADVANCED INSTITUTE OF SCIENCE AND TECHNOLOGY
G06K9/2081G06K9/6255G06N3/0454G06N3/084G06T5/002G06T5/006G06T15/205G06K9/00228G06K2209/29G06N3/0445G06T2207/20081G06T2207/20084
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,360,467
App. No.
14/931,170
Granted
Jul 23, 2019
Kind
B2
Abstract

At least some example embodiments disclose a device and a method for generating a synthetic image and a different-angled image and eliminating noise. The method may include receiving input images, extracting feature values corresponding to the input images using an image learning model, the image learning model permitting an input and an output to be identical and generating a synthetic image based on the feature values corresponding to the input images using the image learning model.

Claims (38)

1. A method of generating a synthetic image, the method comprising:

receiving input images;

extracting feature values corresponding to the input images using a first image learning model, the first image learning model permitting an input and an output to be identical; and

generating a synthetic image based on the feature values corresponding to the input images using the first image learning model, the generating the synthetic image includes,

combining the feature values, wherein each of the feature values are extracted from a different corresponding input image among the input images, and

generating the synthetic image from the combined feature values using the first image learning model.

2. The method of claim 1 , wherein the first image learning model comprises a neural network, the neural network including at least one layer connected to another layer through a connection line, the connection line having a connection weight.

3. The method of claim 1 , wherein the combining the feature values comprises:

combining the feature values based on a set ratio.

4. The method of claim 2 , wherein the feature values correspond to an uppermost layer of the neural network from each input image.

5. The method of claim 2 , wherein the connection weight reduces an error between a reference input image and an output image corresponding to the reference input image.

6. The method of claim 1 , wherein the input images comprise face images of different individuals.

7. The method of claim 1 , further comprising:

receiving the synthetic image and angle information, the synthetic image including an object; and

generating an output image based on the synthetic image and the angle information using a second image learning model, the second image learning model being trained in pairs of references images corresponding to different angles, the output image including the object.

8. The method of claim 7 , wherein the generating the output image comprises:

generating the output image by converting the synthetic image to correspond to the angle information using the second image learning model.

9. The method of claim 7 , wherein

the pairs of reference images comprise a first reference angle image corresponding to a first angle and a second reference angle image corresponding to a second angle, and

wherein the first reference angle image and the second reference angle image include an identical reference object.

10. The method of claim 9 , wherein the second image learning model comprises a neural network, the neural network including at least one layer connected to another layer through a connection line, the connection line having a connection weight.

11. The method of claim 10 , wherein the connection weight of the neural network allows the second reference angle image to be output based on the second angle and the first reference angle image.

12. The method of claim 7 , wherein the angle information comprises information associated with an angle for the object.

13. The method of claim 7 , wherein the object comprises a human face.

14. The method of claim 7 , further comprising:

removing noise from at least one patch in the output image using at least one third image learning model.

15. The method of claim 14 , wherein the third image learning model comprises a neural network, the neural network including at least one layer connected to another layer through a connection line, the connection line having a connection weight.

16. The method of claim 15 , wherein the connection weight is learned to allow a reference output image to be generated from a patch of a reference input image.

17. The method of claim 14 , wherein

the third image learning model permits a reference output image from which noise is eliminated to be generated from a reference input image including noise, and

the removing the noise includes,

eliminating the noise from the output image using the third image learning model.

18. The method of claim 14 , wherein the third image learning model comprises:

a fourth learning model to allow a first size patch of a reference output image from which noise is eliminated to be generated from the first sized patch of a reference input image; and

a fifth learning model to allow a second size patch of the reference output image from which noise is eliminated to be generated from the second size patch of the reference input image.

19. The method of claim 18 , wherein the removing the noise comprises:

eliminating noise from the output image in a unit of the first size patch using the fourth learning model; and

eliminating noise in a unit of the second size patch, using the fifth learning model, from the output image from which the noise is eliminated in the unit of the first size patch.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Nov 3, 2015
From: YIM, JUN HO; KIM, JUN MO; JUNG, HEE CHUL
To: KOREA ADVANCED INSTITUTE OF SCIENCE AND TECHNOLOGY
Reel/Frame 036950/0913 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Nov 3, 2015
From: YOO, BYUNGIN; CHOI, CHANG KYU; HAN, JAEJOON
To: SAMSUNG ELECTRONICS CO., LTD.
Reel/Frame 036951/0075 →
Priority Claims (1)
KR 10-2014-0152902 · Nov 5, 2014 · national
Continuity (1)
Related Publication 20160125572A1 · May 5, 2016
Cited By (1)
US 12,223,300