IP Library Granted Patent US 11,449,733
Granted Patent B2
US 11,449,733 · App. 16/645,344 · Granted Sep 20, 2022

Neural network learning method and device for recognizing class

Inventors: Jun-mo Kim (Daejeon, KR); Byung-ju Kim (Daejeon, KR); Joo-chang Kim (Daejeon, KR); Ye-gang Lee (Daejeon, KR); Min-seok Park (Daejeon, KR); Ju-seung Yun (Daejeon, KR); Jae-young Lee (Daejeon, KR); Dong-gyu Joo (Daejeon, KR)
Assignees: SAMSUNG ELECTRONICS CO., LTD.; KOREA ADVANCED INSTITUTE OF SCIENCE AND TECHNOLOGY
G06N3/0454G06K9/6256G06K9/6262G06T7/136G06T2207/20081G06T2207/20084
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,449,733
App. No.
16/645,344
Granted
Sep 20, 2022
Kind
B2
Abstract

The present disclosure provides a neural network training device for recognizing a class of an object included in an image based on an artificial intelligence (AI) system and an application thereof, the neural network training method including: acquiring, by using a first learning network model trained based on source training images respectively included in at least one class, feature information of a query image included in a class different from the at least one class; obtaining a generated image from the feature information of the query image by using a second learning network model acquiring feature information of the obtained generated image by using the first learning network model; and updating weights of layers respectively included in the first and second learning network models, based on a difference between the feature information of the query image and the feature information of the generated image and on a difference between the query image and the generated image.

Claims (28)

1. A neural network training method for recognizing a class, the neural network training method comprising:

acquiring, by using a first learning network model trained based on source training images respectively included in at least one class, feature information of a query image included in a class different from the at least one class;

obtaining a generated image from the feature information of the query image by using a second learning network model;

acquiring feature information of the obtained generated image by using the first learning network model; and

updating weights of layers respectively included in the first and second learning network models, based on a difference between the feature information of the query image and the feature information of the generated image and on a difference between the query image and the generated image.

2. The neural network training method of claim 1 , further comprising acquiring information about a target class,

wherein the obtaining of the generated image comprises obtaining, based on the feature information of the query image and the information about the target class, a generated image included in the target class by using the second learning network model.

3. The neural network training method of claim 1 , wherein the updating comprises iteratively performing the updating until the difference between the feature information of the query image and the feature information of the generated image and the difference between the query image and the generated image are acquired below thresholds respectively preset with respect to the differences therebetween.

4. The neural network training method of claim 3 , further comprising determining, as a training image for a recognition model for class recognition, a generated image obtained via a second learning network model acquired as a result of the iterative performing of the updating.

5. The neural network training method of claim 1 , wherein the acquiring of the feature information of the generated image comprises acquiring feature information of a generated image having a smallest difference from the query image from among a plurality of generated images obtained based on the feature information of the query image.

6. The neural network training method of claim 1 , wherein the acquiring of the feature information of the generated image comprises receiving, from a server, the feature information of the query image acquired by using the first learning network model stored in the server,

the neural network training method further comprising transmitting, to the server, the generated image obtained using the second learning network model.

7. A neural network training device for recognizing a class, the neural network training device comprising:

a memory storing one or more instructions; and

at least one processor configured to execute the one or more instructions stored in the memory to:

acquire, by using a first learning network model trained based on source training images respectively included in at least one class, feature information of a query image included in a class different from the at least one class;

obtain a generated image from the feature information of the query image by using a second learning network model;

acquire feature information of the obtained generated image by using the first learning network model; and

update weights of layers respectively included in the first and second learning network models, based on a difference between the feature information of the query image and the feature information of the generated image and on a difference between the query image and the generated image.

8. The neural network training device of claim 7 , wherein the at least one processor is further configured to execute the one or more instructions to:

acquire information about a target class; and

obtain, based on the feature information of the query image and the information about the target class, a generated image included in the target class by using the second learning network model.

9. The neural network training device of claim 7 , wherein the at least one processor is further configured to execute the one or more instructions to iteratively perform the updating until the difference between the feature information of the query image and the feature information of the generated image and the difference between the query image and the generated image are acquired below thresholds respectively preset with respect to the differences therebetween.

10. The neural network training device of claim 9 , wherein the at least one processor is further configured to execute the one or more instructions to determine, as a training image for a recognition model for class recognition, a generated image obtained via a second learning network model acquired as a result of the iterative performing of the updating.

11. The neural network training device of claim 7 , wherein the at least one processor is further configured to execute the one or more instructions to acquire feature information of a generated image having a smallest difference from the query image from among a plurality of generated images obtained based on the feature information of the query image.

12. The neural network training device of claim 7 , further comprising a communication unit,

wherein the at least one processor is further configured to execute the one or more instructions to control the communication unit to receive, from a server, the feature information of the query image acquired by using the first learning network model stored in the server and to transmit, to the server, the generated image obtained using the second learning network model stored in the neural network training device.

13. A computer-readable recording medium having recorded thereon a program for executing the neural network training method of claim 1 on a computer.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 6, 2020
From: KIM, JUN-MO; KIM, BYUNG-JU; KIM, JOO-CHANG; LEE, YE-GANG; PARK, MIN-SEOK; YUN, JU-SEUNG; LEE, JAE-YOUNG; JOO, DONG-GYU
To: SAMSUNG ELECTRONICS CO., LTD.; KOREA ADVANCED INSTITUTE OF SCIENCE AND TECHNOLOGY
Reel/Frame 052119/0771 →
Priority Claims (1)
KR 10-2017-0115451 · Sep 8, 2017 · national
Continuity (1)
Related Publication 20200285938A1 · Sep 10, 2020
Cited By (1)
US 12,511,033