IP Library › Granted Patent US 11,562,167
Granted Patent B2
US 11,562,167 · App. 16/832,694 · Granted Jan 24, 2023

Method of training neural network classification model using selected data

Inventors: Andre S. Yoon (Seoul, KR); Sangwoo Shim (Seoul, KR); Yongsub Lim (Gunpo-si, KR); Ki Hyun Kim (Yongin-si, KR); Byungchan Kim (Seoul, KR); JeongWoo Choi (Seoul, KR)
Assignee: MakinaRocks Co., Ltd.
G06K9/6215G06K9/6228G06K9/6256G06N3/084G06N20/00G06N20/10
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,562,167
App. No.
16/832,694
Granted
Jan 24, 2023
Kind
B2
Abstract

Disclosed is a non-transitory computer readable medium storing a computer program. When the computer program is executed by one or more processors of a computing device, the computer program performs the following operations for processing data, and the operations may include: determining an uncertainty level with respect to labeling criteria for each of one or more data included in a dataset; determining a similarity level for one or more data included in a data subset; and selecting at least some of data included in the dataset based on the uncertainty level and the similarity level, and additionally labeling the selected data.

Claims (45)

1. A non-transitory computer readable medium storing a computer program, wherein when the computer program is executed by one or more processors of a computing device, the computer program performs operations for processing data and training a neural network classification model, and the operations comprise:

representing, in at least a two-dimensional vector solution space, one or more data in a dataset each as a vector corresponding to a feature of an article;

determining an uncertainty level for each of the one or more data included in the dataset, wherein the uncertainty level is associated with a distance in the solution space from a classification criteria to the each of the one or more data in the dataset;

determining a similarity level for one or more data included in a data subset, wherein the similarity level is associated with a distance in the solution space between respective ones of the one or more data in the data subset,

wherein one or both of determining the uncertainty level and determining the similarity level are based on determining a location, in the solution space, of the one or more data included in the respective one of the dataset and the data subset;

selecting at least some of data included in the dataset based on a calculation that correlates the uncertainty level and the similarity level by summing relative weights of the uncertainty level and the similarity level; and

labeling the selected data and training the neural network classification model using the selected data.

2. The non-transitory computer readable medium according to claim 1 , wherein the operations further comprise:

mapping the one or more data included in the dataset to the solution space by inputting the one or more data included in the dataset to +the neural network classification model.

3. The non-transitory computer readable medium according to claim 1 , wherein the operations further comprise:

after selecting the at least some of data included in the dataset based on the uncertainty level and the similarity level and labeling the selected data,

updating the neural network classification model based at least in part on the labeled data.

4. The non-transitory computer readable medium according to claim 1 , wherein selecting the at least some of data and labeling the selected data comprises:

selectively labeling data having a high uncertainty level and a low similarity level.

5. The non-transitory computer readable medium according to claim 1 , wherein determining the uncertainty level comprises determining based at least in part on a result of classifying each of the one or more data using the neural network classification model.

6. The non-transitory computer readable medium according to claim 5 , wherein the operations further comprise:

mapping each of the one or more data to the solution space by inputting each of the one or more data to the classification model, and

wherein determining the uncertainty level comprises determining based on a distance between a location in the solution space of each of the one or more data and classification criteria of the classification model.

7. The non-transitory computer readable medium according to claim 1 , wherein the operations further comprise:

mapping each of the one or more data to a data space, and

wherein determining the uncertainty level comprises determining based on a distance between a location in a data space of each of the one or more data and the classification criteria.

8. The non-transitory computer readable medium according to claim 1 , wherein the operations further comprise:

mapping each of the one or more data included in the data subset to the solution space by inputting each of the one or more data included in the data subset to the neural network classification model, and

wherein determining the similarity level comprises determining based on a location in the solution space of each of the one or more data included in the data subset.

9. The non-transitory computer readable medium according to claim 1 , wherein the operations further comprise:

mapping each of the one or more data included in the data subset to a data space, and

wherein determining the similarity level comprises determining based on a location in the data space of each of the one or more data included in the data subset.

10. The non-transitory computer readable medium according to claim 1 , wherein the data subset comprises a unique pair selected from the one or more data included in the dataset.

11. The non-transitory computer readable medium according to claim 1 , wherein the data includes sensor data collected during manufacturing of the article in a manufacturing environment.

12. A method of processing data and training a neural network classification model executed on one or more processors of a computing device, the method comprising:

representing in at least a two-dimensional vector solution space, one or more data in a dataset each as a vector corresponding to a feature of an article;

determining an uncertainty level for each of the one or more data included in the dataset, wherein the uncertainty level is associated with a distance in the solution space from a classification criteria to the each of the one or more data in the dataset;

determining a similarity level for one or more data included in a data subset, wherein the similarity level is associated with a distance in the solution space between respective ones of the one or more data in the data subset,

wherein one or both of determining the uncertainty level and determining the similarity level are based on determining a location, in the solution space, of the one or more data included in the respective one of the dataset and the data subset;

selecting at least some of data included in the dataset based on a calculation that correlates the uncertainty level and the similarity level by summing relative weights of the uncertainty level and the similarity level; and

labeling the selected data and training the neural network classification model using the selected data.

13. A computing device for processing data and training a neural network classification model, comprising:

one or more processors; and

a memory for storing computer programs executable on the one or more processors, wherein the one or more processors are configured to:

represent in at least a two-dimensional vector solution space, one or more data in a dataset each as a vector corresponding to a feature of an article;

determine an uncertainty level for each of the one or more data included in the dataset, wherein the uncertainty level is associated with a distance in the solution space from a classification criteria to the each of the one or more data in the dataset;

determine a similarity level for one or more data included in a data subset, wherein the similarity level is associated with a distance in the solution space between respective ones of the one or more data in the data subset,

wherein one or both of determining the uncertainty level and determining the similarity level are based on determining a location, in the solution space, of the one or more data included in the respective one of the dataset and the data subset;

select at least some of data included in the dataset based on a calculation that correlates the uncertainty level and the similarity level by summing relative weights of the uncertainty level and the similarity level; and

label the selected data and train the neural network classification model using the selected data.

Assignments (2)
ASSIGNEE CHANGE OF ADDRESS Recorded Feb 11, 2021
From: MAKINAROCKS CO., LTD.
To: MAKINAROCKS CO., LTD.
Reel/Frame 055282/0627 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 27, 2020
From: YOON, ANDRE S.; SHIM, SANGWOO; LIM, YONGSUB; KIM, KI HYUN; KIM, BYUNGCHAN; CHOI, JEONGWOO
To: MAKINAROCKS CO., LTD.
Reel/Frame 052249/0349 →
Priority Claims (1)
KR 10-2019-0067175 · Jun 7, 2019 · national
Continuity (2)
Provisional Application 62828346 · Apr 2, 2019
Related Publication 20200320337A1 · Oct 8, 2020
Cited By (4)
US 12,198,035 US 12,566,435 US 12,656,775 US 12,704,839