IP Library › Granted Patent US 11,443,242
Granted Patent B2
US 11,443,242 · App. 16/853,924 · Granted Sep 13, 2022

Iterative training of a machine learning model

Inventors: Alexander Velizhev (Oberrieden, CH); Martin Rufli (Winterthur, CH); Ralf Kaestner (Othmarsingen, CH)
Assignee: International Business Machines Corporation
G06N20/00
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,443,242
App. No.
16/853,924
Granted
Sep 13, 2022
Kind
B2
Abstract

A computer-implemented method, computer program product, and computer system are provided. The method comprises training a machine-learning model using an initial set of training data samples, receiving a new training data sample, and predicting a label for the new training data sample. The method also comprises, upon determining that a prediction quality value for the predicted label of the new training data sample is below a predefined quality value, adding the new training data sample to the initial set, thereby building an extended training data set. The method also comprises retraining the machine-learning model using the extended training data set.

Claims (58)

1. A computer-implemented method comprising:

training a machine-learning model using an initial set of training data samples;

receiving a new training data sample;

predicting a label for the new training data sample;

upon determining that a prediction quality value for the predicted label of the new training data sample is below a predefined quality value, executing the actions comprising:

adding the new training data sample to the initial set, thereby building an extended training data set;

reconfirming the predicted label of the new training data sample by applying a self-supervised learning method to the new training data sample; and

retraining the machine-learning model using the extended training data set; and

upon determining that the prediction quality value for the predicted label of the new training data sample cannot be improved, triggering an alarm event.

2. The computer-implemented method of claim 1 , further comprising:

iteratively repeating the receiving, the predicting, the adding, and the retraining until a stop condition is met.

3. The computer-implemented method of claim 2 , wherein the stop condition is met when a predefined training time value is reached.

4. The computer-implemented method of claim 2 , wherein the stop condition is met when a predefined number of training cycles has been performed.

5. The computer-implemented method of claim 2 , wherein the stop condition is met when a predefined number of new training data samples have been processed.

6. The computer-implemented method of claim 2 , wherein the stop condition is met when a predefined summary prediction quality condition is met.

7. The computer-implemented method of claim 2 , wherein the stop condition is met when, in a predefined time, no additional new training data sample with a prediction quality value below the predefined quality value is determined.

8. The computer-implemented method of claim 1 , wherein the self-supervised learning method includes at least one method selected from the group consisting of:

rotating the new training data sample by a predefined rotation angle and predicting the rotation angle;

flipping the new training data sample by a predefined flipping angle and predicting the flipping angle;

re-colorizing the new training data sample and predicting a class of the resulting re-colorized training data sample; and

puzzling the new training data sample and predicting an original position of a tile of the new training data sample.

9. A computer program product comprising one or more computer readable storage media and program instructions collectively stored on the one or more computer readable storage media, the stored program instructions comprising:

program instructions to train a machine-learning model using an initial set of training data samples;

program instructions to receive a new training data sample;

program instructions to predict a label for the new training data sample;

program instructions to, upon determining that a prediction quality value for the predicted label of the new training data sample is below a predefined quality value, executing the actions comprising:

program instructions to add the new training data sample to the initial set, thereby building an extended training data set;

program instructions to reconfirm the predicted label of the new training data sample by applying a self-supervised learning method to the new training data sample; and

program instructions to retrain the machine-learning model using the extended training data set; and

program instructions to, upon determining that the prediction quality value for the predicted label of the new training data sample cannot be improved, trigger an alarm event.

10. The computer program product of claim 9 , the stored program instructions further comprising:

program instructions to iteratively repeat the receiving, the predicting, the adding, and the retraining until a stop condition is met.

11. The computer program product of claim 9 , wherein the self-supervised learning method includes at least one method selected from the group consisting of:

rotating the new training data sample by a predefined rotation angle and predicting the rotation angle;

flipping the new training data sample by a predefined flipping angle and predicting the flipping angle;

re-colorizing the new training data sample and predicting a class of the resulting re-colorized training data sample; and

puzzling the new training data sample and predicting an original position of a tile of the new training data sample.

12. A computer system comprising:

a processor(s) set; and

a computer readable storage medium;

wherein:

the processor(s) set is structured, located, connected and/or programmed to run program instructions stored on the computer readable storage medium; and

the stored program instructions comprise:

program instructions to train a machine-learning model using an initial set of training data samples;

program instructions to receive a new training data sample;

program instructions to predict a label for the new training data sample;

program instructions to, upon determining that a prediction quality value for the predicted label of the new training data sample is below a predefined quality value, executing the actions comprising:

program instructions to add the new training data sample to the initial set, thereby building an extended training data set;

program instructions to reconfirm the predicted label of the new training data sample by applying a self-supervised learning method to the new training data sample; and

program instructions to retrain the machine-learning model using the extended training data set; and

program instructions to, upon determining that the prediction quality value for the predicted label of the new training data sample cannot be improved, trigger an alarm event.

13. The computer system of claim 12 , the stored program instructions further comprising:

program instructions to iteratively repeat the receiving, the predicting, the adding, and the retraining until a stop condition is met.

14. The computer system of claim 12 , wherein the self-supervised learning method includes at least one method selected from the group consisting of:

rotating the new training data sample by a predefined rotation angle and predicting the rotation angle;

flipping the new training data sample by a predefined flipping angle and predicting the flipping angle;

re-colorizing the new training data sample and predicting a class of the resulting re-colorized training data sample; and

puzzling the new training data sample and predicting an original position of a tile of the new training data sample.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 21, 2020
From: VELIZHEV, ALEXANDER; RUFLI, MARTIN; KAESTNER, RALF
To: INTERNATIONAL BUSINESS MACHINES CORPORATION
Reel/Frame 052450/0847 →
Continuity (1)
Related Publication 20210326749A1 · Oct 21, 2021
Cited By (1)
US 12,737,637