IP Library › Granted Patent US 10,339,471
Granted Patent B2
US 10,339,471 · App. 15/407,692 · Granted Jul 2, 2019

Ensemble based labeling

Inventor: Hiroshi Inoue (Tokyo, JP)
Assignee: International Business Machines Corporation
G06N20/00G06K9/6277G06K9/6289
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,339,471
App. No.
15/407,692
Granted
Jul 2, 2019
Kind
B2
Abstract

A method for ensemble based labeling is provided. The method includes obtaining a plurality of samples of an object. The method further includes estimating, for each of the plurality of samples, a probability that a label applies to the sample, for each of a plurality of labels. The method also includes determining a candidate label among the plurality of labels, based on the estimated probabilities of the plurality of samples for each of the plurality of labels. The method further includes calculating a dispersion of the estimated probabilities of the plurality of samples for the candidate label; and identifying a target label among the plurality of labels, based on the estimated probabilities of the plurality of samples for the candidate label, the dispersion for the candidate label, and a number of the plurality of samples.

Claims (34)

1. An apparatus comprising:

a processor; and

one or more non-transitory computer readable mediums collectively including instructions that, when executed by the processor, cause the processor to perform operations including:

obtaining, by a processor, a plurality of unlabeled samples of an object;

estimating, by the processor, for each of the plurality of unlabeled samples, a probability that a label applies to the unlabeled sample, for each of a plurality of labels;

calculating, by a processor, an average of the estimated probabilities of the plurality of unlabeled samples for each of the plurality of labels;

determining, by the processor, a label that has a largest average among the plurality of labels, as a candidate label among the plurality of labels;

calculating, by the processor, a dispersion of the estimated probabilities of the plurality of unlabeled samples for the candidate label; and

identifying, by the processor, a target label among the plurality of labels based on the average of the estimated probabilities of the plurality of unlabeled samples for the candidate label, the dispersion for the candidate label, and a number of the plurality of unlabeled samples.

2. The apparatus according to claim 1 , wherein the identifying a target label among the plurality of labels includes:

judging whether to identify the target label, based on the estimated probabilities of the plurality of unlabeled samples for the candidate label, the dispersion for the candidate label, and the number of the plurality of unlabeled samples, and

identifying the candidate label as the target label, in response to judging to identify the target label.

3. The apparatus according to claim 2 , wherein the operations further include:

obtaining one or more additional unlabeled samples of the object in response to judging not to determine the target label;

estimating a probability that a label applies to each of the one or more additional unlabeled samples for each of a plurality of labels;

determining a candidate label among the plurality of labels, based on the estimated probabilities of the plurality of unlabeled samples and the one or more additional unlabeled samples for each of the plurality of labels; and

calculating a dispersion of the estimated probabilities of the plurality of unlabeled samples and the one or more additional unlabeled samples for the candidate label,

wherein the identifying a target label among the plurality of labels is based on the estimated probabilities of the plurality of unlabeled samples and the one or more additional unlabeled samples for the candidate label, the dispersion of the plurality of unlabeled samples and the one or more additional unlabeled samples for the candidate label, and the number of the plurality of unlabeled samples and the one or more additional unlabeled samples.

4. A non-transitory computer-readable storage medium having instructions embodied therewith, the instructions executable by a processor or programmable circuitry to cause the processor or programmable circuitry to perform operations comprising:

obtaining, by a processor, a plurality of unlabeled samples of an object;

estimating, by the processor, for each of the plurality of unlabeled samples, a probability that a label applies to the sample, for each of a plurality of labels;

determining, by the processor, a candidate label among the plurality of labels, based on the estimated probabilities of the plurality of unlabeled samples for each of the plurality of labels;

calculating, by the processor, a dispersion of the estimated probabilities of the plurality of unlabeled samples for the candidate label;

identifying, by the processor, a target label among the plurality of labels, according to the estimated probabilities of the plurality of unlabeled samples for the candidate label, the dispersion for the candidate label, and a number of the plurality of unlabeled samples, the identifying including:

judging whether to identify the target label, based on the estimated probabilities of the plurality of unlabeled samples for the candidate label, the dispersion for the candidate label, and the number of the plurality of unlabeled samples, and

identifying the candidate label as the target label, in response to judging to identify the target label;

obtaining one or more additional unlabeled samples of the object in response to judging not to determine the target label;

estimating a probability that a label applies to each of the one or more additional unlabeled samples for each of a plurality of labels;

determining a candidate label among the plurality of labels, based on the estimated probabilities of the plurality of unlabeled samples and the one or more additional unlabeled samples for each of the plurality of labels; and

calculating a dispersion of the estimated probabilities of the plurality of unlabeled samples and the one or more additional unlabeled samples for the candidate label,

wherein the identifying a target label among the plurality of labels is based on the estimated probabilities of the plurality of unlabeled samples and the one or more additional unlabeled samples for the candidate label, the dispersion of the plurality of unlabeled samples and the one or more additional unlabeled samples for the candidate label, and the number of the plurality of unlabeled samples and the one or more additional unlabeled samples.

5. The non-transitory computer-readable storage medium according to claim 4 , wherein the determining a candidate label among the plurality of labels includes:

calculating an average of the estimated probabilities of the plurality of unlabeled samples for each of the plurality of labels; and

determining a label that has the largest average among the plurality of labels, as the candidate label.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 17, 2017
From: INOUE, HIROSHI
To: INTERNATIONAL BUSINESS MACHINES CORPORATION
Reel/Frame 040987/0326 →
Continuity (1)
Related Publication 20180204082A1 · Jul 19, 2018