IP Library › Granted Patent US 12,197,540
Granted Patent B2
US 12,197,540 · App. 17/908,607 · Granted Jan 14, 2025

Learning method, device, learning apparatus and program

Inventors: Osamu Saisho (Musashino, JP); Keiichiro Kashiwagi (Musashino, JP); Yui Saito (Musashino, JP); Tomoyuki Fujino (Musashino, JP)
Assignee: Nippon Telegraph and Telephone Corporation
G06F18/23211G06N3/047
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,197,540
App. No.
17/908,607
Granted
Jan 14, 2025
Kind
B2
Abstract

A learning method includes a step in which a device acquires a plurality of samples, a step in which the device divides the plurality of samples into a plurality of clusters, a step in which the device extracts samples from each of the plurality of clusters according to an effectiveness of each cluster received from a learning apparatus, a step in which the device transmits the extracted samples to the learning apparatus, a step in which the learning apparatus learns the extracted samples, a step in which the learning apparatus calculates, for each cluster, an effectiveness in learning the samples belonging to a cluster from learning results, and a step in which the learning apparatus transmits the effectiveness of each cluster to the device.

Claims (59)

1. A learning method comprising the steps of:

acquiring, by a device, a plurality of samples;

dividing, by the device, the plurality of samples into a plurality of clusters;

extracting, by the device, samples from each of the plurality of clusters according to an effectiveness of each of the plurality of clusters received from a learning apparatus, wherein a number of samples extracted from the each of the plurality of clusters is proportional to the effectiveness of the each of the plurality of clusters;

transmitting, by the device, the extracted samples to the learning apparatus;

learning, by the learning apparatus, the extracted samples;

calculating, by the learning apparatus, for each of the plurality of clusters, an effectiveness in learning samples of the extracted samples belonging to a cluster of the plurality of clusters from learning results; and

transmitting, by the learning apparatus, the effectiveness of each of the plurality of clusters to the device.

2. The learning method according to claim 1 , wherein

any one label out of a plurality of types of labels is assigned to each of the extracted samples, and

the step of calculating includes the steps of:

counting, for each of the plurality of types of labels assigned to the extracted samples, the number of samples where the label is assigned, and

calculating, for each of the plurality of clusters, the effectiveness of the cluster to be larger when the number of samples having the label assigned to the samples belonging to the cluster is small.

3. The learning method according to claim 1 , wherein the step of learning includes the steps of:

calculating, for the extracted samples, probabilities corresponding to each of the plurality of types of labels using a learning model generated by learning the extracted samples, and

calculating, for each of the plurality of clusters, the effectiveness of the cluster to be larger when a degree of variation of the probabilities corresponding to each of the plurality of labels for the samples belonging to the cluster is small.

4. The learning method according to claim 1 , wherein

in the step of extracting of the samples, samples farther from a centroid of the cluster have higher probability of being extracted from the cluster.

5. The learning method according to claim 1 , wherein

a plurality of cycles having from the step of-acquiring of the plurality of samples to the step of-transmitting of the effectiveness for each of the plurality of clusters to the device as one cycle are repeated,

the effectiveness of each of the plurality of clusters received from the learning apparatus is an effectiveness of each of a plurality of clusters in a previous cycle, and

the step of extracting of the sample includes the steps of:

associating the plurality of clusters in the previous cycle with a corresponding plurality of clusters identified in a current cycle based on centroids of clusters, and

extracting samples from each of the plurality of clusters according to the effectiveness of a cluster of the plurality of clusters in the previous cycle corresponding to a cluster of the plurality of clusters identified in the current cycle.

6. The learning method according to claim 2 , wherein in the step of extracting of the samples, samples farther from a centroid of the cluster have higher probability of being extracted from the cluster.

7. The learning method according to claim 3 , wherein in the step of extracting of the samples, samples farther from a centroid of the cluster have higher probability of being extracted from the cluster.

8. The learning method according to claim 2 , wherein

a plurality of cycles having from the step of acquiring of the plurality of samples to the step of transmitting of the effectiveness for each of the plurality of clusters to the device as one cycle are repeated,

the effectiveness of each of the plurality of clusters received from the learning apparatus is an effectiveness of each of a plurality of clusters in a previous cycle, and

the step of extracting of the sample includes the steps of:

associating the plurality of clusters in the previous cycle with a corresponding plurality of clusters identified in a current cycle based on centroids of clusters, and

extracting samples from each of the plurality of clusters according to the effectiveness of a cluster of the plurality of clusters in the previous cycle corresponding to a cluster of the plurality of clusters identified in the current cycle.

9. The learning method according to claim 3 , wherein

a plurality of cycles having from the step of acquiring of the plurality of samples to the step of transmitting of the effectiveness for each of the plurality of clusters to the device as one cycle are repeated,

the effectiveness of each of the plurality of clusters received from the learning apparatus is an effectiveness of each of a plurality of clusters in a previous cycle, and

the step of extracting of the sample includes the steps of:

associating the plurality of clusters in the previous cycle with a corresponding plurality of clusters identified in a current cycle based on centroids of clusters, and

extracting samples from each of the plurality of clusters according to the effectiveness of a cluster of the plurality of clusters in the previous cycle corresponding to a cluster of the plurality of clusters identified in the current cycle.

10. The learning method according to claim 4 , wherein

a plurality of cycles having from the step of acquiring of the plurality of samples to the step of transmitting of the effectiveness for each of the plurality of clusters to the device as one cycle are repeated,

the effectiveness of each of the plurality of clusters received from the learning apparatus is an effectiveness of each of a plurality of clusters in a previous cycle, and

the step of extracting of the sample includes the steps of:

associating the plurality of clusters in the previous cycle with a corresponding plurality of clusters identified in a current cycle based on centroids of clusters, and

extracting samples from each of the plurality of clusters according to the effectiveness of a cluster of the plurality of clusters in the previous cycle corresponding to a cluster of the plurality of clusters identified in the current cycle.

11. A device comprising:

a processor; and

a memory device storing instructions that, when executed by the processor, configure the processor to:

acquire a plurality of samples;

divide the plurality of samples into a plurality of clusters;

extract samples from each of the plurality of clusters according to a ratio of an effectiveness of each of the plurality of clusters received from a learning apparatus, wherein a number of samples extracted from the each of the plurality of clusters is proportional to the effectiveness of the each of the plurality of clusters; and

transmit the extracted samples to the learning apparatus.

12. A learning apparatus comprising:

a processor; and

a memory device storing instructions that, when executed by the processor, configure the processor to:

learn samples extracted by the device of claim 11 ;

calculate, per clusters basis, the plurality of clusters being obtained by clustering the samples by the device, an effectiveness in learning the samples belonging to a cluster of the clusters from learning results; and

transmit the effectiveness of each of the clusters to the device.

13. A non-transitory computer readable medium storing a program, wherein executing of the program causes a computer to operate as the device according to claim 11 .

14. A non-transitory computer readable medium storing a program, wherein executing of the program causes a computer to operate as the learning apparatus according to claim 12 .

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 6, 2022
From: SAISHO, OSAMU; KASHIWAGI, KEIICHIRO; SAITO, YUI; FUJINO, TOMOYUKI
To: NIPPON TELEGRAPH AND TELEPHONE CORPORATION
Reel/Frame 060999/0624 →
Continuity (1)
Related Publication 20230118209A1 · Apr 20, 2023
References Cited (5)
US 20150142322A1 · Okamoto et al. · 2015 [cited by applicant]
JP 2015099468 · 2015 [cited by applicant]
JP 2017167834 · 2017 [cited by applicant]
KR 102314219B1 · 2019 [cited by examiner]
Chen et al., “Distributed Active Learning with Application to Battery Health Management,” 14th International Conference on Information, Chicago, Illinois, Fusion, Jul. 2011, pp. 1431-1437. [cited by applicant]