Granted Patent B2

US 12,339,980 · App. 17/431,719 · Granted Jun 24, 2025

Inventor: Satoshi Hasegawa (Musashino, JP)

Assignee: NIPPON TELEGRAPH AND TELEPHONE CORPORATION

G06F21/6218G06F16/285

Abstract

Claims (24)

1. A data replacement apparatus for replacing attribute values with representative values for each of groups, the data replacement apparatus comprising:

attribute value set retrieval circuitry that retrieves a grouped attribute value set into a primary storage device when a size of the grouped attribute value set is equal to or smaller than a predefined size and retrieves the grouped attribute value set into a secondary storage device when the size of the grouped attribute value set is larger than the predefined size, wherein the primary storage device is physically separate from the secondary storage device, and the secondary storage device is slower than the primary storage device;

median computation circuitry that computes a median of the grouped attribute value set at the primary storage device or at the secondary storage device;

division determination circuitry that, if a size of each of two attribute value sets which are formed by dividing the grouped attribute value set into two parts based on the median is equal to or greater than a predetermined threshold, sets respective ones of the two attribute value sets formed by the division as new groups;

a joined set generation circuitry that generates a joined set which is formed by arranging record numbers associated with the attribute values such that the attribute values in each of the groups which have converged after repeated execution of processing by the attribute value set retrieval circuitry, the median computation circuitry, and the division determination circuitry are consecutive;

a rearrangement circuitry that rearranges the attribute values in the secondary storage device based on the joined set;

a representative value replacement circuitry that sequentially executes processing for retrieving some of the rearranged attribute values from the secondary storage device into the primary storage device, and replaces the attribute values retrieved into the primary storage device with the representative values; and

a re-rearrangement circuitry that moves the representative values to the secondary storage device and rearranges them into an original order.

2. A data replacement method for replacing attribute values with representative values for each of groups, the data replacement method comprising:

retrieving a grouped attribute value set into a primary storage device when a size of the grouped attribute value set is equal to or smaller than a predefined size and retrieving the grouped attribute value set into a secondary storage device when the size of the grouped attribute value set is larger than the predefined size, wherein the primary storage device is physically separate from the secondary storage device and the secondary storage device is slower than the primary storage device;

computing a median of the grouped attribute value set at the primary storage device or at the secondary storage device;

setting respective ones of the two attribute value sets formed by the division as new groups, when a size of each of two attribute value sets which are formed by dividing the grouped attribute value set into two parts based on the median is equal to or greater than a predetermined threshold;

generating a joined set which is formed by arranging record numbers associated with the attribute values such that the attribute values in each of the groups which have converged after repeated execution of the retrieving, the computing and the setting are consecutive;

rearranging the attribute values in the secondary storage device based on the joined set;

sequentially executing processing for retrieving some of the rearranged attribute values from the secondary storage device into the primary storage device, and replacing the attribute values retrieved into the primary storage device with the representative values; and

moving the representative values to the secondary storage device and rearranging them into an original order.

3. A non-transitory computer-readable storage medium storing a program for causing a computer to perform a data replacement method for replacing attribute values with representative values for each of groups, the data replacement method comprising:

retrieving a grouped attribute value set into a primary storage device when a size of the grouped attribute value set is equal to or smaller than a predefined size and retrieving the grouped attribute value set into a secondary storage device when the size of the grouped attribute value set is larger than the predefined size, wherein the primary storage device is physically separate from the secondary storage device, and the secondary storage device is slower than the primary storage device;

computing a median of the grouped attribute value set at the primary storage device or at the secondary storage device;

setting respective ones of the two attribute value sets formed by the division as new groups, when a size of each of two attribute value sets which are formed by dividing the grouped attribute value set into two parts based on the median is equal to or greater than a predetermined threshold;

generating a joined set which is formed by arranging record numbers associated with the attribute values such that the attribute values in each of the groups which have converged after repeated execution of the retrieving, the computing and the setting are consecutive;

rearranging the attribute values in the secondary storage device based on the joined set:

sequentially executing processing for retrieving some of the rearranged attribute values from the secondary storage device into the primary storage device, and replacing the attribute values retrieved into the primary storage device with the representative values; and

moving the representative values to the secondary storage device and rearranging them into an original order.

Assignments (2)

Priority Claims (1)

Continuity (1)

References Cited (9)