Methods and apparatus to estimate cardinality through ordered statistics
View Patent ↗Methods, apparatus, systems, and articles of manufacture to estimate cardinality through ordered statistics are disclosed. In an example, an apparatus includes processor circuitry to selects a sample dataset from a first reference dataset of media assets and partitions the sample dataset into m mutually exclusive subsets of approximately equal size. The processor circuitry then estimates a ratio of a sample weighted average and empirical cumulative distribution of an approximately largest order statistic from at least one of the m subsets and generates an estimate of a total cardinality of the first reference dataset by multiplying the ratio by approximately m.
1. A computing system comprising a processor, the computing system configured to perform a set of acts comprising:
selecting a sample dataset from a reference dataset of media assets;
partitioning the sample dataset into m mutually exclusive subsets of samples of approximately equal size, wherein m is an integer greater than three, and wherein partitioning the sample dataset comprises populating a first set of memory locations in a memory with a first subset of samples of the m subsets of samples and assigning a first register to be a working storage location for a value representing the first subset;
estimating a ratio of a sample weighted average and empirical cumulative distribution of a largest order statistic from at least one of the m subsets; and
generating an estimate of a total cardinality of the reference dataset by multiplying the ratio by m.
2. The computing system of claim 1 , wherein samples in the sample dataset are independently distributed among the reference dataset.
3. The computing system of claim 1 , wherein a base distribution of the reference dataset includes a cumulative distribution function.
4. The computing system of claim 3 , wherein estimating the ratio includes determining an expected value of a logarithm of the cumulative distribution function of the base distribution.
5. A non-transitory machine readable storage medium comprising instructions that, when executed, cause a computing system to at least:
select a sample dataset from a reference dataset of media assets;
partition the sample dataset into m mutually exclusive subsets of samples of approximately equal size, wherein m is an integer greater than three, and wherein partitioning the sample dataset comprises populating a first set of memory locations in a memory with a first subset of samples of the m subsets of samples and assigning a first register to be a working storage location for a value representing the first subset;
estimate a ratio of a sample weighted average and empirical cumulative distribution of a largest order statistic from at least one of the m subsets; and
generate an estimate of a total cardinality of the reference dataset by multiplying the ratio by m.
6. The non-transitory machine readable storage medium of claim 5 , wherein samples in the sample dataset are independent and identically distributed among the reference dataset.
7. The non-transitory machine readable storage medium of claim 5 , wherein a base distribution of the reference dataset includes a cumulative distribution function.
8. The non-transitory machine readable storage medium of claim 7 , wherein to estimate the ratio includes to take an expected value of a logarithm of the cumulative distribution function of the base distribution.
9. A method comprising:
selecting a sample dataset from a reference dataset of media assets;
partitioning the sample dataset into m mutually exclusive subsets of samples of approximately equal size, wherein m is an integer greater than three, and wherein partitioning the sample dataset comprises populating, by a computing system, a first set of memory locations in a memory with a first subset of samples of the m subsets of samples and assigning a first register to be a working storage location for a value representing the first subset;
estimating a ratio of a sample weighted average and empirical cumulative distribution of a largest order statistic from at least one of the m subsets; and
generating an estimate of a total cardinality of the reference dataset by multiplying the ratio by m.
10. The method of claim 9 , wherein samples in the sample dataset are independently distributed among the reference dataset.
11. The method of claim 9 , wherein a base distribution of the reference dataset includes a cumulative distribution function.
12. The method of claim 11 , wherein estimating the ratio includes determining an expected value of a logarithm of the cumulative distribution function of the base distribution.