Catalog-based data inheritance determination
View Patent ↗A computing server may generate a catalog of overrepresented data strings from a database that stores a plurality of data instances. An overrepresented data string is a data string that matches to a number of data instances and the number exceeds a number threshold. The computing server may receive a target data instance that is to be compared to a related data instance. The computing server may determine one or more matched data strings that match between the target data instance and the related data instance. The computing server may compare the matched data strings to the catalog to exclude a subset of matched data strings that are matched to the overrepresented data strings. The computing server may determine a total length of the matched data strings excluding the subset of matched data strings that are matched to the overrepresented data strings.
1 . A computer-implemented method for determining a normalized data inheritance between two data instances, the computer-implemented method comprising:
generating a catalog of overrepresented haplotypes from a database that stores a plurality of data instances in a population, wherein an overrepresented haplotype is a haplotype that matches to a number of data instances in the population and the number exceeds a number threshold, wherein the catalog of overrepresented haplotypes comprises a version of haplotype string sequences and corresponding tallies of the haplotype string sequences in the population, and wherein the number threshold is based on an overall distribution of haplotype sequence repetitiveness;
receiving a target data instance that is to be compared to a related data instance;
determining one or more matched haplotypes that match between the target data instance and the related data instance;
comparing the one or more matched haplotypes to the catalog of overrepresented haplotypes to exclude a subset of the one or more matched haplotypes that are matched to the overrepresented haplotypes;
determining a normalized data inheritance between the target data instance and the related data instance, the normalized data inheritance corresponding to a total length of the one or more matched haplotypes excluding the subset of the one or more matched haplotypes that are matched to the overrepresented haplotypes; and
storing, responsive to the total length being longer than a length threshold, information regarding the target data instance and the related data instance being a pair of identity-by-descent matches.
2 . The computer-implemented method of claim 1 , wherein the overrepresented haplotypes in the catalog are arranged by windows of data locality within which the overrepresented haplotypes are located.
3 . The computer-implemented method of claim 2 , wherein the catalog comprises a plurality of overrepresented haplotypes in one of the windows of data locality.
4 . The computer-implemented method of claim 1 , wherein generating the catalog comprises:
receiving the plurality of data instances that correspond to named entities, wherein each of the plurality of data instances is phased;
dividing each data instance into a plurality of windows of data locality;
tallying, for each window of data locality, the data instance that has a particular data bit sequence; and
determining whether a tally of the particular data bit sequence exceeds the number threshold.
5 . The computer-implemented method of claim 1 , wherein information regarding the target data instance and the related data instance being a pair of matches includes the total length and an indication that the target data instance and the related data instance are related by inheritance of a real-life event.
6 . The computer-implemented method of claim 1 , wherein the catalog is generated before receiving the target data instance and is stored in a second database.
7 . The computer-implemented method of claim 1 , wherein comparing the matched haplotypes to the catalog to exclude the subset of matched haplotypes that are matched to the overrepresented haplotypes comprises:
dividing the target data instance into a plurality of windows of data locality;
receiving, from the catalog, a subset of the windows of data locality that include the overrepresented haplotypes; and
comparing the target data instance and the related data instance in the windows that are not under the subset.
8 . The computer-implemented method of claim 1 , wherein determining one or more matched haplotypes that match between the target data instance and the related data instance is based on one or more weak matches of haplotypes.
9 . The computer-implemented method of claim 1 , wherein determining one or more matched haplotypes that match between the target data instance and the related data instance comprises:
phasing the target data instance into a pair of data sequences;
comparing the pair of data sequences with data sequences in the related data instance.
10 . The computer-implemented method of claim 1 , wherein the database that stores the plurality of data instances comprises over 10,000 data instances and each data instance includes over 10,000 data bits.
11 . A system for determining a normalized data inheritance between two data instances, the system comprising:
a data store configured to store a catalog of overrepresented haplotypes among a plurality of data instances in a population, wherein an overrepresented haplotype is a haplotype that matches to a number of data instances in the population and the number exceeds a number threshold, wherein the catalog of overrepresented haplotypes comprises a version of haplotype string sequences and corresponding tallies of the haplotype string sequences in the population, and wherein the number threshold is based on an overall distribution of haplotype sequence repetitiveness;
a computing server comprising memory and one or more processors, the memory configured to store code comprising instructions, wherein the instructions, when executed by the one or more processors, cause the one or more processors to perform steps comprising:
receiving a target data instance that is to be compared to a related data instance;
determining one or more matched haplotypes that match between the target data instance and the related data instance;
comparing the one or more matched haplotypes to the catalog of overrepresented haplotypes to exclude a subset of the one or more matched haplotypes that are matched to the overrepresented haplotypes;
determining a normalized data inheritance between the target data instance and the related data instance, the normalized data inheritance corresponding to a total length of the one or more matched haplotypes excluding the subset of the one or more matched haplotypes that are matched to the overrepresented haplotypes; and
storing, responsive to the total length being longer than a length threshold, information regarding the target data instance and the related data instance being a pair of identity-by-descent matches.
12 . The system of claim 11 , wherein the overrepresented haplotypes in the catalog are arranged by windows of data locality within which the overrepresented haplotypes are located.
13 . The system of claim 12 , wherein the catalog comprises a plurality of overrepresented haplotypes in one of the windows of data locality.
14 . The system of claim 11 , wherein generating the catalog comprises:
receiving the plurality of data instances that correspond to named entities, wherein each of the plurality of data instances is phased;
dividing each data instance into a plurality of windows of data locality;
tallying, for each window, the phased data instance that has a particular data bit sequence; and
determining whether a tally of the particular data bit sequence exceeds the number threshold.
15 . The system of claim 11 , wherein information regarding the target data instance and the related data instance being a pair of match includes the total length and an indication that the target data instance and the related data instance are related by inheritance of a real-life event.
16 . The system of claim 11 , wherein the catalog is generated before receiving the target data instance and is stored in a second database.
17 . The system of claim 11 , wherein comparing the matched haplotypes to the catalog to exclude the subset of matched haplotypes that are matched to the overrepresented haplotypes comprises:
dividing the target data instance into a plurality of windows of data locality;
receiving, from the catalog, a subset of the windows that include the overrepresented haplotypes; and
comparing the target data instance and the related data instance in the windows that are not under the subset.
18 . The system of claim 11 , wherein determining one or more matched haplotypes that match between the target data instance and the related data instance is based on one or more weak matches of haplotypes.
19 . A non-transitory computer readable medium configured to store code for determining a normalized data inheritance between two data instances, the code comprising instructions, wherein the instructions, when executed by one or more processors, cause the one or more processors to perform steps comprising:
generating a catalog of overrepresented haplotypes from a database that stores a plurality of data instances in a population, wherein an overrepresented haplotype is a haplotype that matches to a number of data instances in the population and the number exceeds a number threshold, wherein the catalog of overrepresented haplotypes comprises a version of haplotype string sequences and corresponding tallies of the haplotype string sequences in the population, and wherein the number threshold is based on an overall distribution of haplotype sequence repetitiveness;
receiving a target data instance that is to be compared to a related data instance;
determining one or more matched haplotypes that match between the target data instance and the related data instance;
comparing the one or more matched haplotypes to the catalog of overrepresented haplotypes to exclude a subset of the one or more matched haplotypes that are matched to the overrepresented haplotypes;
determining a normalized data inheritance between the target data instance and the related data instance, the normalized data inheritance corresponding to a total length of the one or more matched haplotypes excluding the subset of the one or more matched haplotypes that are matched to the overrepresented haplotypes; and
storing, responsive to the total length being longer than a length threshold, information regarding the target data instance and the related data instance being a pair of identity-by-descent matches.
20 . The non-transitory computer readable medium of claim 19 , wherein the overrepresented haplotypes in the catalog are arranged by windows of data locality within which the overrepresented haplotypes are located.