System and method for generation of attribute driven temporal clustering
System and methods for rapid generation of attribute driven temporal clustering are provided. In one embodiment, the system includes a data storage device and a server. The data storage device may be configured to store a database comprising a plurality of records. The system may also include a server in data communication with the data storage device. The server may be suitably programmed to receive a first attribute and a second attribute, search a database stored on a data storage device to obtain a first group of records associated with the first attribute, search the first group of records to obtain a second group of records associated with the second attribute, determine a temporal relationship between a first index date of a first attribute and a second index date of the second attribute, and generate an output comprising a graphical representation of the temporal relationship.
1. A method for temporal clustering of records comprising:
receiving a first attribute and a second attribute different than the first attribute, wherein each of the first attribute and the second attribute comprises an index date and one of: a medical code, a diagnosis, a lab test, a specific stage of disease, a drug treatment, and a procedure;
searching a database stored on a data storage device to obtain a first group of records associated with the first attribute;
searching, with a processing device, the first group of records to obtain a second group of records associated with the second attribute;
generating, with a processing device, a temporal relationship between the first attribute and the second attribute by determining a ratio of the second group of records versus the first group of records, wherein the ratio represents a probability of an occurrence of the second attribute when an occurrence of the first attribute exists, determining a time frame between the occurrence of the first attribute and the occurrence of the second attribute for the second group of records associated with the first and second attributes, and normalizing each of the second group of records with the index date of the first attribute by subtracting the occurrence time of the first attribute from the occurrence time of the second attribute for each of the second group of records; and
generating an output comprising a graphical representation of the temporal relationship.
2. The method of claim 1 , further comprising narrowing the first or second group of records according to a selected time window.
3. The method of claim 1 , wherein generating the temporal relationship further comprises counting distinct records in the second group of records.
4. The method of claim 3 , wherein generating the temporal relationship further comprises computing a ratio of the number of distinct records in the second group and the number of distinct records in the first group.
5. The method of claim 1 , wherein generating the temporal relationship further comprises normalizing the second attribute of records in the second group by the index date associated with the first attribute.
6. The method of claim 5 , wherein generating the temporal relationship further comprises calculating one or more temporal statistics of the second group of records.
7. The method of claim 6 , wherein generating the temporal relationship further comprises identifying and removing outliers.
8. A system for temporal clustering of records comprising:
a data storage device configured to store a database comprising a plurality of records;
a server in data communication with the data storage device, suitably programmed to:
receive a first attribute and a second attribute different than the first attribute, wherein each of the first attribute and the second attribute comprises one of: a medical code, a diagnosis, a lab test, a specific stage of disease, a drug treatment, and a procedure;
search a database stored on a data storage device to obtain a first group of records associated with the first attribute;
search, with a processing device, the first group of records to obtain a second group of records associated with the second attribute;
generate, with a processing device, a temporal relationship between the first attribute and the second attribute by determining a ratio of the second group of records versus the first group of records, wherein the ratio represents a probability of an occurrence of the second attribute when an occurrence of the first attribute exists, determining a time frame between the occurrence of the first attribute and the occurrence of the second attribute for the second group of records associated with the first and second attributes, and normalizing each of the second group of records with the index date of the first attribute by subtracting the occurrence time of the first attribute from the occurrence time of the second attribute for each of the second group of records; and
generate an output comprising a graphical representation of the temporal relationship.
9. The system of claim 8 , the server further programmed to:
narrow the first or second group of records according to a selected time window.
10. The system of claim 8 , wherein to generate the temporal relationship, the server is further programmed to count distinct records in the second group of records.
11. The system of claim 10 , wherein to generate the temporal relationship, the server is further programmed to compute a ratio of the number of distinct records in the second group and the number of distinct records in the first group.
12. The system of claim 8 , wherein to generate the temporal relationship, the server is further programmed to normalize the second attribute of records in the second group by an index date associated with the first attribute.
13. The system of claim 12 , wherein to generate the temporal relationship, the server is further programmed to calculate one or more temporal statistics of the second group of records.
14. The system of claim 13 , wherein to generate the temporal relationship, the server is further programmed to identify and remove outliers.
15. A tangible computer program product comprising a non-transitory computer readable medium having computer usable program code executable to perform operations comprising:
receiving a first attribute and a second attribute different than the first attribute, wherein each of the first attribute and the second attribute comprises one of: a medical code, a diagnosis, a lab test, a specific stage of disease, a drug treatment, and a procedure;
searching a database stored on a data storage device to obtain a first group of records associated with the first attribute;
searching the first group of records to obtain a second group of records associated with the second attribute;
determining a temporal relationship between the first attribute and the second attribute by determining a ratio of the second group of records versus the first group of records, wherein the ratio represents a probability of an occurrence of the second attribute when an occurrence of the first attribute exists, determining a time frame between the occurrence of the first attribute and the occurrence of the second attribute for the second group of records associated with the first and second attributes, and normalizing each of the second group of records with the index date of the first attribute by subtracting the occurrence time of the first attribute from the occurrence time of the second attribute for each of the second group of records; and
generating an output comprising a graphical representation of the temporal relationship.
16. The tangible computer program product of claim 15 , further comprising narrowing the first or second group of records according to a selected time window.
17. The tangible computer program product of claim 15 , wherein determining the temporal relationship further comprises counting distinct records in the second group of records.
18. The tangible computer program product of claim 17 , wherein determining the temporal relationship further comprises computing a ratio of the number of distinct records in the second group and the number of distinct records in the first group.
19. The tangible computer program product of claim 15 , wherein determining the temporal relationship further comprises normalizing the second attribute of records in the second group by an index date associated with the first attribute.
20. The tangible computer program product of claim 19 , wherein determining the temporal relationship further comprises calculating one or more temporal statistics of the second group of records.
21. The tangible computer program product of claim 20 , wherein determining the temporal relationship further comprises identifying and removing outliers.
22. The method of claim 6 , wherein calculating one or more temporal statistics of the second group of records comprises:
calculating a percentile value from the second group of records; and
calculating a smallest time difference between two interpolated percentiles.
23. The system of claim 13 , wherein to calculate the one or more temporal statistics of the second group of records, the server is programmed to:
calculate a percentile value from the second group of records; and
calculate a smallest time difference between two interpolated percentiles.
24. The tangible computer program product of claim 20 , wherein calculating one or more temporal statistics of the second group of records comprises:
calculating a percentile value from the second group of records; and
calculating a smallest time difference between two interpolated percentiles.