Smart de-identification using date jittering
System and method to produce an anonymized cohort having less than a predetermined risk of re-identification. The method includes receiving a data query of requested traits for the anonymized cohort, querying a data source to find records that possess at least some of the traits, forming a dataset from at least some of the records, and grouping the dataset in time into a first boundary group, a second boundary group, and one or more non-boundary groups temporally between the first boundary group and second boundary group. For each non-boundary group, calculating maximum time limits the non-boundary group can be time-shifted without overlapping an adjacent group, calculating a group jitter amount, capping the group jitter amount by the maximum time limits and by respective predetermined jitter limits, and jittering said non-boundary group by the capped group jitter amount to produce an anonymized dataset. Return the anonymized dataset.
1. A computer-implemented method, the method comprising:
receiving a data query to request information on data for multiple patients;
assigning the data for the multiple patients into a plurality of patient groups in response to the data query, wherein each patient is assigned to a single group of the plurality of patient groups;
determining a forward deviation limit and a backward deviation limit for each of the patient groups based on a time deviation of patient data in the plurality of patient groups;
determining a deviation amount for one or more of the patients based on the determined forward deviation limit and the backward deviation limit, wherein a hash function provides security to information associated with the one or more patients; and
providing the data for the multiple patients including the determined deviation amount.
2. The method of claim 1 , further comprising:
providing an additional time deviation to the patient data after calculating the deviation amount for the one or more patients.
3. The method of claim 1 , further comprising:
shifting events associated with the patient data by a fixed amount of time before applying the time deviation to the patient data in the plurality of patient groups to protect the information associated with the one or more patients.
4. The method of claim 1 , further comprising:
comparing the deviation amount of the one or more patients to the forward deviation limit after calculating the deviation amount of the one or more patients to determine a level of the security provided to the information associated with the one or more patients.
5. The method of claim 1 , wherein the patient data into is partitioned into time-separated groups when each of the patients are assigned to their single patient group.
6. The method of claim 1 , wherein the time deviation is applied to prevent an attacker from obtaining knowledge on exact intervals between dates relevant to the one or more patients.
7. The method of claim 1 , further comprising:
comparing the deviation amount for the one or more patients to the backward deviation amount to determine a level of the security provided to the information associated with the one or more patients.
8. A computer program product comprising a tangible storage medium encoded with processor-readable instructions that, when executed by one or more processors, enable the computer program product to:
receive a data query to request information on data for multiple patients;
assign the data for the multiple patients into a plurality of patient groups in response to the data query, wherein each patient is assigned to a single group of the plurality of patient groups;
determine a forward deviation limit and a backward deviation limit for each of the patient groups based on the time deviation applied to the patient data in the plurality of patient groups;
calculate a deviation amount for one or more of the patients based on the determined forward deviation limit and the backward deviation limit, wherein a hash function is utilized to calculate the deviation amount for the one or more patients, and provide security to information associated with the one or more patients; and
provide the data for the multiple patients including the calculated deviation amount.
9. The computer program product of claim 8 , wherein the calculated deviation amount for the one or more patients is a positive deviation amount.
10. The computer program product of claim 8 , wherein the calculated deviation amount for the one or more patients is a negative deviation amount.
11. The computer program product of claim 8 , wherein the calculated deviation amount for the one or more patients is a positive deviation amount that is compared to the forward deviation limit to identify a level of the security provided to the information associated with the one or more patients.
12. The computer program product of claim 8 , wherein zero time deviation is applied to at least one of the patient groups when the time deviation is applied to the patient data in the plurality of patient groups.
13. The computer program product of method of claim 8 , wherein a time shift is applied to events associated with the one or more patients to prevent access to the information associated with the one or more patients before the time deviation is applied.
14. The computer program product of claim 8 , wherein the calculated deviation amount for the one or more patients is a negative deviation amount that is compared to the backward deviation limit.
15. A computer system connected to a network, the system comprising:
one or more processors configured to:
receive a data to request information on data for multiple patients;
assign the data for the multiple patients into a plurality of patient groups in response to the data query, wherein each patient is assigned to a single group of the plurality of patient groups;
determine a forward deviation limit and a backward deviation limit for each of the patient groups based on the time deviation applied to the patient data in the plurality of patient groups;
calculate a deviation amount for one or more of the patients based on the determined forward deviation limit and the backward deviation limit, wherein a hash function is utilized to calculate the deviation amount for the one or more patients, and provide security to information associated with the one or more patients; and
provide the data for the multiple patients including the calculated deviation amount.
16. The system of claim 15 , wherein the patient data in the plurality of patient groups receive a positive time deviation or a negative time deviation when the time deviation is applied to the patient data in the plurality of groups.
17. The system of claim 15 , wherein a time shift is applied to events associated with the one or more patients before the time deviation is applied to the patient data in the plurality of patient groups to prevent access to the information pertinent to the one or more patients.
18. The system of claim 15 , wherein the time deviation is applied to prevent one or more parties from identifying intervals between dates relevant to the one or more patients.
19. The system of claim 15 , wherein the calculated deviation amount for the one or more patients is compared to the forward deviation limit.
20. The system of claim 15 , wherein the calculated deviation amount for the one or more patients is compared to the backward deviation limit.