Smart de-identification using date jittering
System and method to produce an anonymized cohort having less than a predetermined risk of re-identification. The method includes receiving a data query of requested traits for the anonymized cohort, querying a data source to find records that possess at least some of the traits, forming a dataset from at least some of the records, and grouping the dataset in time into a first boundary group, a second boundary group, and one or more non-boundary groups temporally between the first boundary group and second boundary group. For each non-boundary group, calculating maximum time limits the non-boundary group can be time-shifted without overlapping an adjacent group, calculating a group jitter amount, capping the group jitter amount by the maximum time limits and by respective predetermined jitter limits, and jittering said non-boundary group by the capped group jitter amount to produce an anonymized dataset. Return the anonymized dataset.
1. A computer-implemented method to anonymize digitally stored patient records, the method comprising:
receiving a plurality of patient records from one or more databases;
assigning each of the received plurality of patient records into one of a first group associated with a first time period, a second group associated with a second time period, or a third group associated with a third time period, wherein the third time period falls between the first and second time periods;
determining for each of the patient records in the third group a time shift, such that a respective time shifted patient record of the third group is outside the time periods associated with the first group and the second group;
generating a maximum time shift based on the determined time shifts for the patient records of the third group; and
for each of the patient records assigned to the third group, temporally shifting the patient record by an amount less than the maximum time shift to anonymize the patient records in the third group.
2. The method of claim 1 , further comprising:
identifying a forward shifting limit and a backward shifting limit for the first, second, or third group.
3. The method of claim 1 , further comprising:
determining a forward time shifting level for the first, second, and third group positioned between a first boundary and second boundary.
4. The method of claim 1 , further comprising:
shifting the plurality of patient records in one or more of the first, second, or third group by a fixed amount of time.
5. The method of claim 1 , further comprising:
adjusting at least one of the first or second group according to the time shifting levels to provide protection to patients represented by the plurality of patient records.
6. The method of claim 1 , further comprising:
identifying at least one of the first, second, or third group to not apply any of the time shifting levels among the groups between a first boundary and a second boundary.
7. The method of claim 1 , further comprising:
selecting data for the plurality of patient records for the first, second, and third group that satisfy a predetermined selection criteria.
8. A computer program product comprising a tangible storage medium encoded with processor-readable instructions that, when executed by one or more processors, enable the computer program product to:
receive a plurality of patient records from one or more databases;
assign each of the received plurality of patient records into one of a first group associated with a first time period, a second group associated with a second time period, or a third group associated with a third time period, wherein the third time period falls between the first and second time periods;
determine for each of the patient records in the third group a time shift, such that a respective time shifted patient record of the third group is outside the time periods associated with the first group and the second group;
generate a maximum time shift based on the determined time shifts for the patient records of the third group; and
for each of the patient records assigned to the third group, temporally shift the patient record by an amount less than the maximum time shift to anonymize the patient records in the third group.
9. The computer program product of claim 8 , wherein a forward shifting limit and a backward shifting limit for the first, second, or third group are identified.
10. The computer program product of claim 8 , wherein a forward time shifting level for the first, second, and third group positioned between a first boundary and second boundary is determined.
11. The computer program product of claim 8 , wherein the plurality of patient records in one or more of the first, second, or third group are shifted by a fixed amount of time.
12. The computer program product of claim 8 , wherein at least one of the first or second time group are adjusted according to the time shifting levels to provide protection to patients represented by the plurality of patient records.
13. The computer program product of method of claim 8 , wherein at least one of the first, second, or third group is identified to not apply any of the time shifting levels among the groups between a first boundary and a second boundary.
14. The computer program product of claim 8 , wherein data for the plurality of patient records for the first, second, and third group that satisfy a predetermined selection criteria is selected.
15. A computer system connected to a network, the system comprising:
a memory configured to store instructions; and
one or more processors configured to execute the instructions to:
receive a plurality of patient records from one or more databases;
assign each of the received plurality of patient records into one of a first group associated with a first time period, a second group associated with a second time period, or a third group associated with a third time period, wherein the third time period falls between the first and second time periods;
determine for each of the patient records in the third group a time shift, such that a respective time shifted patient record of the third group is outside the time periods associated with the first group and the second group;
generate a maximum time shift based on the determined time shifts for the patient records of the third group; and
for each of the patient records assigned to the third group, temporally shift the patient record by an amount less than the maximum time shift to anonymize the patient records in the third group.
16. The system of claim 15 , wherein a forward shifting limit and a backward shifting limit for the first, second, or third group are identified.
17. The system of claim 15 , wherein a forward time shifting level for the first, second, and third group positioned between a first boundary and second boundary is determined.
18. The system of claim 15 , wherein the plurality of patient records in one or more of the first, second, or third group are shifted by a fixed amount of time.
19. The system of claim 15 , wherein at least one of the first or second time group are adjusted according to the time shifting levels to provide protection to patients represented by the plurality of patient records.
20. The system of claim 15 , wherein at least one of the first, second, or third group is identified to not apply any of the time shifting levels among the groups between a first boundary and a second boundary.