Deleting, auditing, and disaster recovery for personal identifiable information
The present application discloses a method, system, and computer system for deleting, auditing, and/or performing disaster recovery for personal identifiable information (PII). The method includes determining to delete from a dataset PII data corresponding to an individual, determining a PII key associated with the individual, and performing a lookup with respect to the dataset for PII data associated with the individual using the PII key.
1. A system, comprising:
one or more processors configured to:
determine to delete from a dataset of personal identifiable information (PII) data corresponding to an individual;
determine a PII key associated with the individual;
perform a lookup with respect to the dataset for the PII data associated with the individual using the PII key;
determine whether an other process is using or attempting to use the PII data associated with the individual based at least in part on results corresponding to the lookup performed using the PII key;
in response to a determination that the other process is using or attempting to use the associated PII data, terminate the other process; and
delete the associated PII data, wherein deleting comprises moving an encryption key used to encrypt one or more records of the associated PII data to a trusted storage location; and
a memory coupled to the one or more processors and configured to provide the one or more processors with instructions.
2. The system of claim 1 , wherein:
the dataset comprises one or more data records;
the one or more data records respectively comprise at least three fields:
a first field storing a corresponding data record that is designated for storing PII;
a second field in which information pertaining to the PII key is stored; and
a third field corresponding to a flag that indicates whether the corresponding data record stores PII.
3. The system of claim 2 , wherein performing a lookup with respect to the dataset for the PII data associated with the individual based at least in part on the PII key comprises:
using the PII key to search for records comprised in the dataset that include the second field storing information pertaining the PII key.
4. The system of claim 2 , wherein the information pertaining the PII key stored in the second field comprises a PII key identifier.
5. The system of claim 2 , wherein performing a lookup with respect to the dataset for PII data associated with the individual based at least in part on the PII key comprises:
filtering the dataset based at least in part on the flag stored in the third field for the one or more data records to obtain a subset of data records comprising the PII data; and
performing a search across the subset of data records for resulting records comprising the PII data associated with the individual based at least in part on information stored in the second field.
6. The system of claim 2 , wherein the one or more processors are further configured to delete the PII data associated with the individual based at least in part on results corresponding to a lookup performed based at least in part on the PII key.
7. The system of claim 6 , wherein deleting the PII data associated with the individual comprises deleting the one or more records storing the PII data associated with the individual.
8. The system of claim 6 , wherein deleting the PII data associated with the individual comprises deleting the PII key associated with the individual.
9. The system of claim 6 , wherein deleting the PII data associated with the individual comprises moving the PII data from the dataset to a secure storage area.
10. The system of claim 6 , wherein deleting the PII data associated with the individual comprises deleting an encryption key used to encrypt the one or more records comprising the PII data associated with the individual.
11. The system of claim 1 , wherein:
the PII data is stored in association with at least two identifiers; and
the at least two identifiers comprise a PII key identifier and a record identifier.
12. The system of claim 11 , wherein the record identifier identifies a row of the dataset in which a record for the PII data is stored.
13. The system of claim 11 , wherein the PII key identifier is created for association with the PII data, and the record identifier is created based at least in part on a data model corresponding to the dataset.
14. The system of claim 1 , wherein the one or more processors are further configured to store operation information pertaining to one or more operations performed with respect to the dataset in an audit log.
15. The system of claim 14 , wherein the one or more processors are further configured to:
receive a request to recreate an earlier version of the dataset;
determine, based at least in part on the audit log, any intervening requests to delete the PII data associated with one or more individuals since a time corresponding to an earlier version of the dataset; and
recreate the earlier version of the dataset in a modified state to commit the intervening requests to delete the PII data associated with one or more individuals.
16. The system of claim 15 , wherein recreating the earlier version of the dataset in the modified state comprises:
using the earlier version of the dataset to obtain a reconstructed dataset;
searching the reconstructed dataset for the PII data corresponding to the intervening requests to delete the PII data associated with one or more individuals since a time corresponding to the earlier version of the dataset;
deleting the PII data corresponding to the intervening requests from the reconstructed dataset to obtain a resulting dataset; and
providing the resulting dataset in response to the request to recreate the earlier version of the dataset.
17. A method, comprising:
determining, using a processor, to delete from a dataset of personal identifiable information (PII) data corresponding to an individual;
determining a PII key associated with the individual;
performing a lookup with respect to the dataset for the PII data associated with the individual using the PII key;
determining whether an other process is using or attempting to use the PII data associated with the individual based at least in part on results corresponding to the lookup performed using the PII key;
in response to a determination that the other process is using or attempting to use the associated PII data, terminating the other process; and
deleting the associated PII data, wherein deleting comprises moving an encryption key used to encrypt one or more records of the associated PII data to a trusted storage location.
18. A computer program product embodied in a non-transitory computer readable medium and comprising computer instructions for:
determining to delete from a dataset of personal identifiable information (PII) data corresponding to an individual;
determining a PII key associated with the individual;
performing a lookup with respect to the dataset for the PII data associated with the individual using the PII key;
determining whether an other process is using or attempting to use the PII data associated with the individual based at least in part on results corresponding to the lookup performed using the PII key;
in response to a determination that the other process is using or attempting to use the associated PII data, terminating the other process; and
deleting associated PII data, wherein deleting comprises moving an encryption key used to encrypt one or more records of the associated PII data to a trusted storage location.