Data storage arrangement and method for anonymization aware differential compression
An example data storage device includes a memory and a controller. The controller is configured to store at least one of the one or more data elements utilizing differential compression. The controller is further configured to receive a data element to be stored, generate a copy of the data element to be stored, and mask data to be anonymized by deleting one or more portions to be anonymized. The controller is further configured to generate similarity hashes for one or more portions of the copy of the data element with masked data for finding one or more reference portions, and compress the data element to be stored utilizing differential compression with reference to the one or more reference portions.
1. A data storage device comprising a memory and a controller, wherein:
the memory is configured to store one or more data elements, and
the controller is configured to:
store at least one of the one or more data elements utilizing differential compression, wherein a similarity hash for a first portion of a first data element is generated and compared to a stored similarity hash for a second portion of the first data element, and wherein when the similarity hash for the first portion of the first data element matches the stored similarity hash for the second portion of the first data element, the first portion is compressed with reference to the second portion;
receive a second data element to be stored, wherein the second data element is different than the first data element;
generate a copy of the second data element to be stored;
mask data to be anonymized in the copy of the second data element to be stored by deleting one or more portions to be anonymized;
generate similarity hashes for one or more portions of the copy of the second data element with masked data for finding one or more reference portions; and
generating a compressed second data element by compressing the second data element to be stored utilizing differential compression with reference to the one or more reference portions.
2. The data storage device according to claim 1 , wherein the one or more data elements are one or more data blocks, and wherein the controller is further configured to store the one or more data elements utilizing block storage.
3. The data storage device according to claim 1 , wherein the controller is further configured to receive an indication of data to be anonymized, wherein the indication relates to one or more of local legislative requirements, personal information, or faces.
4. The data storage device according to claim 3 , wherein the controller is further configured to parse the data to be anonymized.
5. The data storage device according to claim 3 , wherein the indication of the data to be anonymized further relates to one or more locations of the data to be anonymized in the second data element to be stored.
6. The data storage device according to claim 3 , wherein the indication of the data to be anonymized is received via user input.
7. The data storage device according to claim 3 , wherein the indication of the data to be anonymized is received along with the second data element to be stored.
8. The data storage device according to claim 1 , wherein the controller is further configured to mask the data to be anonymized when generating the copy of the second data element to be stored through a write-with-mask command.
9. The data storage device according to claim 1 , wherein the controller is further configured to store the compressed second data element in the memory.
10. A method applied to a data storage device comprising a memory configured to store one or more data elements, the method comprising:
storing at least one of the one or more data elements utilizing differential compression, wherein a similarity hash for a first portion of a first data element is generated and compared to a stored similarity hash for a second portion of the first data element, and wherein when the similarity hash for the first portion of the first data element matches the stored similarity hash for the second portion of the first data element, the first portion is compressed with reference to the second portion;
receiving a second data element to be stored, wherein the second data element is different than the first data element;
generating a copy of the second data element to be stored;
masking data to be anonymized in the copy of the second data element to be stored by deleting one or more portions to be anonymized;
generating similarity hashes for one or more portions of the copy of the second data element with masked data for finding one or more reference portions; and
generating a compressed second data element by compressing the second data element to be stored utilizing differential compression with reference to the one or more reference portions.
11. The method according to claim 10 , wherein the method further comprises:
storing the one or more data elements utilizing block storage.
12. The method according to claim 10 , wherein the method further comprises:
receiving an indication of data to be anonymized, wherein the indication relates to one or more of local legislative requirements, personal information, or faces.
13. The method according to claim 12 , wherein the method further comprises:
parsing the data to be anonymized.
14. The method according to claim 12 , wherein the indication of data to be anonymized further relates to one or more locations of the data to be anonymized in the second data element to be stored.
15. The method according to claim 12 , wherein the indication of the data to be anonymized is received via user input.
16. The method according to claim 12 , wherein the indication of the data to be anonymized is received along with the second data element to be stored.
17. The method according to claim 10 , wherein the method further comprises:
masking the data to be anonymized when generating the copy of the second data element to be stored through a write-with-mask command.
18. The method according to claim 10 , wherein the method further comprises:
storing the compressed second data element in the memory.