Method and apparatus for linked encryption tokenization of user traceable data

1. A method of tokenization of user traceable data for enabling support of a right to be forgotten privacy requirement upon receipt of a request to be forgotten from a user of a system that handles log records resulting from operations of one or more applications used by the user, the method comprising:

receiving a raw log record including a set of one or more fields storing raw data related to an event that occurred in an application, wherein a first field and a second field of the set of fields are respectively to store a first raw value that represents user traceable data that can be traced back to an identity or an activity of the user and a second raw value;

determining whether the second field from the set of fields has stored therein the second raw value that represents personal data of a user;

in response to determining that the second field from the set of fields has stored therein the second raw value that represents personal data of a user, encrypting the first raw value to generate a first token using a first symmetric key encryption mechanism based at least in part on a combination of the second raw value that represents personal data of the user and a second token resulting from the tokenization of the second raw value, wherein the first token and the second token are respectively an anonymized representation of the first raw value and the second raw value;

responsive to determining that the second field from the set of fields does not have stored therein the second raw value, encrypting the first raw value to generate the first token using a second symmetric key encryption mechanism based on a cryptographic key associated with a time window after which the cryptographic key is to no longer be valid to detokenize tokens; and

outputting a tokenized log record generated based on the raw log record, the first token, and the second token to be used by one or more log record consumers.

2. The method of claim 1 , wherein the time window after which the cryptographic key is to no longer be valid to detokenize tokens is shorter than a period of time within which personal data is to be forgotten responsive to a request from the user.

3. The method of claim 1 , wherein the tokenization of the second raw value includes generation of a one to one mapping between the second raw value and the second token and storage of the one to one mapping, and the method further comprises:

responsive to receiving a request to forget the personal data of the user, deleting the one to one mapping between the second raw value and the second token so that the first token can no longer be detokenized based on the one to one mapping.

4. The method of claim 1 , wherein the encrypting of the first raw value to generate the first token using the symmetric key encryption mechanism based at least in part on the combination of the second raw value and the second token resulting from the tokenization of the second raw value includes:

using the combination of the second raw value and the second token as a key of the symmetric key encryption mechanism, wherein the combination is at least one of a concatenation of the second raw value and the second token and a hash of the concatenation of the second raw value and the second token.

5. The method of claim 1 , wherein the encrypting of the first raw value to generate the first token using the symmetric key encryption mechanism based at least in part on the combination of the second raw value of the second field and the second token resulting from the tokenization of the second raw value includes:

using one of the second raw value and the second token as a key for the symmetric key encryption mechanism; and

using the other one of the second raw value and the second token as an initialization vector of the symmetric key encryption mechanism.

6. The method of claim 1 , wherein the raw log record was generated responsive to activity of a first of a plurality of organizations assigned different organization identifiers in a multi-tenant system, and wherein the encrypting of the first raw value to generate the first token using the first symmetric key encryption mechanism based at least in part on the combination of the second raw value and the second token is further based on an organization identifier uniquely identifying the first of the plurality of organizations.

7. A non-transitory machine readable medium that stores instructions that, when executed by one or more processors of electronic devices, cause the electronic devices to enable support of a right to be forgotten privacy requirement upon receipt of a request to be forgotten from a user of a system that handles log records resulting from operations of one or more applications used by the user, by performing the following operations:

receiving a raw log record including a set of one or more fields storing raw data related to an event that occurred in an application, wherein a first field and a second field of the set of fields are respectively to store a first raw value that represents user traceable data that can be traced back to an identity or an activity of the user and a second raw value;

determining whether the second field from the set of fields has stored therein the second raw value that represents personal data of a user;

in response to determining that the second field from the set of fields has stored therein the second raw value that represents personal data of a user, encrypting the first raw value to generate a first token using a first symmetric key encryption mechanism based at least in part on a combination of the second raw value that represents personal data of the user and a second token resulting from the tokenization of the second raw value, wherein the first token and the second token are respectively an anonymized representation of the first raw value and the second raw value;

responsive to determining that the second field from the set of fields does not have stored therein the second raw value, encrypting the first raw value to generate the first token using a second symmetric key encryption mechanism based on a cryptographic key associated with a time window after which the cryptographic key is to no longer be valid to detokenize tokens; and

outputting a tokenized log record generated based on the raw log record, the first token, and the second token to be used by one or more log record consumers.

8. The non-transitory machine readable medium of claim 7 , wherein the time window after which the cryptographic key is to no longer be valid to detokenize tokens is shorter than a period of time within which personal data is to be forgotten responsive to a request from the user.

9. The non-transitory machine readable medium of claim 7 , wherein the tokenization of the second raw value includes generation of a one to one mapping between the second raw value and the second token and storage of the one to one mapping, and the operation further comprise:

responsive to receiving a request to forget the personal data of the user, deleting the one to one mapping between the second raw value and the second token so that the first token can no longer be detokenized based on the one to one mapping.

10. The non-transitory machine readable medium of claim 7 , wherein the encrypting of the first raw value to generate the first token using the symmetric key encryption mechanism based at least in part on the combination of the second raw value and the second token resulting from the tokenization of the second raw value includes:

using the combination of the second raw value and the second token as a key of the symmetric key encryption mechanism, wherein the combination is at least one of a concatenation of the second raw value and the second token and a hash of the concatenation of the second raw value and the second token.

11. The non-transitory machine readable medium of claim 7 , wherein the encrypting of the first raw value to generate the first token using the symmetric key encryption mechanism based at least in part on the combination of the second raw value of the second field and the second token resulting from the tokenization of the second raw value includes:

using one of the second raw value and the second token as a key for the symmetric key encryption mechanism; and

using the other one of the second raw value and the second token as an initialization vector of the symmetric key encryption mechanism.

12. The non-transitory machine readable medium of claim 7 , wherein the raw log record was generated responsive to activity of a first of a plurality of organizations assigned different organization identifiers in a multi-tenant system, and wherein the encrypting of the first raw value to generate the first token using the first symmetric key encryption mechanism based at least in part on the combination of the second raw value and the second token is further based on an organization identifier uniquely identifying the first of the plurality of organizations.

13. A system for tokenization of user traceable data for enabling support of a right to be forgotten privacy requirement upon receipt of a request to be forgotten from a user of a system that handles log records resulting from operations of one or more applications used by the user, the system comprising:

one or more processors; and

a non-transitory machine-readable storage medium having stored therein instructions that, when executed by the one or more processors, cause the one or more processors to perform operations comprising:

receiving a raw log record including a set of one or more fields storing raw data related to an event that occurred in an application, wherein a first field and a second field of the set of fields are respectively to store a first raw value that represents user traceable data that can be traced back to an identity or an activity of the user and a second raw value;

determining whether the second field from the set of fields has stored therein the second raw value that represents personal data of a user;

in response to determining that the second field from the set of fields has stored therein the second raw value that represents personal data of a user, encrypting the first raw value to generate a first token using a first symmetric key encryption mechanism based at least in part on a combination of the second raw value that represents personal data of the user and a second token resulting from the tokenization of the second raw value, wherein the first token and the second token are respectively an anonymized representation of the first raw value and the second raw value;

responsive to determining that the second field from the set of fields does not have stored therein the second raw value, encrypting the first raw value to generate the first token using a second symmetric key encryption mechanism based on a cryptographic key associated with a time window after which the cryptographic key is to no longer be valid to detokenize tokens; and

outputting a tokenized log record generated based on the raw log record, the first token, and the second token to be used by one or more log record consumers.

14. The system of claim 13 , wherein the time window after which the cryptographic key is to no longer be valid to detokenize tokens is shorter than a period of time within which personal data is to be forgotten responsive to a request from the user.

15. The system of claim 13 , wherein the tokenization of the second raw value includes generation of a one to one mapping between the second raw value and the second token and storage of the one to one mapping, and wherein the operations further comprise:

responsive to receiving a request to forget the personal data of the user, deleting the one to one mapping between the second raw value and the second token so that the first token can no longer be detokenized based on the one to one mapping.

16. The system of claim 13 , wherein the encrypting of the first raw value to generate the first token using the symmetric key encryption mechanism based at least in part on the combination of the second raw value and the second token resulting from the tokenization of the second raw value includes:

using the combination of the second raw value and the second token as a key of the symmetric key encryption mechanism, wherein the combination is at least one of a concatenation of the second raw value and the second token and a hash of the concatenation of the second raw value and the second token.

17. The system of claim 13 , wherein the encrypting of the first raw value to generate the first token using the symmetric key encryption mechanism based at least in part on the combination of the second raw value of the second field and the second token resulting from the tokenization of the second raw value includes:

using one of the second raw value and the second token as a key for the symmetric key encryption mechanism; and

using the other one of the second raw value and the second token as an initialization vector of the symmetric key encryption mechanism.

18. The system of claim 13 , wherein the raw log record was generated responsive to activity of a first of a plurality of organizations assigned different organization identifiers in a multi-tenant system, and wherein the encrypting of the first raw value to generate the first token using the first symmetric key encryption mechanism based at least in part on the combination of the second raw value and the second token is further based on an organization identifier uniquely identifying the first of the plurality of organizations.