Tokenization for big data
The present disclosure is directed to systems, methods, and non-transitory computer-readable media including generating a token using an electronic file, the electronic file having a title and a content, and the token including a title hash based on the title of the electronic file and a file hash based on the content of the file and verifying the token based on at least one of the title hash, the file hash, and the signature.
1 . A method, comprising:
generating a token using an electronic file, the electronic file having a title and a content, and the token comprising a title hash based on the title of the electronic file and a file hash based on the content of the electronic file, wherein a signature is generated over at least the title hash and the file hash; and
verifying the token based on the title hash, the file hash, and the signature, comprising:
verifying the signature;
in response to verifying the signature:
checking the title hash in the token against a hash on the title of the electronic file; and
checking the file hash in the token against a hash on the content of the electronic file.
2 . The method of claim 1 , wherein the content of the electronic file comprises printable character strings and non-printable character data.
3 . The method of claim 1 , comprising generating a title for the token based on the title of the electronic file, the title identifies the token.
4 . The method of claim 3 , wherein the title is generated by adding at least one of a prefix or suffix to the title of the electronic file.
5 . The method of claim 1 , wherein the token comprises a cryptographic signature, the cryptographic signature comprising at least one of a digital signature, Message Authentication Code (MAC), or Keyed Hashed Message Authentication Code (HMAC).
6 . The method of claim 1 , wherein the token comprises a timestamp indicating a time by which token is generated.
7 . The method of claim 1 , comprising generating the title hash using the title of the electronic file, generating the title hash comprising running the title of the electronic file through a hashing function.
8 . The method of claim 7 , wherein the hashing function comprises SHA-256 or SHA-512.
9 . The method of claim 1 , comprising generating the file hash using the content of the electronic file, generating the file hash comprising running binary strings corresponding to the content of the electronic file through a hashing function.
10 . The method of claim 9 , wherein the hashing function comprises SHA-256 or SHA-512.
11 . The method of claim 1 , wherein
the content comprises at least one field;
the token comprises at least one field object generated using data contained in the at least one field.
12 . The method of claim 11 , wherein
the at least one field object comprises at least one of hashed information generated using the data contained in the at least one field or tokenized information generated using the data contained in the at least one field.
13 . The method of claim 12 , comprising generating the hashed information by running the data contained in the at least one field through a hash function.
14 . The method of claim 12 , comprising generating the tokenized information by running the data contained in the at least one field through a tokenization function.
15 . The method of claim 1 , wherein
the electronic file comprises a folder or a compressed file; and
the content comprises a plurality of electronic files.
16 . The method of claim 1 , comprising wrapping the token in a Time Trusted Stamp.
17 . A non-transitory computer-readable medium comprising computer-readable instructions, such that, when executed, causes a processor to:
generate a token using an electronic file, the electronic file having a title and a content, and the token comprising a title hash based on the title of the electronic file and a file hash based on the content of the electronic file, wherein a signature is generated over at least the title hash and the file hash; and
verify the token based on the title hash, the file hash, and the signature, comprising:
verifying the signature;
in response to verifying the signature:
checking the title hash in the token against a hash on the title of the electronic file; and
checking the file hash in the token against a hash on the content of the electronic file.
18 . The non-transitory computer-readable medium of claim 17 , wherein
the token comprises a timestamp indicating a time by which token is generated;
the token comprises a cryptographic signature, the cryptographic signature comprising at least one of a digital signature, Message Authentication Code (MAC), or Keyed Hashed Message Authentication Code (HMAC); and
the token has a title based on the title of the electronic file, the title identifies the token.
19 . A system, comprising:
a memory; and
a processor configured to:
generate a token using an electronic file, the electronic file having a title and a content, and the token comprising a title hash based on the title of the electronic file and a file hash based on the content of the electronic file, wherein a signature is generated over at least the title hash and the file hash; and
verify the token based on the title hash, the file hash, and the signature, comprising:
verifying the signature;
in response to verifying the signature:
checking the title hash in the token against a hash on the title of the electronic file; and
checking the file hash in the token against a hash on the content of the electronic file.
20 . The system of claim 19 , wherein
the token comprises a timestamp indicating a time by which token is generated;
the token comprises a cryptographic signature, the cryptographic signature comprising at least one of a digital signature, Message Authentication Code (MAC), or Keyed Hashed Message Authentication Code (HMAC); and
the token has a title based on the title of the electronic file, the title identifies the token.