Data tokenization system maintaining data integrity
A system to tokenize values may include a processing unit; a storage device comprising instructions, which when executed by the processing unit, configure the processing unit to: receive a data item with an original value from a first storage system; store the data item in a staging table; transform the original value of the data item in the staging table to a changed value based on a stored rule; store a mapping between the original value and the changed value in a library table; and transmit the library table to a second storage system configured to update a database table at the second storage system based on the library table.
1. A system to tokenize values, the system comprising:
a processing unit;
a storage device comprising instructions, which when executed by the processing unit, configure the processing unit to perform operations comprising:
receiving a data item with an original value from a first storage system;
storing the data item in a staging table;
transforming the original value of the data item in the staging table to a changed value based on a stored rule;
storing a mapping between the original value and the changed value in a library table;
transmitting the library table to a second storage system;
receiving a request to re-initialize the library table; and
based on the request:
transforming the original value of the data item in the staging table to a third value, and
storing a mapping between the original value and the third value in the library table.
2. The system of claim 1 , wherein transforming the original value of the data item in the staging table to the changed value further comprises performing a one-way transformation from the original value to the changed value.
3. The system of claim 1 , wherein transforming the original value of the data item in the staging table further comprises:
selecting a data subject table based on a type of the original value; and
randomly selecting a value from the data subject table as the changed value.
4. The system of claim 1 , wherein the transforming comprises determining the original value is an address and determining the changed value to maintain a tax jurisdiction compatibility with the original value.
5. The system of claim 1 , wherein the transforming comprises determining the original value is an address and determining the changed value to preserve a state or country of the address.
6. The system of claim 1 , wherein the transforming comprises determining the original value is a hank account and determining the changed value to be a number compliant with a bank account number compatibility standard.
7. The system of claim 1 , wherein the second storage system is accessible to a non-production system to validate a production system the production system having access to the first storage system.
8. A computer-readable storage device comprising instructions, which when executed by a processing unit, configure the processing unit to perform operations comprising:
receiving a data item with an original value from a first storage system;
storing the data item in a staging table;
transforming the original value of the data item in the staging table to a changed value based on a stored rule;
storing a mapping between the original value and the changed value in a library table;
transmitting the library table to a second storage system;
receiving a request to re-initialize the library table; and
based on the request:
transforming the original value of the data item in the staging table to a third value, and
storing a mapping between the original value and the third value in the library table.
9. The storage device of claim 8 , wherein transforming the original value of the data item in the staging table further comprises performing a one-way transformation from the original value to the changed value.
10. The storage device of claim 8 , wherein transforming the original value of the data item in the staging table further comprises:
selecting a data subject table based on a type of the original value; and
randomly selecting a value from the data subject table as the changed value.
11. The storage device of claim 8 , wherein the transforming comprises determining the original value is an address and determining the changed value to maintain a tax jurisdiction compatibility with the original value.
12. The storage device of claim 8 , wherein the transforming comprises determining the original value is an address and determining the changed value to preserve a state or country of the address.
13. The storage device of claim 8 , wherein the transforming comprises determining the original value is a bank account and determining the changed value to be a number compliant with a bank account number compatibility standard.
14. The storage device of claim 8 , wherein the second storage system is accessible to a non-production system to validate a production system the production system having access to the first storage system.
15. A method comprising:
receiving, at a tokenization server, a data item with an original value from a first storage system;
storing, at the tokenization server, the data item in a staging table;
transforming, at the tokenization server, the original value of the data item in the staging table to a changed value based on a stored rule;
storing, at the tokenization server, a mapping between the original value and the changed value in a library table; and
transmitting, from the tokenization server, the library table to a second storage system receiving a request to re-initialize the library table; and
based on the request:
transforming the original value of the data item in the staging table to a third value, and
storing a mapping between the original value and the third value in the library table.
16. The method of claim 15 , wherein transforming the original value of the data item in the staging table to the changed value based on the stored rule includes performing a one-way transformation from the original value to the changed value.
17. The method of claim 15 , wherein transforming the original value of the data item in the staging table to the changed value based on the stored rule includes:
selecting a data subject table based on a type of the original value; and
randomly selecting a value from the data subject table as the changed value.
18. The method of claim 15 , wherein the transforming comprises determining the original value is an address and determining the changed value to preserve a state or country of the address.
19. The method of claim 15 , wherein the transforming comprises determining the original value is a bank account and determining the changed value to be a number compliant with a bank account number compatibility standard.
20. The method of claim 15 , wherein the second storage system is accessible to a non-production system to validate a production system, the production system having access to the first storage system.