Semantic obfuscation of data in real time
Systems and methods for automatically maintaining the anonymity or privacy of a stream of data as it is transmitted over a network or provided for other use, by receiving a data stream in real-time from an original source and identifying a data subset of interest within the original data stream. The data subset of interest is segregated from the data stream for either obfuscating at least a portion of the data subset in accordance with certain criteria or encrypting it. The data subset is obfuscated or encrypted for purpose of transmission over the network or for testing and reunited at a target source with the remainder of the data stream.
1. A computer-implemented method for automatically maintaining privacy of a stream of data as it is transmitted over a network, the method comprising:
receiving, by at least one of one or more computing devices, an original data stream in real-time from an original source, the original data stream including sensitive and non-sensitive data;
identifying, by at least one of the one or more computing devices, a data subset of interest within the original data stream;
segregating, by at least one of the one or more computing devices, the data subset from the original data stream;
processing, by at least one of the one or more computing devices, the data subset, by obfuscating at least a portion of the data subset in accordance with certain criteria including replacement of a personal name with a random string and randomizing a date; and
reuniting, by at least one of the one or more computing devices, the data subset with obfuscated elements with a remaining portion of the original data stream at a target source.
2. The method of claim 1 , wherein the data of interest is sensitive data.
3. The method of claim 1 , wherein the data of interest is test data for use by a contractor.
4. The method of claim 1 , wherein the data of interest is test data for use by a vendor.
5. The method of claim 1 , wherein the original data stream is a continuous stream of data.
6. The method of claim 1 , wherein the criteria specifies one or more rules for obfuscating the subset of data to maintain anonymity of the subset of data.
7. The method of claim 1 , wherein the subset of data containing obfuscated elements is transmitted from the original source to the target source via an intermediary source.
8. The method of claim 1 , wherein the network is the internet.
9. The method of claim 1 , wherein operations of the method are executed by a platform-independent driver.
10. The method of claim 1 , wherein the original source is at least one of a client device and a database.
11. The method of claim 1 , wherein at least a portion of the subset data or a remaining portion of the original data is encrypted.
12. A non-transitory computer-readable storage medium storing computer-executable program code for automatically maintaining privacy of a stream of data as it is transmitted over a network, the computer-executable program code comprising instructions to:
receive an original data stream in real-time from an original source, the original data stream including sensitive and non-sensitive data;
identify a data subset of interest within the original data stream in real-time as the original data stream is received;
segregate the data subset from the original data stream in real-time as the original data stream is received;
process the data subset, by obfuscating at least a portion of the data subset in accordance with certain criteria including replacement of a personal name with a random string and randomizing a date; and
reunite the data subset with obfuscated elements with a remaining portion of the original data stream at a target source.
13. The computer-readable storage medium of claim 12 , wherein the data of interest is sensitive data.
14. The method of claim 12 , wherein the data of interest is test data for use by a contractor.
15. The method of claim 12 , wherein the data of interest is test data for use by a vendor.
16. The method of claim 12 , wherein the original data stream is a continuous stream of data.
17. The method of claim 12 , wherein the criteria specifies one or more rules for obfuscating the subset of data to maintain anonymity of the subset of data.
18. The method of claim 12 , wherein the subset of data containing obfuscated elements is transmitted from the original source to the target source via an intermediary source.
19. The method of claim 12 , wherein the network is the internet.
20. The method of claim 12 , wherein operations of the method are executed by a platform-independent driver.
21. The method of claim 12 , wherein the original source is at least one of a client device and a database.
22. The method of claim 12 , wherein at least a portion of the subset data or a remaining portion of the original data is encrypted.
23. A system for automatically maintaining privacy of a stream of data as it is transmitted over a network, the system comprising:
a processor; and
memory comprising:
an interface configured to receive an original data stream in real-time from an original source, the original data stream including sensitive and non-sensitive data;
an subset identification module configured to identify a data subset of interest within the original data stream in real-time as the original data stream is received;
a segregation module configured to segregate the data subset from the original data stream in real-time as the original data stream is received;
a data transformation module configured to process the data subset, by obfuscating at least a portion of the data subset in accordance with certain criteria including replacement of a personal name with a random string and randomizing a date; and
a data recreation module for reunite the data subset with obfuscated elements with a remaining portion of the original data stream at a target source.
24. The system of claim 23 , wherein the data of interest is sensitive data.
25. The system of claim 23 , wherein the data of interest is test data for use by a contractor.
26. The system of claim 23 , wherein the data of interest is test data for use by a vendor.
27. The system of claim 23 , wherein the original data stream is a continuous stream of data.
28. The system of claim 23 , wherein the criteria specifies one or more rules for obfuscating the subset of data to maintain anonymity of the subset of data.
29. The system of claim 23 , wherein the subset of data containing obfuscated elements is transmitted from the original source to the target source via an intermediary source.
30. The system of claim 23 , wherein the network is the internet.
31. The system of claim 23 , wherein operations of the method are executed by a platform-independent driver.
32. The system of claim 23 , wherein the original source is at least one of a client device and a database.
33. The system of claim 23 , wherein at least a portion of the subset data or a remaining portion of the original data is encrypted.