PRIVACY-PRESERVING FUZZY TOKENIZATION AND ACROSS DISPARATE DATASETS
A device may receive, at a privacy-preserving engine, first sensitive identifiers from a first dataset and second sensitive identifiers from a second dataset. A device may determine, via a fuzzy match algorithm, matches between the first sensitive identifiers and the second sensitive identifiers to yield a fuzzy match determination. A device may generate, via the fuzzy match algorithm, a set of unique identifiers in which each respective record of the first dataset and the second dataset is augmented by a respective unique identifier from the set of unique identifiers. A device may link records across the first dataset and the second dataset based on the respective unique identifier for each respective record.
1 . A method of privatizing private data, the method comprising:
receiving, at a privacy-preserving engine, first sensitive identifiers from a first dataset and second sensitive identifiers from a second dataset;
determining, via a fuzzy match algorithm, matches between the first sensitive identifiers and the second sensitive identifiers to yield a fuzzy match determination;
generating, via the fuzzy match algorithm, a set of unique identifiers in which each respective record of the first dataset and the second dataset is augmented by a respective unique identifier from the set of unique identifiers; and
linking records across the first dataset and the second dataset based on the respective unique identifier for each respective record.
2 . The method of claim 1 , wherein the first sensitive identifiers from the first dataset and the second sensitive identifiers from the second dataset comprise one or more of a name, an address, a phone number, a physical characteristic of a person, an email address, a social media handle, an age.
3 . The method of claim 1 , wherein the fuzzy match determination is computed using an edit distance metric.
4 . The method of claim 3 , wherein the edit distance metric comprises a Jaro-Winkler similarity string metric.
5 . The method of claim 1 , wherein records first dataset and the second dataset with sensitive identifiers that fuzzily match in the fuzzy match determination are augmented with a same unique identifier.
6 . The method of claim 1 , wherein the set of unique identifiers comprises a set of pseudorandom strings.
7 . The method of claim 6 , wherein the respective unique identifier comprises a respective pseudorandom string of the set of pseudorandom strings.
8 . The method of claim 1 , wherein the first dataset is associated with a first device, the second dataset is associated with a second device, and the privacy-preserving engine operates on a third-party independent computing device.
9 . The method of claim 8 , wherein the privacy-preserving engine further brokers an agreement between the first device and the second device to perform computations.
10 . The method of claim 1 , wherein the privacy-preserving engine operates using one of secure multi-party computation or homomorphic encryption.
11 . The method of claim 1 , wherein the fuzzy match algorithm performs according to a distance metric comprising one or more of a Jaro-Winkler metric, a step-wise algorithm, a neural network, a machine learning algorithm or other distance metric algorithm.
12 . The method of claim 1 , wherein the fuzzy match algorithm performs fuzzy matching for pairs or records according to the first sensitive identifiers and the second sensitive identifiers.
13 . The method of claim 1 , wherein after determining, via the fuzzy match algorithm, matches between the first sensitive identifiers and the second sensitive identifiers to yield the fuzzy match determination, the method comprises:
determining whether the fuzzy match determination is transitive.
14 . The method of claim 13 , wherein, while the fuzzy match determination is not transitive, reducing a fuzziness of a matching operation until a non-transitivity state is eliminated.
15 . The method of claim 1 , further comprising:
distributively generating a respective random identifier, as part of the set of unique identifiers, for each transitive equivalence class of records of the fuzzy match determination.
16 . A system for privatizing private data, the system comprising:
one or more processors; and
a computer-readable storage device storing instructions which, when executed by the one or more processors, cause the one or more processors to perform operations comprising:
receiving, at a privacy-preserving engine, first sensitive identifiers from a first dataset and second sensitive identifiers from a second dataset;
determining, via a fuzzy match algorithm, matches between the first sensitive identifiers and the second sensitive identifiers to yield a fuzzy match determination;
generating, via the fuzzy match algorithm, a set of unique identifiers in which each respective record of the first dataset and the second dataset is augmented by a respective unique identifier from the set of unique identifiers; and
linking records across the first dataset and the second dataset based on the respective unique identifier for each respective record.
17 . A method of privatizing private data, the method comprising:
receiving, at a privacy-preserving engine, first sensitive identifiers from a first dataset of a set of primary datasets;
determining, via a fuzzy match algorithm, matches between the first sensitive identifiers and a second sensitive identifiers associated with auxiliary information to yield a fuzzy match determination;
generating, via the fuzzy match algorithm, a set of unique identifiers in which each respective record of the first dataset is augmented by a respective unique identifier from the set of unique identifiers; and
linking records across the first dataset and the auxiliary information based on the respective unique identifier for each respective record.
18 . The method of claim 17 , wherein the fuzzy match algorithm operates one at a time on respective datasets from the set of primary datasets using the auxiliary information.
19 . The method of claim 17 , wherein the auxiliary information comprises a master person index and other data comprising one or more of consumer data and social media data.
20 . The method of claim 17 , wherein the auxiliary information is held by a tokenization entity.
21 . The method of claim 20 , wherein the tokenization entity is distributed cryptographically across several distributed computing devices.
22 . The method of claim 21 , wherein the tokenization entity is distributed cryptographically across several distributed computing devices via use of secure multi-party computation.
23 . A system for privatizing private data, the system comprising:
one or more processors; and
a computer-readable storage device storing instructions which, when executed by the one or more processors, cause the one or more processors to perform operations comprising:
receiving, at a privacy-preserving engine, first sensitive identifiers from a first dataset of a set of primary datasets;
determining, via a fuzzy match algorithm, matches between the first sensitive identifiers and a second sensitive identifiers associated with auxiliary information to yield a fuzzy match determination;
generating, via the fuzzy match algorithm, a set of unique identifiers in which each respective record of the first dataset is augmented by a respective unique identifier from the set of unique identifiers; and
linking records across the first dataset and the auxiliary information based on the respective unique identifier for each respective record.