Systems and methods for dataset selection optimization in a zero-trust computing environment
Systems and methods for the selection, verification and recommendation of cohort sample sets is provided. In some embodiments, a dataset selection optimization includes first receiving at data stewards classes of data required by the data consumer. The data stewards process their data (or a subset of their data) into a vector set within a sequestered computing node. These vector sets are transferred to a core management system for minimizing a difference between a target vector and any combination of the data stewards' vector sets. A cost function may also be applied to the vector sets during this optimization. Once the data steward(s) that best match the target vector are identified, they may be placed in contact with the data consumer for access of their information.
1 . A computerized method for dataset selection optimization, the method comprising:
receiving at a plurality of data stewards a set of classes required by a data consumer, wherein each data steward has a dataset;
at each data steward, processing their respective dataset to generate a vector set responsive to the set of classes;
homomorphically encrypting a target vector set and the vector sets;
transmitting the encrypted vector set from each data steward to a central system; and
minimizing the difference between the target vector set and any given combination of the vector sets from the data stewards without decrypting the vector sets or the target vector set by subtracting the combination vector set from the target vector while applying a cost function to each vector set based upon a financial cost of the dataset.
2 . The method of claim 1 , wherein the processing occurs within a sequestered computing node, wherein the sequestered computing node preserves privacy of data assets and the set of required classes.
3 . The method of claim 1 , wherein the cost function is for one of number of data stewards, geography of the datasets, and data set quality.
4 . The method of claim 1 , wherein the minimizing is according to the equation of: Goal=minimize∥T{target}−T(Union({data steward}))∥.
5 . The method of claim 1 , further comprising selecting the datasets that minimize the difference.
6 . The method of claim 5 , further comprising facilitating contact between the data stewards associated with the selected datasets and the data consumer.
7 . The method of claim 6 , wherein the facilitating is acting as a broker.
8 . The method of claim 1 , wherein the data consumer is at least one of a clinical trial administrator, a researcher, a clinician, and a public health official.
9 . The method of claim 1 , wherein the generating the vector set includes:
encoding the dataset according to the set of classes;
generating a matrix of the encoded dataset, wherein each row of the matrix is a patient and each column is a class or subset of classes in the set of classes; and
converting the generated matrix into a series of vector spaces.
10 . The zero-trust computing system configured for data set selection optimization, the system comprising:
a plurality of data stewards configured to receive a set of classes required by a data consumer, wherein each data steward has a dataset, and wherein each data steward is configured to process its respective dataset a vector set responsive to the set of classes, and homomorphically encrypting the vector sets;
a first processor for homomorphically encrypting a target vector set; and
at least one central processing unit configured to receive the vector set from each data steward, and wherein the at least one central processing unit is further configured to minimize the difference between the target vector set and any given combination of the respective vector sets from the plurality of data stewards without decrypting the vector sets or the target vector set by subtracting the combination vector set from the target vector while applying a cost function to each vector set based upon a financial cost of the dataset.
11 . The system of claim 10 , wherein the processing at each data steward occurs within a sequestered computing node, wherein the sequestered computing node preserves privacy of data assets and the set of required classes.
12 . The system of claim 10 , wherein the at least one central processing unit is further configured to apply a cost function to the minimizing calculation.
13 . The system of claim 12 , wherein the cost function is for one of number of data stewards, geography of the datasets, financial cost of the datasets, and data set quality.
14 . The system of claim 10 , wherein the minimizing is according to the equation of: Goal=minimize∥T{target}−T(Union({data steward}))∥.
15 . The system of claim 10 , wherein the at least one central processing unit is configured to select the datasets that minimize the difference.
16 . The system of claim 15 , wherein the at least one central processing unit is further configured to facilitate contact between the data stewards associated with the selected datasets and the data consumer.
17 . The system of claim 16 , wherein the facilitating is acting as a broker.
18 . The system of claim 10 , wherein the data consumer is at least one of a clinical trial administrator, a researcher, a clinician, and a public health official.
19 . The system of claim 10 , wherein the generating the vector set includes:
encoding the dataset according to the set of classes;
generating a matrix of the encoded dataset, wherein each row of the matrix is a patient and each column is a class or subset of classes in the set of classes; and
converting the generated matrix into a series of vector spaces.