Systems and methods for classifying data sets using corresponding neural networks
The present disclosure relates to systems and methods for classifying data sets using associated functions from neural networks. In one example, a system for classifying data sets by corresponding functions includes at least one processor and at least one non-transitory memory storing instructions that, when executed by the at least one processor cause the system to perform operations including: obtaining a neural network associated with a data set, the neural network being trained to generate synthetic data sets related to the data set; selecting a test set of inputs to the neural network; obtaining a corresponding set of outputs by applying the neural network to the test set of inputs; estimating one or more functions describing the test set of inputs and the corresponding set of outputs; and indexing the estimated one or more functions to the data.
1. A system for classifying data sets by corresponding functions, the system comprising:
at least one processor; and
at least one non-transitory memory storing instructions that, when executed by the at least one processor, cause the system to perform operations comprising:
obtaining a neural network trained to generate synthetic data sets having at least one characteristic of a first data set;
selecting a test set of inputs for the neural network;
obtaining, by applying the neural network to the test set of inputs, a corresponding set of synthetic data;
estimating at least one function modeling the correspondence of one or more features of the test set of inputs to the set of synthetic data; and
indexing the estimated at least one function to the first data set.
2. The system of claim 1 , wherein estimating the at least one function comprises assessing commonality of features across the test set of inputs and the corresponding set of outputs and identifying one or more features in the test set of inputs that are more likely to be explanatory of the corresponding set of outputs.
3. The system of claim 1 , wherein estimating the at least one function comprises comparing a distance between the test set of inputs and a calculated function.
4. The system of claim 1 , wherein estimating the at least one function comprises analyzing a commonality between the test set of inputs and the corresponding set of outputs.
5. The system of claim 1 , wherein the operations further comprise storing the indexed at least one function and data sets in a function index.
6. The system of claim 5 , wherein the operations further comprise generating a relational mapping for searching a received data set based on the estimated at least one function.
7. The system of claim 5 , wherein the operations further comprise:
receiving, from an interface, a search query, the search query comprising an example data set, one or more statistical measures, or other structural descriptions of a desired data set;
searching the function index based on the search query; and
returning, based on the search, indexed data sets matching the search query.
8. A computer-implemented method for classifying data sets by corresponding functions, the computer-implemented method comprising:
obtaining a neural network trained to generate synthetic data sets having at least one characteristic of a first data set;
selecting a test set of inputs for the neural network;
obtaining, by applying the neural network to the test set of inputs, a corresponding set of synthetic data;
estimating at least one function modeling the correspondence of one or more features of the test set of inputs to the set of synthetic data; and
indexing the estimated at least one function to the first data set.
9. The method of claim 8 , wherein estimating the at least one function comprises comparing a distance between the test set of inputs and a calculated function.
10. The method of claim 9 , wherein estimating the at least one function further comprises utilizing a greedy algorithm to extract the one or more features in a particular order.
11. The method of claim 8 , wherein indexing the estimated at least one function further comprises generating a relational index.
12. The method of claim 8 , wherein indexing the estimated at least one function further comprises generating a graphical index.
13. The method of claim 8 , further comprising clustering the indexed first data set with other indexed data sets using the at least one function, the clustering comprising at least one of a hierarchical clustering, a centroid-based clustering, a distribution-based clustering, or a density-based clustering.
14. The method of claim 8 , wherein the neural network comprises at least one of a convolutional neural network, a recurrent neural network, an auto-encoder, a variational auto-encoder, or a generative adversarial network.
15. A system for classifying data sets by corresponding functions, the system comprising:
at least one processor; and
at least one non-transitory memory storing instructions that, when executed by the at least one processor, cause the system to perform operations comprising:
obtaining a neural network trained to generate synthetic data sets having at least one characteristic of a first data set;
selecting a test set of inputs for the neural network;
obtaining, by applying the neural network to the test set of inputs, a corresponding set of synthetic data;
estimating at least one function modeling the correspondence of one or more features of the test set of inputs to the set of synthetic data; and
indexing the estimated at least one function to the first data set.
16. The system of claim 15 , wherein training the neural network comprises adjusting activation functions of the neural network to reduce an associated loss function.
17. The system of claim 15 , wherein the operations further comprise:
receiving a search query indicating at least one search query function;
searching, based on the search query, a function index including the first data set; and
returning, based on the search, the first data set.
18. The system of claim 15 , wherein the operations further comprise:
identifying one or more activation functions within a node of a branch of a neural network triggered by the one or more features; and
mapping the one or more features to a branch of the neural network.
19. The system of claim 17 , wherein searching the function index based on the search query comprises:
clustering one or more functions of the function index to form a plurality of function clusters; and
matching the search query function to a first cluster of the plurality of function clusters.
20. The system of claim 19 , wherein matching the search query function to a first cluster comprises:
generating a score for the first cluster indicating a degree of belongingness of the search query function to the first cluster; and
determining that the score exceeds a predetermined threshold.