Tag mapping process and pluggable framework for generating algorithm ensemble
The example embodiments are directed to a pluggable framework for managing algorithm ensembles for code design. In one example, the method includes receiving a selection of an algorithm from among a plurality of available algorithms, inserting the selected algorithm into an algorithm ensemble including a grouping of algorithms which combine to perform a data processing operation, the inserting comprising linking an input of the selected algorithm to an output of a first algorithm and linking an output of the selected algorithm to an input of a second algorithm, from among the algorithms included in the algorithm ensemble, and executing the algorithm ensemble on input data in an order defined by the linking to generate a processing result of the input data.
1. A computer-implemented method comprising:
receiving a selection of an algorithm from among a plurality of available algorithms;
inserting the selected algorithm into an algorithm ensemble including a grouping of algorithms, the inserting comprising linking an input of the selected algorithm to an output of a first algorithm and linking an output of the selected algorithm to an input of a second algorithm, from among the algorithms included in the algorithm ensemble, wherein each algorithm in the algorithm ensemble is configured to receive a common data frame comprising a set of data records, and a combined functionality performed by the algorithm ensemble comprises mapping a tag in the set of data records within the common data frame to a tag in a master data set; and
executing the algorithm ensemble on input data in an order defined by the linking to map the tag in the set of data records to the tag in the master data set.
2. The computer-implemented method of claim 1 , wherein the plurality of available algorithms are displayed via a user interface, and the receiving the selection comprises detecting a drag-and-drop operation via the user interface in which an identifier of the algorithm is selected and dropped into a workspace of the user interface.
3. The computer-implemented method of claim 1 , wherein each algorithm included in the algorithm ensemble comprises executable code that is configured to receive input data having the common data frame structure and to transmit output data having the common data frame structure.
4. The computer-implemented method of claim 3 , wherein the common data frame structure comprises a data matrix including rows and columns of data records, and metadata associated with the data records.
5. The computer-implemented method of claim 1 , wherein the executing of the algorithm ensemble is performed by a frame manager that is unique to the respective algorithm ensemble, and the frame manager is configured to manage data as it moves between the algorithms included in the algorithm ensemble.
6. The computer-implemented method of claim 1 , further comprising removing an algorithm from the algorithm ensemble and replacing the removed algorithm with another algorithm from among the available algorithms, based on a second selection.
7. The computer-implemented method of claim 6 , wherein the removed algorithm and the replacement algorithm are designed using different programming languages.
8. The computer-implemented method of claim 6 , wherein the replacing of the removed algorithm with the replacement algorithm does not affect a functioning of any other algorithm included in the algorithm ensemble.
9. The computer-implemented method of claim 1 , wherein the executed algorithm ensemble performs a machine learning operation to identify the target data record.
10. A computing system comprising:
a memory; and
a processor configured to execute instructions stored in the memory, wherein, when executed, the instructions cause the processor to:
receive a selection of an algorithm from among a plurality of available algorithms,
insert the selected algorithm into an algorithm ensemble including a grouping of algorithms, the inserting comprising linking an input of the selected algorithm to an output of a first algorithm and linking an output of the selected algorithm to an input of a second algorithm, from among the algorithms included in the algorithm ensemble, wherein each algorithm in the algorithm ensemble is configured to receive a common data frame comprising a set of data records, and a combined functionality performed by the algorithm ensemble comprises mapping a tag in the set of data records within the common data frame to a tag in a master data set, and
execute the algorithm ensemble on input data in an order defined by the linking to map the tag in the set of data records to the tag in the master data set.
11. The computing system of claim 10 , wherein the plurality of available algorithms are displayed via a user interface, and the receiving the selection comprises detecting, by the processor, a drag-and-drop operation via the user interface in which an identifier of the algorithm is selected and dropped into a workspace of the user interface.
12. The computing system of claim 10 , wherein each algorithm included in the algorithm ensemble comprises executable code that is configured to receive input data having the common data frame structure and to transmit output data having the common data frame structure.
13. The computing system of claim 10 , wherein the common data frame structure comprises a data matrix including rows and columns of data records, and metadata associated with the data records.
14. The computing system of claim 10 , wherein the executing of the algorithm ensemble, by the processor, is performed via a frame manager that is unique to the respective algorithm ensemble, and the frame manager is configured to manage data as it moves between the algorithms included in the algorithm ensemble.
15. The computing system of claim 10 , wherein the processor is further configured to remove an algorithm from the algorithm ensemble and replace the removed algorithm with another algorithm from among the available algorithms, based on a second selection.
16. The computing system of claim 15 , wherein the removed algorithm and the replacement algorithm are designed using different programming languages.
17. The computing system of claim 15 , wherein the replacing of the removed algorithm with the replacement algorithm does not affect a functioning of any other algorithm included in the algorithm ensemble.
18. A non-transitory computer readable medium having stored therein instructions that when executed cause a computer to perform a method comprising:
receiving a selection of an algorithm from among a plurality of available algorithms;
inserting the selected algorithm into an algorithm ensemble including a grouping of algorithms, the inserting comprising linking an input of the selected algorithm to an output of a first algorithm and linking an output of the selected algorithm to an input of a second algorithm, from among the algorithms included in the algorithm ensemble, wherein each algorithm in the algorithm ensemble is configured to receive a common data frame comprising a set of data records, and a combined functionality performed by the algorithm ensemble comprises mapping a tag in the set of data records within the common data frame to a tag in a master data set; and
executing the algorithm ensemble on input data in an order defined by the linking to map the tag in the set of data records to the tag in the master data set.
19. The non-transitory computer readable medium of claim 18 , wherein each algorithm included in the algorithm ensemble comprises executable code that is configured to receive input data having the common data frame structure and to transmit output data having the common data frame structure.