System and method for network event data streaming and processing via modular network event data architecture

1 . A system for network event data streaming and processing via modular network event data architecture, the system comprising:

a processing device;

a non-transitory storage device containing instructions when executed by the processing device, causes the processing device to perform the steps of:

receiving, at an input module, at least one data stream, each data stream of the at least one data stream comprising a plurality of network event data in real-time;

determining, at the input module, a feature of at least one network event data of the plurality of network event data;

labeling, at the input module, the at least one network event data with a label corresponding with the feature;

retrieving, at the input module, a preconfigured routing path corresponding to the label from a path database, wherein the preconfigured routing path is configurable via a user interface by selecting the first processing module of the plurality of processing modules without writing computer code;

routing, from the input module to a first processing module of a plurality of processing modules determined by the preconfigured routing path, the at least one network event data, wherein the first processing module comprises a microservice engine to implement a predetermined rule based on corresponding rule data from a rules data database, wherein the first processing module is reusable for other preconfigured routing paths, wherein the corresponding rule data from the rules data database is amendable, wherein the microservice engine contains a pointer to the corresponding rule data in the rules data database such that the actual corresponding rule data is external to the first processing module, and wherein upon a condition where the corresponding rule data is amended, any subsequent implementing of the corresponding rule data by the microservice engine implements the amended corresponding rule data without disruption to existing network event data flow;

transforming the network event data in accordance with the predetermined rule, wherein the predetermined rule is selected from the group consisting of an insertion rule, a correlating rule, an enriching rule, a transformation rule, a reconciliation rule, and an API rule; and

routing, from a final processing module of the plurality of processing modules to an output module, as determined by the preconfigured routing path.

2 . The system of claim 1 , wherein the preconfigured routing path arranges the plurality of processing modules in series with one another such that a module output from the first processing module provides a module input to a second processing module.

3 . The system of claim 1 , wherein receiving at least one data stream at an input module comprises receiving at least one data stream of a first type and converting from the first type to a second type, and wherein each of the plurality of processing modules is compatible with the second type.

4 . The system of claim 1 , wherein upon a condition where the at least one network event data is labeled as a priority event with a priority label corresponding with the feature, the first processing module transforms the priority event prior to transforming network event data of other data streams.

5 . The system of claim 1 , wherein upon a condition when transforming the network event data in accordance with the predetermined rule is unsuccessful, the network event data is rerouted through the first processing module a predetermined number of times.

6 . A computer program product for network event data streaming and processing via modular network event data architecture, the computer program product comprising a non-transitory computer-readable medium comprising code causing an apparatus to:

receive, at an input module, at least one data stream, each data stream of the at least one data stream comprising a plurality of network event data in real-time;

determine, at the input module, a feature of at least one network event data of the plurality of network event data;

label, at the input module, the at least one network event data with a label corresponding with the feature;

retrieve, at the input module, a preconfigured routing path corresponding to the label from a path database, wherein the preconfigured routing path is configurable via a user interface by selecting the first processing module of the plurality of processing modules without writing computer code;

route, from the input module to a first processing module of a plurality of processing modules determined by the preconfigured routing path, the at least one network event data, wherein the first processing module comprises a microservice engine to implement a predetermined rule based on corresponding rule data from a rules data database, wherein the first processing module is reusable for other preconfigured routing paths, wherein the corresponding rule data from the rules data database is amendable, wherein the microservice engine contains a pointer to the corresponding rule data in the rules data database such that the actual corresponding rule data is external to the first processing module, and wherein upon a condition where the corresponding rule data is amended, any subsequent implementing of the corresponding rule data by the microservice engine implements the amended corresponding rule data without disruption to existing network event data flow;

transform the network event data in accordance with the predetermined rule, wherein the predetermined rule is selected from the group consisting of an insertion rule, a correlating rule, an enriching rule, a transformation rule, a reconciliation rule, and an API rule; and

route, from a final processing module of the plurality of processing modules to an output module, as determined by the preconfigured routing path.

7 . The computer program product of claim 6 , wherein the preconfigured routing path arranges the plurality of processing modules in series with one another such that a module output from the first processing module provides a module input to a second processing module.

8 . The computer program product of claim 6 , wherein receiving at least one data stream at an input module comprises receiving at least one data stream of a first type and converting from the first type to a second type, and wherein each of the plurality of processing modules is compatible with the second type.

9 . The computer program product of claim 6 , wherein upon a condition where the at least one network event data is labeled as a priority event with a priority label corresponding with the feature, the first processing module transforms the priority event prior to transforming network event data of other data streams.

10 . The computer program product of claim 6 , wherein upon a condition when transforming the network event data in accordance with the predetermined rule is unsuccessful, the network event data is rerouted through the first processing module a predetermined number of times.

11 . A method for network event data streaming and processing via modular network event data architecture, the method comprising:

receiving, at an input module, at least one data stream, each data stream of the at least one data stream comprising a plurality of network event data in real-time;

determining, at the input module, a feature of at least one network event data of the plurality of network event data;

labeling, at the input module, the at least one network event data with a label corresponding with the feature;

retrieving, at the input module, a preconfigured routing path corresponding to the label from a path database, wherein the preconfigured routing path is configurable via a user interface by selecting the first processing module of the plurality of processing modules without writing computer code;

routing, from the input module to a first processing module of a plurality of processing modules determined by the preconfigured routing path, the at least one network event data, wherein the first processing module comprises a microservice engine to implement a predetermined rule based on corresponding rule data from a rules data database, wherein the first processing module is reusable for other preconfigured routing paths, wherein the corresponding rule data from the rules data database is amendable, wherein the microservice engine contains a pointer to the corresponding rule data in the rules data database such that the actual corresponding rule data is external to the first processing module, and wherein upon a condition where the corresponding rule data is amended, any subsequent implementing of the corresponding rule data by the microservice engine implements the amended corresponding rule data without disruption to existing network event data flow;

transforming the network event data in accordance with the predetermined rule, wherein the predetermined rule is selected from the group consisting of an insertion rule, a correlating rule, an enriching rule, a transformation rule, a reconciliation rule, and an API rule; and

routing, from a final processing module of the plurality of processing modules to an output module, as determined by the preconfigured routing path.

12 . The method of claim 11 , wherein the preconfigured routing path arranges the plurality of processing modules in series with one another such that a module output from the first processing module provides a module input to a second processing module.

13 . The method of claim 11 , wherein receiving at least one data stream at an input module comprises receiving at least one data stream of a first type and converting from the first type to a second type, and wherein each of the plurality of processing modules is compatible with the second type.

14 . The method of claim 11 , wherein upon a condition where the at least one network event data is labeled as a priority event with a priority label corresponding with the feature, the first processing module transforms the priority event prior to transforming network event data of other data streams.

15 . The method of claim 11 , wherein upon a condition when transforming the network event data in accordance with the predetermined rule is unsuccessful, the network event data is rerouted through the first processing module a predetermined number of times.