Systems and methods for rapid processing of file data
The technique relates to a system and method for selecting dynamic workflow to process file data. This technique facilitates to process file data and business rules simultaneously and thus saves a lot of time. The technique involves receiving a request from File Pattern Recognition Engine (FPRE) to select rules for processing file data by Data Rule Engine (DRE) and to select business rules to be applied on the data by the Business Metrics Engine (BME). After that, DRE and BME select the possible set of rules and send the acknowledgement to FPRE. Thereafter, FPRE sends the signal to proceed to DRE and BME, and after receiving the signal DRE and BME apply at least one of the possible set of rules selected earlier.
1. A computer implemented method for selecting dynamic workflow to process file data, comprising:
receiving, by at least one computing device, a request from a file pattern recognition engine for dynamic workflow selection for a file, wherein the request is accompanied with one or more file details;
selecting, by the at least one computing device, dynamic workflow for the file in response to the request based on the one or more received file details, wherein the selection comprises fetching simultaneously one or more possible set of business rules and possible set of file level rules associated with the file from one or more pre-cached rules stored in a repository;
sending, by the at least one computing device, an acknowledgement of the dynamic workflow selection to the file pattern recognition engine;
in response to the acknowledgement, receiving, by the at least one computing device, a signal from the file pattern recognition engine to apply at least one of the one or more possible set of business rules and file level rules; and
applying, by the at least one computing device, the at least one of the one or more possible set of business rules and file level rules on the said file.
2. The method as claimed in claim 1 , wherein the file is scanned by an omni channel file scanner before receiving the request for the dynamic workflow selection.
3. The method as claimed in claim 1 , wherein the file pattern recognition engine identifies a partner subscribed for the said file.
4. The method as claimed in claim 1 , wherein the file pattern recognition engine identifies one or more preferences of the partner with respect to the processing of the file data.
5. The method as claimed in claim 1 , wherein the file pattern recognition engine removes one or more duplicate files.
6. The method as claimed in claim 1 , wherein the file pattern recognition engine determines the applicability of the one or more possible set of business rules and possible set of file level rules based on one or more predefined preferences of a partner subscribed for the file.
7. The method as claimed in claim 1 , wherein the application of the at least one of the one or more possible set of file level rules comprises:
breaking the file data into a plurality of records;
distributing the plurality of records to a plurality of worker nodes for processing record level data, wherein the processing involves record level rule application;
receiving the processed record level data from the plurality of worker nodes; and
combining the processed record level data received from the plurality of worker nodes to get a desired output.
8. A system for selecting dynamic workflow to process file data, comprising:
a processor in operable communication with a processor readable storage medium, the processor readable storage medium containing one or more programming instructions whereby the processor is configured to implement:
a dynamic workflow selection request receiver, wherein the dynamic workflow selection request receiver receives a request from a file pattern recognition engine for dynamic workflow selection for a file, wherein the request is accompanied with one or more file details;
a dynamic workflow selector, wherein the dynamic workflow selector selects dynamic workflow for the file in response to the request based on the one or more received file details, wherein the selection comprises fetching simultaneously one or more possible set of business rules and possible set of file level rules associated with the file from one or more pre-cached rules stored in a repository;
an acknowledgement sender, wherein the acknowledgement sender sends an acknowledgement of the dynamic workflow selection to the file pattern recognition engine;
a signal receiver, wherein the signal receiver receives a signal from the file pattern recognition engine in response to the acknowledgement to apply at least one of the one or more possible set of business rules and file level rules; and
a rule application component, wherein the rule application component applies the at least one of the one or more possible set of business rules and file level rules on the said file.
9. The system as claimed in claim 8 further comprises an omni channel file scanner, wherein the omni channel file scanner scans the file before receiving the request for the dynamic workflow selection.
10. The system as claimed in claim 8 , wherein the file pattern recognition engine identifies a partner subscribed for the said file.
11. The system as claimed in claim 8 , wherein the file pattern recognition engine identifies one or more preferences of the partner with respect to the processing of the file data.
12. The system as claimed in claim 8 , wherein the file pattern recognition engine removes one or more duplicate files.
13. The system as claimed in claim 8 , wherein the file pattern recognition engine determines the applicability of the one or more possible set of business rules and possible set of file level rules based on one or more predefined preferences of a partner subscribed for the file.
14. The system as claimed in claim 8 , wherein the dynamic workflow selector comprises a data rule engine and a business metrics engine.
15. The system as claimed in claim 8 , wherein the at least one of the one or more possible set of file level rules application component further comprises:
a file data breaking component configured to break the file data into a plurality of records;
a records distribution component configured to distribute the plurality of records to a plurality of worker nodes for processing record level data, wherein the processing involves record level rule application;
a record level data receiving component configured to receive the processed record level data from the plurality of worker nodes; and
a data combination component configured to combine the processed record level data received from the plurality of worker nodes to get a desired output.
16. A non-transitory computer readable medium having stored thereon instructions for selecting dynamic workflow to process file data, comprising machine executable code which when executed by at least one processor, causes the at least one processor to perform steps comprising:
receiving a request from a file pattern recognition engine for dynamic workflow selection for a file, wherein the request is accompanied with one or more file details;
selecting dynamic workflow for the file in response to the request based on the one or more received file details, wherein the selection comprises fetching simultaneously one or more possible set of business rules and possible set of file level rules associated with the file from one or more pre-cached rules stored in a repository;
sending an acknowledgement of the dynamic workflow selection to the file pattern recognition engine;
in response to the acknowledgement, receiving a signal from the file pattern recognition engine to apply at least one of the one or more possible set of business rules and file level rules; and
applying the at least one of the one or more possible set of business rules and file level rules on the said file.