Method of processing data
View Patent ↗Data is extracted from multiple diverse sources and copied into an initial staging area in order to be processed. A copy of the data is persisted in non-volatile storage. Quality functions perform checking on the copy and store a checked copy into a clean staging area. New data elements are created by enriching the checked copy. Joins, lookups, aggregations, and delta processing are used to process the data which is then formatted and filtered into a target filtering area making the data load-ready for target applications.
1. A method of deploying process software for processing data, said deployment comprising:
extracting data from sources and copying to an initial staging area;
persisting said copy of data from sources in a non-volatile storage;
performing quality checking using quality functions or components on said copy and storing the quality checked copy in a clean staging area of storage;
enriching the quality checked copy by creating new data elements or new datasets derived therefrom;
processing data in said clean staging area by the functions of joins, lookups, aggregations, or delta processing;
formatting and filtering data from said clean staging area into a target filtering area, thereby making said data load-ready for target applications;
creating target-specific load-ready files;
installing said process software on at least one server;
identifying server addresses for users accessing said process software on said at least one server;
installing a proxy server if needed;
sending said process software to said at least one server via a file transfer protocol, or sending a transaction to said at least one server containing said process software and receiving and copying said process software to said at least one server's file system;
accessing said process software on a user's client computer file system; and
executing said process software by said users.