Systems and methods for data mart rationalization
Disclosed herein are embodiments of systems, methods, and products comprises an analytic server for data rationalization and migration. The server receives data from a plurality of electronic data sources and stores the received data into a database within a central hub. The server demobilizes the data and performs enhancement on the data to prepare the data for complex calculation. The server copies the enhanced data to an operational data store, performs various calculation functions that filer, rationalize the data, and create data linkage. The server copies back the calculation result to the database for further processing and downstream consumption. The calculation results provide a consolidated view of data from different source systems and satisfy the reporting needs for different consumers. The server uses common data model to generate reports for different consumers. After the data migration and consolidation into a central hub, the server decommissions legacy components.
1 . A method comprising:
executing, by a server, a data enhancement protocol on data received from a plurality of electronic data sources having a plurality of legacy components, to generate enhanced data by tagging the received data with metadata corresponding to a source of origin and a timestamp of the received data, wherein each electronic data source is configured to generate calculation results based on data corresponding to that electronic data source using a legacy component of the plurality of legacy components, wherein the data includes a first set of data received from a first electronic data source of the plurality of electronic data sources has a first data format that is inconsistent with a second data format of a second set of data received from a second electronic data source of the plurality of electronic data sources, wherein the first set of data and the second set of data are tagged with a plurality of attributes corresponding to a database;
replicating, by the server, the enhanced data into the database;
executing, by the server, a basel application configured to perform a set of calculation functions on the enhanced data to generate risk parameters of calculation results by removing duplicated information, performing a netting allocation protocol, and creating at least one data linkage by associating relevant information within the enhanced data, the set of calculation functions comprises a key cutting protocol, the risk parameters comprising at least one of a probability of a default, loss given the default, or exposure at the default;
replicating, by the server, the calculation results into the database;
consolidating, by the server via the database using the replicated calculation results, the data received from each data source of the plurality of data sources into a third data format that is consistent with the first data format and the second data format; and
decommissioning, by the server, each legacy component corresponding to each electronic data source.
2 . The method of claim 1 , further comprising:
generating, by the server, an electronic report using a common data model based on calculation results in the database, wherein the common data model comprises a collection of data schemas representing commonly used concepts.
3 . The method of claim 1 , further comprising:
decommissioning, by the server, the application for performing the set of calculation functions.
4 . The method of claim 1 , further comprising:
rewriting, by the server, one or more extraction scripts according to extraction operation for generating an electronic report.
5 . The method of claim 1 , further comprising:
storing, by the server, the received data as a first level in the database; and
executing, by the server, the data enhancement protocol on the received data by upgrading the received data from the first level to a second level.
6 . The method of claim 1 , wherein the set of calculation functions further comprises transit mapping and the netting allocation protocol.
7 . A system comprising:
a database;
a server having a processor in communication with the database, the server configured to:
execute a data enhancement protocol on data received from a plurality of electronic data sources having a plurality of legacy components, to generate enhanced data by tagging the received data with metadata corresponding to a source of origin and timestamp of the received data, wherein each electronic data source is configured to generate calculation results based on data corresponding to that electronic data source using a legacy component of the plurality of legacy components, wherein a first set of data received from a first electronic data source of the plurality of electronic data sources has a first data format that is inconsistent with a second data format of a second set of data received from a second electronic data source of the plurality of electronic data sources, wherein the first set of data and the second set of data are tagged with a plurality of attributes corresponding to a database;
replicate the enhanced data into the database;
execute a basel application configured to perform a set of calculation functions on the enhanced data to generate risk parameters of calculation results by removing duplicated information, performing a netting allocation protocol, and creating at least one data linkage by associating relevant information within the enhanced data, the set of calculation functions comprises a key cutting protocol, the risk parameters comprising at least one of a probability of a default, loss given the default, or exposure at the default;
replicate the calculation results into the database;
consolidate, via the database using the replicated calculation results, the data received from each data source of the plurality of data sources into a third data format that is consistent with the first data format and the second data format; and
decommission each legacy component corresponding to each electronic data source.
8 . The system of claim 7 , wherein the server is further configured to:
generate an electronic report using a common data model based on calculation results in the database, wherein the common data model comprises a collection of data schemas representing commonly used concepts.
9 . The system of claim 7 , wherein the server is further configured to:
decommission the application for performing the set of calculation functions.
10 . The system of claim 7 , wherein the server is further configured to:
rewrite one or more extraction scripts according to extraction operation for generating an electronic report.
11 . The system of claim 7 , wherein the server is further configured to:
store the received data as a first level in the database; and
execute the data enhancement protocol on the received data by upgrading the received data from the first level to a second level.
12 . The system of claim 7 , wherein the set of calculation functions further comprises transit mapping and the netting allocation protocol.
13 . A system comprising:
a non-transitory computer readable medium having a set of instructions that when executed by a processor, cause the processor to:
execute a data enhancement protocol on data received from a plurality of electronic data sources having a plurality of legacy components, to generate enhanced data by tagging the received data with metadata corresponding to a source of origin and timestamp of the received data, wherein each electronic data source is configured to generate calculation results based on data corresponding to that electronic data source using a legacy component of the plurality of legacy components, wherein a first set of data received from a first electronic data source of the plurality of electronic data sources has a first data format that is inconsistent with a second data format of a second set of data received from a second electronic data source of the plurality of electronic data sources, wherein the first set of data and the second set of data are tagged with a plurality of attributes corresponding to a database;
replicating, by a server, the enhanced data into the database;
executing, by the server, a basel application configured to perform a set of calculation functions on the enhanced data to generate risk parameters of calculation results by removing duplicated information, performing a netting allocation protocol, and creating at least one data linkage by associating relevant information within the enhanced data, the set of calculation functions comprises protocol, the risk parameters comprising at least one of a probability of a default, loss given the default, or exposure at the default;
replicate the calculation results into the database;
consolidate, via the database using the replicated calculation results, the data received from each data source of the plurality of data sources into a third data format that is consistent with the first data format and the second data format; and
decommission each legacy component corresponding to each electronic data source.
14 . The system of claim 13 , wherein the server is further configured to:
generate an electronic report using a common data model based on calculation results in the database, wherein the common data model comprises a collection of data schemas representing commonly used concepts.
15 . The system of claim 13 , wherein the server is further configured to:
decommission the application for performing the set of calculation functions.
16 . The system of claim 13 , wherein the server is further configured to:
rewrite one or more extraction scripts according to extraction operation for generating an electronic report.
17 . The system of claim 13 , wherein the server is further configured to:
store the received data as a first level in the database; and
execute the data enhancement protocol on the received data by upgrading the received data from the first level to a second level.
18 . The system of claim 13 , wherein the set of calculation functions further comprises transit mapping and the netting allocation protocol.