Systems and methods for automated data integration

1. A data integration system for integrating data from multiple sources using configuration based metadata, comprising:

a source database;

a target database;

a configuration database;

a data integration server comprising a processor and a memory, said data integration server in communication with said source database, said target database, and said configuration database, said processor configured to:

receive a library of object definitions defining relationships between a set of data elements and a set of data relationships in the source database;

receive a collection of configuration data from the configuration database including information for mapping the source database to the target database;

apply a metadata module to the collection of configuration data to generate a set of metadata information;

apply the set of metadata information and the library of object definitions to a code generation module to generate data integration code; and

execute the data integration code to integrate a set of information from the source database in the target database.

2. The data integration system of claim 1 , wherein said processor is further configured to:

receive the collection of configuration data further including process information and filter information; and

apply the metadata module to the collection of configuration data to generate the set of metadata information.

3. The data integration system of claim 1 , wherein said processor is further configured to:

receive the library of object definitions defining relationships between a set of data elements and a set of data relationships in the source database, wherein the library includes object definitions for at least one of datasets, dataset attributes, dataset tables, and dataset relationships.

4. The data integration system of claim 1 , wherein said processor is further configured to:

receive a current version of at least one of the library of objection definitions, the collection of configuration data, and the set of metadata information;

process the current version to determine whether at least one of the library of objection definitions, the collection of configuration data, and the set of metadata information have changed; and

generate a revision to the data integration code upon determining that at least one of the library of objection definitions, the collection of configuration data, and the set of metadata information have changed.

5. The data integration system of claim 1 , wherein said processor is further configured to:

generate the data integration code with modular code logic for a plurality of stages including an integration stage, an update stage, and an archive stage.

6. The data integration system of claim 1 , wherein said processor is further configured to:

generate the data integration code such that the data integration code is decomposable into single insert operations or multi-step operations.

7. The data integration system of claim 1 , wherein said processor is further configured to:

receive the collection of configuration data including the information for mapping the source database to the target database and further including transformation rules, default values, business keys, and column sequences; and

apply the metadata module to the collection of configuration data to generate the set of metadata information.

8. A data integration server for integrating data from multiple sources using configuration based metadata comprising a processor and a memory, said data integration server in communication with a source database, a target database, and a configuration database, said processor configured to:

receive a library of object definitions defining relationships between a set of data elements and a set of data relationships in the source database;

receive a collection of configuration data including information for mapping the source database to the target database;

apply a metadata module to the collection of configuration data from the configuration database to generate a set of metadata information;

apply the set of metadata information and the library of object definitions to a code generation module to generate data integration code; and

execute the data integration code to integrate a set of information from the source database in the target database.

9. The data integration server of claim 8 , wherein the processor is further configured to:

receive the collection of configuration data further including process information and filter information; and

apply the metadata module to the collection of configuration data to generate the set of metadata information.

10. The data integration server of claim 8 , wherein the processor is further configured to:

receive the library of object definitions defining relationships between a set of data elements and a set of data relationships in the source database, wherein the library includes object definitions for at least one of datasets, dataset attributes, dataset tables, and dataset relationships.

11. The data integration server of claim 8 , wherein the processor is further configured to:

receive a current version of at least one of the library of objection definitions, the collection of configuration data, and the set of metadata information;

process the current version to determine whether at least one of the library of objection definitions, the collection of configuration data, and the set of metadata information have changed; and

generate a revision to the data integration code upon determining that at least one of the library of objection definitions, the collection of configuration data, and the set of metadata information have changed.

12. The data integration server of claim 8 , wherein the processor is further configured to:

generate the data integration code with modular code logic for a plurality of stages including an integration stage, an update stage, and an archive stage.

13. The data integration server of claim 8 , wherein the processor is further configured to:

generate the data integration code such that the data integration code is decomposable into single insert operations or multi-step operations.

14. The data integration server of claim 8 , wherein the processor is further configured to:

receive the collection of configuration data including the information for mapping the source database to the target database and further including transformation rules, default values, business keys, and column sequences; and

apply the metadata module to the collection of configuration data to generate the set of metadata information.

15. A method for integrating data from multiple sources using configuration based metadata implemented by a data integration server, the data integration server including a processor and a memory, the data integration server in communication with a source database, a target database, and a configuration database, said method comprising:

receiving a library of object definitions defining relationships between a set of data elements and a set of data relationships in the source database;

receiving a collection of configuration data including information for mapping the source database to the target database;

applying a metadata module to the collection of configuration data from the configuration database to generate a set of metadata information;

applying the set of metadata information and the library of object definitions to a code generation module to generate data integration code; and

executing the data integration code to integrate a set of information from the source database in the target database.

16. The method of claim 15 , further comprising:

receiving the collection of configuration data further including process information and filter information; and

applying the metadata module to the collection of configuration data to generate the set of metadata information.

17. The method of claim 15 , further comprising:

receiving the library of object definitions defining relationships between a set of data elements and a set of data relationships in the source database, wherein the library includes object definitions for at least one of datasets, dataset attributes, dataset tables, and dataset relationships.

18. The method of claim 15 , further comprising:

receiving a current version of at least one of the library of objection definitions, the collection of configuration data, and the set of metadata information;

processing the current version to determine whether at least one of the library of objection definitions, the collection of configuration data, and the set of metadata information have changed; and

generating a revision to the data integration code upon determining that at least one of the library of objection definitions, the collection of configuration data, and the set of metadata information have changed.

19. The method of claim 15 , further comprising:

generating the data integration code with modular code logic for a plurality of stages including an integration stage, an update stage, and an archive stage.

20. The method of claim 15 , further comprising:

generating the data integration code such that the data integration code is decomposable into single insert operations or multi-step operations.