Optimized data migration application for database compliant data extraction, loading and transformation

1. A method comprising:

copying, from a source database to at least one staging table stored in a destination database, a data volume using an extract, transform, and load (ETL) data migration operation, wherein the copying comprises modifying the at least one staging table such that a structural format of the at least one staging table is in synchronization with a structural format of the copied data volume;

transferring the data volume from the at least one staging table to at least one target table in the destination database; and

converting a structural format of the data volume from a structural format of the source database to a structural format of the destination database that is different from the structural format of the source database using an ETL transformation.

2. The method of claim 1 , further comprising:

filtering the data volume in the source database prior to copying the data volume to the destination database.

3. The method of claim 1 , wherein the data volume is stored in source tables of the source database, and

wherein the at least one staging table has a same name and data type as a name and data type of the source table.

4. The method of claim 1 , further comprising:

accessing a configuration file to locate at least one data source associated with the data volume;

identifying the at least one staging table; and

determining a location of the destination database.

5. The method of claim 4 , further comprising:

identifying last run information from the configuration file; and

performing the ETL data migration operation based on the last run information.

6. The method of claim 1 , wherein the copying comprises:

migrating the data volume as at least two source tables into at least two corresponding staging tables; and

converting the data stored in the two staging tables into one destination table.

7. The method of claim 1 , wherein only two statements are required for the copying, the converting, and the transferring, and

wherein the at least one staging table is format agnostic.

8. The method of claim 1 , wherein the method further comprises:

determining that a previously scheduled ETL data migration operation for another data volume was unsuccessful; and

in response, automatically copying, transferring, and converting the previously scheduled other data volume with the copying, transferring, and converting of the identified data volume of a current ETL data migration operation.

9. The method of claim 1 , wherein the at least one staging table retains each of a row format, a column format, and a naming format of the copied data volume from any proprietary structural formats.

10. An apparatus comprising:

a hardware-implemented processor that when executing one or instructions stored in memory is configured to:

copy, from a source database to at least one staging table stored in a destination database, a data volume using an extract, transform, and load (ETL) data migration operation, wherein the copying comprises modifying the at least one staging table such that a structural format of the at least one staging table is in synchronization with a structural format of the copied data volume;

transfer the data volume within the destination database from the at least one staging table to at least one target table in the destination database; and

converting a structural format of the data volume from a structural format of the source database to a structural format of the destination database that is different from the structural format of the source database using an ETL transformation.

11. The apparatus of claim 10 , wherein the processor is configured to copy the data volume in response to a query operation performed on the source database.

12. The apparatus of claim 10 , wherein the processor is further configured to:

filter filters the data volume in the source database prior to the copy of the data volume.

13. The apparatus of claim 10 , wherein the data volume is stored in source tables of the source database, and

wherein the at least one staging table has a same name and data type as a name and data type of the source table.

14. The apparatus of claim 10 , wherein the processor is further configured to:

access a configuration file to locate at least one data source associated with the data volume;

identify the at least one staging table; and

determine a location of the destination database.

15. The apparatus of claim 14 , wherein the processor is further configured to:

identify last run information from the configuration file, and

perform the ETL data migration operation based on the last run information.

16. The apparatus of claim 10 , wherein the processor is further configured to:

migrate the data volume as at least two source tables into at least two corresponding staging tables; and

convert the data stored in the two staging tables into one destination table.

17. A non-transitory computer readable storage medium storing one or more instructions that when executed by a processor cause the processor to perform:

copying, from a source database to at least one staging table stored in a destination database, a data volume using an extract, transform, and load (ETL) data migration operation, wherein the copying comprises modifying the at least one staging table such that a structural format of the at least one staging table is in synchronization with a structural format of the copied data volume;

transferring the data volume from the at least one staging table to at least one target table in the destination database; and

converting a structural format of the data volume from a structural format of the source database to a structural format of the destination database that is different from the structural format of the source database using an ETL transformation.

18. The non-transitory computer readable storage medium of claim 17 , wherein the one or more instructions further cause the processor to perform:

filtering the data volume in the source database prior to the data volume being copied to the destination database.

19. The non-transitory computer readable storage medium of claim 17 , wherein the data volume is stored in source tables of the source database, and

wherein the at least one staging table has a same name and data type as a name and data type of the source table.

20. The non-transitory computer readable storage medium of claim 17 , wherein the one or more instructions further cause the processor to perform:

accessing a configuration file to locate at least one data source associated with the data volume;

identifying the at least one staging table; and

determining a location of the destination database.