Asynchronous change capture for data warehousing

1. A method for change data capture, comprising the steps of:

executing a database statement to copy a recovery log that contains change data for all transactions performed from a source object in a first system to a database object in a second system;

storing the recovery log that contains the change data;

grouping a plurality of change tables in the database object of the second system into at least two groups of change tables;

obtaining at least some of the change data from the recovery log based in part on a column in the recovery log that holds data representing when a transaction has been committed;

inserting the at least some change data into one of the at least two groups of change tables in a single transaction, where each change table in the one of the at least two groups of change tables includes a column corresponding to the column in the recovery log; and

renaming a column heading for a source column of the source object and providing the renamed column heading for the source column as a column heading in a change column of the database object.

2. A method according to claim 1 , further comprising: generating the database statement to store the change data in the database object.

3. A method according to claim 1 , further comprising the step of: shipping change data from the recovery log of an on-line transaction processing (OLTP) system to a staging system.

4. A computer-readable storage medium storing instructions for change data capture, said instructions arranged, when executed, to cause one or more processors to perform the steps of:

executing a database statement to copy a recovery log that contains change data for all transactions performed from a source object in a first system to a object in a second system;

storing the recovery log that contains the change data;

grouping a plurality of change tables in the database of the second system into at least two groups of change tables;

obtaining at least some of the change data from the recovery log based in part on a column in the recovery log that holds data representing when a transaction has been committed;

inserting the at least some change data into one of the at least two groups of change tables a single transaction, where each change table in the one of the at least two groups of change tables includes a column corresponding to the column in the recovery log; and

renaming a column heading for a source column of the source object and providing the renamed column heading for the source column as a column heading in a change column of the database object.

5. A method of change data capture, comprising the steps of:

shipping change data for at least one transaction that has been performed on an on-line transaction processing (OLTP) system from a recovery log that contains change data for all transactions performed on the on-line transaction processing (OLTP) system to a staging system; and

at the staging system, performing the steps of:

copying the recovery log from the on-line transaction processing (OLTP) system;

storing the recovery log in a first database object having at least one control column;

grouping a plurality of change tables in a second database object of the staging system into at least two groups of change tables;

obtaining change data from the recovery stored in the first object based in-part on a column in the recovery log that holds data representing when a transaction has been committed;

inserting the change data into one of the at least two groups of change tables in the second database object, in a single transaction, each change table in the one of the at least two groups of change tables having a column corresponding to the column in the recovery log, said change data representing modifications that has been performed to a plurality of source tables of the on-line transaction processing (OLTP) system and that correspond to the change tables in the second database object; and

renaming a column heading for a source column of the source object and providing the renamed column heading for the source column as a column heading in a change column of the database object.

6. A method of change data capture, comprising the steps of:

shipping change data for at least one transaction that has been performed on an on-line transaction processing (OLTP) system from a recovery log that contains change data for all transactions performed the on-line transaction processing (OLTP) system to a staging system; and

at the staging system, performing the steps of:

registering the recovery log with a log viewer;

generating a SQL statement to extract the change data from the recovery log; and

executing the SQL statement, thereby copying the recovery log from the on-line transaction processing (OLTP) system;

storing the recovery log in a first database object having at least one control column;

grouping a plurality of change tables in a second database object of the second system into at least two groups of change tables;

obtaining change data from the recovery log stored in the first database object based in-part on a column in the recovery log that holds data representing when a transaction has been committed;

inserting the change data into one of the at least two groups of change tables in a second database object, in a single transaction, each change table in the plurality of change tables having a column correspond in to the column in the recovery log, said change data represent in modifications that has been performed to a plurality of source tables of the on-line transaction processing (OLTP) system and that corresponds to the change tables in the second database object; and

renaming a column heading for a source column of the source object and providing the renamed column heading for the source column as a column heading in a change column of the database object.

7. A method according to claim 6 , wherein the on-line transaction processing (OLTP) system and the staging system are provided by different database vendors employing a different, incompatible internal implementation.