Reducing reading of database logs by persisting long-running transaction data
View Patent ↗According to one embodiment of the present invention, a system reduces re-reading of database logs by persisting long running transaction data. The system processes the database log records of the database transaction log; generates a snapshot of the database log records at periodic intervals, wherein each snapshot includes database log records for pending transactions; and in response to an interruption in processing of the database log records, utilizes a snapshot to restore database log records for the pending transactions and resume processing of the database transaction log from a position succeeding the database log records of the selected snapshot.
1. A system for processing database log records of a database transaction log comprising:
at least one processor configured to:
receive database log records of the database transaction log and process at least some of the received records;
generate snapshots of the database log records, wherein each snapshot includes database log records for pending transactions, and a transaction is pending when at least one of the log records for the transaction remains to be processed; and
in response to an interruption in processing of the database log records, utilize a selected snapshot to restore database log records for the pending transactions and resume processing of the database transaction log from a position succeeding the database log records of the selected snapshot.
2. The system of claim 1 , wherein each snapshot is associated with log information for a corresponding committed transaction, and the processor is further configured to:
compare a most recent committed transaction to the associated log information of the generated snapshots and select a snapshot based on the comparisons.
3. The system of claim 1 , wherein the processor is further configured to record information pertaining to processed database log records at periodic occasions, and each of the snapshots is generated at one of the occasions based on the recorded information from a prior one of the occasions.
4. The system of claim 1 , wherein processing the database log records comprises storing the records for pending transactions in corresponding transaction queues.
5. The system of claim 4 , wherein restoring database log records comprises restoring the database log records to the corresponding transaction queues.
6. The system of claim 1 , wherein the snapshot excludes database log records for pending transactions processed after a cutoff.
7. The system of claim 6 , wherein the processor is further configured to utilize the database transaction log to restore the database log records for pending transactions processed after the cutoff.
8. A computer program product for processing database log records of a database transaction log comprising:
a non-transitory computer readable storage medium having computer readable program code embodied therewith for execution on a first processing system, the computer readable program code comprising computer readable program code configured to:
receive database log records of the database transaction log and process at least some of the received records;
generate snapshots of the database log records, wherein each snapshot includes database log records for pending transactions, and a transaction is pending when at least one of the log records for the transaction remains to be processed; and
in response to an interruption in processing of the database log records, utilize a selected snapshot to restore database log records for the pending transactions and resume processing of the database transaction log from a position succeeding the database log records of the selected snapshot.
9. The computer program product of claim 8 , wherein each snapshot is associated with log information for a corresponding committed transaction, and the computer readable program code is further configured to:
compare a most recent committed transaction to the associated log information of the generated snapshots and select a snapshot based on the comparisons.
10. The computer program product of claim 8 , wherein the computer readable program code is further configured to record information pertaining to processed database log records at periodic occasions, and each of the snapshots is generated at one of the occasions based on the recorded information from a prior one of the occasions.
11. The computer program product of claim 8 , wherein processing the database log records comprises storing the records for pending transactions in corresponding transaction queues.
12. The computer program product of claim 11 , wherein restoring database log records comprises restoring the database log records to the corresponding transaction queues.
13. The computer program product of claim 8 , wherein the snapshot excludes database log records for pending transactions processed after a cutoff.
14. The computer program product of claim 13 , wherein the computer readable program code is further configured to utilize the database transaction log to restore the database log records for pending transactions processed after the cutoff.