Low latency polling
A poll of a first database is initiated (e.g., a SOT database). The poll of the first database is to identify if any transactions have occurred since a previous poll of the first database. Based on the poll of the first database, information is received that identifies one or more transaction identifiers. A missing transaction identifier is identified based on a contagious list of transaction identifiers. In response to identifying the missing transaction identifier, the missing transaction identifier is stored in a list of missing transaction identifiers for use in a later poll of the first database. By tracking the missing transaction identifier, the process can identify transactions that take longer to commit without introducing lag for transactions that commit quickly.
1. A system, comprising:
a microprocessor; and
a computer readable medium, coupled with the microprocessor and comprising microprocessor readable and executable instructions that, when executed by the microprocessor, cause the microprocessor to:
initiate a poll of a first database, wherein the poll of the first database is to identify if any transactions have occurred since a previous poll;
receive information, based on the poll of the first database, wherein the received information identifies one or more transaction identifiers;
identify a missing transaction identifier based on a contagious list of transaction identifiers,
wherein the contagious list of transaction identifiers includes a numerically ordered list of transaction identifiers;
in response to identifying the missing transaction identifier, storing the missing transaction identifier in a list of missing transaction identifiers for use in a later poll of the first database; and
determine, based on a defined time period, that a transaction associated with the missing transaction identifier was not committed,
wherein determining that the transaction associated with the missing transaction identifier was not committed is based on a timestamp that is created when the missing transaction identifier is first identified.
2. The system of claim 1 , wherein the microprocessor readable and executable instructions further cause the microprocessor to:
determine if the missing transaction identifier is identified in the later poll of the first database; and
in response to determining that the missing transaction identifier is identified in the later poll of the first database, removing the missing transaction identifier from the list of missing transaction identifiers.
3. The system of claim 2 , wherein the later poll is one of:
a separate poll specifically for the missing transaction identifier; or
a poll that is for both new changed records and the missing transaction identifier.
4. The system of claim 1 , wherein the microprocessor readable and executable instructions further cause the microprocessor to
in response to determining that the transaction associated with the missing transaction identifier was not committed, remove the missing transaction identifier from the list of missing transaction identifiers.
5. The system of claim 1 , wherein the microprocessor readable and executable instructions further cause the microprocessor to:
add a column to a database table of the first database to track the one or more transaction identifiers.
6. The system of claim 1 , wherein the one or more transaction identifiers identified in the received information are for one or more committed transactions.
7. The system of claim 1 , wherein the missing transaction identifier is for a transaction that has been received, but not committed.
8. A method, comprising:
initiating, by a microprocessor, a poll of a first database, wherein the poll of the first database is to identify if any transactions have occurred since a previous poll;
receiving information, by the microprocessor, based on the poll of the first database, wherein the received information identifies one or more transaction identifiers;
identifying, by the microprocessor, a missing transaction identifier based on a contagious list of transaction identifiers,
wherein the contagious list of transaction identifiers includes a numerically ordered list of transaction identifiers;
in response to identifying the missing transaction identifier, storing, by the microprocessor, the missing transaction identifier in a list of missing transaction identifiers for use in a later poll of the first database; and
determining, based on a defined time period, that a transaction associated with the missing transaction identifier was not committed,
wherein determining that the transaction associated with the missing transaction identifier was not committed is based on a timestamp that is created when the missing transaction identifier is first identified.
9. The method of claim 8 , further comprising:
determining if the missing transaction identifier is identified in the later poll of the first database; and
in response to determining that the missing transaction identifier is identified in the later poll of the first database, removing the missing transaction identifier from the list of missing transaction identifiers.
10. The method of claim 9 , wherein later poll is one of:
a separate poll specifically for the missing transaction identifier; or
a poll that is for both new changed records and the missing transaction identifier.
11. The method of claim 8 , further comprising
in response to determining that the transaction associated with the missing transaction identifier was not committed, removing the missing transaction identifier from the list of missing transaction identifiers.
12. The method of claim 8 , further comprising:
adding a column to a database table of the first database to track the one or more transaction identifiers.
13. The method of claim 8 , wherein the one or more transaction identifiers identified in the received information are for one or more committed transactions.
14. The method of claim 8 , wherein the missing transaction identifier is for a transaction that has been received, but not committed.
15. A non-transient computer readable medium having stored thereon instructions that cause a microprocessor to execute a method, the method comprising instructions to:
initiate a poll of a first database, wherein the poll of the first database is to identify if any transactions have occurred since a previous poll;
receive information, based on the poll of the first database, wherein the received information identifies one or more transaction identifiers;
identify a missing transaction identifier based on a contagious list of transaction identifiers,
wherein the contagious list of transaction identifiers includes a numerically ordered list of transaction identifiers;
in response to identifying the missing transaction identifier, storing the missing transaction identifier in a list of missing transaction identifiers for use in a later poll of the first database; and
determine, based on a defined time period, that a transaction associated with the missing transaction identifier was not committed,
wherein determining that the transaction associated with the missing transaction identifier was not committed is based on a timestamp that is created when the missing transaction identifier is first identified.
16. The non-transient computer readable medium of claim 15 , wherein the instructions further cause the microprocessor to:
determine if the missing transaction identifier is identified in the later poll of the first database; and
in response to determining that the missing transaction identifier is identified in the later poll of the first database, removing the missing transaction identifier from the list of missing transaction identifiers.
17. The non-transient computer readable medium of claim 16 , wherein the later poll is one of:
a separate poll specifically for the missing transaction identifier; or
a poll that is for both new changed records and the missing transaction identifier.
18. The non-transient computer readable medium of claim 15 , wherein the instructions further cause the microprocessor to
in response to determining that the transaction associated with the missing transaction identifier was not committed, remove the missing transaction identifier from the list of missing transaction identifiers.
19. The system of claim 1 , wherein the first database is a source of truth database.
20. The method of claim 8 , wherein the first database is a source of truth database.