Merging data downloads with real-time data feeds
Methods and apparatuses for merging downloaded data with a real-time data are disclosed. An example includes receiving downloaded item of data from a download connection with a data repository and real-time item of data from a real-time data feed with a data publisher. In response to determining that the downloaded item of data includes the most recent downloaded item of data from the download connection, the downloaded item of data is stored as the last downloaded item of data. In response to determining that the real-time item of data is the most recent real-time item of data received from the real-time data feed, the real-time item of data is stored as the last real-time item of data from the real-time data feed. In response to determining a match between the last downloaded item of data and the last real-time item of data the download connection is ended.
1. A non-transitory computer readable medium having stored therein instructions executable by a processor, including instructions executable to:
receive, by a client device, a first real-time data feed from a data publisher, and a second real-time data feed from a data repository, wherein the first real-time data feed includes a plurality of data items each identified with a message identifier, wherein the second real-time data feed is downloaded using a download connection to the data repository and includes a plurality of downloaded data items each identified with the message identifier, and wherein the message identifier identifies a data location within each of the first and second real-time data feeds;
identify, by the client device, a most recent data item of the plurality downloaded data items and a most recent data item of the plurality of data items based on the message identifier within each of the first and second real-time data feeds;
determine, by the client device, a match according to the most recent data item of the plurality downloaded data items and the most recent data item of the plurality of data items; and
terminate, by the client device in response to determining the match, the download connection and the second real-time data feed from the data repository.
2. The non-transitory computer readable medium of claim 1 , further including instructions executable to:
establish, by the client device, the download connection with the data repository.
3. The non-transitory computer readable medium of claim 1 , where the data repository includes an order repository.
4. The non-transitory computer readable medium of claim 1 , further including instructions executable to:
establish, by the client device, a connection with the real-time data feed.
5. The non-transitory computer readable medium of claim 4 , further including instructions executable to:
subscribe to the first real-time data feed.
6. The non-transitory computer readable medium of claim 1 , where the data publisher includes an electronic exchange.
7. The non-transitory computer readable medium of claim 6 , where the first real-time data feed and the second real-time data feed include market data.
8. The non-transitory computer readable medium of claim 1 , further including instructions executable to:
receive, at the data repository, the real-time data items from the data publisher.
9. A system comprising:
a client device in communication with a data publisher and a data repository, the client device is configured to:
receive a first real-time data feed from the data publisher, and a second real-time data feed from the data repository, wherein the first real-time data feed includes a plurality of data items each identified with a message identifier, wherein the second real-time data feed is downloaded using a download connection to the data repository and includes a plurality of downloaded data items each identified with the message identifier, and wherein the message identifier identifies a data location within each of the first and second real-time data feeds;
identify a most recent data item of the plurality downloaded data items and a most recent data item of the plurality of data items based on the message identifier within each of the first and second real-time data feeds;
determine a match according to the most recent data item of the plurality downloaded data items and the most recent data item of the plurality of data items; and
terminate, in response to determining the match, the download connection and the second real-time data feed from the data repository.
10. The system of claim 9 , wherein the client device is further configured to:
establish the download connection with the data repository.
11. The system of claim 9 , wherein the data repository includes an order repository.
12. The system of claim 9 , wherein the client device is further configured to:
establish a connection with the real-time data feed.
13. The system of claim 12 , wherein the client device is further configured to:
subscribe to the first real-time data feed.
14. The system of claim 9 , where the data publisher includes an electronic exchange.
15. The system of claim 14 , where the first real-time data feed and the second real-time data feed include market data.
16. The system of claim 9 , wherein the system is further configured to: receive, at the data repository, the real-time data items from the data publisher.