Method for the real-time distribution of streaming data on a network
View Patent ↗A method for sampling of streaming data for distribution on a network (e.g., the Internet) includes receiving the streaming data (which includes periodically updated information items) from a streaming data source. The periodically updated information items of the streaming data are subsequently sampled using a sampling process based on a total update rate of the streaming data (U a ) and a capacity of the network (C), thereby creating a sampled data stream. Alternatively, the periodically updated information items of the streaming data can be sampled using a sampling process that is also based on the importance (K qmin ) of each of the periodically updated information items and the update rate (U q ) of each of the periodically updated information items to create the sampled data stream. The sampled data stream is then distributed on the network (e.g., the Internet or a private area network).
1. A method for sampling streaming data, which includes periodically updated information items, for real-time distribution on a network, the method comprising:
receiving the streaming data from a streaming data source;
sampling the periodically-updated information items of the streaming data using a sampling process based at least in part on one or more update rates of the information items of the streaming data and on a capacity of the network into which the data is to be distributed, thereby creating a sampled data stream;
distributing the sampled data stream on the network;
determining, over a sweep interval, if any of the periodically-updated information items were updated by the streaming data but not sampled in the sampling step and distributed in the distributing step; and
distributing on the network the information items determined in the step of determining, independent of the sampling process that would have otherwise excluded the distribution of the information item for the sweep interval.
2. The method of claim 1 , wherein the one or more update rates and network capacity are dynamically determined.
3. The method of claim 1 , wherein the sampling is further based on a determined importance of each of the periodically-updated information items.
4. The method of claim 3 , wherein the one or more update rates comprises an update rate of each of the periodically-updated information items.
5. The method of claim 1 , wherein the one or more update rates comprises a dynamically-determined update rate of each of the periodically-updated information items and a dynamically-determined total update rate of the information items in the streaming data, wherein the network capacity comprises a dynamically-determined network capacity, and wherein the sampling is further based on a determined importance of each of the periodically-updated information items.
6. The method of claim 5 , wherein the dynamically-determined total update rate, the dynamically-determined network capacity and the dynamically-determined update rate of each of the periodically-updated information items are dynamically determined at least every predetermined time interval.
7. The method of claim 3 or 5 , wherein the determined importance is dynamically determined at least every predetermined time interval.
8. The method of claim 7 , wherein the determined importance is dynamically determined based on execution conditions.
9. The method of claim 7 , wherein the determined importance is dynamically determined based on a previously-determined importance, the current network capacity, and a previous network capacity.
10. The method of claim 1 , wherein the streaming data includes periodically-updated financial quote information items.
11. The method of claim 1 , wherein the streaming data includes periodically-updated financial quote information items.
12. A method for sampling streaming data, which includes periodically-updated information items, for distribution on a network, the method comprising:
receiving the streaming data from a streaming data source;
sampling each of the periodically-updated information items of the streaming data so as to create a sampled data stream using a sampling process based on:
a dynamically-determined total update rate of the streaming data (U a );
a dynamically-determined capacity of the network (C);
a determined importance (K qmin ) of each of the periodically-updated information items; and
a dynamically-determined update rate (U q ) of each of the periodically-updated information items;
distributing the sampled data stream on the network;
determining, over a sweep interval, if any of the periodically-updated information items were updated by the streaming data but not sampled and distributed; and
distributing on the network the information items determined in the step of determining, independent of the sampling process that would have otherwise excluded the distribution of the information item for the sweep interval.
13. The method of claim 10 , wherein the streaming data includes periodically-updated financial quote information items.
14. The method of claim 10 , wherein the total update rate, the network capacity and the dynamically-determined update rate of each of the periodically-updated information items are dynamically-determined at least every predetermined time interval.
15. The method of claim 10 , wherein the determined importance (Kqmii) of each of the periodically-updated information items is dynamically determined based on execution conditions.
16. The method of claim 10 , wherein the determined importance (Kqmiti) of each of the periodically-updated information items is dynamically determined based on a previously-determined importance, the current network capacity, and a previous network capacity.