System and method for dynamically managing message flow
System and method for dynamically managing message flow. According to the example embodiments, an intermediary network device or a client device dynamically manages the flow of messages received from an electronic exchange by analyzing the client device's capabilities, such as CPU utilization. Based on a percentage of total CPU utilization, the level of throttling is dynamically adjusted, such that if the percentage of CPU utilization, or load, increases, then throttling is increased from a lower level to a higher level. Similarly, if the percentage of CPU utilization decreases significantly enough, then throttling is decreased to a lower level.
1. A non-transitory computer readable medium of a client device having instructions stored thereon, which when executed by an electronic processor causes the electronic processor to carry out acts comprising:
monitoring a resource of the client device, wherein the resource of the client device is a rate that messages are received by the client device from a gateway device;
dynamically throttling by the gateway device market information sent to the client device between a plurality of levels of throttling according to utilization of the monitored resource, wherein each level of throttling of the plurality of levels of throttling includes storing the market information at the gateway device for a corresponding hold time;
sending by the gateway device messages including the market information to the client device according to expiration of the corresponding hold time for the level of throttling; and
displaying by the client device the dynamically throttled market information.
2. The non-transitory computer readable medium of claim 1 , wherein the resource of the client device is the rate that marking information messages are received by the client device from the gateway device.
3. The non-transitory computer readable medium of claim 2 , further including:
receiving by the gateway device a throttling management strategy; and
selecting by the gateway device a level of throttling of the plurality of levels of throttling based on the throttling management strategy.
4. The non-transitory computer readable medium of claim 1 , wherein each level of throttling of the plurality of levels of throttling includes a different hold time.
5. The non-transitory computer readable medium of claim 1 , wherein dynamically throttling the market information includes adjusting between at least a first level of throttling and a second level of throttling according to a change in a utilization level of the monitored resource.
6. The non-transitory computer readable medium of claim 1 , wherein the monitored resource further includes a central processing unit.
7. The non-transitory computer readable medium of claim 1 , wherein the monitored resource further includes a plurality of central processing units.
8. The non-transitory computer readable medium of claim 7 , wherein the utilization of the monitored resource includes utilization of a first central processing unit of the plurality of central processing units.
9. The non-transitory computer readable medium of claim 8 , wherein the first central processing unit includes a busiest central processing unit of the plurality of central processing units.
10. The non-transitory computer readable medium of claim 1 , wherein the market information sent to the client device according to expiration of the hold time is only the latest market information.