Grid network throttle and load collector
View Patent ↗A method and apparatus for a grid project throttle control for controlling the rate at which a grid job utilizes processor and network resources at the grid node. This throttling mechanism controls the rate of network and processor utilization based on a determination of the expected network and processor availability determined when a grid project is scheduled so that the grid project does not adversely affect the functioning of the nodes with regard to their regular, non-grid work.
1. A computer implemented method comprising:
sending a set of parameters to an application at a grid node, wherein the application supports control of data transmission based on the set of parameters, wherein the set of parameters includes an expected network availability threshold and an expected processor availability threshold;
controlling a rate of data transmission, for data generated by processing a grid job at the grid node, to be between a minimum threshold value and a maximum threshold value for a network capacity based on the rate of data transmission and the set of parameters;
limiting the rate of data transmission by a throttling mechanism at the grid node in response to the rate of data transmission exceeding the expected network availability threshold; and
limiting a rate of processor utilization by the throttling mechanism in response to the rate of processor utilization exceeding the expected processor availability threshold.
2. The computer implemented method of claim 1 further comprising receiving the expected network availability threshold packaged into a wrapper associated with the grid job or grid job data.
3. The computer implemented method of claim 1 further comprising collecting statistics on network utilization from a network utilization monitor on the grid node.
4. The computer implemented method of claim 1 further comprising determining network utilization attributable to grid work and non-grid work.
5. A computer program product comprising:
a computer readable storage device;
first program instructions to send a set of parameters to an application at a grid node, wherein the application supports control of data transmission based on the set of parameters, wherein the set of parameters includes an expected network availability threshold and an expected processor availability threshold;
second program instructions to control a rate of data transmission, for data generated by processing a grid job at the grid node, to be between a minimum threshold value and a maximum threshold value for a network capacity based on the rate of data transmission and the set of parameters;
third program instructions to limit the rate of data transmission by a throttling mechanism at the grid node in response to the rate of data transmission exceeding the expected network availability threshold; and
fourth program instructions to limit a rate of processor utilization by the throttling mechanism in response to the rate of processor utilization exceeding the expected processor availability threshold;
wherein the first through the fourth program instructions are stored in the computer readable storage device.
6. The computer program product of claim 5 further comprising:
fifth program instructions to limit the rate of data transmission if the rate of data transmission exceeds the expected network availability threshold set forth in the set of parameters;
wherein the fifth program instructions are stored in the computer readable storage device.
7. The computer program product of claim 5 further comprising:
fifth program instructions to determine whether the grid node has an application that supports controlling data transmission based on the set of parameters; and
sixth program instructions to send the set of parameters to the application on the grid node responsive to the application being present on the grid node;
wherein the fifth and sixth program instructions are stored in the computer readable storage device.
8. The computer program product of claim 5 further comprising:
fifth program instructions to receive the expected network availability threshold and the expected processor availability threshold packaged into a wrapper associated with the grid job or grid job data;
wherein the fifth program instructions are stored in the computer readable storage device.
9. The computer program product of claim 5 further comprising:
fifth program instructions to collect statistics on network utilization from a network utilization monitor on the grid node;
wherein the fifth program instructions are stored in the computer readable storage device.
10. The computer program product of claim 5 further comprising:
fifth program instructions to determine a network utilization and a processor utilization attributable to grid work and to non-grid work;
wherein the fifth program instructions are stored in the computer readable storage device.
11. The computer program product of claim 5 further comprising:
fifth program instructions to collect statistics on processor utilization from a processor utilization monitor of the grid node;
wherein the fifth program instructions are stored in the computer readable storage device.
12. The computer program product of claim 5 further comprising:
fifth program instructions to determine whether the rate of data transmission attributable to grid work exceeds the expected network availability threshold for data transmission;
wherein the fifth program instructions are stored in the computer readable storage device.
13. The computer program product of claim 5 further comprising:
fifth program instructions to determine processor utilization attributable to grid workloads and non-grid workloads:
sixth program instructions to compare processor utilization data to identifiers associated with grid jobs being processed by the grid node;
wherein the fifth and sixth program instructions are stored in the computer readable storage device.
14. An apparatus for controlling execution of grid jobs on a grid node comprising:
a computer having a processor and a computer readable memory operably coupled to a bus;
a computer readable storage device operably coupled to the bus;
first program instructions to send a set of parameters to an application at the grid node, wherein the application supports control of data transmission based on the set of parameters, wherein the set of parameters includes an expected network availability threshold and an expected processor availability threshold;
second program instructions to control a rate of data transmission, for data generated by processing a grid job at the grid node, to be between a minimum threshold value and a maximum threshold value for a network capacity based on the rate of data transmission and the set of parameters;
third program instructions to limit the rate of data transmission by a throttling mechanism at the grid node in response to the rate of data transmission exceeding the expected network availability threshold; and
fourth program instructions to limit a rate of processor utilization by the throttling mechanism in response to the rate of processor utilization exceeding the expected processor availability threshold;
wherein the first through the fourth program instructions are stored in the computer readable storage device for execution by the processor via the computer readable memory.
15. The apparatus of claim 14 further comprising:
fifth program instructions to determine whether the rate of processor utilization attributable to grid work exceeds the expected processor availability threshold;
wherein the fifth program instructions are stored in the computer readable storage device for execution by the processor via the computer readable memory.
16. The apparatus of claim 14 further comprising:
fifth program instructions to determine whether the rate of data transmission attributable to grid work exceeds the expected network availability threshold;
wherein the fifth program instructions are stored in the computer readable storage device for execution by the processor via the computer readable memory.