Reducing workload on a backend system using client side request throttling
View Patent ↗Embodiments of the present invention address deficiencies of the art in respect to workload management of backend systems and provide a novel and non-obvious method, system and computer program product for limiting a request rate from a client based on a health state of a server system. In one embodiment of the invention, a computer-implemented method for limiting a request rate from a client based on a health state of a server system that includes monitoring a server system, determining a measure of health of the server system, sending the determined measure of health to a client submitting a request to the server system and receiving a subsequent request from the client that is delayed by a time period, wherein the time period is based at least in part upon the determined measure of health. The computer-implemented method can further include receiving server system CPU utilization, determining an approximate predicted real server response time of a transaction and sending the determined approximate predicted real server response time of a transaction to a client submitting a request to the server system.
1. A computer-implemented method for limiting a request rate from a client based on a health state of a server system, the method comprising:
monitoring a server system;
determining a measure of health of the server system, wherein the measure of health comprises a matrix of health values;
sending the determined measure of health to a client submitting a request to the server system; and,
receiving a subsequent request from the client that is delayed by a time period, wherein the time period is based at least in part upon the determined measure of health.
2. The method of claim 1 , wherein the determining a measure of health of the server system comprises receiving server system CPU utilization.
3. The method of claim 1 , further comprising:
determining an approximate predicted real server response time of a transaction; and,
sending the determined approximate predicted real server response time of a transaction to a client submitting a request to the server system.
4. The method of claim 1 , wherein the determined measure of health sent to the client submitting the request to the server system comprises embedding the matrix of health values in a hyper text markup language (HTML) response.
5. The method of claim 1 , further comprising:
converting links in a HTML response with an onClick function;
transmitting the HTML response to a client submitting a request to the server system; and,
creating a delay in the transmission of the request by the client for a calculated time based upon selection of one of the converted links having the onClick function.
6. The method of claim 1 , further comprising:
implementing a request time delay based on a service level agreement (SLA) requirement.
7. The method of claim 1 , further comprising:
generating a processing notification for the request sent by the client.
8. The method of claim 7 , wherein the generating a processing notification for the request sent by the client comprises an audio signal and an animating symbol.
9. The method of claim 7 , wherein the generating a processing notification for the request sent by the client comprises a dynamic HTML (DHTML) popover frame having a progress animation.
10. A data processing hardware system for limiting a request rate from a client based on a health state of a server system, the data processing system comprising:
a server comprising hardware and configured for communicative coupling to one or more requesting clients over a computer communications network;
a request throttler for embedding time delay values in HTML responses to client requests; and
a system health monitor comprising program code enabled to monitor the health of the server system and to determine a measure of health of the server system, wherein the determined measure of health of the server system comprises a matrix of health values.
11. A computer program product comprising a computer usable storage medium having stored thereon computer usable program code for limiting a request rate from a client based on a health state of a server system, the
computer usable program code, which when executed by a computer hardware system causes the computer hardware system to perform
monitoring a server system;
determining a measure of health of the server system, wherein the measure of health comprises a matrix of health values;
sending the determined measure of health to a client submitting a request to the server system; and,
receiving a subsequent request from the client that is delayed by a time period, wherein the time period is based at least in part upon the determined measure of health.
12. The computer program product of claim 11 , wherein the computer usable program code further causes the computer hardware system to perform receiving server system CPU utilization.
13. The computer program product of claim 11 , wherein the computer usable program code further causes the computer hardware system to perform
determining an approximate predicted real server response time of a transaction; and,
sending the determined approximate predicted real server response time of a transaction to a client submitting a request to the server system.
14. The computer program product of claim 11 , wherein the computer usable program code further causes the computer hardware system to perform
embedding the matrix of health values in a hyper text markup language (HTML) response.
15. The computer program product of claim 11 , wherein the computer usable program code further causes the computer hardware system to perform
converting links in a HTML response with an onClick function;
transmitting the HTML response to a client submitting a request to the server system; and,
creating a delay in the transmission of the request by the client for a calculated time based upon selection of one of the converted links having the onClick function.
16. The computer program product of claim 11 , wherein the computer usable program code further causes the computer hardware system to perform implementing a request time delay based on a service level agreement (SLA) requirement.