Optimizing server resources using multiple retry for high traffic websites
A method for optimizing resources on a web server is provided. A web page may include areas for displaying content that is time consuming to retrieve. The content may be geographically far away or the content server itself may be slow. A caching proxy between the web server and the content server responds to requests for data immediately, with or without the data requested from the cache. On a cache miss, the caching proxy asynchronously retrieves data so that the next time the same content is requested, the data should be available in the cache. Asynchronous retrieval means that no valuable resources are tied up on the web server while waiting for the content to be provided from the content server. The initial web page sent from the web server to the web browser includes retry logic. The data may be retrieved from the cache during one of the retries.
1. A computer-implemented method comprising:
in response to a request for a web page, a web server generating and providing the web page to a web browser executing on a client device, wherein the web server generating the web page includes the web server including in the web page a plurality of executable statements that includes:
a first set of one or more executable statements which, when executed by the web browser, causes the web browser to perform generating a first data request to return data to be displayed within the web page;
a second set of one or more executable statements which, when executed by the web browser, causes the web browser to perform sending the first data request to the web server;
a third set of one or more executable statements which, when executed by the web browser, causes the web browser to perform determining whether the requested data to be displayed within the web page was returned to the web browser; and
a fourth set of one or more executable statements which, when executed by the web browser, causes the web browser to perform in response to determining that the requested data to be displayed within the web page was not returned to the web browser,
generating a second data request to return the data to be displayed within the web page; and
sending the second data request to return the data to be displayed within the web page to the web server.
2. The method of claim 1 , wherein the plurality of executable statements is executed in response to a user requesting data to be returned and displayed by selecting an area on the web page.
3. The method of claim 1 , wherein the plurality of executable statements is executed automatically by the web browser without waiting for a user select a region displayed on the web page.
4. The method of claim 1 , wherein the plurality of executable statements, which when executed by the web browser, cause the web browser to wait a specified time between determining that the requested data to be displayed within the web page was not returned to the web browser and when the second data request to return the data to be displayed within the web page is sent to the web server; and
wherein the plurality of executable statements, which, when executed by the web browser, cause data requests to continue to be sent to the web server for a specified number of retries.
5. The method of claim 4 , wherein the specified time is based on a location of the computer running the service that returns the requested data to be displayed within the web page.
6. The method of claim 4 , wherein the specified time is based on an amount of time to retrieve data from the service over recent history.
7. The method of claim 1 , wherein the plurality of executable statements further includes executable statements, which when executed by the web browser cause the web browser to perform:
in response to determining that the requested data to be displayed within the web page was not returned to the web browser in response to the second data request to return the data to be displayed within the web page, generating a third data request to return the data to be displayed within the web page;
sending the third data request to return the data to be displayed within the web page to the web server;
wherein a time interval between the first data request to return data to be displayed within the web page and the second data request to return the data to be displayed within the web page is different than the time interval between the second data request to return the data to be displayed within the web page and the third data request to return the data to be displayed within the web page.
8. The method of claim 1 , further comprising:
the web server receiving the first data request to return data to be displayed within the web page from the web browser, wherein the first data request to return data to be displayed within the web browser identifies a user and a service from which to request the data;
forwarding the first data request to return data to be displayed within the web page to the service through a web caching proxy;
returning an indication that the requested data is not stored in a cache;
forwarding the first data request to return data to be displayed within the web page to the service;
receiving the requested data from the service;
storing the requested data in the cache;
receiving the second data request to return the data to be displayed within the web page from the web browser;
retrieving the requested data from the cache; and
forwarding the requested data to the web browser.
9. One or more non-transitory computer-readable storage media storing instructions which, when processed by one or more processors, causes:
in response to a request for a web page, a web server generating and providing the web page to a web browser executing on a client device, wherein the web server generating the web page includes the web server including in the web page:
a first set of one or more executable statements which, when executed by the web browser, causes the web browser to perform generating a first data request to return data to be displayed within the web page;
a second set of one or more executable statements which, when executed by the web browser, causes the web browser to perform sending the first data request to the web server;
a third set of one or more executable statements which, when executed by the web browser, causes the web browser to perform determining whether the requested data to be displayed within the web page was returned to the web browser; and
a fourth set of one or more executable statements which, when executed by the web browser, causes the web browser to perform in response to determining that the requested data to be displayed within the web page was not returned to the web browser,
generating a second data request to return the data to be displayed within the web page; and
sending the second data request to return the data to be displayed within the web page to the web server.
10. The one or more non-transitory computer-readable storage media of claim 9 , wherein the plurality of executable statements is executed in response to a user requesting data to be returned and displayed by selecting an area on the web page.
11. The one or more non-transitory computer-readable storage media of claim 9 , wherein the plurality of executable statements is executed automatically by the web browser without waiting for a user select a region displayed on the web page.
12. The one or more non-transitory computer-readable storage media of claim 9 , wherein the plurality of executable statements, which when executed by the web browser, cause the web browser to wait a specified time between determining that the requested data to be displayed within the web page was not returned to the web browser and when the second data request to return the data to be displayed within the web page is sent to the web server; and
wherein the plurality of executable statements, which, when executed by the web browser, cause data requests to continue to be sent to the web server for a specified number of retries.
13. The one or more non-transitory computer-readable storage media of claim 12 , wherein the specified time is based on a location of the computer running the service that returns the requested data to be displayed within the web page.
14. The one or more non-transitory computer-readable storage media of claim 12 , wherein the specified time is based on an amount of time to retrieve data from the service over recent history.
15. The one or more non-transitory computer-readable storage media of claim 9 , wherein the plurality of executable statements further includes executable statements, which when executed by the web browser cause the web browser to perform:
in response to determining that the requested data to be displayed within the web page was not returned to the web browser in response to the second data request to return the data to be displayed within the web page, generating a third data request to return the data to be displayed within the web page;
sending the third data request to return the data to be displayed within the web page to the web server;
wherein a time interval between the first data request to return data to be displayed within the web page and the second data request to return the data to be displayed within the web page is different than the time interval between the second data request to return the data to be displayed within the web page and the third data request to return the data to be displayed within the web page.
16. The one or more non-transitory computer-readable storage media of claim 9 , further comprising additional instructions which, when processed by the one or more processors cause:
the web server receiving the first data request to return data to be displayed within the web page from the web browser, wherein the first data request to return data to be displayed within the web browser identifies a user and a service from which to request the data;
forwarding the first data request to return data to be displayed within the web page to the service through a web caching proxy;
returning an indication that the requested data is not stored in a cache;
forwarding the first data request to return data to be displayed within the web page to the service;
receiving the requested data from the service;
storing the requested data in the cache;
receiving the second data request to return the data to be displayed within the web page from the web browser;
retrieving the requested data from the cache; and
forwarding the requested data to the web browser.