Application hosting in a distributed application execution system
In an application execution system having a plurality of application servers, each application server stores a plurality of applications, and has computational resources for executing applications in response to received requests. Each application server also includes instructions for loading a respective application into volatile storage and executing the application in response to a request from a client, and for returning a result. A generic application instance may be cloned, creating a pool of generic application instance clones that can be loaded with code for a requested application to produce an application instance. The application instance can then be stored in a cache to be used for a future application request.
1. A front end server, comprising:
memory; and
one or more processors configured to:
receive a request for application execution, wherein the request is received from a client for execution of a specific application;
access information from a shared memory, wherein the information is related to instances of the specific application loaded in volatile memory of a cluster of application servers;
determine a particular application server, of the cluster of application servers interfacing with the front end server, to which the request is to be routed based at least in part on the information from the shared memory; and
transmit the request to the particular application server.
2. The front end server of claim 1 , wherein determining the particular application server comprises identifying each application server of the cluster of application servers has a copy of the specific application in its local library.
3. The front end server of claim 1 , wherein determining the particular application server to which the request is to be routed comprises performing one or more load balancing operations.
4. The front end server of claim 3 , wherein the one or more load balancing operations comprises selecting an application server meeting a criteria, the criteria comprising the lowest load or a load below a predefined threshold.
5. The front end server of claim 3 , wherein the one or more load balancing operations comprises:
determining a number of instances of the application loaded in volatile memory of each of the application servers; and
sending the request to an application server having one or more loaded instances of the application and also meeting predefined load criteria.
6. The front end server of claim 3 , wherein the one or more processors are configured to routes requests based on current and historical load information.
7. The front end server of claim 6 , wherein the front end server has observed the current and historical load information directly.
8. The front end server of claim 1 , wherein the memory stores a distribution map and determining the particular application server is based on the distribution map.
9. The front end server of claim 8 , wherein the memory stores a respective record for each application to which the front-end server is configured to route application execution requests.
10. The front end server of claim 1 , wherein the one or more processors are configured to monitor status of application instances and store the status in cache.
11. A method, comprising:
receiving, at a front end server, a request for application execution, wherein the request is received from a client for execution of a specific application;
accessing, by the front end server, information from a shared memory, wherein the information is related to instances of the specific application loaded in volatile memory a cluster of application servers;
determining, at the front end server, a particular application server of the cluster of application servers interfacing with the front end server to which the request is to be routed based at least in part on the information from the shared memory; and
transmitting, by the front end server, the request to the particular application server.
12. The method of claim 11 , wherein determining the particular application server comprises identifying whether each application server of the cluster of application servers has a copy of the specific application in its local library.
13. The method of claim 11 , wherein determining the particular application server to which the request is to be routed comprises performing one or more load balancing operations.
14. The method of claim 13 , wherein the one or more load balancing operations comprises selecting an application server meeting a criteria, the criteria comprising the lowest load or a load below a predefined threshold.
15. The method of claim 13 , wherein the one or more load balancing operations comprises:
determining a number of instances of the application loaded in volatile memory of each of the application servers; and
sending the request to an application server having one or more loaded instances of the application and also meeting predefined load criteria.
16. The method of claim 13 , wherein selecting the particular application server is based on current and historical load information.
17. The method of claim 16 , further comprising directly observing, by the front end server, the current and historical load information.
18. The method of claim 11 , wherein determining the particular application server is based on a distribution map stored at the front end server.
19. The method of claim 11 , further comprising monitoring a status of application instances and store the status in cache.