Systems and methods for managing spillover limits in a multi-core system
Disclosed embodiments describe a system for managing spillover via a plurality of cores of a multi-core device intermediary to a plurality of clients and one or more services. The system may include a spillover limit of a resource. and a plurality of packet engines operating on a corresponding core of a plurality of cores of the device. The system may include a pool manager allocating to each of the plurality of packet engines a number of resource uses from an exclusive quota pool and shared quota pool based on the spillover limit of a resource. The device determines that the number of resources used by a packet engine has reached the allocated number of resource uses of the packet engine, and responsive to the determination, forwards to a backup virtual server a request of a client received by the device for the virtual server.
1. A method comprising:
a) assigning, by a device intermediary to a client and a server, to each processor of a plurality of processors of a device, a predetermined number of times a resource can be used by each processor based on applying a function to a limit received via user input established for the device, the limit comprising a total number of times the resource can be used across the plurality of processors of the device, wherein the predetermined number of times of uses includes a number of times of use from an exclusive quota pool and a number of times of use from a non-exclusive quota pool;
b) determining, by the device responsive to a first processor of the device receiving a request from the client to a service on the server that uses the resource, that the number of times the resource is used by the first processor has reached the predetermined number of times of use assigned to the first processor from the exclusive quota pool and the non-exclusive pool has been exhausted;
c) allocating, by the device responsive to the determination, an additional number of times of use of the resource to the first processor from the total number of times the resource can be used by another processor of the plurality of processors using less than its predetermined number of times assigned from the exclusive quota pool; and
d) processing, by the first processor, the request from the client responsive to allocation of the additional number of times of use of the resource to the first processor.
2. The method of claim 1 , wherein (a) further comprises assigning to each processor the predetermined number of times the resource can be used by each processor, wherein the predetermined number of times comprises a result of applying the function to the limit received via user input.
3. The method of claim 1 , wherein (a) further comprises allocating, by the device, the predetermined number of times of uses as exclusive uses from an exclusive quota pool.
4. The method of claim 1 , wherein (a) further comprises allocating, by the device, the predetermined number of times of uses as non-exclusive uses from a non-exclusive quota pool.
5. The method of claim 1 , wherein (b) further comprises determining, by the first processor, that the first processor has reached the predetermined number of times prior to use of the resource by the request.
6. The method of claim 1 , wherein (c) further comprises requesting, by the first processor, the additional number of times of use from a pool manager.
7. The method of claim 1 , wherein (c) further comprises allocating, by the device, the additional number of times to use of the resource as non-exclusive uses from a non-exclusive quota pool.
8. The method of claim 1 , wherein (c) further comprises allocating, by the device, the additional number of times to uses of the resource as exclusive uses from an exclusive quota pool.
9. The method of claim 1 , wherein (c) further comprising receiving, by the first processor, the additional number of times of use previously allocated to a second processor.
10. The method of claim 1 , wherein the resource comprises one of the following a connection, bandwidth or bytes per unit of time processed by the first processor.
11. A system comprising:
a device comprising a plurality of processors and intermediary to a client and a server;
a pool manager configured to execute on one or more processors of the plurality of processors and configured to assign to each processor of the plurality of processors, a predetermined number of times a resource can be used by each processor based on applying a function to a limit received via user input established for the device the limit comprising a total number of times the resource can be used across the plurality of processors of the device;
wherein the predetermined number of times of uses includes a number of times of use from an exclusive quota pool and a number of times of use from a non-exclusive quota pool;
wherein the device is configured to determine, responsive to a first processor of the device receiving a request from the client to a service on the server that uses the resource, that the number of times the resource is used by the first processor has reached the predetermined number of times assigned to the first processor from the exclusive quota pool and the non-exclusive pool has been exhausted; and
wherein responsive to the determination, the pool manager is configured to assign an additional number of times of use of the resource to the first processor from the total number of times the resource can be used by another processor of the plurality of processors using less than its predetermined number of times assigned from the exclusive quota pool; and
responsive to allocation of the additional number of times of use of the resource to the first processor, the first processor is configured to process the request from the client.
12. The system of claim 11 , wherein the device is further configured to assign to each processor the predetermined number of times the resource can be used by each processor, wherein the predetermined number of times comprises a result of applying the function to the limit received via user input based on applying a function to the limit received via user input.
13. The system of claim 11 , wherein the device is further configured to allocate the predetermined number of times of uses as exclusive uses from an exclusive quota pool.
14. The system of claim 11 , wherein the device is further configured to allocate the predetermined number of times of uses as non-exclusive uses from a non-exclusive quota pool.
15. The system of claim 11 , wherein the device is further configured to determine that the first processor has reached the predetermined number of times prior to use of the resource by the request.
16. The system of claim 11 , wherein the device is further configured to request the additional number of times of use from a pool manager.
17. The system of claim 11 , wherein the device is further configured to allocate the additional number of times to use of the resource as non-exclusive uses from a non-exclusive quota pool.
18. The system of claim 11 , wherein the device is further configured to allocate the additional number of times to uses of the resource as exclusive uses from an exclusive quota pool.
19. The system of claim 11 , wherein the first processor is further configured to request additional number of times of use previously allocated to a second processor.
20. The system of claim 11 , wherein the resource comprises one of the following a connection, bandwidth or bytes per unit of time processed by the first processor.