Proactive adaptation in handling service requests in cloud computing systems
Methods, systems, and computer-readable storage media for receiving a first request parameter for each of the plurality of tenants, receiving a second request parameter for each of the plurality of tenants, assigning the plurality of tenants to an N plurality of tenant groups based on the first request parameter for each of the plurality of tenants, assigning each tenant in the N plurality of tenant groups to a server group in an M plurality of server groups based on the second request parameter for each of the plurality of tenants, and directing, by a load balancer, tenant requests of tenants in the plurality of tenants to servers based on the M plurality of server groups.
1 . A computer-implemented method executed by one or more processors and comprising:
receiving a first request parameter for each of a plurality of tenants;
receiving a second request parameter for each of the plurality of tenants;
and
load balancing tenant requests of tenants in the plurality of tenants to servers of a plurality of servers based on M plurality of server groups, wherein:
the plurality of tenants is associated with N plurality of tenant groups based on the first request parameter for each of the plurality of tenants,
each tenant in the N plurality of tenant groups is associated with a server group in the M plurality of server groups based on the second request parameter for each of the plurality of tenants, and
each tenant group (i) for each tenant (p) in the association of the plurality of tenants with the N plurality of tenant groups comprises:
i
=
MIN
{
R
N
D
down
(
tReqCn
t
p
*
N
T
C
)
N
-
1
,
wherein tReqCnt p is the first request parameter for the tenant (p) and T C is a largest (MAX) tenant request count for all tenants in the plurality of tenants.
2 . The computer-implemented method of claim 1 , wherein the first request parameter is a request count for each of the plurality of tenants over a period of time.
3 . The computer-implemented method of claim 1 , wherein the second request parameter is a peak time of requests for each tenant over a period of time.
4 . The computer-implemented method of claim 1 , wherein the association of the plurality of tenants of the N plurality of tenant groups with the M plurality of server groups comprises, for each tenant (j) within a tenant group (i), a server group (k) being based on j modulo M.
5 . The computer-implemented method of claim 1 , wherein a value of N is based on no tenant group X having more associated tenants than any other tenant group.
6 . The computer-implemented method of claim 1 , further comprising:
receiving a request from a first tenant of the plurality of tenants;
and
distributing the request from the first tenant to a first server group of the M plurality of server groups to which the first tenant is associated.
7 . A non-transitory computer-readable storage medium coupled to one or more processors and having instructions stored thereon which, when executed by the one or more processors, cause the one or more processors to perform operations comprising:
receiving a first request parameter for each of a plurality of tenants;
receiving a second request parameter for each of the plurality of tenants;
and
load balancing tenant requests of tenants in the plurality of tenants to servers of a plurality of servers based on the M plurality of server groups, wherein:
the plurality of tenants is associated with N plurality of tenant groups based on the first request parameter for each of the plurality of tenants,
each tenant in the N plurality of tenant groups is associated with a server group in the M plurality of server groups based on the second request parameter for each of the plurality of tenants, and
each tenant group (i) for each tenant (p) in the association of the plurality of tenants with the N plurality of tenant groups comprises:
i
=
MIN
{
R
N
D
down
(
tReqCnt
p
*
N
T
C
)
N
-
1
,
wherein tReqCnt p is the first request parameter for the tenant (p) and To is a largest (MAX) tenant request count for all tenants in the plurality of tenants.
8 . The non-transitory computer-readable storage medium of claim 7 , wherein the first request parameter is a request count for each of the plurality of tenants over a period of time.
9 . The non-transitory computer-readable storage medium of claim 7 , wherein the second request parameter is a peak time of requests for each tenant over a period of time.
10 . The non-transitory computer-readable storage medium of claim 7 , wherein the association of the plurality of tenants of the N plurality of tenant groups with the M plurality of server groups comprises, for each tenant (j) within a tenant group (i), a server group (k) being based on j modulo M.
11 . The non-transitory computer-readable storage medium of claim 7 , wherein a value of N is based on no tenant group X having more associated tenants than any other tenant group.
12 . The non-transitory computer-readable storage medium of claim 7 , wherein operations further comprise:
receiving a request from a first tenant of the plurality of tenants;
and
distributing the request from the first tenant to a first server group of the M plurality of server groups to which the first tenant is associated.
13 . A system, comprising:
a computing device; and
a computer-readable storage device coupled to the computing device and having instructions stored thereon which, when executed by the computing device, cause the computing device to perform operations comprising:
receiving a first request parameter for each of a plurality of tenants;
receiving a second request parameter for each of the plurality of tenants;
and
load balancing tenant requests of tenants in the plurality of tenants to servers of a plurality of servers based on M plurality of server groups, wherein:
the plurality of tenants is associated with N plurality of tenant groups based on the first request parameter for each of the plurality of tenants,
each tenant in the N plurality of tenant groups is associated with a server group in the M plurality of server groups based on the second request parameter for each of the plurality of tenants, and
each tenant group (i) for each tenant (p) in the association of the plurality of tenants with the N plurality of tenant groups comprises:
i
=
MIN
{
R
N
D
down
(
tReqCnt
p
*
N
T
C
)
N
-
1
,
wherein tReqCnt p is the first request parameter for the tenant (p) and T C is a largest (MAX) tenant request count for all tenants in the plurality of tenants.
14 . The system of claim 13 , wherein the first request parameter is a request count for each of the plurality of tenants over a period of time.
15 . The system of claim 13 , wherein the second request parameter is a peak time of requests for each tenant over a period of time.
16 . The system of claim 13 , wherein the association of the plurality of tenants of the N plurality of tenant groups with the M plurality of server groups comprises, for each tenant (j) within a tenant group (i), a server group (k) being based on j modulo M.
17 . The system of claim 13 , wherein a value of N is based on no tenant group X having more associated tenants than any other tenant group.