System and method for managing size of clusters in a computing environment
A number of hosts in a logical cluster is adjusted up or down in an elastic manner by tracking membership of hosts in the cluster using a first data structure and tracking membership of hosts in a spare pool using a second data structure, and upon determining that a triggering condition for adding another host is met and that all hosts in the cluster are being used, selecting a host from the spare pool, and programmatically adding an identifier of the selected host to the first data structure and programmatically deleting the identifier of the selected host from the second data structure.
1. A method executed by a management server comprising:
storing membership of hosts in a cluster in a first data structure;
storing membership of hosts in a spare host pool in a second data structure;
storing membership of hosts in a failed host pool in a third data structure;
when a first host in the cluster is experiencing a partial or total failure and the cluster does not include a sufficient number of hosts based on available resources for a plurality of virtual computing instances (VCIs) in the cluster falling below a minimum threshold value, the available resources comprising at least one of CPU resources, memory resources, or storage resources:
migrating a second host from the spare host pool to the cluster;
migrating at least one VCI from the first host to the second host in the cluster; and
migrating the first host from the cluster to the failed host pool;
while the available resources remain below the minimum threshold value:
migrating one or more hosts from the spare host pool to the cluster;
updating the membership of hosts in the cluster to include the second host and the one or more hosts from the spare host pool by programmatically adding identifiers of the second host and the one or more hosts to the first data structure;
updating the membership of hosts in the cluster to remove the first host by programmatically deleting an identifier of the first host from the first data structure;
updating the membership of hosts in the spare host pool to remove the second host and the one or more hosts from the spare host pool by programmatically deleting the identifiers of the second host and the one or more hosts from the second data structure; and
updating the membership of hosts in the failed host pool to include the first host from the cluster by programmatically adding the identifier of the first host to the third data structure, wherein the management server is separate from the cluster, the spare host pool, and the failed host pool.
2. The method of claim 1 , wherein the cluster the management server includes a high availability module, a distributed resource scheduler module, and a host provisioning module.
3. The method of claim 1 , wherein each host in the cluster comprises a hypervisor and a virtual storage area network module.
4. The method of claim 1 , wherein the cluster does not include a sufficient number of hosts based on utilization data associated with hosts in the cluster.
5. The method of claim 4 , wherein the utilization data comprises a CPU utilization of hosts in the cluster, memory utilization of hosts in the cluster, or storage utilization of hosts in the cluster.
6. The method of claim 5 , wherein the cluster does not include a sufficient number of hosts when at least one of the CPU utilization, memory utilization, or storage utilization exceeds a respective threshold.
7. The method of claim 1 , further comprising:
when utilization data indicates that the cluster is underutilized based on available resources for the plurality of VCIs in the cluster:
migrating at least one VCI from a third host of the cluster to the second host of the cluster;
migrating the third host to the spare host pool;
updating the membership of hosts in the cluster to remove the third host from the cluster by programmatically deleting an identifier of the third host from the first data structure; and
updating the membership of hosts in the spare host pool to include the third host by programmatically adding the identifier of the third host to the second data structure.
8. A non-transitory computer-readable medium comprising instructions that are executable in a computing device to cause the computing device to at least:
store membership of hosts in a cluster in a first data structure;
store membership of hosts in a spare host pool in a second data structure;
store membership of hosts in a failed host pool in a third data structure;
when a first host in the cluster is experiencing a partial or total failure and the cluster does not include a sufficient number of hosts based on available resources for a plurality of virtual computing instances (VCIs) in the cluster falling below a minimum threshold value, the available resources comprising at least one of CPU resources, memory resources, or storage resources:
migrate a second host from the spare host pool to the cluster;
migrate at least one VCI from the first host to the second host in the cluster; and
migrate the first host from the cluster to the failed host pool;
while the available resources remain below the minimum threshold value:
migrate one or more hosts from the spare host pool to the cluster;
update the membership of hosts in the cluster to include the second host and the one or more hosts from the spare host pool by programmatically adding identifiers of the second host and the one or more hosts to the first data structure;
update the membership of hosts in the cluster to remove the first host by programmatically deleting an identifier of the first host from the first data structure;
update the membership of hosts in the spare host pool to remove the second host and the one or more hosts from the spare host pool by programmatically deleting the identifiers of the second host and the one or more hosts from the second data structure; and
update the membership of hosts in the failed host pool to include the first host from the cluster by programmatically adding the identifier of the first host to the third data structure, wherein the management server is separate from the cluster, the spare host pool, and the failed host pool.
9. The non-transitory computer-readable medium of claim 8 , wherein the computing device comprises a management server that includes a high availability module, a distributed resource scheduler module, and a host provisioning module.
10. The non-transitory computer-readable medium of claim 8 , wherein each host in the cluster comprises a hypervisor and a virtual storage area network module.
11. The non-transitory computer-readable medium of claim 8 , wherein the cluster does not include a sufficient number of hosts based on utilization data associated with hosts in the cluster.
12. The non-transitory computer-readable medium of claim 11 , wherein the utilization data comprises a CPU utilization of hosts in the cluster, memory utilization of hosts in the cluster, or storage utilization of hosts in the cluster.
13. The non-transitory computer-readable medium of claim 12 , wherein the cluster does not include a sufficient number of hosts when at least one of the CPU utilization, memory utilization, or storage utilization exceeds a respective threshold.
14. The non-transitory computer-readable medium of claim 8 , wherein the instructions further cause the computing device to at least:
when utilization data indicates that the cluster is underutilized based on available resources for the plurality of VCIs in the cluster:
migrate at least one VCI from a third host of the cluster to the second host of the cluster;
migrate the third host to the spare host pool;
update the membership of hosts in the cluster to remove the third host from the cluster by programmatically deleting an identifier of the third host from the first data structure; and
update the membership of hosts in the spare host pool to include the third host by programmatically adding the identifier of the third host to the second data structure.
15. A system comprising:
a cluster of hosts; and
a management server configured to at least:
store membership of hosts in a cluster in a first data structure;
store membership of hosts in a spare host pool in a second data structure;
store membership of hosts in a failed host pool in a third data structure;
when a first host in the cluster is experiencing a partial or total failure and the cluster does not include a sufficient number of hosts based on available resources for a plurality of virtual computing instances (VCIs) in the cluster falling below a minimum threshold value, the available resources comprising at least one of CPU resources, memory resources, or storage resources:
migrate a second host from the spare host pool to the cluster;
migrate at least one VCI from the first host to the second host in the cluster; and
migrate the first host from the cluster to the failed host pool;
while the available resources remain below the minimum threshold value:
migrate one or more hosts from the spare host pool to the cluster;
update the membership of hosts in the cluster to include the second host and the one or more hosts from the spare host pool by programmatically adding identifiers of the second host and the one or more hosts to the first data structure;
update the membership of hosts in the cluster to remove the first host by programmatically deleting an identifier of the first host from the first data structure;
update the membership of hosts in the spare host pool to remove the second host and the one or more hosts from the spare host pool by programmatically deleting the identifiers of the second host and the one or more hosts from the second data structure; and
update the membership of hosts in the failed host pool to include the first host from the cluster by programmatically adding the identifier of the first host to the third data structure, wherein the management server is separate from the cluster, the spare host pool, and the failed host pool.
16. The system of claim 15 , wherein the management server includes a high availability module, a distributed resource scheduler module, and a host provisioning module.
17. The system of claim 15 , wherein each host in the cluster comprises a hypervisor and a virtual storage area network module.
18. The system of claim 15 , wherein the cluster does not include a sufficient number of hosts based on utilization data associated with hosts in the cluster.
19. The system of claim 18 , wherein the utilization data comprises a CPU utilization of hosts in the cluster, memory utilization of hosts in the cluster, or storage utilization of hosts in the cluster.
20. The system of claim 19 , wherein the management server the cluster does not include a sufficient number when at least one of the CPU utilization, memory utilization, or storage utilization exceeds a respective threshold.
21. The system of claim 15 , wherein the management server is further configured to at least:
when utilization data indicates that the cluster is underutilized based on available resources for the plurality of VCIs in the cluster:
migrate at least one VCI from a third host of the cluster to the second host of the cluster;
migrate the third host to the spare host pool;
update the membership of hosts in the cluster to remove the third host from the cluster by programmatically deleting an identifier of the third host from the first data structure; and
update the membership of hosts in the spare host pool to include the third host by programmatically adding the identifier of the third host to the second data structure.