Cluster balancing for zones of a database system
The subject technology selects a particular zone among multiple zones based on a target skew to meet a global balancing of cluster instances. The subject technology deploys a particular type of cluster instance to the particular zone. The subject technology, for each zone from the multiple zones, determines a respective number of cluster instances. The subject technology identifies a second particular type of cluster instance to add based on a total number of the second particular type of cluster instance in the multiple zones and a second total number of the particular type of cluster instance in the multiple zones. The subject technology adds the second particular type of cluster instance to a second particular zone to meet the global balancing of cluster instances in the multiple zones.
1. A network-based database system comprising:
at least one hardware processor; and
a memory storing instructions that cause the at least one hardware processor to perform operations comprising:
selecting a particular zone among multiple zones based on a target skew to meet a global balancing of cluster instances;
deploying a particular type of cluster instance to the particular zone;
for each zone from the multiple zones, determining a respective number of cluster instances;
identifying a second particular type of cluster instance to add based on a total number of the second particular type of cluster instance in the multiple zones and a second total number of the particular type of cluster instance in the multiple zones; and
adding the second particular type of cluster instance to a second particular zone to meet the global balancing of cluster instances in the multiple zones.
2. The system of claim 1 , wherein the operations further comprise:
identifying a third particular type of cluster instance to add based on a particular total number of the third particular type of cluster instance in the multiple zones and a third total number of the second particular type of cluster instance in the multiple zones;
adding the third particular type of cluster instance to a third particular zone to meet the global balancing of cluster instances in the multiple zones; and
adding the second particular type of cluster instance to the third particular zone to meet the global balancing of cluster instances in the multiple zones.
3. The system of claim 2 , wherein the operations further comprise:
adding the third particular type of cluster instance to the second particular zone to meet the global balancing of cluster instances in the multiple zones.
4. The system of claim 1 , wherein the second particular zone includes a particular number of cluster instances that is fewer than each number of instances from each of the multiple zones.
5. The system of claim 2 , wherein the third particular zone does not include a particular instance of the third particular type of cluster instance.
6. The system of claim 2 , wherein the second particular zone does not include a particular instance of the third particular type of cluster instance.
7. The system of claim 2 , wherein the third particular zone does not include a particular instance of the second particular type of cluster instance.
8. The system of claim 1 , wherein the operations further comprise:
determining an availability zone skew among the multiple zones; and
based on the availability zone skew, determining the target skew to meet the global balancing of cluster instances, wherein the availability zone skew is based on a difference between a number of instances in a most loaded zone and a second number of instances in a least loaded zone among the multiple zones.
9. The system of claim 8 , wherein the operations further comprise:
prior to determining the availability zone skew among the multiple zones:
determining, after a period of time elapses over a periodic segment of time, an imbalance of cluster instances deployed in multiple zones based on a threshold value, the cluster instances including different types of clusters associated with compute service manager instances.
10. The system of claim 9 , wherein the operations further comprise:
determining, after a second period of time elapses over the periodic segment of time, that a number of cluster instances deployed in the multiple zones is below the threshold value indicating a current balance of cluster instances in the multiple zones.
11. A method comprising:
selecting a particular zone among multiple zones based on a target skew to meet a global balancing of cluster instances;
deploying a particular type of cluster instance to the particular zone;
for each zone from the multiple zones, determining a respective number of cluster instances;
identifying a second particular type of cluster instance to add based on a total number of the second particular type of cluster instance in the multiple zones and a second total number of the particular type of cluster instance in the multiple zones; and
adding the second particular type of cluster instance to a second particular zone to meet the global balancing of cluster instances in the multiple zones.
12. The method of claim 11 , further comprising:
identifying a third particular type of cluster instance to add based on a particular total number of the third particular type of cluster instance in the multiple zones and a third total number of the second particular type of cluster instance in the multiple zones;
adding the third particular type of cluster instance to a third particular zone to meet the global balancing of cluster instances in the multiple zones; and
adding the second particular type of cluster instance to the third particular zone to meet the global balancing of cluster instances in the multiple zones.
13. The method of claim 12 , further comprising:
adding the third particular type of cluster instance to the second particular zone to meet the global balancing of cluster instances in the multiple zones.
14. The method of claim 11 , wherein the second particular zone includes a particular number of cluster instances that is fewer than each number of instances from each of the multiple zones.
15. The method of claim 12 , wherein the third particular zone does not include a particular instance of the third particular type of cluster instance.
16. The method of claim 12 , wherein the second particular zone does not include a particular instance of the third particular type of cluster instance.
17. The method of claim 12 , wherein the third particular zone does not include a particular instance of the second particular type of cluster instance.
18. The method of claim 11 , further comprising:
determining an availability zone skew among the multiple zones; and
based on the availability zone skew, determining the target skew to meet the global balancing of cluster instances, wherein the availability zone skew is based on a difference between a number of instances in a most loaded zone and a second number of instances in a least loaded zone among the multiple zones.
19. The method of claim 18 , further comprising:
prior to determining the availability zone skew among the multiple zones:
determining, after a period of time elapses over a periodic segment of time, an imbalance of cluster instances deployed in multiple zones based on a threshold value, the cluster instances including different types of clusters associated with compute service manager instances.
20. The method of claim 19 , further comprising:
determining, after a second period of time elapses over the periodic segment of time, that a number of cluster instances deployed in the multiple zones is below the threshold value indicating a current balance of cluster instances in the multiple zones.
21. A non-transitory computer-storage medium comprising instructions that, when executed by one or more processors of a machine, configure the machine to perform operations comprising:
selecting a particular zone among multiple zones based on a target skew to meet a global balancing of cluster instances;
deploying a particular type of cluster instance to the particular zone;
for each zone from the multiple zones, determining a respective number of cluster instances;
identifying a second particular type of cluster instance to add based on a total number of the second particular type of cluster instance in the multiple zones and a second total number of the particular type of cluster instance in the multiple zones; and
adding the second particular type of cluster instance to a second particular zone to meet the global balancing of cluster instances in the multiple zones.
22. The non-transitory computer-storage medium of claim 21 , wherein the operations further comprise:
identifying a third particular type of cluster instance to add based on a particular total number of the third particular type of cluster instance in the multiple zones and a third total number of the second particular type of cluster instance in the multiple zones;
adding the third particular type of cluster instance to a third particular zone to meet the global balancing of cluster instances in the multiple zones; and
adding the second particular type of cluster instance to the third particular zone to meet the global balancing of cluster instances in the multiple zones.
23. The non-transitory computer-storage medium of claim 22 , wherein the operations further comprise:
adding the third particular type of cluster instance to the second particular zone to meet the global balancing of cluster instances in the multiple zones.
24. The non-transitory computer-storage medium of claim 21 , wherein the second particular zone includes a particular number of cluster instances that is fewer than each number of instances from each of the multiple zones.
25. The non-transitory computer-storage medium of claim 22 , wherein the third particular zone does not include a particular instance of the third particular type of cluster instance.
26. The non-transitory computer-storage medium of claim 22 , wherein the second particular zone does not include a particular instance of the third particular type of cluster instance.
27. The non-transitory computer-storage medium of claim 22 , wherein the third particular zone does not include a particular instance of the second particular type of cluster instance.
28. The non-transitory computer-storage medium of claim 21 , wherein the operations further comprise:
determining an availability zone skew among the multiple zones; and
based on the availability zone skew, determining the target skew to meet the global balancing of cluster instances, wherein the availability zone skew is based on a difference between a number of instances in a most loaded zone and a second number of instances in a least loaded zone among the multiple zones.
29. The non-transitory computer-storage medium of claim 28 , wherein the operations further comprise:
prior to determining the availability zone skew among the multiple zones:
determining, after a period of time elapses over a periodic segment of time, an imbalance of cluster instances deployed in multiple zones based on a threshold value, the cluster instances including different types of clusters associated with compute service manager instances.
30. The non-transitory computer-storage medium of claim 29 , wherein the operations further comprise:
determining, after a second period of time elapses over the periodic segment of time, that a number of cluster instances deployed in the multiple zones is below the threshold value indicating a current balance of cluster instances in the multiple zones.