Provisioning Tasks Across a Plurality of Clusters Based on Priority and Geographic Proximity
Systems and methods for multi-cluster worker management for speed and proximity use cases. A method includes providing a plurality of tasks to a priority-based backlog queue and provisioning each of the plurality of tasks to one of a plurality of clusters. Provisioning each of the plurality of tasks comprises provisioning based on a proximity-based allocation process. The proximity-based allocation process includes identifying a network element location associated with each of the plurality of tasks, identifying a geographic location for each of the plurality of clusters, and prioritizing a nearest cluster of the plurality of clusters.
1 . A method comprising:
providing a plurality of tasks to a priority-based backlog queue; and
provisioning each of the plurality of tasks to one of a plurality of clusters;
wherein provisioning each of the plurality of tasks comprises provisioning based on a proximity-based allocation process comprising:
identifying a network element location associated with each of the plurality of tasks;
identifying a geographic location for each of the plurality of clusters; and
prioritizing a nearest cluster of the plurality of clusters.
2 . The method of claim 1 , wherein provisioning each of the plurality of tasks further comprises prioritizing the plurality of clusters based on user selection of one or more of the plurality of clusters.
3 . The method of claim 2 , wherein the user selection of the one or more of the plurality of clusters comprises the user identifying one or more preferred labels for executing at least a portion of the plurality of tasks, wherein each of the one or more preferred labels is associated with one or more pods or containers within a containerized workload system.
4 . The method of claim 1 , wherein provisioning each of the plurality of tasks further comprises provisioning based on a round robin allocation protocol.
5 . The method of claim 4 , wherein provisioning based on the round robin allocation protocol comprises:
identifying one or more healthy clusters of the plurality of clusters;
identifying available cluster capacity across the plurality of clusters; and
assign at least a portion of the plurality of tasks to the healthy and available clusters of the plurality of clusters based on round robin placement.
6 . The method of claim 1 , wherein each of the plurality of clusters comprises a plurality of compute nodes.
7 . The method of claim 1 , wherein identifying the network element location associated with each of the plurality of tasks comprises retrieving from inventory a latitude and longitude location associated with each of the plurality of tasks; and
wherein identifying the geographic location for each of the plurality of clusters comprises retrieving from the inventory a latitude and longitude location associated with a bare metal server supporting each of the plurality of clusters.
8 . The method of claim 1 , wherein the nearest cluster is located a shortest physical distance away from a task associated with the network element location when compared with remaining clusters of the plurality of clusters, and wherein prioritizing the nearest cluster of the plurality of clusters comprises:
determining whether the nearest cluster is healthy and available; and
in response to determining the nearest cluster is healthy and available, generating a plan indicating the task associated with the network element location should be executed by the nearest cluster.
9 . The method of claim 1 , wherein provisioning each of the plurality of tasks comprises first provisioning based on manual user selection of clusters and then provisioning based on the proximity-based allocation process.
10 . The method of claim 1 , wherein the method is executed by a multi-data center automation platform engine associated with a containerized workload system, and wherein the multi-data center automation platform engine comprises a worker cluster manager configured to:
validate a new cluster to be added to a bank of available worker clusters;
register the new cluster within the bank of available worker clusters such that the new cluster is eligible to receive tasks provided to the priority-based backlog queue; and
monitor health of the plurality of clusters in real-time.
11 . A system comprising one or more processors configured to execute instructions stored in non-transitory computer readable storage medium, the instructions comprising:
providing a plurality of tasks to a priority-based backlog queue; and
provisioning each of the plurality of tasks to one of a plurality of clusters;
wherein provisioning each of the plurality of tasks comprises provisioning based on a
identifying a network element location associated with each of the plurality of tasks;
identifying a geographic location for each of the plurality of clusters; and
prioritizing a nearest cluster of the plurality of clusters.
12 . The system of claim 11 , wherein the instructions are such that provisioning each of the plurality of tasks further comprises prioritizing the plurality of clusters based on user selection of one or more of the plurality of clusters; and
wherein the user selection of the one or more of the plurality of clusters comprises the user identifying one or more preferred labels for executing at least a portion of the plurality of tasks, wherein each of the one or more preferred labels is associated with one or more pods or containers within a containerized workload system.
13 . The system of claim 11 , wherein the instructions are such that provisioning each of the plurality of tasks further comprises provisioning based on a round robin allocation protocol, and wherein provisioning based on the round robin allocation protocol comprises:
identifying one or more healthy clusters of the plurality of clusters;
identifying available cluster capacity across the plurality of clusters; and
assign at least a portion of the plurality of tasks to the healthy and available clusters of the plurality of clusters based on round robin placement.
14 . The system of claim 11 , wherein the instructions are such that identifying the network element location associated with each of the plurality of tasks comprises retrieving from inventory a latitude and longitude location associated with each of the plurality of tasks; and
wherein identifying the geographic location for each of the plurality of clusters comprises retrieving from the inventory a latitude and longitude location associated with a bare metal server supporting each of the plurality of clusters.
15 . The system of claim 11 , wherein the instructions are such that the nearest cluster is located a shortest physical distance away from a task associated with the network element location when compared with remaining clusters of the plurality of clusters, and wherein prioritizing the nearest cluster of the plurality of clusters comprises:
determining whether the nearest cluster is healthy and available; and
in response to determining the nearest cluster is healthy and available, generating a plan indicating the task associated with the network element location should be executed by the nearest cluster.
16 . Non-transitory computer readable storage medium storing instructions for execution by one or more processors, the instructions comprising:
providing a plurality of tasks to a priority-based backlog queue; and
provisioning each of the plurality of tasks to one of a plurality of clusters;
wherein provisioning each of the plurality of tasks comprises provisioning based on a proximity-based allocation process comprising:
identifying a network element location associated with each of the plurality of tasks;
identifying a geographic location for each of the plurality of clusters; and
prioritizing a nearest cluster of the plurality of clusters.
17 . The non-transitory computer readable storage medium of claim 16 , wherein the instructions are such that provisioning each of the plurality of tasks further comprises prioritizing the plurality of clusters based on user selection of one or more of the plurality of clusters; and
wherein the user selection of the one or more of the plurality of clusters comprises the user identifying one or more preferred labels for executing at least a portion of the plurality of tasks, wherein each of the one or more preferred labels is associated with one or more pods or containers within a containerized workload system.
18 . The non-transitory computer readable storage medium of claim 16 , wherein the instructions are such that provisioning each of the plurality of tasks further comprises provisioning based on a round robin allocation protocol, and wherein provisioning based on the round robin allocation protocol comprises:
identifying one or more healthy clusters of the plurality of clusters;
identifying available cluster capacity across the plurality of clusters; and
assign at least a portion of the plurality of tasks to the healthy and available clusters of the plurality of clusters based on round robin placement.
19 . The non-transitory computer readable storage medium of claim 16 , wherein the instructions are such that identifying the network element location associated with each of the plurality of tasks comprises retrieving from inventory a latitude and longitude location associated with each of the plurality of tasks; and
wherein identifying the geographic location for each of the plurality of clusters comprises retrieving from the inventory a latitude and longitude location associated with a bare metal server supporting each of the plurality of clusters.
20 . The non-transitory computer readable storage medium of claim 16 , wherein the instructions are such that the nearest cluster is located a shortest physical distance away from a task associated with the network element location when compared with remaining clusters of the plurality of clusters, and wherein prioritizing the nearest cluster of the plurality of clusters comprises:
determining whether the nearest cluster is healthy and available; and
in response to determining the nearest cluster is healthy and available, generating a plan indicating the task associated with the network element location should be executed by the nearest cluster.