Policy controller for distributed virtualization infrastructure element monitoring
This disclosure describes techniques for monitoring, scheduling, and performance management for virtualization infrastructures within networks. In one example, a computing system includes a plurality of different cloud-based compute clusters (e.g., different cloud projects), each comprising a set of compute nodes. Policy agents execute on the compute nodes to monitor performance and usage metrics relating to resources of the compute nodes. Policy controllers within each cluster deploy policies to the policy agents and evaluate performance and usage metrics from the policy agents by application of one or more rulesets for infrastructure elements of the compute cluster. Each of the policy controllers outputs data to a multi-cluster dashboard software system indicative of a current health status for the infrastructure elements based on the evaluation of the performance and usage metrics for the cluster. The multi-cluster dashboard software system data outputs, as single user interface screen, the current health status for each of the cloud-based compute clusters.
1. A method comprising:
enabling, by a controller, a plurality of policy agents to monitor usage metrics for each of a first plurality of compute nodes within a first compute cluster and to monitor usage metrics for each of a second plurality of compute nodes within a second compute cluster;
receiving, by the controller and from the plurality of policy agents, information about the usage metrics for the first plurality of compute nodes and information about the usage metrics for the second plurality of compute nodes;
evaluating, by the controller and based on the information about the usage metrics for the first plurality of compute nodes, infrastructure elements for the first compute cluster;
evaluating, by the controller and based on the information about the usage metrics for the second plurality of compute nodes, infrastructure elements for the second compute cluster;
generating, by the controller, health data including first health status information for the infrastructure elements for the first compute cluster and second health status information for the infrastructure elements for the second compute cluster;
outputting, by the controller, a first single-cluster user interface for presentation as a single-cluster dashboard for the first compute cluster, wherein the first single-cluster user interface presents the first health status information but not the second health status information; and
outputting, by the controller, a second single-cluster user interface for presentation as a single-cluster dashboard for the second compute cluster, wherein the second single-cluster user interface presents the second health status information but not the first health status information.
2. The method of claim 1 ,
wherein evaluating infrastructure elements for the first compute cluster includes evaluating, based on a first ruleset applied to the information about the usage metrics for the first plurality of compute nodes, the infrastructure elements for the first compute cluster; and
wherein evaluating infrastructure elements for the second compute cluster includes evaluating, based on a second ruleset applied to the information about the usage metrics for the second plurality of compute nodes, the infrastructure elements for the second compute cluster.
3. The method of claim 1 , wherein outputting the first single-cluster user interface includes:
enabling presentation of a plurality of graphical regions arranged within the first single-cluster user interface, wherein each of the plurality of graphical regions includes a plurality of graphical tiles.
4. The method of claim 3 ,
wherein each of the graphical tiles corresponds to a different type of infrastructure element and includes an integer count of infrastructure elements being monitored, and
wherein each of the graphical tiles has an appearance indicating whether the corresponding type of infrastructure element has been determined to be unhealthy.
5. The method of claim 1 , further comprising:
enabling, by the controller, switching between the first single-cluster user interface and the second single-cluster user interface without requiring re-authentication of a user.
6. The method of claim 1 , further comprising:
maintaining, by the controller, a hash table storing authentication tokens for each of the compute clusters; and
switching, by the controller and responsive to input, between the first single-cluster user interface and the second single-cluster user interface without requiring reauthentication of a user by utilizing the authentication tokens from the hash table.
7. The method of claim 2 ,
wherein the first ruleset includes a first set of alarms; and
wherein the second ruleset includes a second set of alarms.
8. The method of claim 7 ,
wherein the first ruleset includes a first set of assigned weights for the first set of alarms; and
wherein the second ruleset includes a second set of assigned weights for the second set of alarms.
9. The method of claim 8 , wherein generating the health data includes:
generating health data by applying the first set of assigned weights to the first set of alarms, and by applying the second set of assigned weights to the second set of alarms.
10. The method of claim 1 , wherein the first health status information is a current first health status, wherein the second health status information is a current second health status, and wherein generating health data includes:
generating first difference information specifying changes to a prior first health status of infrastructure elements for the first compute cluster; and
generating second difference information specifying changes a prior second health status of infrastructure elements for the second compute cluster.
11. A controller comprising a storage system and processing circuitry, wherein the processing circuitry has access to the storage system and is configured to:
enable a plurality of policy agents to monitor usage metrics for each of a first plurality of compute nodes within a first compute cluster and to monitor usage metrics for each of a second plurality of compute nodes within a second compute cluster;
receive, from the plurality of policy agents, information about the usage metrics for the first plurality of compute nodes and information about the usage metrics for the second plurality of compute nodes;
evaluate, based on the information about the usage metrics for the first plurality of compute nodes, infrastructure elements for the first compute cluster;
evaluate, based on the information about the usage metrics for the second plurality of compute nodes, infrastructure elements for the second compute cluster;
generate health data including first health status information for the infrastructure elements for the first compute cluster and second health status information for the infrastructure elements for the second compute cluster;
output a first single-cluster user interface for presentation as a single-cluster dashboard for the first compute cluster, wherein the first single-cluster user interface presents the first health status information but not the second health status information; and
output a second single-cluster user interface for presentation as a single-cluster dashboard for the second compute cluster, wherein the second single-cluster user interface presents the second health status information but not the first health status information.
12. The controller of claim 11 ,
wherein to evaluate infrastructure elements for the first compute cluster, the processing circuitry is further configured to evaluate, based on a first ruleset applied to the information about the usage metrics for the first plurality of compute nodes, the infrastructure elements for the first compute cluster; and
wherein to evaluate infrastructure elements for the second compute cluster, the processing circuitry is further configured to evaluate, based on a second ruleset applied to the information about the usage metrics for the second plurality of compute nodes, the infrastructure elements for the second compute cluster.
13. The controller of claim 11 , wherein to output the first single-cluster user interface, the processing circuitry is further configured to:
enable presentation of a plurality of graphical regions arranged within the first single-cluster user interface, wherein each of the plurality of graphical regions includes a plurality of graphical tiles.
14. The controller of claim 13 ,
wherein each of the graphical tiles corresponds to a different type of infrastructure element and includes an integer count of infrastructure elements being monitored, and
wherein each of the graphical tiles has an appearance indicating whether the corresponding type of infrastructure element has been determined to be unhealthy.
15. The controller of claim 11 , wherein the processing circuitry is further configured to:
enable switching between the first single-cluster user interface and the second single-cluster user interface without requiring re-authentication of a user.
16. The controller of claim 11 , wherein the processing circuitry is further configured to:
maintain a hash table storing authentication tokens for each of the compute clusters; and
switch, responsive to input, between the first single-cluster user interface and the second single-cluster user interface without requiring reauthentication of a user by utilizing the authentication tokens from the hash table.
17. The controller of claim 12 ,
wherein the first ruleset includes a first set of alarms; and
wherein the second ruleset includes a second set of alarms.
18. The controller of claim 17 ,
wherein the first ruleset includes a first set of assigned weights for the first set of alarms; and
wherein the second ruleset includes a second set of assigned weights for the second set of alarms.
19. The controller of claim 18 , wherein to generate the health data, the processing circuitry is further configured to:
generate health data by applying the first set of assigned weights to the first set of alarms, and by applying the second assigned weights to the second set of alarms.
20. A non-transitory computer-readable medium comprising instructions that, when executed, configure processing circuitry of a computing system to:
enable a plurality of policy agents to monitor usage metrics for each of a first plurality of compute nodes within a first compute cluster and to monitor usage metrics for each of a second plurality of compute nodes within a second compute cluster;
receive, from the plurality of policy agents, information about the usage metrics for the first plurality of compute nodes and information about the usage metrics for the second plurality of compute nodes;
evaluate, based on the information about the usage metrics for the first plurality of compute nodes, infrastructure elements for the first compute cluster;
evaluate, based on the information about the usage metrics for the second plurality of compute nodes, infrastructure elements for the second compute cluster;
generate health data including first health status information for the infrastructure elements for the first compute cluster and second health status information for the infrastructure elements for the second compute cluster;
output a first single-cluster user interface for presentation as a single-cluster dashboard for the first compute cluster, wherein the first single-cluster user interface presents the first health status information but not the second health status information; and
output a second single-cluster user interface for presentation as a single-cluster dashboard for the second compute cluster, wherein the second single-cluster user interface presents the second health status information but not the first health status information.