Host malfunction detection for CI/CD systems

1. A method comprising: for each node of a plurality of nodes, determining, by a processing device executing instructions associated with a continuous integration and continuous delivery/deployment (CI/CD) pipeline manager, a runtime value associated with an execution of a CI/CD pipeline; determining, by the processing device executing instructions associated with a continuous integration and continuous delivery/deployment (CI/CD) pipeline manager, for each node of the plurality of nodes, an aggregate performance statistic reflecting the runtime values of the plurality of nodes, wherein the aggregate performance statistic represents a ratio of a difference between a runtime value of a node of the plurality of nodes and an average runtime value of the plurality of nodes excluding the node of the plurality of nodes and the average runtime value of the plurality of nodes excluding the node of the plurality of nodes; identifying, by the processing device executing instructions associated with a continuous integration and continuous delivery/deployment (CI/CD) pipeline manager, among the plurality of nodes, a node having the aggregate performance statistic that satisfies a performance threshold criterion; and marking, by the processing device executing instructions associated with a continuous integration and continuous delivery/deployment (CI/CD) pipeline manager, the node as underperforming.

2. The method of claim 1 , wherein the runtime value represents an elapsed time of executing the CI/CD pipeline by the node.

3. The method of claim 1 , wherein identifying the node of the plurality of nodes that satisfies the performance threshold criterion includes determining whether the aggregate performance statistic of the node of the plurality of nodes exceeds the performance threshold.

4. The method of claim 3 , wherein the performance threshold refers to a predetermined aggregate performance statistic value at which a node of the plurality of nodes is considered underperforming with respect to other nodes of the plurality of nodes.

5. The method of claim 1 , wherein the node comprises at least one of: a container, a virtual machine, or a bare-metal host.

6. The method of claim 1 , further comprising:

analyzing the node to determine a cause of underperformance.

7. The method of claim 1 , further comprising:

for each node of a plurality of nodes, determining a failure count associated with the execution of the CI/CD pipeline;

identifying, among the plurality of nodes, a node that satisfies a failure threshold criterion; and

responsive to identifying the node of the plurality of nodes that satisfied the failure threshold criterion, marking the node as experiencing a high rate of failure.

8. The method of claim 7 , wherein identifying the node of the plurality of nodes that satisfies the failure threshold criterion includes determining whether the failure count of a node of the plurality of nodes exceeds the failure threshold, and wherein the failure threshold is in view of an aggregate failure statistic reflecting the failure counts of the plurality of nodes.

9. A system comprising: a memory; and a processing device, operatively coupled to the memory, to perform operations comprising: for each node of a plurality of nodes, determining, by the processing device executing instructions associated with a continuous integration and continuous delivery/deployment (CI/CD) pipeline manager, a runtime value associated with an execution of a CI/CD pipeline; determining, by the processing device executing instructions associated with a continuous integration and continuous delivery/deployment (CI/CD) pipeline manager, for each node of the plurality of nodes, an aggregate performance statistic reflecting the runtime values of the plurality of nodes, wherein the aggregate performance statistic represents a ratio of a difference between a runtime value of a node of the plurality of nodes and an average runtime value of the plurality of nodes excluding the node of the plurality of nodes and the average runtime value of the plurality of nodes excluding the node of the plurality of nodes; identifying, by the processing device executing instructions associated with a continuous integration and continuous delivery/deployment (CI/CD) pipeline manager, among the plurality of nodes, a node having the aggregate performance statistic that satisfies a performance threshold criterion; and marking, by the processing device executing instructions associated with a continuous integration and continuous delivery/deployment (CI/CD) pipeline manager, the node as underperforming.

10. The system of claim 9 , wherein the runtime value represents an elapsed time of executing the CI/CD pipeline by the node.

11. The system of claim 9 , wherein identifying the node of the plurality of nodes that satisfies the performance threshold criterion includes determining whether the aggregate performance statistic of the node of the plurality of nodes exceeds the performance threshold.

12. The system of claim 11 , wherein the performance threshold refers to a predetermined aggregate performance statistic value at which a node of the plurality of nodes is considered underperforming with respect to other nodes of the plurality of nodes.

13. The system of claim 9 , wherein the node comprises at least one of: a container, a virtual machine, or a bare-metal host.

14. The system of claim 9 , wherein the operations further comprise:

analyzing the node to determine a cause of the underperformance.

15. The system of claim 9 , wherein the operations further comprise:

for each node of a plurality of nodes, determine a failure count associated with the execution of the CI/CD pipeline, wherein the failure count represent a number of times the execution of the CI/CD pipeline failed;

identifying, in view of the failure count, at least one node of the plurality of nodes that satisfies a failure threshold criterion; and

responsive to identifying the at least one node of the plurality of nodes that satisfied the failure threshold criterion, marking the at least one node of the plurality of nodes as experiencing a high rate of failure.

16. The system of claim 15 , wherein identifying the at least one node of the plurality of nodes that satisfies the failure threshold criterion includes determining whether the failure count of the at least one node of the plurality of nodes exceeds the failure threshold, and wherein the failure threshold is in view of an average of the failure count of the plurality of nodes excluding the at least one node of the plurality of nodes.

17. A non-transitory computer-readable storage medium comprising instructions that, when executed by a processing device executing instructions associated with a continuous integration and continuous delivery/deployment (CI/CD) pipeline manager, cause the processing device to perform operations comprising:

for each node of a plurality of nodes, determining a failure count associated with an execution of a CI/CD pipeline;

identifying, among the plurality of nodes, a node in which the corresponding failure count exceeds an aggregate failure statistic reflecting the failure counts of the plurality of nodes, wherein the aggregate failure statistic represents a ratio of a difference between a runtime value of a node of the plurality of nodes and an average runtime value of the plurality of nodes excluding the node of the plurality of nodes and the average runtime value of the plurality of nodes excluding the node of the plurality of nodes; and

responsive to identifying the node of the plurality of nodes in which the corresponding failure count exceeds the aggregate failure statistic, marking the node as experiencing a high rate of failure.

18. The non-transitory computer-readable storage medium of claim 17 , further comprising:

analyzing the node of the plurality of nodes marked as experiencing a high rate of failure to determine a cause of the high rate of failure.