Certificate resiliency validation using chaos engineering
Generally discussed herein are devices, systems, and methods for certificate management resiliency validation. A method can include receiving, at a resiliency tester of a cloud network, experiment data defining a certificate management resilience experiment to be performed on a resource of the cloud network, accessing, by the resiliency tester and a fault library and based on the experiment data, one or more faults that implement the certificate management resilience experiment, altering, by the resiliency tester and based on the experiment data, an attribute of a certificate, a version of the certificate, accessibility to a secrets vault that houses the certificate, or a combination thereof resulting in a modified certificate or modified certificate availability, and altering a certificate management tool based on telemetry data regarding access of the modified certificate.
1 . A method for certificate management resiliency testing, the method comprising:
receiving, at a resiliency tester of a cloud network, experiment data defining a certificate management resilience experiment to be performed on a resource of the cloud network;
accessing, by the resiliency tester, a fault library and based on the experiment data to identify one or more certificate-related faults for implementing in the certificate management resilience experiment;
altering, by the resiliency tester during execution of the certificate management resilience experiment and based on the experiment data, an attribute of a certificate, a version of the certificate, and accessibility to a secrets vault that houses the certificate in accord with the one or more certificate-related faults, thereby producing a resulting in a modified certificate and modified certificate availability;
executing an application that operates using certificate management code, the certificate management code relies on access to the modified certificate and the modified certificate availability;
monitoring execution of the application to collect telemetry data regarding how the certificate management code responds to the modified certificate and the modified certificate availability; and
altering the certificate management code based on the telemetry data regarding access of the modified certificate.
2 . The method of claim 1 , wherein the one or more faults comprise a disabled certificate fault.
3 . The method of claim 1 , wherein the one or more faults comprise a secrets vault unavailable fault.
4 . The method of claim 1 , wherein the one or more faults comprise a certificate attribute alteration fault.
5 . The method of claim 4 , wherein the certificate attribute alteration fault alters a certificate attribute value.
6 . The method of claim 4 , wherein the attribute of the certificate comprises one or more of a key size, content type, certificate name, or key type of the certificate.
7 . The method of claim 1 , wherein the one or more faults comprises a fault that alters a version number of the certificate.
8 . The method of claim 1 , wherein the one or more faults comprises a fault that alters a validity period of the certificate.
9 . The method of claim 1 , wherein the experiment ensures that certificate validation is performed based on only (i) whether an issuer is on a list of valid issuers and (ii) subject name of the certificate matches a pre-defined string.
10 . A compute system of a cloud network comprising:
a resiliency tester;
a memory coupled to the resiliency tester, the memory comprising instructions that, when executed by the resiliency tester, cause the resiliency tester to perform operations for certificate management resiliency testing, the operations comprising:
receiving experiment data defining a certificate management resilience experiment to be performed on a cloud resource of the cloud network;
accessing, by a fault library accessible by the resiliency tester and based on the experiment data, one or more certificate-related faults that implement the certificate management resilience experiment;
altering, based on the experiment data and during execution of the certificate management resilience experiment, an attribute of a certificate, a version of the certificate, and accessibility to a secrets vault that houses the certificate, resulting in a modified certificate and modified certificate availability;
executing an application that operates using certificate management code that relies on access to the modified certificate and the modified certificate availability;
monitoring the execution of the application to collect telemetry data regarding how the certificate management code responds to the modified certificate and the modified certificate availability; and
altering the certificate management code based on the monitoring and the telemetry data regarding access of the modified certificate.
11 . The system of claim 10 , wherein the one or more faults comprise a disabled certificate fault.
12 . The system of claim 10 , wherein the one or more faults comprise a secrets vault unavailable fault.
13 . The system of claim 10 , wherein the one or more faults comprise a certificate attribute alteration fault.
14 . The system of claim 13 , wherein the certificate attribute alteration fault alters a certificate attribute value.
15 . The system of claim 14 , wherein the attribute value of the certificate comprises one or more of a key size, content type, certificate name, or key type of the certificate.
16 . A non-transitory machine-readable medium including instructions that, when executed by a machine, cause the machine to perform operations for certificate management resiliency testing of certificate management code that manages certificates of a cloud resource of a cloud network, the operations comprising:
receiving, at a resiliency tester of the cloud network, experiment data defining a certificate management resilience experiment to be performed on the cloud resource;
accessing, by a fault library accessible by the resiliency tester and based on the experiment data, one or more certificate-related faults that implement the certificate management resilience experiment;
altering, by the resiliency tester, based on the experiment data and during execution of the certificate management resilience experiment, an attribute of a certificate, a version of the certificate, and accessibility to a secrets vault that houses the certificate resulting in a modified certificate and modified certificate availability in accord with the one or more certificate-related faults;
executing an application that operates using the certificate management code that relies on access to the modified certificate and the modified certificate availability;
monitoring the execution of the application to collect telemetry data regarding how the certificate management code responds to the modified certificate and the modified certificate availability; and
altering the certificate management code based on the monitoring and the telemetry data regarding access of the modified certificate.
17 . The non-transitory machine-readable medium of claim 16 , wherein the one or more certificate-related faults comprises a fault that alters a validity period of the certificate or a version number of the certificate.
18 . The non-transitory machine-readable medium of claim 16 , wherein the experiment ensures that certificate validation is performed based on only (i) whether an issuer is on a list of valid issuers and (ii) subject name of the certificate matches a pre-defined string.
19 . The non-transitory machine-readable medium of claim 16 , wherein the one or more certificate-related faults comprises two or more of a disabled certificate fault, a secrets vault unavailable fault, and a certificate attribute alteration fault.
20 . The non-transitory machine-readable medium of claim 19 , wherein the certificate attribute alteration fault alters a certificate attribute value, the attribute of the certificate comprises one or more of a key size, content type, certificate name, or key type of the certificate.