API dependency error and latency injection
The disclosure is directed towards systems and methods for injecting or introducing synthetic errors and latency for testing purposes into microservices provided by one or more servers. A device acting as an intermediary to communication can inject errors into responses or requests traversing the device. The errors can include additional latency, dropped packets, or memory or disk errors. Introducing errors and latency for testing purposes can be used to proactively monitor and identify issues with resources.
1. A method for validating a microservice, the method comprising:
(a) identifying, by a device intermediary to a plurality of microservices, a synthetic error and a first criteria relating to a status or condition of a first microservice of the plurality of microservices, the first criteria comprising a standard operating status or condition;
(b) comparing, by the device, the status or condition of the first microservice to a threshold associated with the standard operating status or condition;
(c) responsive to a determination that the monitored status or condition is within the threshold associated with the standard operating status or condition, implementing the synthetic error by:
(d) receiving, by the device, a request from the first microservice to access a second microservice of the plurality of microservices, the request provided to the second microservice by the device,
(e) receiving, by the device, a response to the request from the second microservice, and
(f) communicating, by the device responsive to the determination, to the first microservice, the response from the second microservice while implementing the synthetic error; and
(g) validating, by the device, that the first microservice one of handled or did not handle the synthetic error.
2. The method of claim 1 , wherein the first criteria comprises one of a time period, a duration, or a frequency.
3. The method of claim 1 , wherein the first criteria comprises identification of a type of request.
4. The method of claim 3 , wherein (d) further comprises determining, by the device, that the request corresponds to the type of request of the first criteria.
5. The method of claim 1 , wherein (a) further comprises identifying, by the device, a latency time and a second criteria for implementing the latency.
6. The method of claim 5 , further comprising determining, by the device, that the second criteria has been met.
7. The method of claim 6 , further comprising:
receiving, by the device, a second request from the first microservice to access one of the plurality of microservices;
delaying, by the device, a second response to the second request in accordance with the latency time; and
validating, by the device, that the first microservice one of handled or did not handle the latency.
8. The method of claim 1 , further comprising:
identifying, by the device, one of a plurality of synthetic errors or a plurality of latency times to implement responsive to a plurality of criteria to validate one or more of the plurality of microservices; and
responding, by the device, to requests by implementing the one of the plurality of synthetic errors or one of the plurality of latency times.
9. The method of claim 1 , wherein the threshold is based on at least one of: a usage of the first microservice, a central processing unit of the first microservice, a memory load of the first microservice, a number of concurrent users, a number of concurrent connections, or an uptime duration.
10. The method of claim 1 , wherein validating, by the device, that the first microservice one of handled or did not handle the synthetic error comprises at least one of determining that the first microservice returned to the standard operating status or condition within a predetermined time or reported an error in an error log.
11. A system for implementing a synthetic error to validate a microservice, the system comprising:
a device comprising one or more processors, coupled to memory and intermediary to a plurality of microservices, the device configured to:
identify the synthetic error and a first criteria relating to a status or condition of a first microservice of the plurality of microservices for implementing the synthetic error to validate the first microservice of the plurality of microservices, the first criteria comprising a standard operating status or condition;
compare the status or condition of the first microservice to a threshold associated with the standard operating status or condition;
responsive to a determination that the monitored status or condition is within the threshold associated with the standard operating status or condition, implementing the synthetic error by:
receiving a request from the first microservice to access a second microservice of the plurality of microservices, the request provided to the second microservice by the device,
receiving a response to the request from the second microservice, and
communicating, responsive to the determination, to the first microservice, the response from the second microservice while implementing the synthetic error; and
validate that the first microservice one of handled or did not handle the synthetic error.
12. The system of claim 11 , wherein the first criteria comprises one of a time period, a duration or a frequency.
13. The system of claim 11 , wherein the first criteria comprises identification of a type of request.
14. The system of claim 13 , wherein the device is further configured to determine the request corresponds to the type of request of the first criteria.
15. The system of claim 11 , wherein the device is further configured to identify a latency time and a second criteria for implementing the latency.
16. The system of claim 15 , wherein the device is further configured to determine that the second criteria has been met.
17. The system of claim 16 , wherein the device is further configured to receive a second request from the first microservice to access one of the plurality of microservices; delay a second response to the second request in accordance with the latency time; and validate that the first microservice one of handled or did not handle the latency.
18. The system of claim 11 , wherein the device is further configured to identify, in order to validate one or more of the plurality of microservices, one of a plurality of synthetic errors or a plurality of latency times to implement responsive to a plurality of criteria; and respond to requests to implement the one of the plurality of synthetic errors or one of the plurality of latency times.
19. The system of claim 11 , wherein the threshold is based on at least one of: a usage of the first microservice, a central processing unit of the first microservice, a memory load of the first microservice, a number of concurrent users, a number of concurrent connections, or an uptime duration.
20. The system of claim 11 , wherein validating that the first microservice one of handled or did not handle the synthetic error comprises at least one of determining that the first microservice returned to the standard operating status or condition within a predetermined time or reported an error in an error log.