Method and system for variable level of logging based on (long term steady state) system error equilibrium
In general, embodiments of the invention relate to a method for enabling enhanced logging. The method includes obtaining historical data for a target entity, determining a steady state error probability of the target entity using the historical data, and enabling, based on the steady state error probability, a first level of enhanced logging on the target entity.
1. A method for enabling enhanced logging, comprising:
obtaining historical data for a target entity;
determining a steady state error probability of the target entity using the historical data, the determining comprising:
determining an initial state of the target entity as one selected from a group of states comprising an error state and a warning state; and
determining a transition probability for the target entity; and
enabling, based on the steady state error probability, a first level of enhanced logging on the target entity.
2. The method of claim 1 , further comprising:
obtaining, after the enabling, second historical data for the target entity;
determining a second steady state error probability of the target entity using the second historical data; and
deactivating, based on the second steady state error probability, the first level of enhanced logging on the target entity on the target entity.
3. The method of claim 2 , further comprising:
after the deactivating the first level of enhanced logging, enabling a second level of enhanced logging on the target entity.
4. The method of claim 3 , wherein the first level of enhanced logging comprises less granular data than the second level of enhanced logging.
5. The method of claim 2 , wherein enabling, based on the steady state error probability, the first level of enhanced logging on the target entity comprises enabling the enhanced logging for a target period, and wherein the second steady state error probability is determined after the target period has elapsed.
6. The method of claim 1 , wherein the transition probability specifies a first probability of the target entity transitioning from the error state to the warning state and a second probability of the target entity transitioning from the warning state to the error state.
7. The method of claim 1 , wherein enabling, based on the steady state error probability, the first level of enhanced logging on the target entity comprises selecting the first level of enhanced logging using a log level mapping.
8. The method of claim 1 , wherein the target entity is a microservice.
9. The method of claim 1 , wherein the target entity is a backup node.
10. A non-transitory computer readable medium comprising computer readable program code, which when executed by a computer processor enables the computer processor to perform a method, the method comprising:
obtaining historical data for a target entity;
determining a steady state error probability of the target entity using the historical data, the determining comprising:
determining an initial state of the target entity as one selected from a group of states comprising an error state and a warning state; and
determining a transition probability for the target entity; and
enabling, based on the steady state error probability, a first level of enhanced logging on the target entity.
11. The non-transitory computer readable medium of claim 10 , the method further comprising:
obtaining, after the enabling, second historical data for the target entity;
determining a second steady state error probability of the target entity using the second historical data; and
deactivating, based on the second steady state error probability, the first level of enhanced logging on the target entity on the target entity.
12. The non-transitory computer readable medium of claim 11 , the method further comprising:
after the deactivating the first level of enhanced logging, enabling a second level of enhanced logging on the target entity.
13. The non-transitory computer readable medium of claim 12 , wherein the first level of enhanced logging comprises less granular data than the second level of enhanced logging.
14. The non-transitory computer readable medium of claim 11 , wherein enabling, based on the steady state error probability, the first level of enhanced logging on the target entity comprises enabling the enhanced logging for a target period, and wherein the second error steady state probability is determined after the target period has elapsed.
15. The non-transitory computer readable medium of claim 10 , wherein the transition probability specifies a first probability of the target entity transitioning from the error state to the warning state and a second probability of the target entity transitioning from warning state to an error state.
16. The non-transitory computer readable medium of claim 10 , wherein enabling, based on the steady state error probability, the first level of enhanced logging on the target entity comprises selecting the first level of enhanced logging using a log level mapping.
17. The non-transitory computer readable medium of claim 10 , wherein the target entity is a microservice.
18. The non-transitory computer readable medium of claim 10 , wherein the target entity is a backup node.