Methods and system for throttling analytics processing
A method comprising: receiving an analytic task which includes a priority indicator associated with the analytic task, determining a position of the analytic task in a task queue, the task queue arranged in an order according to their priority indicators, selecting the analytic task based on the order of the task queue, sending the analytic task to an analytics service to determine if the analytics service has sufficient available resources to perform the analytic task, receiving an indication that the analytics service does not have sufficient available resources to perform the analytic task, repositioning the analytic task within the task queue, selecting the analytic task from the task queue based on the order of the task queue and a new position of the analytic task, sending the analytic task to the analytics service, and retrieving another analytic task to send to the analytics service.
1. A system comprising:
one or more processors; and
memory containing instructions configured to control the one or more processors to:
receive, from an analytic service, assessed available resources of an analytic software of the analytic service;
receive, by an analytics task submitter of an application-centric infrastructure management system, a first data flow analysis task of a plurality of data flow analysis tasks, the first data flow analysis task including a priority indicator associated with the first data flow analysis task, the application-centric infrastructure management system including a digital device that manages the plurality of data flow analysis tasks, the first data flow analysis task being responsible for monitoring an application of an enterprise network;
determine, by the analytic task submitter, a position of the first data flow analysis task in a task queue, the task queue including the plurality of data flow analysis tasks arranged in an order according to their respective priority indicators, the determining the position of the first data flow analysis task being based at least on the priority indicator of the first data flow analysis task;
select, by an analytic task manager of the application-centric infrastructure management system, the first data flow analysis task from the task queue based on the order of the task queue;
estimate, by the analytic task manager, a number of analytic service resources required to execute the first data flow analysis task;
determine, by the analytic task manager-if the analytics service has sufficient available analytical resources to perform the first data flow analysis task based on the estimated number of analytic resources required to execute the first data flow analysis task and the assessed available resources of the analytic software;
in response to determining that there is insufficient analytic resources to perform the first data flow analysis task:
reposition the first data flow analysis task within the task queue to a position lower down the task queue, wherein the repositioning the first data flow analysis task within the task queue includes lowering the priority indicator of the first data flow analysis task by one level of less significant priority, and wherein the position lower down in the task queue is determined based on an estimated time frame of when the analytic service may have sufficient analytic resource to execute the analytic task; and
after repositioning the first data flow analysis task, retrieve a second data flow analysis task of the plurality of data flow analysis tasks having lower priority than an original priority of the first data flow analysis task from the task queue, thereby reducing instances of over burdening the analytic service.
2. The system of claim 1 wherein when there is insufficient analytic resources to perform the first data flow analysis task, the analytic task manager receives a rejection signal.
3. The system of claim 1 comprising memory further containing instructions configured to control the one or more processor to: send, by the analytics service, a utilization indication signal if a current workload of the analytic service is greater than a predetermined threshold.
4. The system of claim 1 , comprising memory further containing instructions configured to control the one or more processor to:
perform, by the analytic service, the second data flow analysis task; and
receive, by the analytic task manager, a second indication that the analytics service does have sufficient available analytical resources to perform the second data flow analysis task.
5. The system of claim 4 wherein the second indication is an acceptance signal.
6. The system of claim 1 , wherein determining the position of the first data flow analysis task is further based on a time that the first data flow analysis task is received by the analytic task submitter.
7. The system of claim 1 , wherein determining the position of the first data flow analysis task is further based on a tier of service of one or more entities of the enterprise network associated with the first data flow analysis task.
8. A method comprising:
receiving, from an analytic service, assessed available resources of an analytic software of the analytic service;
receiving, by an analytics task submitter of an application-centric infrastructure management system, a first data flow analysis task of a plurality of data flow analysis tasks, the first data flow analysis task including a priority indicator associated with the first data flow analysis task, the application-centric infrastructure management system including a digital device that manages the plurality of data flow analysis tasks, the first data flow analysis task being responsible for monitoring an application of an enterprise network;
determining, by the analytic task submitter, a position of the first data flow analysis task in a task queue, the task queue including a plurality of data flow analysis tasks arranged in an order according to their respective priority indicators, the determining the position of the first data flow analysis task being based at least on the priority indicator of the first data flow analysis task;
selecting, by an analytic task manager of the application-centric infrastructure management system, the first data flow analysis task from the task queue based on the order of the task queue;
estimating, by the analytic task manager, a number of analytic service resources required to execute the first data flow analysis task;
determining, by the analytic task manager, if the analytics service has sufficient available analytic resources to perform the first data flow analysis task based on the estimated number of analytic resources required to execute the first data flow analysis task and the assessed available resources of the analytic software;
in response to determining that there is insufficient analytic resources to perform the first data flow analysis task:
repositioning the first data flow analysis task within the task queue to a position lower down the task queue, wherein the repositioning the first data flow analysis task within the task queue includes lowering the priority indicator of the first data flow analysis task by one level of less significant priority, and wherein the position lower down in the task queue is determined based on an estimated time frame of when the analytic service may have sufficient analytic resource to execute the analytic task; and
after repositioning the first data flow analysis task, retrieving a second data flow analysis task of the plurality of data flow analysis tasks having lower priority than an original priority of the first data flow analysis task from the task queue, thereby reducing instances of over burdening the analytic service.
9. The method of claim 8 wherein when there is insufficient analytic resources to perform the first data flow analysis task, the analytic task manager receives a is rejection signal.
10. The method of claim 8 further comprising: sending, by the analytics service, a utilization indication signal if the current workload of the analytic service is greater than a predetermined threshold.
11. The method of claim 8 further comprising:
performing, by the analytic service, the second data flow analysis task; and
receiving, by the analytic task manager, a second indication that the analytics service does have sufficient available analytical resources to perform the second data flow analysis task.
12. The method of claim 11 wherein the second indication is an acceptance signal.
13. The method of claim 8 , wherein determining the position of the first data flow analysis task is further based on a time that the first data flow analysis task is received by the analytic task submitter.
14. The method of claim 8 , wherein determining the position of the first data flow analysis task is further based on a tier of service of one or more entities of the enterprise network associated with the first data flow analysis task.
15. A non-transitory computer readable medium including executable instructions, the instructions being executable by a processor to perform a method, the method comprising:
receiving, from an analytic service, assessed available resources of an analytic software of the analytic service;
receiving, by an analytics task submitter of an application-centric infrastructure management system, a first data flow analysis task of a plurality of data flow analysis tasks, the first data flow analysis task including a priority indicator associated with the first data flow analysis task;
determining, by the analytic task submitter, a position of the first data flow analysis task in a task queue, the task queue including a plurality of analytic tasks arranged in an order according to their respective priority indicators, the determining the position of the first data flow analysis task being based at least on the priority indicator of the first data flow analysis task, the application-centric infrastructure management system including a digital device that manages the plurality of data flow analysis tasks, the first data flow analysis task being responsible for monitoring an application of an enterprise network;
selecting, by an analytic task manager of an application-centric infrastructure management system, the first data flow analysis task from the task queue based on the order of the task queue;
estimating, by the analytic task manager, a number of analytic service resources required to execute the first data flow analysis task;
determining, by the analytic task manager, if the analytics service has sufficient available analytical resources to perform the first data flow analysis task based on the estimate number of analytic resources required to execute the first data flow analysis task and the assessed available resources of the analytic software;
in response to determining that there is insufficient analytic resources to perform the first data flow analysis task:
repositioning the first data flow analysis task within the task queue to a position lower down the task queue, wherein the repositioning the first data flow analysis task within the task queue includes lowering the priority indicator of the first data flow analysis task by one level of less significant priority, and wherein the position lower down in the task queue is determined based on an estimated time frame of when the
analytic service may have sufficient analytic resource to execute the analytic task; and after repositioning the first data flow analysis task, retrieving a second data flow analysis task of the plurality of data flow analysis tasks having lower priority than an original priority of the first data flow analysis task from the task queue, thereby reducing instances of over burdening the analytic service.
16. The non-transitory computer readable medium of claim 15 including executable instructions, the instructions being executable by a process to perform the method, the method further comprising:
performing, by the analytic service, the second data flow analysis task; and
receiving, by the analytic task manager, a second indication that the analytics service does have sufficient available resources to perform the second data flow analysis task.