Composition of custom key performance indicators for real-time analysis of network telemetry events
A graphical user interface (“GUI”) allows for the creation of custom key performance indicators (“KPIs”) for real-time analysis of network telemetry events. The GUI can include options for defining variables based on event attributes. These can correspond to events that exist in input telemetry streams at a stream processor. The GUI can allow creation of a formula based on these variables. An aggregation section specifies how the output of the formula is aggregated. This can be based on group, aggregation function, and time period. A manager process causes the stream processor to apply the custom KPI definition to real-time input streams. An output KPI stream can then be routed to a destination for analysis.
1. A method for key performance indicator (“KPI”) composition, comprising:
displaying, on a graphical user interface (“GUI”), events that correspond to input telemetry streams that are available in a network;
composing a KPI definition on the GUI based on:
receiving selections to define variables based on attributes of at least one of the events;
receiving input of a KPI formula that is comprised of the variables; and
receiving a selection of a function for aggregating an output of the formula; and
causing a stream processor to apply the KPI definition to create an output KPI stream, wherein the stream processor applies the KPI definition to the input telemetry streams in real-time.
2. The method of claim 1 , further comprising setting, on the GUI, a retention period for the KPI definition, wherein access to the KPI definition by the stream processor is removed after the retention period ends.
3. The method of claim 1 , further comprising:
determining, by a manager process, that a timing threshold is exceeded for creating the KPI stream;
muting the creation of the output KPI stream from the KPI definition; and
issuing an alert regarding the muting.
4. The method of claim 1 , wherein the output KPI stream is routed to a destination selected on the GUI, and wherein the destination includes at least one of a file system, a database, and a web service.
5. The method of claim 1 , further comprising:
receiving selections on the GUI to update the KPI definition; and
contacting the stream processor to cause the stream processor to apply the updated KPI definition.
6. The method of claim 1 , wherein composing the KPI definition is further based on receiving a grouping selection that determines how event attributes are grouped together in applying the formula to the input telemetry streams.
7. The method of claim 1 , wherein the KPI definition includes filtering criteria that causes the stream processor to apply the formula differently based on different event attribute values.
8. A non-transitory, computer-readable medium comprising instructions that are executed by a processor to perform stages for key performance indicator (“KPI”) composition, the stages comprising:
displaying, on a graphical user interface (“GUI”), events that correspond to input telemetry streams that are available in a network;
composing a KPI definition on the GUI based on:
receiving selections to define variables based on attributes of at least one of the events;
receiving input of a KPI formula that is comprised of the variables; and
receiving a selection of a function for aggregating an output of the formula; and
causing a stream processor to apply the KPI definition to create an output KPI stream, wherein the stream processor applies the KPI definition to the input telemetry streams in real-time.
9. The non-transitory, computer-readable medium of claim 8 , the stages further comprising setting, on the GUI, a retention period for the KPI definition, wherein access to the KPI definition by the stream processor is removed after the retention period ends.
10. The non-transitory, computer-readable medium of claim 8 , the stages further comprising:
determining, by a manager process, that a timing threshold is exceeded for creating the KPI stream;
muting the creation of the output KPI stream from the KPI definition; and
issuing an alert regarding the muting.
11. The non-transitory, computer-readable medium of claim 8 , wherein the output KPI stream is routed to a destination selected on the GUI, and wherein the destination includes at least one of a file system, a database, and a web service.
12. The non-transitory, computer-readable medium of claim 8 , the stages further comprising:
receiving selections on the GUI to update the KPI definition; and
contacting the stream processor to cause the stream processor to apply the updated KPI definition.
13. The non-transitory, computer-readable medium of claim 8 , wherein composing the KPI definition is further based on receiving a grouping selection that determines how event attributes are grouped together in applying the formula to the input telemetry streams.
14. The non-transitory, computer-readable medium of claim 8 , wherein the KPI definition includes filtering criteria that causes the stream processor to apply the formula differently based on different event attribute values.
15. A system for key performance indicator (“KPI”) composition, comprising:
a non-transitory, computer-readable medium containing instructions; and
a processor that executes the instructions to perform stages comprising:
displaying, on a graphical user interface (“GUI”), events that correspond to input telemetry streams that are available in a network;
composing a KPI definition on the GUI based on:
receiving selections to define variables based on attributes of at least one of the events;
receiving input of a KPI formula that is comprised of the variables; and
receiving a selection of a function for aggregating an output of the formula; and
causing a stream processor to apply the KPI definition to create an output KPI stream, wherein the stream processor applies the KPI definition to the input telemetry streams in real-time.
16. The system of claim 15 , the stages further comprising setting, on the GUI, a retention period for the KPI definition, wherein access to the KPI definition by the stream processor is removed after the retention period ends.
17. The system of claim 15 , the stages further comprising:
determining, by a manager process, that a timing threshold is exceeded for creating the KPI stream;
muting the creation of the output KPI stream from the KPI definition; and
issuing an alert regarding the muting.
18. The system of claim 15 , wherein the output KPI stream is routed to a destination selected on the GUI, wherein the destination includes at least one of a file system, a database, and a web service.
19. The system of claim 15 , the stages further comprising:
receiving selections on the GUI to update the KPI definition; and
contacting the stream processor to cause the stream processor to apply the updated KPI definition.
20. The system of claim 15 , wherein the KPI definition includes filtering criteria that causes the stream processor to apply the formula differently based on different event attribute values.