Configuring metric collection based on application information
A computer-implemented method of monitoring programmatic containers performed through executing an agent processor is disclosed. The method comprises transmitting, by a processor, one or more deployment configurations from a monitoring server related to an application hosted in a container to a backend device, the processor receiving, from the backend device, a plurality of monitoring configurations for the application, the processor merging the plurality of monitoring configurations for the application into a merged monitoring configuration for the application, the processor providing the merged monitoring configuration for the application to the monitoring server, and the processor periodically receiving, from the monitoring server, telemetry data that characterizes one or more instances of the application.
1 . A computer-implemented method for monitoring a plurality of instances of an application, each of the plurality of instances of the application running in one of a plurality of containers of a computing cloud according to a deployment configuration for the application, the computer-implemented method comprising:
executing at least one of the plurality of instances of the application in at least one of the plurality of containers of the computing cloud according to the deployment configuration;
acquiring, by a first agent processor application from a backend device of the computing cloud, a plurality of monitoring configurations that specify telemetry data to collect from the plurality of instances of the application, wherein the first agent processor application executes on a first computer of the computing cloud that is separate from the backend device;
identifying, by the first agent processor application, a subset of the plurality of monitoring configurations (1) that are redundant with respect to others of the plurality of monitoring configurations or (2) that are not relevant to the deployment configuration;
creating, by the first agent processor application, a merged monitoring configuration file or data structure from the plurality of monitoring configurations, wherein the merged monitoring configuration excludes the subset;
periodically acquiring, by the first agent processor application, from a monitoring server of the computing cloud that is configured according to the merged monitoring configuration, first telemetry data for the plurality of monitoring configurations excluding the subset, which the monitoring server collects from at least some of the plurality of instances of the application; and
transmitting, by the first agent processor application to the backend device, the first telemetry data to be persisted by the backend device for analysis of the application.
2 . The computer-implemented method of claim 1 , further comprising:
acquiring, by the first agent processor application from the monitoring server or from a cluster manager of a cluster that includes the plurality of containers, the deployment configuration.
3 . The computer-implemented method of claim 1 , further comprising:
acquiring, by the first agent processor application from a second agent processor application, second telemetry data, wherein the second agent processor application executes on a second computer of the computing cloud that is separate from the first computer and the backend device, the first telemetry data being collected from instances of the application executing on the first computer, and the second telemetry data being collected from instances of the application executing on the second computer; and
transmitting, by the first agent processor application to the backend device, the second telemetry data to be persisted by the backend device for analysis of the application.
4 . The computer-implemented method of claim 1 , wherein the plurality of monitoring configurations includes monitoring configurations corresponding to a first application type and monitoring configurations corresponding to a second application type, the computer-implemented method further comprising:
excluding, by the first agent processor application in the merged monitoring configuration, the monitoring configurations corresponding to the second application type.
5 . The computer-implemented method of claim 1 , further comprising:
specifying, by the first agent processor application in the merged monitoring configuration, not to collect telemetry data for a particular metric for the application that is to be ignored.
6 . The computer-implemented method of claim 1 , further comprising:
including, by the first agent processor application in the merged monitoring configuration, a regular expression that matches values for some telemetry data collected by the monitoring server from the at least some of the plurality of instances of the application, the acquiring of the first telemetry data being based at least in part on the matching of the regular expression.
7 . The computer-implemented method of claim 1 , further comprising:
replacing, by the first agent processor application, a first name of a metric of the first telemetry data with a second name different from the first name, wherein the first telemetry data associates the first name with the metric when collected by the monitoring server from the at least some of the plurality of instances of the application, and the first telemetry data associates the second name with the metric when transmitted by the first agent processor application to the backend device.
8 . The computer-implemented method of claim 1 , further comprising:
specifying, by the first agent processor application in the merged monitoring configuration, a calculation to perform with respect to a metric to be collected by the monitoring server, the first telemetry data containing a result of performing the calculation.
9 . A non-transitory computer-readable storage medium storing instructions which, when executed by a first computer of a computing cloud, cause a first agent processor application executing on the first computer to carry out a method of monitoring a plurality of instances of an application, each of the plurality of instances of the application running in one of a plurality of containers of the computing cloud according to a deployment configuration for the application, wherein the method comprises:
executing at least one of the plurality of instances of the application in at least one of the plurality of containers of the computing cloud according to the deployment configuration;
acquiring, from a backend device of the computing cloud that is separate from the first computer, a plurality of monitoring configurations that specify telemetry data to collect from the plurality of instances of the application;
identifying a subset of the plurality of monitoring configurations (1) that are redundant with respect to others of the plurality of monitoring configurations or (2) that are not relevant to the deployment configuration;
creating a merged monitoring configuration file or data structure from the plurality of monitoring configurations, the merged monitoring configuration excluding the subset;
periodically acquiring, from a monitoring server of the computing cloud that is configured according to the merged monitoring configuration, first telemetry data for the plurality of monitoring configurations excluding the subset, which the monitoring server collects from at least some of the plurality of instances of the application; and
transmitting, to the backend device, the first telemetry data to be persisted by the backend device for analysis of the application.
10 . The non-transitory computer-readable storage medium of claim 9 , wherein the method further comprises:
acquiring the deployment configuration from the monitoring server or from a cluster manager of a cluster that includes the plurality of containers.
11 . The non-transitory computer-readable storage medium of claim 9 , wherein the method further comprises:
acquiring, from a second agent processor application, second telemetry data, the second agent processor application executing on a second computer of the computing cloud that is separate from the first computer and the backend device, the first telemetry data being collected from instances of the application executing on the first computer, and the second telemetry data being collected from instances of the application executing on the second computer; and
transmitting, to the backend device, the second telemetry data to be persisted by the backend device for analysis of the application.
12 . The non-transitory computer-readable storage medium of claim 9 , wherein the plurality of monitoring configurations includes monitoring configurations corresponding to a first application type and monitoring configurations corresponding to a second application type, wherein the method further comprises:
excluding, in the merged monitoring configuration, the monitoring configurations corresponding to the second application type.
13 . The non-transitory computer-readable storage medium of claim 9 , wherein the method further comprises:
specifying, in the merged monitoring configuration, not to collect telemetry data for a particular metric for the application that is to be ignored.
14 . The non-transitory computer-readable storage medium of claim 9 , wherein the method further comprises:
including, in the merged monitoring configuration, a regular expression that matches values for some telemetry data collected by the monitoring server from the at least some of the plurality of instances of the application, the acquiring of the first telemetry data being based at least in part on the matching of the regular expression.
15 . The non-transitory computer-readable storage medium of claim 9 , wherein the method further comprises:
replacing a first name of a metric of the first telemetry data with a second name different from the first name, the first telemetry data associating the first name with the metric when collected by the monitoring server from the at least some of the plurality of instances of the application, and the first telemetry data associating the second name with the metric when transmitted by the first agent processor application to the backend device.
16 . The non-transitory computer-readable storage medium of claim 9 , wherein the method further comprises:
specifying, in the merged monitoring configuration, a calculation to perform with respect to a metric to be collected by the monitoring server, the first telemetry data containing a result of performing the calculation.
17 . A computer including a processor and memory, wherein the processor executes instructions stored in the memory to monitor a plurality of instances of an application, each of the plurality of instances of the application running in one of a plurality of containers of a computing cloud according to a deployment configuration for the application, by performing the following steps:
executing at least one of the plurality of instances of the application in at least one of the plurality of containers of the computing cloud according to the deployment configuration;
acquiring, by a first agent processor application from a backend device of the computing cloud that is separate from the computer, a plurality of monitoring configurations that specify telemetry data to collect from the plurality of instances of the application, the first agent processor application executing on the computer;
identifying, by the first agent processor application, a subset of the plurality of monitoring configurations (1) that are redundant with respect to others of the plurality of monitoring configurations or (2) that are not relevant to the deployment configuration;
creating, by the first agent processor application, a merged monitoring configuration file or data structure from the plurality of monitoring configurations, the merged monitoring configuration excluding the subset;
periodically acquiring, by the first agent processor application from a monitoring server of the computing cloud that is configured according to the merged monitoring configuration, first telemetry data for the plurality of monitoring configurations excluding the subset, which the monitoring server collects from at least some of the plurality of instances of the application; and
transmitting, by the first agent processor application to the backend device, the first telemetry data to be persisted by the backend device for analysis of the application.
18 . The computer of claim 17 , wherein the steps further include:
acquiring, by the first agent processor application from the monitoring server or from a cluster manager of a cluster that includes the plurality of containers, the deployment configuration.
19 . The computer of claim 17 , wherein the steps further include:
acquiring, by the first agent processor application from a second agent processor application, second telemetry data, the second agent processor application executing on another computer of the computing cloud that is separate from the computer and the backend device, the first telemetry data being collected from instances of the application executing on the computer, and the second telemetry data being collected from instances of the application executing on the other computer; and
transmitting, by the first agent processor application to the backend device, the second telemetry data to be persisted by the backend device for analysis of the application.
20 . The computer of claim 17 , wherein the plurality of monitoring configurations includes monitoring configurations corresponding to a first application type and monitoring configurations corresponding to a second application type, and wherein the steps further include:
excluding, by the first agent processor application in the merged monitoring configuration, the monitoring configurations corresponding to the second application type.