Key name synthesis
Key name synthesis is disclosed. A metrics data point is received. Based at least in part on a translation statement, at least a portion of the received metrics data point is associated with a key specified by the translation statement such that the specified key and the associated at least portion of the received metrics data point form a key-value pair. The key-value pair is associated with the received metrics data point.
1. A system, comprising:
a processor configured to:
receive a log message collected from a monitored remote device, the log message comprising a timestamp, a metric name, a metric value corresponding to the metric name, a first field name, and a first field value corresponding to the first field name;
based on a translation statement, associate the received log message with a metrics data point comprising the timestamp, the metric name, the metric value, the first field name, and the first field value, wherein the first field name and the first field value form a key-value pair;
determine identifying metadata for identifying a time series from a plurality of time series, the identifying metadata comprising the key-value pair, wherein metrics data points for the metric name with different identifying metadata are stored in different time series;
identify a particular time series, from the plurality of time series, that corresponds to the metric name and the identifying metadata; and
store the metrics data point associated with the received log message in the identified particular time series based on the metric name and the identifying metadata; and
a memory coupled to the processor and configured to provide the processor with instructions.
2. The system of claim 1 , wherein the translation statement comprises a filtering condition, and wherein the processor is configured to:
associate the metrics data point with the metric name in response to determining that the metrics data point matches to the filtering condition.
3. The system of claim 2 wherein in response to determining that the metrics data point matches to the filtering condition, the processor is configured to:
extract, according to the translation statement, the first field name, the first field value, and the metric value.
4. The system of claim 1 , wherein the received log message comprises a dot-separated metric name, and wherein the processor is configured to form the key-value pair at least in part by addressing an individual segment of the dot-separated metric name and mapping the addressed segment of the dot-separated metric name to the key specified in the translation statement.
5. A method, comprising:
receiving a log message collected from a monitored remote device, the log message comprising a timestamp, a metric name, a metric value corresponding to the metric name, a first field name, and a first field value corresponding to the first field name;
based on a translation statement, associating the received log message with a metrics data point comprising the timestamp, the metric name, the metric value, the first field name, and the first field value, wherein the first field name and the first field value form a key-value pair;
determining identifying metadata for identifying a time series from a plurality of time series, the identifying metadata comprising the key-value pair, wherein metrics data points for the metric name with different identifying metadata are stored in different time series;
identifying a particular time series, from the plurality of time series, that corresponds to the metric name and the identifying metadata; and
storing the metrics data point associated with the received log message in the identified particular time series based on the metric name and the identifying metadata.
6. The method of claim 5 wherein the translation statement comprises a filtering condition, the method further comprising:
associating the metrics data point with the metric name in response to determining that the metrics data point matches to the filtering condition.
7. The method of claim 6 , further comprising:
in response to determining that the received log message matches to the filtering condition, extracting, according to the translation statement, the first field name, the first field value, and the metric value.
8. The method of claim 5 , wherein the received log message comprises a dot-separated metric name, and further comprising forming the key-value pair at least in part by addressing an individual segment of the dot-separated metric name and mapping the addressed segment of the dot-separated metric name to the key specified in the translation statement.
9. A computer program product embodied in a tangible computer readable storage medium and comprising computer instructions for:
receiving a log message collected from a monitored remote device, the log message comprising a timestamp, a metric name, a metric value corresponding to the metric name, a first field name, and a first field value corresponding to the first field name;
based on a translation statement, associating the received log message with a metrics data point comprising the timestamp, the metric name, the metric value, the first field name, and the first field value, wherein the first field name and the first field value form a key-value pair;
determining identifying metadata for identifying a time series from a plurality of time series, the identifying metadata comprising the key-value pair, wherein metrics data points for the metric name with different identifying metadata are stored in different time series;
identifying a particular time series, from the plurality of time series, that corresponds to the metric name and the identifying metadata; and
storing the metrics data point associated with the received log message in the identified particular time series based on the metric name and the identifying metadata.
10. The computer program product of claim 9 wherein the translation statement comprises a filtering condition, the computer program product further comprising computer instructions for:
associating the metrics data point with the metric name in response to determining that the metrics data point matches to the filtering condition.
11. The computer program product of claim 10 , the computer program product further comprising computer instructions for:
in response to determining that the received log message matches to the filtering condition, extracting, according to the translation statement, the first field name, the first field value, and the metric value.
12. The computer program product of claim 9 , wherein the received log message comprises a dot-separated metric name, and further comprising computer instructions for forming the key-value pair at least in part by addressing an individual segment of the dot-separated metric name and mapping the addressed segment of the dot-separated metric name to the key specified in the translation statement.
13. The system of claim 1 , wherein the identifying metadata further comprises a file name.
14. The system of claim 1 , wherein the identifying metadata further comprises an entity name.
15. The system of claim 1 , wherein the identifying metadata further comprises an output queue.
16. The system of claim 1 , wherein the processor is further configured to:
associate the metrics data point with a second key and a second-key value that form a second key-value pair; and
generate non-identifying metadata based on the second key-value pair.
17. The method of claim 5 , further comprising:
associating the metrics data point with a second key and a second-key value that form a second key-value pair; and
generating non-identifying metadata based on the second key-value pair.
18. The computer program product of claim 9 further comprising computer instructions for:
associating the metrics data point with a second key and a second-key value that form a second key-value pair; and
generating non-identifying metadata based on the second key-value pair.