Metric collection and aggregation for distributed software services
Various embodiments disclosed herein relate to collection and aggregation of metrics for software services operating across a plurality of computing nodes.
1. A method, comprising:
requesting, from a software service deployment manager on a first computing node, by a hardware processor, identification of metric-providing software service instances operating on a plurality of computing nodes not including the first computing node, each particular metric-providing software service instance including a metric provider that produces pre-calculated metric data for the particular metric-providing software service instance, wherein the particular metric-providing software service instance registers with the software service deployment manager a metric-providing capability of the particular metric-providing software service instance, the pre-calculated metric data includes a metric calculated for the particular metric-providing software service instance, and the metric is calculated at a particular computing node operating the particular metric-providing software service instance;
responsive to the requesting, receiving, by the hardware processor, response data from the software service deployment manager on the first computing node, wherein the response data includes identification of the metric-providing software service instances;
collecting, by the hardware processor, pre-calculated metric data from at least one of the metric-providing software service instances identified by the response data; and
aggregating, by the hardware processor, the collected pre-calculated metric data into a metric packet, wherein the aggregating is based on software service identifiers, timestamps, metric names, and user identifiers included in the pre-calculated metric data, wherein the collected pre-calculated metric data comprises a first data portion associated with a particular software service identifier and a second data portion associated with the particular software service identifier, wherein the first data portion aggregates metrics generated by first software service instances on at least two different computing nodes while servicing requests for a first user identifier, wherein the second data portion aggregates metrics generated by second software service instances on at least two different computing nodes while servicing requests for a second user identifier, wherein the first software services instances and the second software services instances are associated with the particular software service identifier, wherein the first data portion comprises at least one metric relating to a count of data sets managed by the first software service instances for servicing requests for the first user identifier, and wherein the count of data sets managed by the first software service instances is calculated by counting the first user identifier only once for the first software service instances across two or more different computing nodes.
2. The method of claim 1 , wherein the response data is received over a communications network from a software service deployment manager, and the software service deployment manager monitors for metric-providing software service instances operating on a computing node.
3. The method of claim 1 , wherein the aggregating is based on software service deployment identifiers, each of which identifies an exclusive group of software service identifiers.
4. The method of claim 1 , wherein the response data comprises a universal resource locator (URL) for collecting pre-calculated metric data from the at least one of the metric-providing software service instances.
5. The method of claim 1 , wherein the metric comprises software version information for the particular metric-providing software service instance.
6. The method of claim 1 , wherein the metric comprises unique users over a time period.
7. The method of claim 1 , wherein the metric comprises metrics calculated according to at least one of user identifiers, time, and date.
8. The method of claim 1 , comprising storing the metric packet to a database that services software metric queries.
9. The method of claim 1 , wherein the method is being performed by a software service instance operating on a computing node separate from the plurality of computing nodes.
10. A system comprising:
a hardware processor of a machine; and
a memory storing instructions that, when executed by the hardware processor, cause the machine to perform operations comprising:
requesting, from a software service deployment manager on a first computing node, identification of metric-providing software service instances operating on a plurality of computing nodes not including the first computing node, each particular metric-providing software service instance including a metric provider that produces pre-calculated metric data for the particular metric-providing software service instance, wherein the particular metric-providing software service instance registers with the software service deployment manager a metric-providing capability of the particular metric-providing software service instance, the pre-calculated metric data includes a metric calculated for the particular metric-providing software service instance, and the metric is calculated at a particular computing node operating the particular metric-providing software service instance;
responsive to the requesting, receiving response data from the software service deployment manager on the first computing node, wherein the response data includes identification of the metric-providing software service instances;
collecting, from one of the plurality of computing nodes, pre-calculated metric data for at least one of the metric-providing software service instances identified by the response data; and
aggregating the collected pre-calculated metric data into a metric packet, wherein the aggregating is based on software service identifiers, timestamps, metric names, and user identifiers included in the pre-calculated metric data, wherein the collected pre-calculated metric data comprises a first data portion associated with a particular software service identifier and a second data portion associated with the particular software service identifier, wherein the first data portion aggregates metrics generated by first software service instances on at least two different computing nodes while servicing requests for a first user identifier, wherein the second data portion aggregates metrics generated by second software service instances on at least two different computing nodes while servicing requests for a second user identifier, wherein the first software services instances and the second software services instances are associated with the particular software service identifier, wherein the first data portion comprises at least one metric relating to a count of data sets managed by the first software service instances for servicing requests for the first user identifier, and wherein the count of data sets managed by the first software service instances is calculated by counting the first user identifier only once for the first software service instances across two or more different computing nodes.
11. The system of claim 10 , wherein the response data is received over a communications network from a software service deployment manager, and the software service deployment manager monitors for metric-providing software service instances operating on a computing node.
12. The system of claim 10 , wherein the aggregating is based on software service deployment identifiers, each of which identifies an exclusive group of software service identifiers.
13. The system of claim 10 , wherein the response data comprises a universal resource locator (URL) for collecting pre-calculated metric data from the at least one of the metric-providing software service instances.
14. The system of claim 10 , wherein the metric comprises software version information for the particular metric-providing software service instance.
15. The system of claim 10 , wherein the metric comprises unique users over a time period.
16. The system of claim 10 , wherein the metric comprises metrics calculated according to at least one of user identifiers, time, and date.
17. The system of claim 10 , comprising storing the metric packet to a database that services software metric queries.
18. A machine-readable storage device embodying instructions that, when executed by at least one hardware processor of a machine, cause the machine to perform operations comprising:
requesting, from a software service deployment manager on a first computing node, identification of metric-providing software service instances operating on a plurality of computing nodes not including the first computing node, each particular metric-providing software service instance including a metric provider that produces pre-calculated metric data for the particular metric-providing software service instance, wherein the particular metric-providing software service instance registers with the software service deployment manager a metric-providing capability of the particular metric-providing software service instance, the pre-calculated metric data includes a metric calculated for the particular metric-providing software service instance, and the metric is calculated at a particular computing node operating the particular metric-providing software service instance;
responsive to the requesting, receiving response data from the software service deployment manager on the first computing node, wherein the response data includes identification of the metric-providing software service instances;
collecting, from one of the plurality of computing nodes, pre-calculated metric data for at least one of the metric-providing software service instances identified by the response data; and
aggregating the collected pre-calculated metric data into a metric packet, wherein the aggregating is based on software service identifiers, timestamps, metric names, and user identifiers included in the pre-calculated metric data, wherein the collected pre-calculated metric data comprises a first data portion associated with a particular software service identifier and a second data portion associated with the particular software service identifier, wherein the first data portion aggregates metrics generated by first software service instances on at least two different computing nodes while servicing requests for a first user identifier, wherein the second data portion aggregates metrics generated by second software service instances on at least two different computing nodes while servicing requests for a second user identifier, wherein the first software services instances and the second software services instances are associated with the particular software service identifier, wherein the first data portion comprises at least one metric relating to a count of data sets managed by the first software service instances for servicing requests for the first user identifier, and wherein the count of data sets managed by the first software service instances is calculated by counting the first user identifier only once for the first software service instances across two or more different computing nodes.