Telemetry system extension
A method of operating a telemetry system includes automatically populating a base field of a schema in an event definition using a logging library of the telemetry system for an event of an instrumented application, and automatically populating a conditional field of the schema in the event definition using the logging library in response to a selected condition for the event.
1. A method of operating a telemetry system to collect telemetry data of an instrumented application, the method comprising:
implementing an event ingestion pipeline to shuttle events through multiple components of the telemetry system;
determining quality of the event ingestion pipeline by ingesting telemetry data to a schema in an event definition,
automatically populating a base field with telemetry data using a filter declared in a logging library of the telemetry system for an event of the instrumented application, the base field of the schema;
automatically populating conditional fields with telemetry data using a second filter in the logging library in response to selected conditions for the event, the conditional fields of the schema, the automatically populating the conditional fields including:
statically determining and automatically populating a first conditional field for application events for a given environmental subset of the instrumented application; and
dynamically determining and automatically populating a second conditional field for events of a given use subset for the instrumented application;
providing the telemetry data in the first conditional field for application events to the given environmental subset of the instrumented application;
providing the telemetry data in the second conditional field for events to the given use subset for the instrumented application; and
providing events in the event ingestion pipeline to real-time systems or batch processing systems in a format to allow analytical applications to query for telemetry data according to the telemetry data in the base field and the conditional fields.
2. The method of claim 1 wherein the base field is automatically populated with data in all events of the instrumented application.
3. The method of claim 2 wherein the data common to all events includes client system data.
4. The method of claim 1 wherein at least one of the conditional fields is automatically populated with data related to an application environment condition.
5. The method of claim 4 wherein the application environment condition includes application platform, operating system, or cloud environment.
6. The method of claim 4 wherein the at least one of the conditional fields is populated with data in all events of the application environment condition.
7. The method of claim 1 wherein at least one of the conditional fields is automatically populated with data related to an application usage condition.
8. A method of operating a telemetry system, the method comprising:
implementing an event ingestion pipeline to shuttle events through multiple components of the telemetry system;
determining quality of the event ingestion pipeline by ingesting telemetry data to a first schema in an event definition;
automatically populating base fields with telemetry data using a filter declared in a logging library of the telemetry system for an event, the base fields of the first schema;
automatically populating conditional fields with telemetry data using a second filter in the logging library in response to a selected condition for the event, the conditional fields of the first schema, the automatically populating the conditional fields including:
statically determining and automatically populating a first conditional field for application events for a given environmental subset of the instrumented application; and
dynamically determining and automatically populating a second conditional field for events of a given use subset for the instrumented application;
populating fields with telemetry data selected by an event author, the fields in a second schema;
providing the telemetry data in the first conditional field for application events to the given environmental subset of the instrumented application;
providing the telemetry data in the second conditional field for events to the given use subset for the instrumented application; and
providing events in the event ingestion pipeline to real-time systems or batch processing systems in a format to allow analytical applications to query for telemetry data according to the telemetry data in the base field and the conditional fields.
9. The method of claim 8 wherein populating set of fields in the second schema includes preselected fields from the telemetry system.
10. The method of claim 9 wherein the preselected fields are populated with data common to a plurality of applications.
11. The method of claim 9 wherein the preselected fields include a predefined name and data type.
12. The method of claim 8 wherein populating set of fields in the second schema includes custom fields from the event author.
13. The method of claim 12 wherein the custom fields include custom name and custom data type.
14. The method of claim 8 wherein the first set of fields in the schema includes an event envelope semantic and an ingest section.
15. The method of claim 8 wherein a field of the conditional fields is automatically populated with data related to an application environment condition.
16. The method of claim 15 wherein another field of the conditional fields is automatically populated with data related to an application usage condition.
17. The method of claim 15 wherein the logging library includes a code library corresponding with a platform of the instrumented application.
18. A telemetry system, comprising:
a computing device including a processor and a memory configured to:
implement an event ingestion pipeline to shuttle events through multiple components of the telemetry system;
determine quality of the event ingestion pipeline by ingesting telemetry data to a schema in an event definition;
automatically populate a base field with telemetry data using a filter declared in a logging library of the telemetry system for an event of an instrumented application, the base field of the schema; and
automatically populate conditional fields with telemetry data using a second filter in the logging library in response to a selected condition for the event, the conditional fields of the schema, the automatically populate the conditional field including:
statically determining and automatically populating a first conditional field for application events for a given environmental subset of the instrumented application; and
dynamically determining and automatically populating a second conditional field for events of a given use subset for the instrumented application;
provide the telemetry data in the first conditional field for application events to the given environmental subset of the instrumented application;
provide the telemetry data in the second conditional field for events to the given use subset for the instrumented application; and
provide events in the event ingestion pipeline to real-time systems or batch processing systems in a format to allow analytical applications to query for telemetry data according to the telemetry data in the base field and the conditional fields.
19. The telemetry system of claim 18 wherein the base field is automatically populated with data in all events of the instrumented application.
20. The telemetry system of claim 18 wherein at least one of the conditional fields is automatically populated with data related to an application environment condition.