Streaming data visualizations
A device executes a visualization application program on a processor. Via the visualization application, a technique for visualizing data paths are performed. The technique includes receiving a data structure from a data intake and query system, where the data stream includes event stream data associated with the data path. The data path includes a set of entities, including an origin entity and a destination entity. The technique further includes generating visualizations of the origin entity, destination entity, and the event stream data. The visualization of the event stream data includes visualizations of events streaming between the visualization of the origin entity and visualization of the destination entity. The technique also includes causing the visualizations of the origin entity, destination entity, and the event stream data to be presented in an extended reality environment.
1 . A computer-implemented method, comprising:
obtaining one or more logs of one or more events;
querying the one or more logs to extract data event information;
defining a first data path that identifies a transmission of a first set of events from the one or more events between a first set of entities, wherein the first set of events comprise events of a first event type;
defining a second data path that identifies a transmission of a second set of events from the one or more events between a second set of entities, wherein the second set of events comprise events of a second event type;
generating, based on the data event information, a data structure comprising at least the first data path and the second data path, the first data path including event stream data associated with the first data path and the second data path including event stream data associated with the second data path, wherein the first data path comprises the first set of entities, the first set of entities including an origin entity, a destination entity, and a host entity that recorded the data event information and wherein at least one entity in the first set of entities is different from an entity in the second set of entities; and
transmitting the data structure to a client device.
2 . The computer-implemented method of claim 1 , wherein the one or more events are associated with an event type.
3 . The computer-implemented method of claim 1 , wherein at least one of the origin entity or the destination entity comprises a machine.
4 . The computer-implemented method of claim 1 , wherein at least one of the origin entity or the destination entity comprises a group of machines.
5 . The computer-implemented method of claim 1 , wherein the event stream data associated with the first data path comprises, for each time period in a sequence of time periods, a count of one or more recorded events transmitted between the origin entity and the destination entity via the first data path.
6 . The computer-implemented method of claim 1 , wherein the first data path is defined based on a topology of a data stream pipeline, and wherein the topology of the data stream pipeline specifies the origin entity and the destination entity.
7 . The computer-implemented method of claim 1 , wherein the origin entity functions as a data source, the destination entity functions as a data sink, and one or more other entities included in the first set of entities function as branching paths for a data flow from the origin entity to the destination entity.
8 . The computer-implemented method of claim 1 , wherein the first set of entities further comprises at least one additional entity, and wherein the first data path includes:
a first path between the origin entity and the at least one additional entity, and
a second path between the destination entity and the at least one additional entity.
9 . The computer-implemented method of claim 1 , wherein the origin entity and the destination entity function as branching paths for a data flow.
10 . The computer-implemented method of claim 1 , wherein the data structure is generated by a data stream processor operating at a data intake and query system.
11 . The computer-implemented method of claim 1 , further comprising aggregating event data associated with a group of entities to generate aggregated stream data, wherein the group of entities includes at least two entities included in the set of entities that are associated with the origin entity, and wherein the data structure includes the aggregated stream data.
12 . The computer-implemented method of claim 1 , further comprising mapping one or more events associated with an event type to a status classification, wherein the status classification is associated with the data path.
13 . The computer-implemented method of claim 1 , wherein the host entity is different from the origin entity.
14 . The computer-implemented method of claim 1 , wherein the event stream data associated with the second data path comprises, for each time period in a sequence of time periods, a count of one or more recorded events transmitted between one or more entities in the second set of entities via the second data path.
15 . One or more non-transitory computer-readable storage media including instructions that, when executed by one or more processors, cause the one or more processors to perform the steps of:
obtaining one or more logs of one or more events;
querying the one or more logs to extract data event information;
defining a first data path that identifies a transmission of a first set of events from the one or more events between a first set of entities, wherein the first set of events comprise events of a first event type;
defining a second data path that identifies a transmission of a second set of events from the one or more events between a second set of entities, wherein the second set of events comprise events of a second event type;
generating, based on the data event information, a data structure comprising at least the first data path and the second data path, the first data path including event stream data associated with the first data path and the second data path including event stream data associated with the second data path, wherein the first data path comprises the first set of entities, the first set of entities including an origin entity, a destination entity, and a host entity that recorded the data event information and wherein at least one entity in the first set of entities is different from an entity in the second set of entities; and
transmitting the data structure to a client device.
16 . The one or more non-transitory computer-readable storage media of claim 15 , wherein the event stream data associated with the first data path comprises, for each time period in a sequence of time periods, a count of one or more recorded events transmitted between the origin entity and the destination entity in the first data path.
17 . The one or more non-transitory computer-readable storage media of claim 15 , wherein the first data path is defined based on a topology of a data stream pipeline, and wherein the topology of the data stream pipeline specifies the origin entity and the destination entity, and wherein the origin entity represents a data source, the destination entity represents a data sink, and other entities of the set of entities represent branching paths of a data flow from the origin entity to the destination entity.
18 . The one or more non-transitory computer-readable storage media of claim 15 , wherein the first set of entities further comprises a further entity, and wherein the first data path includes at least:
a first path between the origin entity and the further entity, and
a second path between the destination entity and the further entity.
19 . A computing device, comprising:
a memory storing instructions; and
a processor that is coupled to the memory and, when executing the instructions, is configured to perform the steps of:
obtaining one or more logs of one or more events;
querying the one or more logs to extract data event information;
defining a first data path that identifies a transmission of a first set of events from the one or more events between a first set of entities, wherein the first set of events comprise events of a first event type;
defining a second data path that identifies a transmission of a second set of events from the one or more events between a second set of entities, wherein the second set of events comprise events of a second event type;
generating, based on the data event information, a data structure comprising at least the first data path and the second data path, the first data path including event stream data associated with the first data path and the second data path including event stream data associated with the second data path, wherein the first data path comprises the first set of entities, the first set of entities including an origin entity, a destination entity, and a host entity that recorded the data event information and wherein at least one entity in the first set of entities is different from an entity in the second set of entities; and
transmitting the data structure to a client device.
20 . The computing device of claim 19 , wherein the event stream data associated with the first data path comprises, for each time period in a sequence of time periods, a count of one or more recorded events transmitted between the origin entity and the destination entity in the first data path.
21 . The computing device of claim 19 , wherein the first data path is defined based on a topology of a data stream pipeline, and wherein the topology of the data stream pipeline specifies the origin entity and the destination entity, and wherein the origin entity represents a data source, the destination entity represents a data sink, and other entities of the first set of entities represent branching paths of a data flow from the origin entity to the destination entity.
22 . The computing device of claim 19 , wherein the first set of entities further comprises a further entity, and wherein the first data path includes at least:
a first path between the origin entity and the further entity, and
a second path between the destination entity and the further entity.