Agentless generation of a topology of components in a distributed computing system
A computer system retrieves provisioning data and observability data (metrics, logs, events, alerts, inventory) for a plurality of components from remote servers. The computer system extracts component identifiers from the provisioning data and the log data. The computer system identifies relationships between components from the provisioning data and the log data, such as environmental variable relationships, network relationships, session relationships, access relationships, and network connection relationships. The computer system generates a topology in which nodes represent components and edges represent relationships. The topology is updated to show changes to components and relationships. A user may interact with a visual representation of the topology to change data displayed or invoke changes to the components and relationships represented by the topology.
1 . An apparatus comprising:
a computing device including one or more processing devices and one or more memory devices operably coupled to the one or more processing devices, the one or more memory devices storing executable code that, when executed by the one or more processing devices, causes the one or more processing devices to:
retrieve provisioning data describing instantiation of a plurality of components on remote servers over a network;
extract component identifiers of the plurality of components from the provisioning data;
retrieve log data from the remote servers without use of an agent executing on the remote servers; and
process the provisioning data and the log data to obtain a topology of the plurality of components, the topology including nodes representing the plurality of components and edges representing relationships between pairs of components of the plurality of components.
2 . The apparatus of claim 1 , wherein the relationships include at least one of hosting relationships, environmental variable relationships, network relationships, session relationships, access relationships, and network connection relationships.
3 . The apparatus of claim 1 , wherein the relationships include hosting relationships; and
wherein the executable code, when executed by the one or more processing devices, further causing the one or more processing devices to extract the hosting relationships between the pairs of components of the plurality of components from one or both of the provisioning data and the log data.
4 . The apparatus of claim 1 , wherein the relationships include environmental variable relationships; and
wherein the executable code, when executed by the one or more processing devices, further causes the one or more processing devices to extract environmental variable relationships between the pairs of components of the plurality of components from one or both of the provisioning data and the log data.
5 . The apparatus of claim 1 , wherein the relationships include network relationships; and
wherein the executable code, when executed by the one or more processing devices, further causes the one or more processing devices to extract the network relationships between the pairs of components of the plurality of components from one or both of the provisioning data and the log data.
6 . The apparatus of claim 1 , wherein the relationships include session relationships; and
wherein the executable code, when executed by the one or more processing devices, further causes the one or more processing devices to extract the session relationships between the pairs of components of the plurality of components from one or both of the provisioning data and the log data.
7 . The apparatus of claim 1 , wherein the relationships include access relationships; and
wherein the executable code, when executed by the one or more processing devices, further causes the one or more processing devices to extract the access relationships between the pairs of components of the plurality of components from one or both of the provisioning data and the log data.
8 . The apparatus of claim 1 , wherein the relationships include network connection relationships; and
wherein the executable code, when executed by the one or more processing devices, further causes the one or more processing devices to extract the network connection relationships between the pairs of components of the plurality of components from one or both of the provisioning data and the log data.
9 . The apparatus of claim 1 , wherein the executable code, when executed by the one or more processing devices, further causes the one or more processing devices to obtain the provisioning data from a manifest ingested by an orchestrator, the manifest instructing the orchestrator to instantiate the plurality of components.
10 . The apparatus of claim 1 , wherein the executable code, when executed by the one or more processing devices, further causes the one or more processing devices to:
invoke display of a visual representation of the topology on a display device;
receive an interaction with the visual representation of the topology;
in response to the interaction, modify at least one of the visual representation of the topology and the plurality of components.
11 . A method comprising:
retrieving, by a computing device, provisioning data describing instantiation of a plurality of components on remote servers over a network;
extracting, by the computing device, component identifiers of the plurality of components from the provisioning data;
retrieving, by the computing device, log data from the remote servers without use of an agent executing on the remote servers; and
processing, by the computing device, the provisioning data and the log data to obtain a topology of the plurality of components, the topology including nodes representing the plurality of components and edges representing relationships between pairs of components of the plurality of components.
12 . The method of claim 11 , wherein the relationships include at least one of hosting relationships, environmental variable relationships, network relationships, session relationships, access relationships, and network connection relationships.
13 . The method of claim 11 , wherein the relationships include hosting 13 . relationships; and
wherein the method further comprises extracting the hosting relationships between the pairs of components of the plurality of components from one or both of the provisioning data and the log data.
14 . The method of claim 11 , wherein the relationships include environmental variable relationships; and
wherein the method further comprises extracting the environmental variable relationships between the pairs of components of the plurality of components from one or both of the provisioning data and the log data.
15 . The method of claim 11 , wherein the relationships include network relationships; and
wherein the method further comprises extracting the network relationships between the pairs of components of the plurality of components from one or both of the provisioning data and the log data.
16 . The method of claim 11 , wherein the relationships include session relationships; and
wherein the method further comprises extracting the session relationships between the pairs of components of the plurality of components from one or both of the provisioning data and the log data.
17 . The method of claim 11 , wherein the relationships include access relationships; and
wherein the method further comprises extracting the access relationships between the pairs of components of the plurality of components from one or both of the provisioning data and the log data.
18 . The method of claim 11 , wherein the relationships include network connection relationships; and
wherein the method further comprises extracting the network connection relationships between the pairs of components of the plurality of components from one or both of the provisioning data and the log data.
19 . The method of claim 11 , wherein the method further comprises obtaining, by the computing device, the provisioning data from a manifest ingested by an orchestrator, the manifest instructing the orchestrator to instantiate the plurality of components.
20 . The method of claim 11 , wherein the method further comprises
invoking, by the computing device, display of a visual representation of the topology on a display device;
receiving, by the computing device, an interaction with the visual representation of the topology;
in response to the interaction, modifying, by the computing device, at least one of the visual representation of the topology and the plurality of components.