Selective data collection using a management system
A management system sends a first request for first data associated with multiple network entities. If the first request times out, the first request is split to create multiple smaller requests and the multiple smaller requests sent, requesting data from a subset of the multiple network entities. Based on responses to the multiple smaller requests, the management system identifies a particular network entity that caused the first request to time out and adds the particular network entity to a set of problematic entities. The management system sends a second request that requests second data from a portion of the multiple network entities that excludes the particular network entity. The multiple network entities may include one or more of a virtual machine (VM), a host node (to host VMs), a storage device, a network link, another type of network entity, or any combination thereof.
1. A computer-implemented method, comprising:
sending, from a management system, a first request to provide first data associated with a plurality of network entities comprising a plurality of host nodes, wherein individual host nodes of the plurality of host nodes each host a plurality of virtual machines;
in response to determining that the first request timed out, creating a plurality of smaller requests based on the first request;
sending the plurality of smaller requests, each of the plurality of smaller requests requesting data from a subset of the plurality of network entities;
identifying a particular network entity of the plurality of network entities that caused the first request to time out based on responses to the plurality of smaller requests;
in response to determining that the particular network entity is not included in a set of potentially problematic entities:
adding the particular network entity to the set of potentially problematic entities; and
associating a counter with the particular network entity;
incrementing the counter associated with the particular network entity;
associating a current timestamp with the counter;
performing a first comparison of the counter with a first threshold;
performing a second comparison of the current timestamp with a previous timestamp associated with the counter;
based at least in part on the first comparison and the second comparison, moving the particular network entity from the set of potentially problematic entities to a set of confirmed problematic entities; and
sending a second request to provide second data associated with a portion of the plurality of network entities that excludes the set of confirmed problematic entities.
2. The computer-implemented method of claim 1 , wherein the plurality of network entities further comprises at least one of:
a plurality of network links,
a plurality of storage devices, or
a sub-network comprising a portion of the plurality of network entities.
3. The computer-implemented method of claim 1 , further comprising:
sending, after a predetermined period of time, a third request to provide third data associated with the plurality of network entities including the particular network entity.
4. The computer-implemented method of claim 3 , further comprising:
in response to receiving a response to the third request, removing the particular network entity from the set of confirmed problematic entities.
5. The computer-implemented method of claim 3 , further comprising:
in response to the response to the third request timing out, maintaining the particular network entity in the set of confirmed problematic entities.
6. The computer-implemented method of claim 1 , wherein the particular network entity is added to the set of confirmed problematic entities in response to determining that the particular network entity has caused a predetermined number of requests to time out.
7. The computer-implemented method of claim 1 , wherein the first request:
identifies the plurality of network entities, and
identifies one or more types of data to request from the plurality of network entities.
8. One or more non-transitory computer-readable media, comprising instructions that are executable by one or more processors to perform operations comprising:
sending, from a management system, a first request to provide first data associated with a plurality of network entities comprising a plurality of virtual machines hosted by a plurality of host nodes;
in response to determining that no response to the first request was received within a predetermined time interval, splitting the first request to create a plurality of smaller requests;
sending the plurality of smaller requests, individual smaller requests of the plurality of smaller requests requesting data from a portion of the plurality of network entities;
identifying a particular network entity of the plurality of network entities that caused the first request to time out based on responses to the plurality of smaller requests;
in response to determining that the particular network entity is not included in a set of potentially problematic entities:
adding the particular network entity to the set of potentially problematic entities; and
associating a counter with the particular network entity;
incrementing the counter associated with the particular network entity;
associating a current timestamp with the counter;
performing a first comparison of the counter with a first threshold;
performing a second comparison of the current timestamp with a previous timestamp associated with the counter;
based at least in part on the first comparison and the second comparison, moving the particular network entity from the set of potentially problematic entities to a set of confirmed problematic entities; and
sending a second request to provide second data associated with a portion of the plurality of network entities that excludes the set of confirmed problematic entities.
9. The one or more non-transitory computer-readable media of claim 8 , wherein the plurality of network entities further comprises:
a plurality of network links,
a plurality of storage devices, and
a plurality of sub-networks.
10. The one or more non-transitory computer-readable media of claim 8 , further comprising:
sending, after a predetermined period of time, a third request to provide third data associated with the plurality of network entities including the particular network entity; and
in response to receiving a response to the third request, removing the particular network entity from the set of confirmed problematic entities.
11. The one or more non-transitory computer-readable media of claim 10 , further comprising:
in response to the response to the third request timing out, continuing to include the particular network entity in the set of confirmed problematic entities.
12. The one or more non-transitory computer-readable media of claim 8 , further comprising:
moving the particular network entity to the set of confirmed problematic entities in response to determining that the counter satisfies the first threshold.
13. The one or more non-transitory computer-readable media of claim 8 , wherein the first request:
identifies the plurality of network entities, and
identifies one or more types of data to request from the plurality of network entities.
14. A computing device, comprising: one or more processors; and
one or more non-transitory computer-readable media storing instructions that are executable by
the one or more processors to perform operations comprising:
sending, from a management system, a first request to provide first data associated with a plurality of network entities comprising a plurality of virtual machines hosted by a plurality of host nodes;
in response to determining that the first request timed out, creating a plurality of smaller requests based on the first request;
sending the plurality of smaller requests, each of the plurality of smaller requests requesting data from a subset of the plurality of network entities;
identifying a particular network entity of the plurality of network entities that caused the first request to time out based on responses to the plurality of smaller requests;
in response to determining that the particular network entity is not included in a set of potentially problematic entities:
adding the particular network entity to the set of potentially problematic entities;
and
associating a counter with the particular network entity;
incrementing the counter associated with the particular network entity;
associating a current timestamp with the counter;
performing a first comparison of the counter with a first threshold;
performing a second comparison of the current timestamp with a previous timestamp associated with the counter;
based at least in part on the first comparison and the second comparison, moving the particular network entity from the set of potentially problematic entities to a set of confirmed problematic entities; and
sending a second request to provide second data associated with a portion of the plurality of network entities that excludes the set of confirmed problematic entities.
15. The computing device of claim 14 , wherein the network entities comprise at least one of:
a plurality of network links,
a plurality of storage devices, or
a plurality of sub-networks.
16. The computing device of claim 14 , further comprising:
sending, after a predetermined period of time, a third request to provide third data associated with the plurality of network entities including the particular network entity.
17. The computing device of claim 15 , further comprising:
in response to receiving a response to the third request, removing the particular network entity from the set of confirmed problematic entities.
18. The computing device of claim 15 , further comprising:
in response to the response to the third request timing out, continuing to include the particular network entity in the set of confirmed problematic entities.
19. The computing device of claim 14 , further comprising:
moving the particular network entity on the set of confirmed problematic entities in response to determining that the counter satisfies the first threshold.
20. The computing device of claim 14 , wherein the first request comprises:
an identifier associated with each of the plurality of network entities, and
specifies one or more types of data to request from the plurality of network entities.