Automatic entity control in a machine data driven service monitoring system
Automated discovery of relationships between entities within an IT environment. A technique is performed by a relationship module that performs a discovery search for entity relationships to produce a set of relationship search results. The relationship module then generates a set of relationship definitions from the set of relationship search results which are stored to a relationship collection in a data store. A technique for automatically updating entity and relationship definitions and removing outdated entity and relationship definitions stored to a data store. An update module automatically updates entity and relationship definitions at predetermined time intervals. The update history in each definition is also modified to reflect the update process. A retire module automatically removes outdated definitions using the update history in each definition.
1. A computer-implemented method comprising:
retrieving a set of item definitions stored in a data store, wherein an item definition is associated with an entity in a technology environment or an entity relationship within the technology environment, and wherein the item definition includes an update history and one or more fields;
determining, for a particular item definition from the set of item definitions, a state of the particular item definition based on a difference between a current time and a last update time specified in an update history included in the particular item definition, wherein the last update time indicates a time at which an update process was performed on the set of item definitions and a set of item search results;
modifying one or more fields included in the particular item definition based on the state of the particular item definition; and
applying a removal policy to the set of item definitions, wherein application of the removal policy causes a subset of the set of item definitions to be removed from the data store based on respective one or more fields included in the subset of the set of item definitions.
2. The computer-implemented method of claim 1 , wherein an update history included in a given item definition indicates when the given item definition was last updated and a source from which the given item definition was last updated.
3. The computer-implemented method of claim 1 , wherein the update process comprises:
retrieving a current set of item definitions stored in the data store, wherein the retrieved current set of item definitions comprises a first set of items;
performing a discovery search that identifies the set of item search results, wherein the set of item search results comprises a second set of items;
performing a comparison between the first set of items and the second set of items to determine a set of changed items; and
applying the set of changed items to the set of item definitions.
4. The computer-implemented method of claim 1 , wherein modifying one or more fields included in the particular item definition comprises modifying a stale-state time field to reflect the current time.
5. The computer-implemented method of claim 1 , wherein applying the removal policy comprises determining, based on one or more fields included in a given item definition, that the given item definition is stale.
6. The computer-implemented method of claim 5 , wherein applying the removal policy further comprises removing the given item definition when more than a threshold duration has elapsed since the given item definition was determined as being stale.
7. The computer-implemented method of claim 1 , wherein the removal policy is applied at various intervals.
8. The computer-implemented method of claim 1 , further comprising, prior to removing the subset of the set of item definitions from the data store, displaying the subset of item definitions in a graphical user interface.
9. The computer-implemented method of claim 1 , wherein:
an item definition comprises an entity definition stored in the data store; and
an entity definition is defined by one or more values extracted from machine data collected from the technology environment.
10. The computer-implemented method of claim 1 , wherein:
an item definition comprises an entity relationship definition stored in the data store; and
an entity relationship definition specifies a relationship between a first entity and a second entity within the technology environment.
11. One or more non-transitory computer readable media storing instructions that, when executed by one or more processors, cause the one or more processors to perform the steps of:
retrieving a set of item definitions stored in a data store, wherein an item definition is associated with an entity in a technology environment or an entity relationship within the technology environment and includes a corresponding update history and one or more fields; and
for each item definition in the set of item definitions,
determining a state of the item definition based on a difference between a current time and a last update time specified in the corresponding update history, wherein the last update time indicates a time at which an update process was performed on the set of item definitions and a set of item search results, and
modifying the one or more fields included in the item definition based on the state of the item definition; and
applying a removal policy to the set of item definitions, wherein the application of the removal policy causes at least a subset of the set of item definitions to be removed from the data store based on the one or more fields included in the at least a subset of the set of item definitions.
12. The one or more non-transitory computer readable media of claim 11 , wherein the update history corresponding to a given item definition indicates when the item definition was last updated and a source from which the item definition was last updated.
13. The one or more non-transitory computer readable media of claim 11 , wherein the update process comprises:
retrieving a current set of item definitions stored in the data store, wherein the current set of item definitions comprises a first set of items;
performing a discovery search that identifies the set of item search results, wherein the set of item search results comprises a second set of items;
performing a comparison between the first set of items and the second set of items to determine a set of changed items; and
applying the set of changed items to the set of item definitions.
14. The one or more non-transitory computer readable media of claim 11 , wherein modifying the one or more fields comprises modifying a stale-state time field included in the one or more fields to reflect the current time.
15. The one or more non-transitory computer readable media of claim 11 , wherein applying the removal policy comprises determining, based on the one or more fields corresponding to a given item definition, that the item definition is stale.
16. The one or more non-transitory computer readable media of claim 15 , wherein applying the removal policy further comprises removing the item definition when more than a threshold duration has elapsed since the item definition was determined as being stale.
17. The one or more non-transitory computer readable media of claim 11 , further comprising, prior to removing at least the subset of the set of items removed from the data store, displaying at least the subset of item definitions in a graphical user interface.
18. The one or more non-transitory computer readable media of claim 11 , wherein:
an item definition comprises an entity definition stored in the data store; and
an entity definition is defined by one or more values extracted from machine data collected from the technology environment.
19. The one or more non-transitory computer readable media of claim 11 , wherein:
an item definition comprises an entity relationship definition stored in the data store; and
an entity relationship definition specifies a relationship between a first entity and a second entity within the technology environment.
20. A computer system, comprising:
a memory storing one or more instructions; and
one or more processors that execute the one or more instructions to:
retrieve a set of item definitions stored in a data store, wherein an item definition is associated with an entity in a technology environment or an entity relationship within the technology environment and includes a corresponding update history and one or more fields; and
for each item definition in the set of item definitions,
determine a state of the item definition based on a difference between a current time and a last update time specified in the corresponding update history, wherein the last update time indicates a time at which an update process was performed on the set of item definitions and a set of item search results, and
modify the one or more fields included in the item definition based on the state of the item definition; and
apply a removal policy to the set of item definitions, wherein the application of the removal policy causes at least a subset of the set of item definitions to be removed from the data store based on the one or more fields included in the at least a subset of the set of item definitions.