Processing data using containerized nodes in a containerized scalable environment
Systems and methods are disclosed for processing and executing queries in a data intake and query system. The data intake and query system receives raw machine data at an indexing system, and stores at least a portion of the raw machine data in buckets using containerized indexing nodes instantiated in a containerized environment. The data intake and query system stores the buckets in a shared storage system.
1. A method comprising:
monitoring a status of containerized search nodes in a containerized environment, wherein a particular containerized search node of the containerized search nodes is instantiated as one or more containers on a hosted computing device in the containerized environment;
based on said monitoring the status of the containerized search nodes, identifying a plurality of containerized search nodes of the containerized search nodes;
receiving, by a computing device of a data intake and query system, a first query and a second query, each of the first query and the second query identifying a particular set of data to be processed and a particular manner of processing the particular set of data, each particular set of data stored in one or more buckets, each bucket of the one or more buckets storing raw machine data associated with a timestamp;
in response to receiving the first query and the second query, dynamically identifying, by the computing device of the data intake and query system, a first set of containerized search nodes of the plurality of containerized search nodes to execute the first query and a second set of containerized search nodes of the plurality of containerized search nodes to execute the second query based on the status of the containerized search nodes;
executing the first query, wherein said executing the first query comprises assigning a first containerized search node of the first set of containerized search nodes to search a particular bucket of the one or more buckets; and
executing the second query, wherein said executing the second query comprises assigning a second containerized search node of the second set of containerized search nodes to search the particular bucket.
2. The method of claim 1 , wherein the raw machine data reflects activity in an information processing environment and is produced by a component of the information processing environment.
3. The method of claim 1 , wherein the one or more buckets are field-searchable time series buckets.
4. The method of claim 1 , wherein said executing the first query further comprises assigning the first containerized search node to search the particular bucket using a late binding schema.
5. The method of claim 1 , wherein each bucket of the one or more buckets comprises a plurality of events and an inverted index corresponding to the plurality of events.
6. The method of claim 1 , further comprising determining the plurality of containerized search nodes are available.
7. The method of claim 1 , wherein said identifying the plurality of containerized search nodes is based at least in part on determining the plurality of containerized search nodes are available.
8. The method of claim 1 , wherein said dynamically identifying the first set of containerized search nodes and the second set of containerized search nodes is based at least in part on a search node catalog.
9. The method of claim 1 , wherein said dynamically identifying the first set of containerized search nodes and the second set of containerized search nodes is based at least in part on a search node catalog, the method further comprising, based at least in part on said monitoring the status of the containerized search nodes, updating the search node catalog with the status of the containerized search nodes.
10. The method of claim 1 , further comprising determining that the one or more buckets stores the first set of data based on a data store catalog that includes an identifier for each bucket of the one or more buckets.
11. The method of claim 1 , further comprising determining that the one or more buckets stores the first set of data based on a data store catalog that includes an identifier and location information in a shared storage system for each bucket of the one or more buckets.
12. The method of claim 1 , further comprising determining that the one or more buckets stores the first set of data based on a data store catalog that includes an identifier for, a time range associated with, a tenant associated with, a partition associated with, and location information in a shared storage system for each bucket of the one or more buckets.
13. The method of claim 1 , further comprising determining that the one or more buckets stores the first set of data based on a data store catalog that stores information about buckets stored in a shared storage system and is updated over time by an indexing system as buckets are stored in the shared storage system by the indexing system.
14. The method of claim 1 , wherein said executing the first query further comprises assigning the first containerized search node to search a subset of the one or more buckets based on a search node mapping policy.
15. The method of claim 1 , wherein said executing the first query further comprises assigning the first containerized search node to search a subset of the one or more buckets based on a hash of a bucket identifier of the subset of the one or more buckets received from a data store catalog, wherein the data store catalog includes a bucket identifier for each bucket of the one or more buckets.
16. The method of claim 1 , wherein said executing the first query further comprises assigning the first containerized search node to search the particular bucket based on a determination that the first containerized search node was assigned to search the particular bucket as part of a previous query.
17. The method of claim 1 , wherein said executing the first query further comprises assigning the first containerized search node to search the particular bucket based on a determination that the first containerized search node includes a copy of the particular bucket on a local or shared data store.
18. The method of claim 1 , wherein said executing the first query further comprises assigning the first containerized search node to search the particular bucket based on a determination that a local or shared data store associated with the first containerized search node includes a copy of the particular bucket.
19. Non-transitory computer-readable media comprising computer-executable instructions that, when executed by a computing system of a data intake and query system, cause the computing system to:
monitor a status of containerized search nodes in a containerized environment, wherein a particular containerized search node of the containerized search nodes is instantiated as one or more containers on a hosted computing device in the containerized environment;
based at least in part on monitoring the status of the containerized search nodes, identify a plurality of containerized search nodes of the containerized search nodes;
receive a first query and a second query, each of the first query and the second query identifying a particular set of data to be processed and a particular manner of processing the particular set of data, each particular set of data stored in one or more buckets, each bucket of the one or more buckets storing raw machine data associated with a timestamp;
in response to receiving the first query and the second query, dynamically identify a first set of containerized search nodes of the plurality of containerized search nodes to execute the first query and a second set of containerized search nodes of the plurality of containerized search nodes to execute the second query based at least in part on the status of the containerized search nodes;
execute the first query, wherein, to execute the first query, the computer-executable instructions further cause the computing system to assign a first containerized search node of the first set of containerized search nodes to search a particular bucket of the one or more buckets; and
execute the second query, wherein, to execute the second query, the computer-executable instructions further cause the computing system to assign a second containerized search node of the second set of containerized search nodes to search the particular bucket.
20. A computing system, comprising:
a memory; and one or more processing devices coupled to the memory and configured to:
monitor a status of containerized search nodes in a containerized environment, wherein a particular containerized search node of the containerized search nodes is instantiated as one or more containers on a hosted computing device in the containerized environment;
based on monitoring the status of the containerized search nodes, identify a plurality of containerized search nodes of the containerized search nodes;
receive a first query and a second query, each of the first query and the second query identifying a particular set of data to be processed and a particular manner of processing the particular set of data, each particular set of data stored in one or more buckets, each bucket of the one or more buckets storing raw machine data associated with a timestamp;
in response to receiving the first query and the second query, dynamically identify a first set of containerized search nodes of the plurality of containerized search nodes to execute the first query and a second set of containerized search nodes of the plurality of containerized search nodes to execute the second query based on the status of the containerized search nodes;
execute the first query, wherein, to execute the first query, the one or more processing devices are further configured to assign a first containerized search node of the first set of containerized search nodes to search a particular bucket of the one or more buckets; and
execute the second query, wherein, to execute the second query, the one or more processing devices are further configured to assign a second containerized search node of the second set of containerized search nodes to search the particular bucket.