Disaster recovery in a clustered environment using generation identifiers
A method for performing disaster recovery in a clustered environment comprises identifying, at a master device, a first indexer from a set of indexers to serve as a primary indexer for responding to queries pertaining to a subset of data. The method also comprises assigning, at the master device, a generation identifier indicating that the first indexer is the primary indexer for the subset of data. Responsive to an event prompting a change in a primary indexer designation for the subset of data, the method comprises identifying, at the master device, a second indexer from the set of indexers to serve as the primary indexer for responding to queries pertaining to the subset of data. Further, the method comprises assigning, at the master device, a new generation identifier indicating that the second indexer is the primary indexer for the subset of data.
1. A method comprising:
receiving, at an indexer, a generation identifier, wherein the generation identifier indicates that the indexer has primary responsibility for responding to search queries for a first grouped subset of data, wherein the indexer is one of a plurality of indexers included in a cluster, and wherein a master node coordinates searches against data indexed by the plurality of indexers in the cluster;
generating, at the indexer, summary data corresponding to the first grouped subset of data based on instructions received by the indexer;
receiving, at the indexer, a search query;
determining, based on the generation identifier, that the indexer has primary responsibility for responding to the search query; and
generating results for the search query based upon the summary data and the first grouped subset of data.
2. The method of claim 1 , wherein the summary data is associated with a report, and wherein the search query is a recurring search used to generate the report.
3. The method of claim 1 , wherein the summary data is associated with a data model for data stored by the cluster, and wherein the results correspond to fields included in the data model.
4. The method of claim 1 , wherein the summary data is generated prior to receiving the search query at the indexer.
5. The method of claim 1 , further comprising generating results for a subsequent instance of the search query based upon the summary data.
6. The method of claim 1 , further comprising generating results of a subsequent search query based upon the summary data, wherein the subsequent search query is different from the search query.
7. The method of claim 1 , wherein the data is transformed using at least one of an aggregation operation, a filtering operation, or a data conversion.
8. The method of claim 1 , further comprising:
receiving a new generation identifier at the indexer indicating that a new indexer has primary responsibility for the search query;
replicating the summary data; and
transmitting the summary data to the new indexer.
9. The method of claim 1 , further comprising:
determining that the summary data corresponding to the search query is not stored by the indexer; and
generating the summary data.
10. The method of claim 1 , further comprising:
identifying a replication factor that indicates a number of times that the first grouped subset of data is to be replicated; and
transmitting the first subset of data to a number of other indexers, wherein the number corresponds to the replication factor.
11. A non-transitory computer-readable medium storing computer-executable instructions which, when executed by a processor, cause the processor to perform operations comprising:
receiving, at an indexer, a generation identifier, wherein the generation identifier indicates that the indexer has primary responsibility for responding to search queries for a first grouped subset of data, wherein the indexer is one of a plurality of indexers included in a cluster, and wherein a master node coordinates searches against data indexed by the plurality of indexers in the cluster;
generating, at the indexer, summary data corresponding to the first grouped subset of data based on instructions received by the indexer;
receiving, at the indexer, a search query;
determining, based on the generation identifier, that the indexer has primary responsibility for responding to the search query; and
generating results for the search query based upon the summary data and the first grouped subset of data.
12. The non-transitory computer-readable medium of claim 11 , wherein the generation identifier is generated by the master node of the cluster.
13. The non-transitory computer-readable medium of claim 11 , further comprising sending, by a master node of the cluster, summary data replication instructions to the indexer, the summary data replication instructions causing the indexer to send the summary data to a second indexer in the cluster.
14. The non-transitory computer-readable medium of claim 11 , wherein the grouped subset of data includes a plurality of events, and wherein the plurality of events are associated with a time span.
15. The non-transitory computer-readable medium of claim 11 , wherein the summary data is associated with a report, and wherein the search query is a recurring search used to generate the report.
16. The non-transitory computer-readable medium of claim 11 , wherein the summary data is associated with a data model for data stored by the group of indexers, and wherein the results correspond to fields included in the data model.
17. The non-transitory computer-readable medium of claim 11 , wherein the summary data is generated prior to receiving the search query at the indexer.
18. The non-transitory computer-readable medium of claim 11 , further comprising generating results for a subsequent instance of the search query based upon the summary data.
19. The non-transitory computer-readable medium of claim 11 , wherein the data is transformed using at least one of an aggregation operation, a filtering operation, or a data conversion.
20. A system comprising:
one or more memories; and
one or more processors for:
receiving, at an indexer, a generation identifier, wherein the generation identifier indicates that the indexer has primary responsibility for responding to search queries for a first grouped subset of data, wherein the indexer is one of a plurality of indexers included in a cluster, and wherein a master node coordinates searches against data indexed by the plurality of indexers in the cluster;
generating, at the indexer, summary data corresponding to the first grouped subset of data based on instructions received by the indexer;
receiving, at the indexer, a search query;
determining, based on the generation identifier, that the indexer has primary responsibility for responding to the search query; and
generating results for the search query based upon the summary data and the first grouped subset of data.