Determining and spawning a number and type of ERP processes
A search request received at a computer of a search support system is processed by analyzing the received search request to identify request parameters and connecting to a system index of the search support system that is referenced in the request parameters. An external result provider (ERP) process is initiated that establishes communication between the search support system and a data source external to the search support system, for a virtual index referenced in the request parameters. Thus, the ERP process provides an interface between the search support system and external data sources, such as by third parties. The ERP process can operate in a streaming mode (providing realtime search results with minimal processing) and/or a reporting mode (providing results with a greater delay and processing extent) and can switch between modes. The search request results are received from the connected system indexes and the referenced virtual indexes.
1. A computer-implemented method, comprising:
determining, by a search support system and based on a first query, a set of data storage systems referenced by the first query;
determining, based on the first query referencing the set of data storage systems, a number and type of external results provider (ERP) processes that support searching the set of data storage systems;
spawning the number and type of ERP processes;
retrieving, from each of the data storage systems by a corresponding one of the ERP processes, a set of search results responsive to a corresponding portion of the first query; and
providing aggregated search results based on the set of search results from each of the data storage systems.
2. The computer-implemented method of claim 1 , wherein the number and type of ERP processes include a common ERP process that supports searching a common type of the data storage systems.
3. The computer-implemented method of claim 1 , wherein the number and type of ERP processes include a common ERP process that supports searching a subset of the data storage systems operated by a common vendor as a service for an operator of the search support system.
4. The computer-implemented method of claim 1 , wherein the number and type of ERP processes include a common ERP process that supports searching a subset of the data storage systems of different types operated by a common vendor as a service for an operator of the search support system.
5. The computer-implemented method of claim 1 , wherein the number and type of ERP processes include a common ERP process that supports searching a subset of the data storage systems with a common indexing scheme.
6. The computer-implemented method of claim 1 , wherein the number and type of ERP processes include different ERP processes for different instances of a common type of the data storage systems.
7. The computer-implemented method of claim 1 , wherein retrieving the set of search results from each of the data storage systems by the corresponding ERP process comprises:
transforming the corresponding portion of the first query into a transformed query with a syntax that is compatible with the data storage system; and
establishing communication between the search support system and an interface application of the corresponding ERP process installed at the data storage system; and
passing the transformed query to the interface application at the data storage system.
8. One or more computer-readable storage media containing instructions which, when executed by one or more processors, cause the one or more processors to perform operations comprising:
determining, by a search support system and based on a first query, a set of data storage systems referenced by the first query;
determining, based on the first query referencing the set of data storage systems, a number and type of external results provider (ERP) processes that support searching the set of data storage systems;
spawning the number and type of ERP processes;
retrieving, from each of the data storage systems by a corresponding one of the ERP processes, a set of search results responsive to a corresponding portion of the first query; and
providing aggregated search results based on the set of search results from each of the data storage systems.
9. The one or more computer-readable storage media of claim 8 , wherein the number and type of ERP processes include a common ERP process that supports searching a common type of the data storage systems.
10. The one or more computer-readable storage media of claim 8 , wherein the number and type of ERP processes include a common ERP process that supports searching a subset of the data storage systems operated by a common vendor as a service for an operator of the search support system.
11. The one or more computer-readable storage media of claim 8 , wherein the number and type of ERP processes include a common ERP process that supports searching a subset of the data storage systems of different types operated by a common vendor as a service for an operator of the search support system.
12. The one or more computer-readable storage media of claim 8 , wherein the number and type of ERP processes include a common ERP process that supports searching a subset of the data storage systems with a common indexing scheme.
13. The one or more computer-readable storage media of claim 8 , wherein the number and type of ERP processes include different ERP processes for different instances of a common type of the data storage systems.
14. The one or more computer-readable storage media of claim 8 , wherein retrieving the set of search results from each of the data storage systems by the corresponding ERP process comprises:
transforming the corresponding portion of the first query into a transformed query with a syntax that is compatible with the data storage system; and
establishing communication between the search support system and an interface application of the corresponding ERP process installed at the data storage system; and
passing the transformed query to the interface application at the data storage system.
15. A computing system, comprising:
one or more processors; and
one or more computer-readable storage media containing instructions which, when executed by the one or more processors, cause the one or more processors to perform operations comprising:
determining, by a search support system and based on a first query, a set of data storage systems referenced by the first query;
determining, based on the first query referencing the set of data storage systems, a number and type of external results provider (ERP) processes that support searching the set of data storage systems;
spawning the number and type of ERP processes;
retrieving, from each of the data storage systems by a corresponding one of the ERP processes, a set of search results responsive to a corresponding portion of the first query; and
providing aggregated search results based on the set of search results from each of the data storage systems.
16. The computing system of claim 15 , wherein the number and type of ERP processes include a common ERP process that supports searching a common type of the data storage systems.
17. The computing system of claim 15 , wherein the number and type of ERP processes include a common ERP process that supports searching a subset of the data storage systems operated by a common vendor as a service for an operator of the search support system.
18. The computing system of claim 15 , wherein the number and type of ERP processes include a common ERP process that supports searching a subset of the data storage systems of different types operated by a common vendor as a service for an operator of the search support system.
19. The computing system of claim 15 , wherein the number and type of ERP processes include a common ERP process that supports searching a subset of the data storage systems with a common indexing scheme.
20. The computing system of claim 15 , wherein the number and type of ERP processes include different ERP processes for different instances of a common type of the data storage systems.