Utilizing multiple connections for generating a job result
A method to assist with processing distributed jobs by retrieving and/or synchronizing supplemental job data. The method includes receiving a request pertaining to a job from a first virtualized execution environment using a non-persistent connection between the first virtualized execution environment and a second virtualized execution environment, transmitting, by the secondary machine using a persistent connection between the first virtualized execution environment and the second virtualized execution environment, a task request for supplemental information pertaining to the job, generating a job result for the job based on the supplemental information received from the first virtualized execution environment via the persistent connection, and transmitting, to the first virtualized execution environment, the job result for the job using the non-persistent connection.
1. A method comprising:
transmitting, by a first component of a first execution environment via a first connection to a second component of a second execution environment, a first request associated with a job;
receiving, by the first component via a second connection from the second component, a second request associated with the job;
transmitting, by the first component via the second connection to the second component, a response to the second request, the response comprising an information associated with the job;
receiving, by the first component via the first connection from the second component, a result of the job; and
responsive to receiving the result, closing the first connection and keeping the second connection open.
2. The method of claim 1 , wherein at least one of the first execution environment and the second execution environment is a virtual machine.
3. The method of claim 1 , wherein the first connection is a non-persistent connection, and wherein the second connection is a persistent connection.
4. The method of claim 1 , wherein the second connection and the first connection are Hyper Text Transfer Protocol (HTTP) connections.
5. The method of claim 1 , further comprising:
synchronizing, based on the response, a portion of a first data store associated with the first component with a second data store associated with the second component.
6. The method of claim 1 , wherein the job pertains to a search query, and the result of the job is a search result produced using a late-binding schema.
7. The method of claim 1 , wherein the first component comprise a lookup table including an entry storing a mapping of a first data item identified by the second request to a second data item, wherein the response to the second request identifies the second data item.
8. The method of claim 1 , further comprising:
synchronizing, by a one-way pull synchronization, a portion of a second data store associated with the second component with a first data store associated with the first component.
9. The method of claim 1 , wherein the second component comprises a plurality of second components of a second execution environments and the second connection with the second component comprises a plurality of persistent connections, each persistent connection being between the first component and one of the plurality of second components.
10. The method of claim 1 , wherein the job pertains to a search query for searching source data that comprises raw machine data.
11. The method of claim 1 , wherein the job pertains to a search query for searching source data that comprises time-stamped events, and wherein each of the time-stamped events includes at least a portion of raw machine data.
12. A system, comprising:
a memory; and
one or more processing devices coupled to the memory, the one or more processing devices to implement a first execution environment to:
transmit, by a first component of the first execution environment via a first connection to a second component of a second execution environment, a first request associated with a job;
receive, by the first component via a second connection from the second component, a second request associated with the job;
transmit, by the first component via the second connection to the second component, a response to the second request, the response comprising an information associated with the job;
receive, by the first component via the first connection from the second component, a result of the job; and
responsive to receiving the result, close the first connection and keep the second connection open.
13. The system of claim 12 , wherein the first connection is a non-persistent connection, and wherein the second connection is a persistent connection.
14. The system of claim 12 , wherein the first execution environment is further to:
synchronize, based on the response, a portion of a first data store associated with the first component with a second data store associated with the second component.
15. The system of claim 12 , wherein the first component comprise a lookup table including an entry storing a mapping of a first data item identified by the second request to a second data item, wherein the response to the second request identifies the second data item.
16. A non-transitory computer readable storage medium encoding instructions thereon, which in response to execution by one or more processing devices cause the one or more processing devices to implement a first execution environment to:
transmit, by a first component of the first execution environment via a first connection to a second component of a second execution environment, a first request associated with a job;
receive, by the first component via a second connection from the second component, a second request associated with the job;
transmit, by the first component via the second connection to the second component, a response to the second request, the response comprising an information associated with the job;
receive, by the first component via the first connection from the second component, a result of the job; and
responsive to receiving the result, close the first connection and keep the second connection open.
17. The non-transitory computer readable storage medium of claim 16 , wherein the first connection is a non-persistent connection, and wherein the second connection is a persistent connection.
18. The non-transitory computer readable storage medium of claim 16 , wherein the job pertains to a search query, and the result of the job is a search result produced using a late-binding schema.
19. The non-transitory computer readable storage medium of claim 16 , wherein the first component comprise a lookup table including an entry storing a mapping of a first data item identified by the second request to a second data item, wherein the response to the second request identifies the second data item.