Automatic selection of precompiled or code-generated operator variants
A system for generating a mixed query plan including operator alternatives. A method may include generating a mixed query plan including a first operator selected as a pre-compiled operator; generating the mixed query plan including a second operator selected as operator alternatives, the operator alternatives configuring the second operator as pre-compiled or code-generating alternatives; delaying selection of one of the operator alternatives until additional information regarding the mixed query plan becomes available; generating the mixed query plan including a third operator selected as a code-generating operator; and selecting, given the third operator representing the additional information, one of the operator alternatives to enable execution of the mixed query plan using the selected operator alternative. Related methods and articles of manufacture are also described.
1. A system comprising:
at least one data processor; and
at least one memory storing instructions which, when executed by the at least one data processor, result in operations comprising:
generating a mixed query plan including a first operator selected as either a first pre-compiled operator or a first code-generating operator and a second operator configured as operator alternatives, wherein the operator alternatives comprise a second pre-compiled operator and a second code-generating operator, and wherein the operator alternatives are configured to allow a later selection between the second pre-compiled operator and the second code-generating operator after additional information is available regarding whether a subsequent third operator is selected as either a third code-generating operator or a third pre-compiled operator;
continuing to generate the mixed query plan including the selection of the third operator;
selecting the second pre-compiled operator to replace the operator alternatives in response to the third operator being selected as a third pre-compiled operator;
selecting the second code-generating operator to replace the operator alternatives in response to the third operator being selected as a third code-generating operator; and
executing, by an execution engine, the mixed query plan using the selected one of the operator alternatives.
2. The system of claim 1 , wherein the second code-generating operator is associated with code which, when executed at runtime, generates additional code for compilation and execution as part of the mixed query plan.
3. The system of claim 1 , wherein when the selected one of the operator alternatives corresponds to the code-generated operator, the query plan optimizer inserts glue code into the mixed query plan, wherein the glue code decomposes one or more data chunks into a plurality of constituent rows of data.
4. The system of claim 1 , wherein the second pre-compiled operator operates on a different unit of data from the second code-generating operator.
5. A method comprising:
generating a mixed query plan including a first operator selected as either a first pre-compiled operator or a first code-generating operator and a second operator configured as operator alternatives, wherein the operator alternatives comprise a second pre-compiled operator and a second code-generating operator, and wherein the operator alternatives are configured to allow a later selection between the second pre-compiled operator and the second code-generating operator after additional information is available regarding whether a subsequent third operator is selected as either a third code-generating operator or a third pre-compiled operator;
continuing to generate the mixed query plan including the selection of the third operator;
selecting the second pre-compiled operator to replace the operator alternatives in response to the third operator being selected as a third pre-compiled operator;
selecting the second code-generating operator to replace the operator alternatives in response to the third operator being selected as a third code-generating operator; and
executing, by an execution engine, the mixed query plan using the selected one of the operator alternatives.
6. The method of claim 5 , wherein the second code-generating operator is associated with code which, when executed at runtime, generates additional code for compilation and execution as part of the mixed query plan.
7. The method of claim 5 , wherein when the selected one of the operator alternatives corresponds to the code-generated operator, the query plan optimizer inserts glue code into the mixed query plan, wherein the glue code decomposes one or more data chunks into a plurality of constituent rows of data.
8. The method of claim 5 , wherein the second pre-compiled operator operates on a different unit of data from the second code-generating operator.
9. A non-transitory computer-readable storage medium including program code which when executed by at least one data processor, result in operations comprising:
generating a mixed query plan including a first operator selected as either a first pre-compiled operator or a first code-generating operator and a second operator configured as operator alternatives, wherein the operator alternatives comprise a second pre-compiled operator and a second code-generating operator, and wherein the operator alternatives are configured to allow a later selection between the second pre-compiled operator and the second code-generating operator after additional information is available regarding whether a subsequent third operator is selected as either a third code-generating operator or a third pre-compiled operator;
continuing to generate the mixed query plan including the selection of the third operator;
selecting the second pre-compiled operator to replace the operator alternatives in response to the third operator being selected as a third pre-compiled operator;
selecting the second code-generating operator to replace the operator alternatives in response to the third operator being selected as a third code-generating operator; and
executing, by an execution engine, the mixed query plan using the selected one of the operator alternatives.
10. The non-transitory computer-readable storage medium of claim 9 , wherein the second code-generating operator is associated with code which, when executed at runtime, generates additional code for compilation and execution as part of the mixed query plan.
11. The non-transitory computer-readable storage medium of claim 9 , wherein when the selected one of the operator alternatives corresponds to the code-generated operator, the query plan optimizer inserts glue code into the mixed query plan, wherein the glue code decomposes one or more data chunks into a plurality of constituent rows of data.