Secure query processing
A distributed database identifies classifications of risk associated with stages of a query plan. The distributed database generates an execution plan in which incompatible risk classifications are assigned to separate stages of an execution plan that is derived from the query plan. The stages are assigned to computing nodes for execution based, at least in part, on the risk classifications. A result for the query is generated based on execution of the stages on the assigned computing nodes.
1. A system, comprising:
at least one processor; and
at least one memory that stores computer-executable instructions that, in response to execution by the at least one processor, cause the system to:
identify a first portion of a query plan, the first portion indicative of executing a user-defined function;
identify a second portion of the query plan, the second portion indicative of accessing a database table associated with a security policy, wherein each of the first and the second portions of the query plan are to be executed by different computing nodes;
generate, based at least in part on:
the identification of the first and second portions, and
a security rule that prohibits the same computing node from executing user-defined functions and accessing the database table where security of the database table could be jeopardized by execution of user-defined functions at the same computing node,
an execution plan in which the first portion is to be performed in a first stage separate from a second stage of the execution plan in which the second portion is to be performed;
cause the first stage of the execution plan to be performed on a first computing node;
cause the second stage of the execution plan to be performed on a second computing node; and
provide a result of the query based, at least in part, on the performance of the first and second stages.
2. The system of claim 1 , wherein the at least one memory comprising further computer-executable instructions that, in response to execution by the at least one processor, cause the system to:
reserve the first computing node for executing other stages comprising user-defined functions, or operations compatible with user-defined functions, in other execution plans, in response to using the first computing node to perform the first stage comprising the user-defined functions.
3. The system of claim 1 , wherein the at least one memory comprising further computer-executable instructions that, in response to execution by the at least one processor, cause the system to:
select the second computing node to perform the second stage of the execution plan based, at least in part, on a determination that the second computing node has not been used to execute a user-defined function.
4. The system of claim 1 , wherein the database table stores data on behalf of a plurality of users and the security policy limits access by any one user to a subset of the table associated with that one user.
5. A computer-implemented method of processing a query of a database, comprising:
identifying a first portion of a query plan associated with a first classification of risk;
identifying a second portion of a query plan associated with a second classification of risk, wherein each of the first and the second portions of the query plan are to be executed by separate computing nodes in accordance with a security rule that prohibits the same computing node from executing at least one type of function and accessing at least one type of data where security of the at least one type of data could be jeopardized by execution of the at least one type of function at the same computing node;
generating an execution plan in which the first portion is to be performed in a first stage separate from a second stage of the execution plan in which the second portion is to be performed;
performing the execution plan using at least a first computing node to execute the first stage and a second computing node to execute the second stage; and
generating results of the query based, at least in part, on execution of the first and second stages.
6. The computer-implemented method of claim 5 , wherein the first classification of risk is associated with a user-defined function and the second classification of risk is associated with multiple users sharing a table of a database.
7. The computer-implemented method of claim 5 , wherein a stage of the execution plan comprises one or more operations corresponding to one or more portions of the query plan.
8. The computer-implemented method of claim 5 , wherein a classification of risk is identified based, at least in part, on examination of at least one of a database catalog or a schema.
9. The computer-implemented method of claim 5 , wherein the first computing node is reserved for executing stages that comprise the first classification of risk and executing stages compatible with the first classification of risk.
10. The computer-implemented method of claim 5 , further comprising:
determining that the second computing node has not been, and is not being, used to execute a stage associated with the first classification of risk; and
selecting the second computing node to execute the second stage based, at least in part, on the determining.
11. The computer-implemented method of claim 5 , further comprising:
generating a version of the query plan in which portions of the query plan are marked according to their respective association with a classification of risk.
12. The computer-implemented method of claim 5 , wherein the execution plan is generated based, at least in part, on assigning operations to stages according to a classification of risk associated with an assigned operation.
13. A non-transitory computer-readable storage medium storing thereon executable instructions that, as a result of being executed by one or more processors of a computer system, cause the computer system to at least:
identify a first portion of a query plan associated with a first classification of risk;
identify a second portion of a query plan associated with a second classification of risk, wherein each of the first and the second portions of the query plan are to be executed by different computing nodes;
generate an execution plan in which the first portion is to be performed in a first stage separate from a second stage of the execution plan in which the second portion is to be performed; and
cause the execution plan to be performed using at least a first computing node to execute the first stage and a second computing node to execute the second stage in accordance with a rule that prohibits the same computing node from executing at least one type of function and accessing at least one type of data where security of the at least one type of data could be jeopardized by execution of the at least one type of function at the same computing node.
14. The non-transitory computer-readable storage medium of claim 13 , comprising further instructions that, as a result of being executed by the one or more processors, cause the computer system to:
mark a portion of the query plan according to a classification of risk associated with the portion.
15. The non-transitory computer-readable storage medium of claim 13 , comprising further instructions that, as a result of being executed by the one or more processors, cause the computer system to:
identify a portion of the query plan associated with the second classification of risk; and
modify the identified portion so that the second classification of risk is associated with at least one of a child portion or sibling portion of the identified portion.
16. The non-transitory computer-readable storage medium of claim 13 , wherein the second classification of risk is associated with access to a database table that stores data on behalf of a plurality of users and a security policy that limits access by any one user to a subset of the table associated with that one user.
17. The non-transitory computer-readable storage medium of claim 13 , wherein the first computing node is reserved for executing stages that comprise user-defined functions and stages that are compatible with risk associated with executing user-defined functions.
18. The non-transitory computer-readable storage medium of claim 13 , comprising further instructions that, as a result of being executed by the one or more processors, cause the computer system to:
determine that a computing node to be used to execute a stage associated with the second classification of risk has not been used to execute a stage associated with the first classification of risk.
19. The non-transitory computer-readable storage medium of claim 13 , comprising further instructions that, as a result of being executed by the one or more processors, cause the computer system to:
select the first computing node to perform the first stage based, at least in part, on a determination that the first computing node is not currently executing a stage associated with the second classification of risk.
20. The non-transitory computer-readable storage medium of claim 13 , comprising further instructions that, as a result of being executed by the one or more processors, cause the computer system to:
identify an additional portion of the query plan that is not associated with either of the first classification of risk or the second classification of risk; and
assign the additional portions to a selected stage of the execution plan, the selection made irrespective of classifications of risk associated with other portions assigned to the selected stage.