EXECUTING COMMANDS FROM A DISTRIBUTED EXECUTION MODEL
Systems and methods are disclosed for generating a distributed execution model with untrusted commands. The system can receive a query, and process the query to identify the untrusted commands. The system can use data associated with the untrusted command to identify one or more files associated with the untrusted command. Based on the files, the system can generate a data structure and include one or more identifiers associated with the data structure in the distributed execution model. The system can distribute the distributed execution model to one or more nodes in a distributed computing environment for execution.
1 . A computer-implemented method, comprising:
parsing a syntax model to identify a command from a plurality of commands;
communicating data associated with the command to a restricted computing environment, wherein the restricted computing environment generates a data structure based on a file containing computer-executable instructions associated with the command; and
including an identifier associated with the data structure in a distributed execution model.
2 . The computer-implemented method of claim 1 , wherein communicating the data associated with the command to the restricted computing environment comprises communicating the data associated with the command to the restricted computing environment using an external transformer.
3 . The computer-implemented method of claim 1 , wherein communicating the data associated with the command to the restricted computing environment comprises communicating the data associated with the command to the restricted computing environment using an external transformer, the method further comprising receiving the data structure from the restricted computing environment using the external transformer.
4 . The computer-implemented method of claim 1 , wherein the data associated with the command includes a filename and a file location associated with the file.
5 . The computer-implemented method of claim 1 , wherein the data associated with the command includes a filename and a file location associated with the file, wherein the restricted computing environment uses the filename and file location to identify the file and uses the file to generate the data structure.
6 . The computer-implemented method of claim 1 , further comprising generating a syntax model based on a query, the syntax model comprising the plurality of commands.
7 . The computer-implemented method of claim 1 , wherein the syntax model comprises an abstract syntax tree.
8 . The computer-implemented method of claim 1 , wherein the syntax model includes a command node corresponding to each command in a query.
9 . The computer-implemented method of claim 1 , wherein the syntax model includes one or more trusted commands and one or more untrusted commands.
10 . The computer-implemented method of claim 1 , wherein the plurality of commands includes a trusted command that is associated with libraries and dependencies that are known by a system executing the query.
11 . The computer-implemented method of claim 1 , further comprising communicating the distributed execution model to one or more worker nodes.
12 . A computing system, comprising:
one or more processing devices configured to:
parse a syntax model to identify a command from a plurality of commands;
communicate data associated with the command to a restricted computing environment, wherein the restricted computing environment generates a data structure based on a file containing computer-executable instructions associated with the command; and
include an identifier associated with the data structure in a distributed execution model.
13 . The system of claim 12 , wherein communicating the data associated with the command to the restricted computing environment comprises communicating the data associated with the command to the restricted computing environment using an external transformer.
14 . The system of claim 12 , wherein communicating the data associated with the command to the restricted computing environment comprises communicating the data associated with the command to the restricted computing environment using an external transformer, the method further comprising receiving the data structure from the restricted computing environment using the external transformer.
15 . The system of claim 12 , wherein the data associated with the command includes a filename and a file location associated with the file.
16 . Non-transitory computer readable media comprising computer-executable instructions that, when executed by a computing system, cause the computing system to:
parse a syntax model to identify a command from a plurality of commands;
communicate data associated with the command to a restricted computing environment, wherein the restricted computing environment generates a data structure based on a file containing computer-executable instructions associated with the command; and
include an identifier associated with the data structure in a distributed execution model.
17 . The non-transitory computer readable media of claim 16 , wherein the data associated with the command includes a filename and a file location associated with the file, wherein the restricted computing environment uses the filename and file location to identify the file and uses the file to generate the data structure.
18 . The non-transitory computer readable media of claim 16 , further comprising generating a syntax model based on a query, the syntax model comprising the plurality of commands.
19 . The non-transitory computer readable media of claim 16 , wherein the syntax model comprises an abstract syntax tree.
20 . The non-transitory computer readable media of claim 16 , wherein the syntax model includes a command node corresponding to each command in a query.