Reconfigurable cloud computing
A method, system, and computer-readable storage medium for using a distributed computing system are disclosed. For example, one method involves receiving one or more parameters. The one or more parameters indicate one or more operations. The method also involves selecting one or more computing resources from computing resources. This selecting is based on the parameter(s). An application is configured to be executed using the computing resource(s). The method also involves generating a workflow. The workflow indicates that the application is to be executed using the computing resource(s). The workflow indicates that the application performs the operation(s). The method also involves communicating at least a part of the workflow to one or more nodes, where the node(s) include the computing resource(s).
1. A method comprising:
identifying one or more parameters, wherein
the one or more parameters indicate
an application, and
one or more operations;
selecting a model from a plurality of models, wherein
the selecting the model is based on the one or more parameters, and
the model indicates resource requirements for the one or more operations;
selecting one or more hardware computational elements from a plurality of hardware computational elements, wherein
the selecting the one or more hardware computational elements comprises
comparing one or more attributes of each of the plurality of hardware computational elements with the resource requirements, and
determining the one or more hardware computational elements needed to execute the application, based on the one or more parameters;
generating a workflow, wherein
the generating the workflow is based on the one or more parameters, and
the workflow indicates that
the application is to be executed using the one or more hardware computational elements,
the application is to perform the one or more operations,
a first part of the workflow is to be executed by a first hardware computational element of the one or more hardware computational elements,
a second part of the workflow is to be executed by a second hardware computational element of the one or more hardware computational elements, and
execution of the second part of the workflow is configured to use a result of execution of the first part of the workflow; and
communicating at least a part of the workflow to one or more nodes, wherein
the one or more nodes comprise the one or more hardware computational elements.
2. The method of claim 1 , wherein
the one or more nodes are configured to facilitate execution of the application by the one or more hardware computational elements,
during the execution of the application, the application is configured to perform the one or more operations on data,
the one or more hardware computational elements are configured to execute the application according to the workflow, and
the execution of the application accesses the data.
3. The method of claim 2 , wherein
the application is configured to generate a second result during the execution of the application, and
further comprising:
receiving the second result from the one or more nodes.
4. The method of claim 2 , further comprising:
storing the data, wherein
the data is stored prior to accessing the data,
the data is stored at a networked storage, and
the accessing the data comprises accessing the data at the networked storage.
5. The method of claim 1 , further comprising:
verifying the one or more parameters, wherein
the verifying is performed prior to the selecting the one or more hardware computational elements.
6. The method of claim 1 , further comprising:
determining whether the one or more hardware computational elements are to be configured prior to the execution of the application, and
in response to a determination that the one or more hardware computational elements are to be configured prior to the execution of the application, indicating in the workflow that the one or more hardware computational elements are to be configured prior to the execution of the application, wherein
the generating the workflow comprises the indicating.
7. The method of claim 1 , wherein
the model further comprises a data format, and
further comprising:
verifying data using the data format of the model.
8. The method of claim 1 , wherein the generating the workflow comprises generating one or more scripts, wherein
each of at least some of the one or more scripts is configured to perform one of the one or more operations, and
the execution of the application comprises execution of the one or more scripts.
9. The method of claim 1 , wherein
the one or more hardware computational elements comprise one or more of
one or more field-programmable gate arrays (FPGAs),
one or more graphical processing units (GPUs),
one or more digital signal processors (DSPs), or
one or more central processing units (CPUs), and
the one or more nodes provide cloud computing service.
10. The method of claim 1 , wherein
the first part of the workflow indicates execution of a first part of the application by the first hardware computational element, and
the second part of the workflow indicates execution of a second part of the application by the second hardware computational element.
11. The method of claim 10 , wherein
the workflow indicates that a third part of the workflow is to be executed by the first hardware computational element of the one or more hardware computational elements, and
the workflow further indicates that the first hardware computational element is to be re-configured prior to executing the third part of the workflow.
12. The method of claim 1 , wherein
the first hardware computational element is of a different type than the second hardware computational element.
13. A system, comprising:
a server, comprising
one or more processors,
a model selector, wherein
the model selector is configured to
select a model from a plurality of models, wherein
the selection of the model is based on one or more parameters,
the one or more parameters indicate an application, and
one or more operations to be performed by the application, and
the model indicates resource requirements for the one or more operations,
a resource selector, wherein
the resource selector is configured to
select one or more hardware computational elements from a plurality of hardware computational elements, wherein
the selection of the one or more hardware computational elements comprises
comparing one or more attributes of each of the plurality of hardware computational elements with the resource requirements, and
determining the one or more hardware computational elements needed to execute the application, based on the one or more parameters,
a workflow generator, wherein
the workflow generator is executable using the one or more processors and configured to
generate a workflow based on the one or more parameters, wherein the workflow indicates that
the application is to be executed by the one or more hardware computational elements,
the application is to perform the one or more operations,
a first part of the workflow is to be executed by a first hardware computational element of the one or more hardware computational elements,
a second part of the workflow is to be executed by a second hardware computational element of the one or more hardware computational elements, and
execution of the second part of the workflow is configured to use a result of execution of the first part of the workflow, and
a communication module, wherein
the communication module is configured to
communicate at least a part of the workflow to one or more nodes, wherein
the one or more nodes comprise the one or more hardware computational elements.
14. The system of claim 13 , further comprising:
the one or more nodes, wherein
the one or more nodes comprise the one or more hardware computational elements, and
the one or more nodes are configured to
facilitate the execution of the application by the one or more hardware computational elements, wherein
during the execution of the application, the application is configured to perform the one or more operations on data,
the hardware computational elements execute the application according to the workflow, and
the execution of the application accesses the data.
15. The system of claim 13 , wherein
the workflow generator is further configured to
determine whether the one or more hardware computational elements are to be configured prior to the execution of the application, and
in response to a determination that the one or more hardware computational elements are to be configured, indicate in the workflow that the one or more hardware computational elements are to be configured prior to the execution of the application.
16. The system of claim 13 , wherein
the workflow generator is further configured to
generate one or more configuration scripts, wherein
the one or more configuration scripts are configured to configure the one or more hardware computational elements prior to the execution of the application.
17. A computer program product embodied in a non-transitory computer readable storage medium comprising:
a plurality of instructions, comprising
a first set of instructions, executable on a computer system, configured to receive one or more parameters, wherein
the one or more parameters indicate an application, and
one or more operations to be performed by the application,
a second set of instructions, executable on the computer system, configured to select a model from a plurality of models, wherein
the model is selected based on the one or more parameters, and
the model indicates resource requirements for the one or more operations,
a third set of instructions, executable on the computer system, configured to select one or more hardware computational elements from a plurality of hardware computational elements, wherein
the one or more hardware computational elements are selected by
comparing one or more attributes of each of the plurality of hardware computational elements with the resource requirements, and
determining the one or more hardware computational elements needed to execute the application, based on the one or more parameters,
a fourth set of instructions, executable on the computer system, configured to
generate a workflow based on the one or more parameters, wherein
the workflow indicates that
the application is to be executed by the one or more hardware computational elements,
the application is to perform the one or more operations,
a first part of the workflow is to be executed by a first hardware computational element of the one or more hardware computational elements,
a second part of the workflow is to be executed by a second hardware computational element of the one or more hardware computational elements, and
execution of the second part of the workflow is configured to use a result of execution of the first part of the workflow, and
a fifth set of instructions, executable on the computer system, configured to communicate at least a part of the workflow to one or more nodes, wherein
the one or more nodes comprise the one or more hardware computational elements; and
a non-transitory computer-readable storage medium, wherein the instructions are encoded in the non-transitory computer-readable storage medium.
18. The computer program product embodied in the non-transitory computer readable storage medium of claim 17 , wherein
the one or more nodes are configured to facilitate the execution of the application by the one or more hardware computational elements,
the hardware computational elements execute the application according to the workflow, and
the execution of the application accesses data.
19. The computer program product embodied in the non-transitory computer readable storage medium of claim 17 , wherein the instructions further comprise:
a sixth set of instructions, executable on the computer system, configured to
determine whether the one or more hardware computational elements are to be configured prior to the execution of the application, and
a seventh set of instructions, executable on the computer system, configured to
indicate in the workflow that the one or more hardware computational elements are to be configured prior to the execution of the application, in response to a determination that the one or more hardware computational elements are to be configured prior to the execution of the application.
20. The computer program product embodied in the non-transitory computer readable storage medium of claim 17 , wherein the instructions further comprise:
a sixth set of instructions, executable on the computer system, configured to generate one or more configuration scripts, wherein
the one or more configuration scripts are configured to configure the one or more hardware computational elements prior to the execution of the application.