System and method for batch computing
A method, system, and computer-readable storage medium for creating and executing containerized applications in cloud computing are disclosed. For example, one method involves identifying a command. Such a command indicates an application to be executed by a compute node. The method also involves generating a job for transmission to the compute node. The job indicates a container. The compute node, upon receipt of the job, is configured to create an environment for such a container, execute the application within the container, and generate results of the execution of the application.
1. A system for batch computing, comprising:
a plurality of environment template data structures stored in a first data storage device, each environment template data structure having associated functionality;
a user interface system operating on a first processor and configured to retrieve one of the environment template data structures by transmitting a request to a second processor, to generate a user interface display for the environment template data structure on a display associated with the first processor, to receive a user-entered update to the environment template data structure at the first processor to modify the functionality of the environment template data structure and to transmit the user-entered update to the second processor;
a server module operating on the second processor, the server module configured to receive the user-entered update to the environment template data structure, to store an updated environment template data structure in a second data storage device and to generate a container for the updated environment template data structure that is configured to execute an application using the updated environment template data structure to modify functionality of the application, wherein the server module is configured to generate a first container for the updated environment template data structure that is configured to execute a first application using the updated environment template data structure and a second container for the updated environment template data structure that is configured to execute a second application using the updated environment template data structure.
2. The system of claim 1 wherein the server module is configured to select one of a plurality of compute nodes to receive the container and to transmit the container to the selected compute node.
3. The system of claim 2 wherein the server module is configured to track the processing of the container by a third processor at the selected compute node and to receive output results data from the selected compute node that is associated with the container.
4. The system of claim 1 wherein the server module is configured to select one of a plurality of compute nodes to receive the container as a function of a selected cost of the selected compute node and to transmit the container to the selected compute node.
5. The system of claim 1 wherein the server module is configured to generate the first container for the updated environment template data structure that is configured to execute the first application at a first time using the updated environment template data structure and the second container for the updated environment template data structure that is configured to execute the second application at a second time using the updated environment template data structure.
6. The system of claim 1 wherein the server module is configured to generate the first container for the updated environment template data structure that is configured to execute the first application at a first time using the updated environment template data structure and the second container for the updated environment template data structure that is configured to execute the second application at a second time using the updated environment template data structure, wherein the first time is prior to the second time.
7. The system of claim 1 wherein the server module is configured to generate the first container for the updated environment template data structure that is configured to execute the first application during a first time period using the updated environment template data structure and the second container for the updated environment template data structure that is configured to execute the second application during a second time period using the updated environment template data structure, wherein the first time period completes prior to a start of the second time period.
8. A method for batch computing, comprising:
storing a plurality of environment template data structures in a first data storage device, each environment template data structure having associated functionality;
retrieving one of the environment template data structures by transmitting a request from a user interface operating on a first processor to a second processor, wherein the user interface generates a user interface display for the environment template data structure on a display associated with the first processor that is configured to receive a user-entered update to the environment template data structure at the first processor to modify the functionality of the environment template data structure and to transmit the user-entered update to the second processor;
receive the user-entered update to the environment template data structure at a server module;
storing an updated environment template data structure having modified functionality in a second data storage device;
generating a container for the updated environment template data structure that is configured to execute an application using the modified functionality of the updated environment template data structure to modify functionality of the application;
generating a first container for the updated environment template data structure using the server module that is configured to execute a first application using the updated environment template data structure; and
generating a second container for the updated environment template data structure using the server module that is configured to execute a second application using the updated environment template data structure.
9. The method of claim 8 further comprising:
selecting one of a plurality of compute nodes with the server module to receive the container; and
transmitting the container from the server module to the selected compute node.
10. The method of claim 9 further comprising:
tracking the processing of the container by a third processor at the selected compute node with the server module; and
receiving output results data from the selected compute node at the server module that is associated with the container.
11. The method of claim 8 further comprising:
selecting one of a plurality of compute nodes with the server module to receive the container as a function of a selected cost of the selected compute node; and
transmitting the container from the server module to the selected compute node.
12. The method of claim 8 further comprising:
generating the first container for the updated environment template data structure using the server module that is configured to execute the first application at a first time using the updated environment template data structure; and
generating the second container for the updated environment template data structure using the server module that is configured to execute the second application at a second time using the updated environment template data structure.
13. The method of claim 8 further comprising:
generating the first container for the updated environment template data structure using the server module that is configured to execute the first application at a first time using the updated environment template data structure; and
generating the second container for the updated environment template data structure using the server module that is configured to execute the second application at a second time using the updated environment template data structure, wherein the first time is prior to the second time.
14. The method of claim 8 further comprising:
generating the first container for the updated environment template data structure using the server module that is configured to execute the first application during a first time period using the updated environment template data structure; and
generating the second container for the updated environment template data structure using the server module that is configured to execute the second application during a second time period using the updated environment template data structure, wherein the first time period completes prior to a start of the second time period.
15. The method of claim 8 wherein the user interface generates the user interface display for the environment template data structure on the display associated with the first processor that is configured to receive the user-entered update to the environment template data structure at the first processor to modify the functionality of the environment template data structure by determining modifiable functionality of the environment template data structure and generating a user display control associated with the modifiable functionality.
16. The method of claim 15 wherein the user display control associated with the modifiable functionality comprises a configuration file control.
17. The method of claim 15 wherein the user display control associated with the modifiable functionality comprises a configuration parameter control.
18. The method of claim 15 wherein the user display control associated with the modifiable functionality comprises an application image control.
19. A system for batch computing, comprising:
a plurality of environment template data structures stored in a first data storage device, each environment template data structure having associated functionality;
a user interface system operating on a first processor and configured to retrieve one of the environment template data structures by transmitting a request to a second processor, to generate a user interface display for the environment template data structure on a display associated with the first processor, to receive a user-entered update to the environment template data structure at the first processor to modify the functionality of the environment template data structure and to transmit the user-entered update to the second processor;
a server module operating on the second processor, the server module configured to receive the user-entered update to the environment template data structure, to store an updated environment template data structure in a second data storage device and to generate a first container for the updated environment template data structure that is configured to execute a first application using the updated environment template data structure to modify functionality of the application and a second container for the updated environment template data structure that is configured to execute a second application using the updated environment template data structure.