Provisioning system and method for a distributed computing environment using a map reduce process
View Patent ↗A provisioning system for a distributed computing environment includes a map reduce framework that includes a splitter process, a mapper process, and a reduce process. The splitter process receives a task associated with a distributed application to be deployed on the distributed computing environment, and selects which of the resources are to be provisioned for executing the distributed application. The mapper process converts at least one abstract address included in the task to an absolute address, and executes the task for provisioning the selected resources, while the reduce process consolidates results of the executed task.
1. A provisioning system for a distributed computing environment, the provisioning system comprising:
a map reduce framework stored in at least one memory and executed on at least one processor of each of a plurality of computing nodes comprising one or more resources, the plurality of computing nodes comprising the distributed computing environment, the map reduce framework comprising:
a splitter process to receive a task associated with a distributed application to be deployed on the distributed computing environment, and select which of the resources are to be provisioned for executing the distributed application;
a mapper process to convert at least one abstract address included in the task to an absolute address, and execute the task for provisioning the selected resources; and
a reduce process to consolidate results of the executed task.
2. The provisioning system of claim 1 , wherein the splitter process is executed on a first computing node, and the mapper process and the reduce process are executed on one or more second computing nodes, and wherein the selected resources are configured on the second computing nodes.
3. The provisioning system of claim 1 , wherein the absolute address is associated with a resource management application to provision the selected resource.
4. The provisioning system of claim 1 , wherein the reduce process generates a report message indicating whether or not the task completes successfully, and wherein the mapper process to perform one or more corrective actions when the report message indicates that the task has not completed successfully, the corrective actions comprising at least one of instructing the map reduce framework to select one or more other resources to be provisioned, instructing the map reduce framework to perform one or more additional attempts to provision the selected resource, and generating an alert message to indicate that the provisioning of the selected resource has failed.
5. The provisioning system of claim 1 , wherein the reduce process determines a type of the task, and select an executor to execute the task according to the type of the task.
6. The provisioning system of claim 1 , wherein the map reduce framework comprises a commercial off-the-shelf map reduce application.
7. The provisioning system of claim 1 , further comprising logic to select which of the resources are to be provisioned for executing the distributed application is in communication with an application program interface (API) of the splitter process, convert at least one abstract address included in the task to an absolute address is in communication with an application program interface (API) of the mapper process, and execute the task for provisioning the selected resources is in communication with an application program interface (API) of the reduce process.
8. The provisioning system of claim 1 , wherein the splitter process to select resources according to at least one of an automatic selection process, a system wide selection process, or a specific resource selection process.
9. The provisioning system of claim 1 , wherein the mapper process receives and processes a task group for provisioning the resources, the task group comprising a plurality of the tasks and a master script that is executed to control how the plurality of tasks are processed.
10. A provisioning method for a distributed computing environment, the provisioning method comprising:
receiving, using instructions stored in a non-transitory, computer-readable medium and executed on at least one processor, a task associated with a distributed application to be deployed on the distributed computing environment, and select which of the resources are to be provisioned for executing the distributed application using a splitter process of a map reduce framework;
converting, using the instructions, at least one abstract address included in the task to an absolute address using a mapper process of a map reduce framework;
executing, using the instructions, the task for provisioning the selected resources using the mapper process of a map reduce framework; and
consolidating, using the instructions, results of the executed task using a reduce process.
11. The provisioning method of claim 10 , further comprising executing the splitter process on a first computing node, and executing the mapper process and the reduce process on one or more second computing nodes, wherein the selected resources are configured on the second computing nodes.
12. The provisioning method of claim 10 , wherein the absolute address is associated with a resource management application configured to provision the selected resource.
13. The provisioning method of claim 10 , further comprising generating, using the reduce process, a report message indicating whether or not the task completes successfully, and performing one or more corrective actions when the report message indicates that the task has not completed successfully.
14. The provisioning method of claim 10 , further comprising determining a type of the task, and selecting an executor to execute the task according to the type of the task using the reduce process.
15. The provisioning method of claim 10 , wherein the map reduce framework comprises a commercial off-the-shelf map reduce application.
16. The provisioning method of claim 10 , further comprising selecting the resources according to at least one of an automatic selection process, a system wide selection process, or a specific resource selection process.
17. The provisioning method of claim 10 , further comprising receiving and processing a task group for provisioning the selected resources, the task group comprising a plurality of the tasks and a master script that is executed to control how the plurality of tasks are processed.
18. Code implemented in a non-transitory, computer readable medium that when executed by at least one processor, to perform at least the following:
receiving a task associated with a distributed application to be deployed on the distributed computing environment, and select which of the resources are to be provisioned for executing the distributed application using a splitter process of a map reduce framework;
converting at least one abstract address included in the task to an absolute address using a mapper process of a map reduce framework;
executing using the instructions, the task for provisioning the selected resources using the mapper process of a map reduce framework; and
consolidating results of the executed task using a reduce process of the map reduce framework.
19. The code of claim 18 , further configured to perform determining a type of the task, and selecting an executor to execute the task according to the type of the task using the reduce process.
20. The code of claim 18 , further configured to perform generating, using the reduce process, a report message indicating whether or not the task completes successfully, and performing one or more corrective actions when the report message indicates that the task has not completed successfully.