Distributed package management using meta-scheduling
A system for package management includes an interface and a processor. The interface is to receive an indication to install a package. The processor is to determine a configured package using a set local configuration properties and using the package and to launch, using a metascheduler, a set of subschedulers to install a plurality of applications of the configured package.
1. A system for package management, comprising:
an interface to:
receive an indication to install a package; and
a processor configured to:
determine a configured package using a set local configuration properties and using the package;
launch, using a metascheduler, a set of subschedulers to install a plurality of applications of the configured package, comprising to:
cause instantiation of the metascheduler to install an application, wherein at least one subscheduler of the set of subschedulers reports success or failure of its tasks to the metascheduler; and
monitor the set of subschedulers and the metascheduler, comprising to:
determine whether the metascheduler is performing the installation without error; and
in response to a determination that the metascheduler is not performing the installation without error, perform a remedial action.
2. A system as in claim 1 , wherein monitoring the set of subschedulers detects a failure of a subscheduler of the set of sub schedulers.
3. A system as in claim 2 , wherein the remedial action includes the metascheduler restarting the subscheduler in the event that the failure of the subscheduler is detected.
4. A system as in claim 1 , wherein processor comprises a processor of a cluster manager of a cluster.
5. A system as in claim 4 , wherein monitoring the metascheduler detects a failure of the metascheduler.
6. A system as in claim 5 , wherein the remedial action includes the cluster manager restarting the metascheduler in the event that the failure of the metascheduler is detected.
7. A system as in claim 1 , wherein a subscheduler is executed using a cluster node of a cluster.
8. A system as in claim 7 , wherein the subscheduler installs an application of the plurality of application of the configured package on one or more nodes of the cluster.
9. A system as in claim 8 , wherein the subscheduler monitors the installation of the application.
10. A system as in claim 9 , wherein monitoring the installation detects a failure to install the application.
11. A system as in claim 10 , wherein the subscheduler restarts the installation of the application in the event that the failure to install the application is detected.
12. A system as in claim 8 , wherein the subscheduler monitors performance of the application when executing a task.
13. A system as in claim 12 , wherein monitoring the performance of the application detects a failure of the application.
14. A system as in claim 12 , wherein monitoring the performance of the application detects under performance.
15. A system as in claim 12 , wherein monitoring the performance of the application detects idle resources.
16. A method of package management, comprising:
receiving an indication to install a package;
determining, using a processor, a configured package using a set local configuration properties and using the package;
launching, using a metascheduler, a set of subschedulers to install a plurality of applications of the configured package, comprising:
causing instantiation of the metascheduler to install an application, wherein at least one subscheduler of the set of subschedulers reports success or failure of its tasks to the metascheduler; and
monitoring the set of subschedulers and the metascheduler, comprising:
determining whether the metascheduler is performing the installation without error; and
in response to a determination that the metascheduler is not performing the installation without error, performing a remedial action.
17. A computer program product for package management, the computer program product being embodied in a non-transitory computer readable storage medium and comprising computer instructions for:
receiving an indication to install a package;
determining a configured package using a set local configuration properties and using the package;
launching, using a metascheduler, a set of subschedulers to install a plurality of applications of the configured package, comprising:
causing instantiation of the metascheduler to install an application, wherein at least one subscheduler of the set of subschedulers reports success or failure of its tasks to the metascheduler; and
monitoring the set of subschedulers and the metascheduler, comprising:
determining whether the metascheduler is performing the installation without error; and
in response to a determination that the metascheduler is not performing the installation without error, performing a remedial action.