Cluster instance management system
A system for cluster management comprises a status monitor and an instance replacement manager. The status monitor is for monitoring status of an instance of a set of instances on a cluster provider. The instance replacement manager is for determining a replacement strategy for the instance in the event the instance does not respond. The replacement strategy for the instance is based at least in part on a management criteria for on-demand instances and spot instances on the cluster provider.
1. A system for cluster management, comprising:
a processor; and
a memory coupled with the processor, wherein the memory is configured to provide the processor with instructions which when executed cause the processor to:
monitor status of an instance of a set of instances on a cluster provider; and
determine a replacement strategy for the instance in the event the instance does not respond, wherein the replacement strategy for the instance is based at least in part on a management criteria for on-demand instances and spot instances on the cluster provider, wherein the determining of the replacement strategy comprises to:
determine whether it is acceptable to not replace the instance immediately based on the management criteria; and
in response to a determination that it is acceptable to not replace the instance immediately based on the management criteria:
monitor availability of a new spot instance; and
in response to a determination that the new spot instance is available, replace the instance that does not respond with the new spot instance.
2. A system as in claim 1 , wherein the processor is further configured to receive the management criteria.
3. A system as in claim 2 , wherein the management criteria comprise one or more of the following: a maximum number of on-demand instances or a minimum number of on-demand instances.
4. A system as in claim 2 , wherein the management criteria comprise one or more of the following: a maximum number of total instances or a minimum number of total instances.
5. A system as in claim 2 , wherein the management criteria comprise a budget limit.
6. A system as in claim 2 , wherein the management criteria comprise a failure criterion.
7. A system as in claim 2 , wherein the management criteria comprise a reserve criterion.
8. A system as in claim 2 , wherein the management criteria comprise a reserve poolsize.
9. A system as in claim 1 , wherein the processor is further configured to determine a new set of instances to request based at least in part on the management criteria.
10. A system as in claim 9 , wherein the processor is further configured to:
determine availability of the new set of instances on the cluster provider; and
in the event there is availability, indicate to create the new set of instances.
11. A system as in claim 9 , wherein the processor is further configured to determine a request strategy based at least in part on a cluster availability and on the management criteria.
12. A system as in claim 1 , wherein the monitoring of the status comprising to monitor the status of the instance periodically.
13. A system as in claim 1 , wherein the monitoring of the status comprising to monitor the status of each instance of the set of instances.
14. A system as in claim 1 , wherein the monitoring of the status comprising to monitor the status of each spot instance of the set of instances.
15. A system as in claim 1 , wherein the replacement strategy comprises replacing the instance with a spot instance from a reserve pool.
16. A system as in claim 1 , wherein the replacement strategy comprises replacing the instance with an on-demand instance in the event that this is allowed under the management criteria.
17. A system as in claim 1 , wherein the replacement strategy comprises stopping the set of instances.
18. A system as in claim 17 , wherein the replacement strategy comprises saving the state of the set of instances.
19. A system as in claim 17 , wherein the replacement strategy comprises maintaining one on-demand instance of the set of instances.
20. A method for cluster management, comprising:
monitoring status of an instance of a set of instances on a cluster provider; and
determining, using a processor, a replacement strategy for the instance in the event the instance does not respond, wherein the replacement strategy for the instance is based at least in part on a management criteria for on-demand instances and spot instances on the cluster provider, wherein the determining of the replacement strategy comprises:
determining whether it is acceptable to not replace the instance immediately based on the management criteria; and
in response to a determination that it is acceptable to not replace the instance immediately based on the management criteria:
monitoring availability of a new spot instance; and
in response to a determination that the new spot instance is available, replacing the instance that does not respond with the new spot instance.
21. A computer program product for cluster management, the computer program product being embodied in a non-transitory computer readable storage medium and comprising computer instructions for:
monitoring status of an instance of a set of instances on a cluster provider; and
determining a replacement strategy for the instance in the event the instance does not respond, wherein the replacement strategy for the instance is based at least in part on a management criteria for on-demand instances and spot instances on the cluster provider, wherein the determining of the replacement strategy comprises:
determining whether it is acceptable to not replace the instance immediately based on the management criteria; and
in response to a determination that it is acceptable to not replace the instance immediately based on the management criteria:
monitoring availability of a new spot instance; and
in response to a determination that the new spot instance is available, replacing the instance that does not respond with the new spot instance.