On-demand access to compute resources
Disclosed are systems, methods and computer-readable media for controlling and managing the identification and provisioning of resources within an on-demand center as well as the transfer of workload to the provisioned resources. One aspect involves creating a virtual private cluster within the on-demand center for the particular workload from a local environment. A method of managing resources between a local compute environment and an on-demand environment includes detecting an event associated with a local compute environment and based on the detected event, identifying information about the local environment, establishing communication with an on-demand compute environment and transmitting the information about the local environment to the on-demand compute environment, provisioning resources within the on-demand compute environment to substantially duplicate the local environment and transferring workload from the local-environment to the on-demand compute environment. The event can be a threshold or a triggering event within or outside of the local environment.
1. A method of operating a computerized apparatus within a first compute environment to enable execution of workload having one or more quality or service level requirements, the method comprising:
receiving a request to process workload, the request specifying at least one of a required service level or a required quality of service for processing of the workload;
causing processing of at least part of the workload using resources of the first compute environment;
determining that the at least one of the required service level or the quality of service is not being met by the processing of at least part of the workload using resources of the first compute environment;
based at least on the determining, causing creation of a specification of resources, the specification of resources comprising at least data relating to at least one resource requirement necessary for processing the workload to the at least one of the required service level or a required quality of service;
causing transmission of at least a portion of the specification of resources from a first module of the computerized apparatus to a second module operating in an on-demand compute environment, the at least portion of the specification of resources configured to cause provisioning of one or more resources within the on-demand compute environment according to the at least one resource requirement; and
causing transfer of at least a portion of the workload to the second compute environment for processing using at least the provisioned one or more resources.
2. The method of claim 1 , further comprising:
causing creation of at least one new software instance in the on-demand compute environment, the at least one new software instance configured to enable the processing using at least the provisioned one or more resources; and
receiving confirmation of removal or destruction of the at least one new software instance when the processing using at least the provisioned one or more resources is complete.
3. A non-transitory computer-readable medium storing instructions for operating a computerized apparatus within a first compute environment to enable execution of workload having one or more quality or service level requirements, the instructions, when executed by a processor, perform operations comprising:
receiving a request to process workload, the request specifying at least one of a required service level or a required quality of service for processing of the workload;
causing processing of at least part of the workload using resources of the first compute environment;
determining that the at least one of the required service level or the quality of service is not being met by the processing of at least part of the workload using resources of the first compute environment;
based at least on the determining, causing creation of a specification of resources, the specification of resources comprising at least data relating to at least one resource requirement necessary for processing the workload to the at least one of the required service level or a required quality of service;
causing transmission of at least a portion of the specification of resources from a first module of the computerized apparatus to a second module operating in an on-demand compute environment, the at least portion of the specification of resources configured to cause provisioning of one or more resources within the on-demand compute environment according to the at least one resource requirement; and
causing transfer of at least a portion of the workload to the second compute environment for processing using at least the provisioned one or more resources.
4. The non-transitory computer-readable medium of claim 3 , wherein the at least portion of the specification of resources is configured to cause creation of at least one virtual cluster within the first compute environment.
5. The non-transitory computer-readable medium of claim 3 , wherein the at least portion of the specification of resources is configured to cause dynamic co-allocation of a plurality of compute resources.
6. The non-transitory computer-readable medium of claim 3 , wherein the at least portion of the specification of resource comprises both (i) data relating to at least one explicit resource requirement, and (ii) data relating to at least one second resource requirement.
7. The non-transitory computer-readable medium of claim 3 , wherein the at least portion of the specification of resources is configured to cause creation of a management module on a second computerized apparatus in the first compute environment, the management module configured to manage at least one compute node in the first compute environment to process the at least portion of the workload.
8. The non-transitory computer-readable medium of claim 3 , wherein the creation of the specification of resources is performed dynamically in preparation for an assumption of at least a portion of the workload by the first compute environment.
9. The non-transitory computer-readable medium of claim 3 , the at least portion of the specification of resources comprises data relating to user-specified data submitted via a computerized job request.
10. The method of claim 1 , wherein the at least portion of the specification of resources is configured to cause creation of at least one virtual cluster within the first compute environment.
11. The method of claim 1 , wherein the at least portion of the specification of resources is configured to cause dynamic co-allocation of a plurality of compute resources.
12. The method of claim 1 , wherein the at least portion of the specification of resource comprises both (i) data relating to at least one explicit resource requirement, and (ii) data relating to at least one second resource requirement.
13. The method of claim 1 , wherein the at least portion of the specification of resources is configured to cause creation of a management module on a second computerized apparatus in the first compute environment, the management module configured to manage at least one compute node in the first compute environment to process the at least portion of the workload.
14. The method of claim 1 , wherein the creation of the specification of resources is performed dynamically in preparation for an assumption of at least a portion of the workload by the first compute environment.
15. The method of claim 1 , wherein the at least portion of the specification of resources comprises data relating to user-specified data submitted via a computerized job request.