On-demand access to compute resources
Disclosed are systems, methods and computer-readable media for controlling and managing the identification and provisioning of resources within an on-demand center as well as the transfer of workload to the provisioned resources. One aspect involves creating a virtual private cluster within the on-demand center for the particular workload from a local environment. A method of managing resources between a local compute environment and an on-demand environment includes detecting an event associated with a local compute environment and based on the detected event, identifying information about the local environment, establishing communication with an on-demand compute environment and transmitting the information about the local environment to the on-demand compute environment, provisioning resources within the on-demand compute environment to substantially duplicate the local environment and transferring workload from the local-environment to the on-demand compute environment. The event can be a threshold or a triggering event within or outside of the local environment.
1. A non-transitory computer-readable medium storing instructions that, when executed by a processor, perform operations comprising:
receiving a request to process compute workload;
responsive to the request, placing at least a portion of the compute workload in one or more queues associated with a first compute environment;
determining the existence of a backlog of workload in the one or more queues;
based at least on the determining, causing creation of a data structure comprising at least data relating to at least one resource requirement associated with processing of at least some of the backlogged workload;
causing transmission of at least a portion of the data structure from a first module of the computerized apparatus to a second module operating in a second compute environment, the at least portion of the data structure configured to cause (i) placing one or more resources within the second compute environment in a reserved state; and (ii) provisioning of the one or more resources according to the at least one resource requirement; and
causing transfer of at least a portion of the backlogged workload to the second compute environment for processing using at least the reserved and provisioned one or more resources.
2. The non-transitory computer-readable medium of claim 1 , wherein the one or more resources are placed in the reserved state for use at a time after the reserved state is entered.
3. The non-transitory computer-readable medium of claim 1 , wherein the instructions, when executed by the processor, further perform operations comprising creating a reservation object.
4. The non-transitory computer-readable medium of claim 3 , wherein at least a portion of the reservation object is configured to be affect placement of the one or more resources into the reserved state.
5. The non-transitory computer-readable medium of claim 1 , wherein the instructions, when executed by the processor, further perform operations comprising causing transmission of at least a portion of a specification of resources.
6. The non-transitory computer-readable medium of claim 1 , wherein the request specifies a required service level.
7. The non-transitory computer-readable medium of claim 1 , wherein the request specifies a required quality of service.
8. A system comprising:
a processor; and
non-transitory computer-readable medium storing instructions that, when executed by the processor, perform operations comprising:
receiving a request to process compute workload;
responsive to the request, placing at least a portion of the compute workload in one or more queues associated with a first compute environment;
determining the existence of a backlog of workload in the one or more queues;
based at least on the determining, causing creation of a data structure comprising at least data relating to at least one resource requirement associated with processing of at least some of the backlogged workload;
causing transmission of at least a portion of the data structure from a first module of the computerized apparatus to a second module operating in a second compute environment, the at least portion of the data structure configured to cause (i) placing one or more resources within the second compute environment in a reserved state; and (ii) provisioning of the one or more resources according to the at least one resource requirement; and
causing transfer of at least a portion of the backlogged workload to the second compute environment for processing using at least the reserved and provisioned one or more resources.
9. The system of claim 8 , wherein the one or more resources are placed in the reserved state for use at a time after the reserved state is entered.
10. The system of claim 8 , wherein the instructions, when executed by the processor, further perform operations comprising creating a reservation object.
11. The system of claim 10 , wherein at least a portion of the reservation object is configured to be affect placement of the one or more resources into the reserved state.
12. The system of claim 8 , wherein the instructions, when executed by the processor, further perform operations comprising causing transmission of at least a portion of a specification of resources.
13. The system of claim 8 , wherein the request specifies a required service level or a required quality of service.