Simple integration of an on-demand compute environment
Disclosed are a system and method of integrating an on-demand compute environment into a local compute environment. The method includes receiving a request from an administrator to integrate an on-demand compute environment into a local compute environment and, in response to the request, automatically integrating local compute environment information with on-demand compute environment information to make available resources from the on-demand compute environment to requestors of resources in the local compute environment such that policies of the local environment are maintained for workload that consumes on-demand compute resources.
1. A method comprising:
determining presence of a job in a processing queue at a local compute environment for more than a threshold time;
upon determining the threshold time is exceeded, routing local workload information and resource configuration information associated with the job to a remote compute environment to select compute resources of the remote compute environment that are compatible with local compute resources of the local compute environment;
integrating local compute environment information with remote compute environment information to make available the compute resources of the remote compute environment to requestors of the compute resources in the local compute environment under the local compute environment requirements; and
transferring workload associated with the job whose presence in the processing queue exceeded the threshold time from the local compute environment to the remote compute environment to yield transferred workload, such that compliance with at least one of: a data management policy, a security requirement, a quality of service, and a cost associated with the local compute environment is maintained for the transferred workload.
2. The method of claim 1 , wherein the compute resources from the remote compute environment are handled and appear locally.
3. The method of claim 1 , wherein availability of the remote compute environment is transparent to requestors.
4. The method of claim 1 , wherein the requestor of the compute resources in the local compute environment uses a one-click request.
5. The method of claim 1 , further comprising:
presenting an administrator with a plurality of options related to available modifications to the compute resources within the remote compute environment.
6. The method of claim 5 , wherein making available the compute resources of the remote compute environment includes receiving a selection from the administrator in response to presenting the administrator with the plurality of options related to the available modifications to the compute resources within the remote compute environment.
7. The method of claim 1 , further comprising:
presenting, based on an event, an administrator at least one option related to the compute resources within the remote compute environment, wherein making available the compute resources of the remote compute environment is based, at least in part on a selection from the at least one option.
8. The method of claim 1 , wherein integrating the local compute environment information with the remote compute environment information comprises integrating at least one of: resource configuration; state information; resource utilization reporting; workload submission information; workload management; information resource management; policy controls including priority, resource ownership, queue configuration, workload accounting, and tracking; and resource accounting and tracking.
9. The method of claim 1 , wherein integrating the local compute environment information with the remote compute environment information further comprises automatically creating at least one of a data migration interface and a workload migration interface.
10. The method of claim 1 , wherein the local compute environment information is accessed from one of a database or a user account and provides configuration information to provision the compute resources in the remote compute environment similar to a configuration of the local compute environment.
11. A non-transitory computer readable storage medium storing instructions which, when executed by a processor, cause the processor to perform operations comprising:
determining presence of a job in a processing queue at a local compute environment for more than a threshold time;
upon determining the threshold time is exceeded, routing local workload information and resource configuration information associated with the job to a remote compute environment to select compute resources of the remote compute environment that are compatible with local compute resources of the local compute environment;
integrating local compute environment information with remote compute environment information to make available the compute resources of the remote compute environment to requestors of the compute resources in the local compute environment under the local compute environment requirements; and
transferring workload associated with the job whose presence in the processing queue exceeded the threshold time from the local compute environment to the remove compute environment to yield transferred workload, such that compliance with at least one of: a data management policy, a security requirement, a quality of service, and cost associated with the local compute environment is maintained for the transferred workload.
12. The non-transitory computer readable storage medium of claim 11 , wherein the compute resources from the remote compute environment are handled and appear locally.
13. The non-transitory computer readable storage medium of claim 11 , wherein the availability of the remote compute environment is transparent to requestors.
14. The non-transitory compute readable storage medium of claim 11 , wherein the local compute environment information is accessed from one of a database or a user account and provides configuration information to provision the compute resources in the remote compute environment similar to a configuration of the local compute environment.
15. The non-transitory computer readable storage medium of claim 11 , wherein integrating the local compute environment information with the remote compute environment information further comprises integrating at least one of: resource configuration, state information, resource utilization reporting, workload submission information, workload management information, resource management, policy or governance controls, resource ownership, queue configuration, workload accounting and tracking, and resource accounting and tracking.
16. A system comprising:
a processor; and
a non-transitory computer readable storage medium storing instructions which, when executed by the processor, cause the processor to perform operations comprising:
determining presence of a job in a processing queue at a local compute environment for more than a threshold time;
upon determining the threshold time is exceeded, routing local workload information and resource configuration information associated with the job to a remote compute environment to select compute resources of the remote compute environment that are compatible with local compute resources of the local compute environment;
integrating local compute environment information with remote compute environment information to make available the compute resources of the remote compute environment to requestors of the compute resources in the local compute environment under the local compute environment requirements; and
transferring workload associated with the job whose presence in the processing queue exceeded the threshold time from the local compute environment to the remote compute environment to yield transferred workload, such that compliance with at least one of: a data management policy, a security requirement, a quality of service and a cost associated with the local compute environment is maintained for the transferred workload.