Simple integration of on-demand compute environment
View Patent ↗Disclosed are a system and method of integrating an on-demand compute environment into a local compute environment. The method includes receiving a request from an administrator to integrate an on-demand compute environment into a local compute environment and, in response to the request, automatically integrating local compute environment information with on-demand compute environment information to make available resources from the on-demand compute environment to requestors of resources in the local compute environment.
1. A method comprising:
receiving a request to integrate a remote compute environment into a local compute environment, wherein a specification of compute resources associated with the request is one of fully explicit, partially explicit, fully implicit based on workload, and based on a virtual private cluster package concept where a virtual private cluster package can include aspects of provisioning a support environment and adjustments to resource request timeframes including pre-allocation, allocation duration, and post-allocation timeframe adjustments, wherein the remote compute environment comprises a plurality of networked compute nodes under common management and the local compute environment comprises a plurality of networked compute nodes under common management that is separate from the common management of the remote compute environment, wherein the remote compute environment and the local compute environment are configured to receive and process user-submitted workload, and wherein the compute resources comprise at least one of a server, memory, network bandwidth, a processor, and a virtual compute resource;
in response to the request, automatically integrating local compute environment information with remote compute environment information to make available resources from the remote compute environment to requestors of resources in the local compute environment under the local compute environment requirements; and
receiving a transfer of user-submitted workload at the remote compute environment from the local compute environment to yield transferred workload, such that policies, classes, qualities of service and resource limits associated with the local compute environment information are maintained for the transferred workload, wherein the user-submitted workload was submitted by a requestor to the local compute environment for processing.
2. The method of claim 1 , wherein all data associated with the local compute environment and the remote compute environment is handled and appears locally.
3. The method of claim 1 , wherein availability of the remote compute environment is transparent to requestors.
4. The method of claim 1 , wherein the request is a one-click request for access to the remote compute environment.
5. The method of claim 1 , wherein integrating the local compute environment information with the remote compute environment information causes the remote compute environment to consume workload based on policy requirements for jobs submitted to the local compute environment.
6. The method of claim 1 , further comprising:
presenting an administrator with a plurality of options related to available modifications to resources within the remote compute environment.
7. The method of claim 6 , wherein the request from the administrator is associated with a selection of one of the plurality of options.
8. The method of claim 1 , further comprising:
prior to receiving the request, sending an event notice to an administrator; and
presenting, based on the event, the administrator at least one option related to resources with the remote compute environment, wherein the request that is received is based on a selection from the at least one option.
9. The method of claim 1 , wherein integrating the local compute environment information comprises integrating at least one of: resource configuration, state information, resource utilization reporting, job submission information, job management, information resource management, policy controls including priority, resource ownership, queue configuration, job accounting and tracking, and resource accounting and tracking.
10. The method of claim 1 , wherein integrating the local compute environment information further comprises automatically creating at least one of a data migration interface and a job migration interface.
11. The method of claim 1 , wherein the request is received from an administrator via a web interface.
12. A non-transitory computer readable storage medium storing instructions which, when executed by a processor, cause the processor to perform operations comprising:
receiving a request to integrate a remote compute environment into a local compute environment, wherein a specification of compute resources associated with the request is one of fully explicit, partially explicit, fully implicit based on workload, and based on a virtual private cluster package concept where the virtual private cluster package can include aspects of provisioning a support environment and adjustments to resource request timeframes including pre-allocation, allocation duration, and post-allocation timeframe adjustments, wherein the remote compute environment comprises a plurality of compute nodes under common management and the local compute environment comprises a plurality of networked compute nodes under common management that is separate from the common management of the remote compute environment, wherein the remote compute environment and the local compute environment are configured to receive and process user-submitted workload, and wherein the compute resources comprise at least one of a server, memory, network bandwidth, a processor, and a virtual compute resource;
in response to the request, integrating local compute environment information with remote compute environment information to make available resources from the remote compute environment to requestors of resources in the local compute environment under requirements in the local compute environment information; and
receiving a transfer of the user-submitted workload at the remote compute environment that was submitted by a requestor to the local compute environment, to yield transferred workload, wherein policies, classes, qualities of service and resource limits associated with the local compute environment information are maintained for the transferred workload.
13. The non-transitory computer readable storage medium of claim 12 , wherein all data associated with the local compute environment and the remote compute environment is handled and appears locally.
14. The non-transitory computer readable storage medium of claim 12 , wherein the availability of the remote compute environment is transparent to requestors.
15. The non-transitory computer readable storage medium of claim 12 , wherein integrating the local compute environment information further comprises integrating at least one of: resource configuration, state information, resource utilization reporting, job submission information, job management information, resource management, policy controls including priority, resource ownership, queue configuration, job accounting and tracking, and resource accounting and tracking.