System and method for dynamic backup sessions

1. An orchestrator for providing a client storage access to remote storages via a plurality of storage gateways, comprising:

a persistent storage comprising a workload policy; and

a processor programmed to:

obtain a data storage access request from the client specifying a workload;

identify a type of the workload indicated by the data storage access request to obtain an identified type of the workload;

analyzing the plurality of storage gateways to select an identified storage gateway for servicing the data storage access request, wherein the identified storage gateway is selected based on:

the workload policy,

the identified type of the workload,

a mode of the workload, wherein the mode of the workload corresponds to a mode of data storage between the client and the remote storages and is based on a classification of the client from which the data storage access request originated, and

a classification of a file that will be stored in the identified storage gateway as part of the workload; and

assign the identified storage gateway to provide the client with storage access to the remote storages.

2. The orchestrator of claim 1 , wherein the workload policy comprises a set of rules that specify an availability of each storage gateway of the plurality of storage gateways to service the data storage access request based on:

the type of the workload, and

a number of concurrent sessions of the type of the workload serviced by the respective storage gateway of the plurality of storage gateways.

3. The orchestrator of claim 2 , wherein the type of workload specifies a database type used by a storage among the remote storages to which the storage access is provided.

4. The orchestrator of claim 1 , wherein analyzing the plurality of storage gateways to obtain the identified storage gateway comprises:

selecting a storage gateway of the plurality of storage gateways that has available computing resources sufficient to service the data storage request;

making a comparison of a number of concurrent sessions of the identified type of the workload of the selected storage gateway to the workload policy; and

making a determination, based on the comparison, that the number of concurrent sessions exceeds a maximum number of concurrent sessions of the identified type specified by the workload policy while the selected storage gateway of the plurality of storage gateways has available computing resources sufficient to service the data storage request; and

in response to the determination, using a different storage gateway from that of the selected storage gateway as the identified storage gateway.

5. The orchestrator of claim 4 , wherein analyzing the plurality of storage gateways to obtain the identified storage gateway further comprises:

selecting a second storage gateway of the plurality of storage gateways that has available computing resources sufficient to service the data storage request;

making a second comparison of a number of concurrent sessions of the identified type of the workload of the selected second storage gateway to the workload policy;

making a second determination, based on the comparison, that the number of concurrent sessions is less than the maximum number of concurrent sessions of the identified type specified by the workload policy while the selected storage gateway of the plurality of storage gateways has available computing resources sufficient to service the data storage request; and

in response to the second determination, using the second storage gateway as the identified storage gateway.

6. The orchestrator of claim 1 , wherein the workload policy comprises:

a first entry that specifies a first maximum number of concurrent sessions for servicing the identified type of workload by the identified storage gateway; and

a second entry that specifies a second maximum number of concurrent sessions for servicing a second type of workload by the identified storage gateway.

7. The orchestrator of claim 6 , wherein the processor is further programmed to:

obtain a second data storage access request from the client;

identify a second type of workload indicated by the second data storage access request;

making a determination, based on the second entry, that servicing the second data storage access request would violate the workload policy,

in response to the determination, identify a second storage gateway of the plurality of storage gateways to service the second storage access request using the workload policy and the second identified type of workload; and

assign the identified second storage gateway to provide the client storage access to the remote storages.

8. The orchestrator of claim 1 , wherein the identified storage gateway is obtained using a set of rules that directly map the workload policy, the identified type of the workload, the mode of the workload, and the classification of the file that will be stored in the identified storage gateway as part of the workload on the identified storage gateway.

9. The orchestrator of claim 1 , wherein the classification of the file specifies whether the file is one or more of a database, unstructured data, and a file system backup.

10. The orchestrator of claim 6 , wherein the mode of the workload specifies whether the mode of data storage between the client and the remote storages in a synchronous mode or an asynchronous mode.

11. The orchestrator of claim 10 , wherein the synchronous mode indicates that the client will provide changes to the file as the changes occur to the identified storage gateway for storage, wherein the asynchronous mode indicates that the client will not send changes to the file as the changes occur to the identified storage gateway.

12. The orchestrator of claim 6 , wherein the first maximum number of concurrent sessions is based on an available cache of the identified storage gateway.

13. The orchestrator of claim 1 , wherein the processor is further programmed to:

before obtaining the data storage access request, dynamically modify the workload policy based on a plurality of connections, wherein the plurality of connections are between the identified storage gateway and the remote storages that store data from clients.

14. The orchestrator of claim 13 , wherein the workload policy is dynamically modified to adjust a number of concurrent sessions specified by the workload policy proportionally to respective changes in bandwidth of the plurality of connections.

15. The orchestrator of claim 13 , wherein the workload policy is dynamically modified to adjust a number of concurrent sessions specified by the workload policy proportionally to respective changes in latency of the plurality of connections.

16. A method of operating an orchestrator for providing a client storage access to remote storages via a plurality of storage gateways, comprising:

obtaining, by the orchestrator, a data storage access request from the client specifying a workload;

identifying, by the orchestrator, a type of the workload indicated by the data storage access request to obtain an identified type of the workload;

analyzing, by the orchestrator, the plurality of storage gateways to select an identified storage gateway for servicing the data storage access request, wherein the identified storage gateway is selected based on:

a workload policy,

the identified type of the workload,

a mode of the workload, wherein the mode of the workload corresponds to a mode of data storage between the client and the remote storages and is based on a classification of the client from which the data storage access request originated, and

a classification of a file that will be stored in the identified storage gateway as part of the workload; and

assigning, by the orchestrator, the identified storage gateway to provide the client with storage access to the remote storages.

17. The method of claim 16 , further comprising:

before obtaining the data storage access request, dynamically modify the workload policy based on a plurality of connections, wherein the plurality of connections are between the identified storage gateway and the remote storages that store data from clients.

18. The method of claim 17 , wherein the workload policy is dynamically modified to adjust a number of concurrent sessions specified by the workload policy proportionally to respective changes in bandwidth of the plurality of connections.

19. A non-transitory computer readable medium comprising computer readable program code, which when executed by a computer processor enables the computer processor to perform a method for operating an orchestrator for providing a client storage access to remote storages via a plurality of storage gateways, the method comprising:

obtaining, by the orchestrator, a data storage access request from the client specifying a workload;

identifying, by the orchestrator, a type of the workload indicated by the data storage access request to obtain an identified type of the workload;

analyzing, by the orchestrator, the plurality of storage gateways to select an identified storage gateway for servicing the data storage access request, wherein the identified storage gateway is selected based on:

a workload policy,

the identified type of the workload,

a mode of the workload, wherein the mode of the workload corresponds to a mode of data storage between the client and the remote storages and is based on a classification of the client from which the data storage access request originated, and

a classification of a file that will be stored in the identified storage gateway as part of the workload; and

assigning, by the orchestrator, the identified storage gateway to provide the client with storage access to the remote storages.

20. The non-transitory computer readable medium of claim 19 , wherein the method further comprises:

before obtaining the data storage access request, dynamically modify the workload policy based on a plurality of connections, wherein the plurality of connections are between the identified storage gateway and the remote storages that store data from clients.