Method and system for performing data protection services using a subsystem level feedback mechanism
Techniques described herein relate to a method for managing performances of data protection services. The method may include obtaining subsystem statistics from subsystems; in response to obtaining the subsystem statistics, making a determination that the subsystem statistics indicate a concurrency adjustment; and in response to the determination, assigning an adjusted concurrency to the subsystems based on the subsystem statistics and priorities; and initiating performance of data protection services using the adjusted concurrency.
1. A method for managing performances of data protection services, the method comprising:
obtaining subsystem statistics from subsystems;
in response to obtaining the subsystem statistics:
making a determination that the subsystem statistics indicate a concurrency adjustment; and
in response to the determination:
assigning adjusted concurrencies to the subsystems based on the subsystem statistics, priorities, and priority mappings, wherein assigning the adjusted concurrencies comprises:
assigning a first adjusted concurrency to a first subsystem of the subsystems;
assigning an adjusted priority mapping associated with the first adjusted concurrency comprising a first adjusted percentage, a second adjusted percentage, and a third adjusted percentage of the first adjusted concurrency to high priority operations, medium priority operations, and low priority operations respectively; and
in response to assigning the first adjusted concurrency to the first subsystem, assigning a second adjusted concurrency to a second subsystem of the subsystems, wherein the second subsystem depends, at least in part, on the first subsystem to perform data protection services; and
initiating performance of the data protection services using the adjusted concurrencies.
2. The method of claim 1 , wherein an adjusted concurrency of the adjusted concurrencies specifies a quantity of concurrent operations performed by a subsystem of the subsystems during the performance of the data protection services.
3. The method of claim 2 , wherein the subsystem comprises one selected from a group consisting of:
a host data subsystem,
a storages data subsystem,
a network subsystem,
a metadata subsystem, and
a compute subsystem.
4. The method of claim 1 , wherein the subsystem statistics of a subsystem comprises information which specifies whether the subsystem is performing a portion of the data protection services in compliance with requirements specified by a protection policy.
5. The method of claim 1 , wherein the adjusted concurrencies are different than initial concurrencies, wherein the initial concurrencies were assigned to the subsystems prior to the obtaining the subsystem statistics from the subsystems.
6. The method of claim 1 , wherein the adjusted concurrencies are the same as initial concurrencies, wherein the initial concurrencies were assigned to the subsystems prior to the obtaining the subsystem statistics from the subsystems.
7. A non-transitory computer readable medium comprising computer readable program code, which when executed by a computer processor enables the computer processor to perform a method for managing performances of data protection services, the method comprising:
obtaining sub system statistics from sub systems;
in response to obtaining the subsystem statistics:
making a determination that the subsystem statistics indicate a concurrency adjustment; and
in response to the determination:
assigning adjusted concurrencies to the subsystems based on the subsystem statistics, priorities, and priority mappings, wherein assigning the adjusted concurrencies comprises:
assigning a first adjusted concurrency to a first subsystem of the subsystems;
assigning an adjusted priority mapping associated with the first adjusted concurrency comprising a first adjusted percentage, a second adjusted percentage, and a third adjusted percentage of the first adjusted concurrency to high priority operations, medium priority operations, and low priority operations respectively; and
in response to assigning the first adjusted concurrency to the first subsystem, assigning a second adjusted concurrency to a second subsystem of the subsystems, wherein the second subsystem depends, at least in part, on the first subsystem to perform data protection services; and
initiating performance of the data protection services using the adjusted concurrency.
8. The non-transitory computer readable medium of claim 7 , wherein an adjusted concurrency of the adjusted concurrencies specifies a quantity of concurrent operations performed by a subsystem of the subsystems during the performance of the data protection services.
9. The non-transitory computer readable medium of claim 8 , wherein the subsystem comprises one selected from a group consisting of:
a host data subsystem,
a storages data subsystem,
a network subsystem,
a metadata subsystem, and
a compute subsystem.
10. The non-transitory computer readable medium of claim 7 , wherein the subsystem statistics of a subsystem comprises information which specifies whether the subsystem is performing a portion of the data protection services in compliance with requirements specified by a protection policy.
11. The non-transitory computer readable medium of claim 7 , wherein the adjusted concurrencies are different than initial concurrencies, wherein the initial concurrencies were assigned to the subsystems prior to the obtaining the subsystem statistics from the subsystems.
12. The non-transitory computer readable medium of claim 7 , wherein the adjusted concurrencies are the same as initial concurrencies, wherein the initial concurrencies were assigned to the subsystems prior to the obtaining the subsystem statistics from the subsystems.
13. The non-transitory computer readable medium of claim 7 , wherein the assigning of the adjusted concurrency to a subsystem of the subsystems based on the subsystem statistics and the priorities comprises:
assigning a first adjusted concurrency to a first subsystem of the subsystems; and
assigning a second adjusted concurrency to a second subsystem of the subsystems, wherein the second subsystem depends, at least in part, on the first subsystem to perform the data protection services.
14. A system for managing performances of data protection services, the system comprising:
persistent storage for storing subsystem statistics;
a data protection manager, comprising a processor and memory, and configured to:
obtain the subsystem statistics from subsystems;
in response to obtaining the subsystem statistics:
make a determination that the subsystem statistics indicate a concurrency adjustment; and
in response to the determination:
assign adjusted concurrencies to the subsystems based on the subsystem statistics, priorities, and priority mappings, wherein assigning the adjusted concurrencies comprises:
assigning a first adjusted concurrency to a first subsystem of the subsystems;
assigning an adjusted priority mapping associated with the first adjusted concurrency comprising a first adjusted percentage, a second adjusted percentage, and a third adjusted percentage of the first adjusted concurrency to high priority operations, medium priority operations, and low priority operations respectively; and
in response to assigning the first adjusted concurrency to the first subsystem, assigning a second adjusted concurrency to a second subsystem of the subsystems, wherein the second subsystem depends, at least in part, on the first subsystem to perform data protection services; and
initiate performance of the data protection services using the adjusted concurrency.
15. The system of claim 14 , wherein an adjusted concurrency of the adjusted concurrencies specifies a quantity of concurrent operations performed by a subsystem of the subsystems during the performance of the data protection services.
16. The system of claim 15 , wherein the subsystem comprises one selected from a group consisting of:
a host data subsystem,
a storages data subsystem,
a network subsystem,
a metadata subsystem, and
a compute subsystem.
17. The system of claim 14 , wherein the subsystem statistics of a subsystem comprises information which specifies whether the subsystem is performing a portion of the data protection services in compliance with requirements specified by a protection policy.