Server load management for data migration
A system and method for controlling a migration of data items in a data directory from a source system to a destination system by setting one or more target properties for implementing the migration are disclosed. A migration controller can be employed to obtain statistical information regarding the migration. The statistical information can then be used to compute the one or more target properties. For example, a target number of network connections for achieving an optimal total throughput and concurrency can be computed based on an average throughput per network connection. The target number of network connections may be determined by a migration monitor, which may set the determined target number of network connections as a policy to be enforced by the migration controller.
1. A method comprising:
receiving, by a migration controller, a policy for migrating a set of one or more data items, wherein the policy specifies one or more target properties of the migration;
measuring, by the migration controller, one or more properties of the migration;
determining, by the migration controller, the one or more measured properties are outside of the one or more target properties;
determining, by the migration controller, that the policy is violated based on the one or more measured properties being outside of the one or more target properties;
generate, by the migration controller, a fault message when the policy is violated; and
receiving, by the migration controller, from a migration monitor, a command to control the migration for the policy to be enforced at the migration controller; and, wherein the command is configured to cause a number of network connections currently provided by the migration controller to be reduced to a target number.
2. The method of claim 1 , wherein the one or more target properties include the target number of network connections to be provided by the migration controller.
3. The method of claim 1 , wherein the command to control the migration for the policy to be enforced at the migration controller is determined by the migration monitor.
4. A system for controlling a migration of data items in a data directory, the system comprising:
a migration controller having one or more processors configured to:
receive a policy for migrating the set of one or more data items, wherein the policy specifies one or more target properties of the migration;
measure one or more properties of the migration;
determine the one or more measured properties are outside of the one or more target properties;
determine that the policy is violated based on the one or more measured properties being outside of the one or more target properties;
generate, by the migration controller, a fault message when the policy is violated; and
receive, by the migration controller, from a migration monitor, a command to control the migration for the policy to be enforced at the migration controller; and, wherein the command is configured to cause a number of network connections currently provided by the migration controller to be reduced to a target number.
5. The system of claim 4 , wherein the one or more target properties include the target number of network connections to be provided by the migration controller.
6. The system of claim 4 , wherein the command to control the migration for the policy to be enforced at the migration controller is determined by the migration monitor.