Server load management for data migration
A system and method for controlling a migration of data items in a data directory from a source system to a destination system by setting one or more target properties for implementing the migration are disclosed. A migration controller can be employed to obtain statistical information regarding the migration. The statistical information can then be used to compute the one or more target properties. For example, a target number of network connections for achieving an optimal total throughput and concurrency can be computed based on an average throughput per network connection. The target number of network connections may be determined by a migration monitor, which may set the determined target number of network connections as a policy to be enforced by the migration controller.
1. A method comprising:
registering a migration controller with a migration monitor, the migration controller designated to migrate a set of one or more data items from a source server to destination server;
sending, from the migration monitor to the migration controller, a policy to be enforced by the migration controller when migrating the set of one or more data items, wherein the policy specifies one or more target properties of the migration;
measuring, by the migration controller, one or more properties of the migration;
determining, by the migration controller, the one or more measured properties are outside of the one or more target properties;
determining, by the migration controller, that the policy is violated based on the one or more measured properties being outside of the one or more target properties; and
sending, from the migration controller to the migration monitor, a fault message when the policy is violated.
2. The method of claim 1 , wherein the one or more target properties include a target number of network connections to be provided by the migration controller.
3. The method of claim 1 , further comprising sending, from the migration monitor to the migration controller, a command to control the migration by the migration controller such that the policy is enforced at the migration controller.
4. The method of claim 3 , wherein the command causes the number of network connections currently provided by the migration controller to be reduced to the target number.
5. The method of claim 1 , further comprising determining, by the migration monitor, a command to control the migration such that the policy is enforced.
6. A system for controlling a migration of data items in a data directory, the system comprising:
a migration controller having one or more processors configured to:
migrate a set of one or more data items from a source server to destination server;
measure one or more properties of the migration;
determine the one or more measured properties are outside of one or more target properties;
determine that a policy is violated based on the one or more measured properties being outside of the one or more target properties; and
a migration monitor having one or more processors configured to:
send, to the migration controller, the policy to be enforced by the migration controller when migrating the set of one or more data items, wherein the policy specifies the one or more target properties of the migration,
wherein the one or more processors of the migration controller are further configured to:
send, to the migration monitor, a fault message when the policy is violated.
7. The system of claim 6 , wherein the one or more target properties include a target number of network connections to be provided by the migration controller.
8. The system of claim 6 , wherein the migration monitor is further configured to send, to the migration controller, a command to control the migration by the migration controller such that the policy is enforced at the migration controller.
9. The system of claim 8 , wherein the command causes the number of network connections currently provided by the migration controller to be reduced to the target number.
10. The system of claim 6 , wherein the migration monitor is further configured to determine a command to control the migration such that the policy is enforced.