Data storage management

1. A method of copying data from a first block provided by a first storage device to a second block provided by a second storage device, the method comprising:

dividing the first and second blocks into an equal number of sub-blocks;

performing a first copy operation, the first copy operation comprising copying at least one sub-block of the first block to a sub-block of the second block;

receiving during the first copy operation a first write request indicating data to be written to the first block; and

performing a first write operation, the first write operation writing the first data to the first block;

marking as dirty each sub-block of the first block affected by the write operation;

performing at least one re-copy operation, each re-copy operation copying one of the sub-blocks of the first block marked as dirty to a sub-block of the second block;

determining whether a predetermined number of re-copy operations has been performed;

if it is determined that the predetermined number of re-copy operations has not been performed, performing at least one further re-copy operation;

if it is determined that the predetermined number of re-copy operations has been performed:

determining whether a total number of remaining sub-blocks marked as dirty is below a predetermined threshold; and

if it is determined that the total number of remaining sub-blocks marked as dirty is not below the predetermined threshold increasing a rate at which the re-copy operations are performed or increasing the predetermined number of re-copy operations.

2. The method of claim 1 , wherein if it is determined that the predetermined number of re-copy operations has been performed, the method further comprises determining whether a total number of remaining sub-blocks marked as dirty is below a predetermined threshold; and

if it is determined that the total number of remaining sub-blocks marked as dirty is below the predetermined threshold temporarily preventing further write operations writing data to the first block.

3. The method of claim 2 , wherein further write operations are prevented for a duration of time required to perform re-copy operations for each of the remaining sub-blocks marked as dirty.

4. The method of claim 1 , wherein the predetermined number of re-copy operations is increased if it is determined that the total number of remaining sub-blocks marked as dirty is below a second predetermined threshold.

5. The method of claim 1 , further comprising performing a second write operation, the second write operation comprising writing the first data to the second block.

6. The method of claim 1 , wherein increasing the rate at which the re-copy operations are performed includes easing or removing control of an initial rate at which the re-copy operations were performed in order to allow the re-copy operation to complete.

7. The method of claim 1 , wherein if it is determined that the predetermined number of re-copy operations has been performed, and if it is determined that the total number of remaining sub-blocks marked as dirty is below the predetermined threshold, further write operations are prevented and the predetermined threshold is increased to allow the remaining dirty sub-blocks to be copied.

8. A storage system comprising a first device, a second device, a first storage device providing a first block and a second storage device providing a second block, the first device, the second device, the first storage device and the second storage device connected to a switch;

wherein the first device stores computer readable instructions arranged to cause the first device to perform a copy operation comprising:

dividing the first and second blocks into an equal number of sub-blocks;

copying at least one sub-block of the first block to a sub-block of the second block; and

wherein the computer readable instructions are further arranged to cause the first device to:

receive through the switch from the second device during the copy operation a first write request indicating first data to be written to the first block; and

perform a first write operation, the first write operation comprising writing the first data to the first block;

mark as dirty each sub-block of the first block affected by the write operation;

perform at least one re-copy operation, each re-copy operation copying one of the sub-blocks of the first block marked as dirty to a sub-block of the second block;

determine whether a predetermined number of re-copy operations has been performed;

if it is determined that the predetermined number of re-copy operations has not been performed, performing at least one further re-copy operation;

if it is determined that the predetermined number of re-copy operations has been performed:

determine whether a total number of remaining sub-blocks marked as dirty is below a predetermined threshold; and

if it is determined that the total number of remaining sub-blocks marked as dirty is not below the predetermined threshold increase a rate at which the re-copy operations are performed or increase the predetermined number of re-copy operations.

9. The storage system of claim 8 , wherein the computer readable instructions are arranged to cause the first device to perform a second write operation, the second write operation comprising writing the first data to the second block.

10. The storage system of claim 8 , wherein, to increase the rate at which the re-copy operations are performed, control of an initial rate at which the re-copy operations were performed is eased or removed in order to allow the re-copy operation to complete.

11. The storage system of claim 8 , wherein if it is determined that the predetermined number of re-copy operations has been performed, and if it is determined that the total number of remaining sub-blocks marked as dirty is below the predetermined threshold, further write operations are prevented and the predetermined threshold is increased to allow the remaining dirty sub-blocks to be copied.

12. The storage system of claim 11 , wherein if it is determined that the predetermined number of re-copy operations has been performed, and if it is determined that the total number of remaining sub-blocks marked as dirty is not below the predetermined threshold, a failure message is provided to a user.

13. A method of removing a storage device from a storage system comprising a plurality of storage devices, each storage device providing at least one block, the method comprising:

receiving an indication that a first storage device of the plurality of storage devices is to be removed, the first storage device providing a first block;

selecting a second storage device, the second storage device providing a second block;

dividing the first and second blocks into a plurality of sub-blocks;

performing a first copy operation, the first copy operation comprising copying at least one sub-block of the first block to a sub-block of the second block;

receiving during the first copy operation a first write request indicating first data to be written to the first block;

performing a first write operation, the first write operation to write the first data to the first block;

marking as dirty each sub-block of the first block affected by the write operation;

performing at least one re-copy operation, each re-copy operation copying one of the sub-blocks of the first block marked as dirty to a sub-block of the second block;

determining whether a predetermined number of re-copy operations has been performed;

if it is determined that the predetermined number of re-copy operations has not been performed, performing at least one further re-copy operation;

if it is determined that the predetermined number of re-copy operations has been performed, determining whether a total number of remaining sub-blocks marked as dirty is below a predetermined threshold; and

if it is determined that the total number of remaining sub-blocks marked as dirty is not below the predetermined threshold increasing a rate at which the re-copy operations are performed or increasing the predetermined number of re-copy operations.

14. The method of claim 13 , further comprising performing a second write operation, the second write operation comprising writing the first data to the second block.

15. The method of claim 13 further comprising:

receiving an indication that a third storage device has been added to the storage system, the third storage device providing a third block;

dividing the second and third blocks into a plurality of sub-blocks; and

performing a second copy operation, the second copy operation comprising copying at least one sub-block of the second block to a sub-block of the third block.

16. The method of claim 15 , further comprising:

receiving during the second copy operation a second write request indicating second data to be written to the second block; and

performing a third write operation, the third write operation comprising writing the second data to the second block.

17. The method of claim 16 , further comprising marking as dirty each sub-block of the second block affected by the third write operation; and

performing at least one re-copy operation, each re-copy operation copying one of the sub-blocks of the second block marked as dirty to a sub-block of the third block.

18. The method of claim 17 , further comprising:

performing a fourth write operation, the fourth write operation comprising writing the second data to the third block.

19. The method of claim 13 , wherein increasing the at which the re-copy operations are performed includes easing or removing control of an initial rate at which the re-copy operations are performed in order to allow the re-copy operation to complete.

20. The method of claim 13 , wherein if it is determined that the predetermined number of re-copy operations has been performed, and if it is determined that the total number of remaining sub-blocks marked as dirty is not below the predetermined threshold, a failure message is provided to a user.