Cluster member transfer for raid system expansion
In a storage system that implements RAID (D+P) with an existing cluster of drives in which the drives have (D+P) partitions that are protection group members, cluster member transfer code creates a new drive cluster when fewer than D+P new drives are added to the storage system. The cluster member transfer code moves one or more drives from the existing cluster into a new cluster so that the number of new drives plus the number of moved drives equals D+P. One or more protection groups may be moved to the new cluster.
1. An apparatus, comprising:
at least one computing node comprising a processor and non-transitory memory;
an existing cluster of C drives managed by the at least one computing node, wherein redundant array of independent drives (RAID) protection groups each comprising no more or less than (D+P) members are implemented on the existing cluster, wherein D and P are constants and each D member contains data respectively being used to rebuild at least one parity member of a protection group to which the D member belongs and each P member of that protection group contains parity information respectively being used with remaining data to rebuild a data member of the protection group; and
the processor, in response to introduction of N new drives, to:
partition each new drive into (D+P) partitions; and
calculate that N is less than (D+P) and C is greater than (D+P) and select a donor drive from the existing cluster and form a new cluster using the donor drive and the new drives.
2. The apparatus of claim 1 comprising selection instructions that select a protection group on the existing cluster for migration such that a first member of the selected protection group resides on the donor drive.
3. The apparatus of claim 2 wherein the transfer instructions move members of the selected protection group other than the first member to the new drives.
4. The apparatus of claim 3 wherein the transfer instructions distribute the members of the selected protection group other than the first member to different ones of the new drives such that no more than one member of the selected protection group resides on a single one of the new drives.
5. The apparatus of claim 4 wherein the transfer instructions move members of protection groups other than the selected protection group from the donor drive to other drives of the existing cluster.
6. The apparatus of claim 5 wherein the transfer instructions move the members of protection groups other than the selected protection group from the donor drive to other drives of the existing cluster such that no more than one of the members of any protection group resides on a single one of the other drives of the existing cluster.
7. The apparatus of claim 6 wherein the transfer instructions move the donor drive with the first member to the new cluster.
8. A method implemented in a storage system comprising: at least one computing node having a processor and non-transitory memory, and an existing cluster of C drives managed by the at least one computing node, wherein redundant array of independent drives (RAID) protection groups each comprising no more or less than (D+P) members are implemented on the existing cluster, wherein D and P are constants and each D member contains data respectively being used to rebuild at least one parity member of a protection group to which the D member belongs and each P member contains parity information respectively being used with remaining data to rebuild a data member of the protection group, wherein:
responsive to introduction of N new drives, partitioning each new drive into (D+P) partitions;
calculating that N is less than (D+P) and C is greater than (D+P);
selecting a donor drive from the existing cluster; and
forming a new cluster using the donor drive and the new drives.
9. The method of claim 8 comprising selecting a protection group on the existing cluster for migration such that a first member of the selected protection group resides on the donor drive.
10. The method of claim 9 comprising moving members of the selected protection group other than the first member to the new drives.
11. The method of claim 10 comprising distributing the members of the selected protection group other than the first member to different ones of the new drives such that no more than one member of the selected protection group resides on a single one of the new drives.
12. The method of claim 11 comprising moving members of protection groups other than the selected protection group from the donor drive to other drives of the existing cluster.
13. The method of claim 12 comprising moving the members of protection groups other than the selected protection group from the donor drive to other drives of the existing cluster such that no more than one of the members of any protection group resides on a single one of the other drives of the existing cluster.
14. The apparatus of claim 13 comprising moving the donor drive with the first member to the new cluster.
15. A non-transitory computer-readable storage medium storing instructions that when executed by a computer cause the computer to perform a method for using a computer system to increase storage capacity, the method comprising:
responsive to introduction of N new drives to a system comprising an existing cluster of C drives managed by at least one computing node, wherein redundant array of independent drive (RAID) protection groups each comprising no more or less than (D+P) members that are implemented on the existing cluster, and wherein D and P are constants and each D member contains data respectively being used to rebuild at least one parity member of a protection group to which the D member belongs and each P member contains parity information capable of respectively being used with remaining data to rebuild a data member of the protection group, partitioning each new drive into (D+P) partitions;
responsive to calculating that N is less than (D+P) and C is greater than (D+P), selecting a donor drive from the existing cluster; and
forming a new cluster using the donor drive and the new drives.
16. The non-transitory computer-readable storage medium of claim 8 wherein the method further comprises selecting a protection group on the existing cluster for migration such that a first member of the selected protection group resides on the donor drive.
17. The non-transitory computer-readable storage medium of claim 16 wherein the method further comprises moving members of the selected protection group other than the first member to the new drives.
18. The non-transitory computer-readable storage medium of claim 17 wherein the method further comprises moving members of protection groups other than the selected protection group from the donor drive to other drives of the existing cluster.
19. The non-transitory computer-readable storage medium of claim 18 wherein the method further comprises moving the members of protection groups other than the selected protection group from the donor drive to other drives of the existing cluster such that no more than one of the members of any protection group resides on a single one of the other drives of the existing cluster.
20. The non-transitory computer-readable storage medium of claim 19 wherein the method further comprises moving the donor drive with the first member to the new cluster.