Method and apparatus for power-efficient high-capacity scalable storage system
View Patent ↗Systems and methods for providing scalable, reliable, power-efficient, high-capacity data storage, wherein large numbers of closely packed data drives having corresponding metadata and parity volumes are individually powered on and off, depending upon their respective usage. In one embodiment, the invention is implemented in a RAID-type data storage system which employs a large number of hard disk drives that are individually controlled, so that only the disk drives that are in use are powered on. The reduced power consumption allows the disk drives to be contained in a smaller enclosure than would conventionally be possible. In a preferred embodiment, the data protection scheme is designed to utilize large, contiguous blocks of space on the data disk drives, and to use the space on one data disk drive at a time, so that the data disk drives which are not in use can be powered down.
1. A system comprising:
a plurality of data storage drives;
a controller coupled to each of the data storage drives;
wherein the controller is configured to power on a first subset of the data storage drives and to power off a second subset of the data storage drives, wherein each of the first and second subsets contains at least one of the data storage drives, and wherein the first subset comprises at least one data storage drive in a first RAID set and the second subset comprises at least one data storage drive in the first RAID set.
2. A system comprising:
a plurality of data storage drives;
a controller coupled to each of the data storage drives;
wherein the controller is configured to power on a first subset of the data storage drives and to power off a second subset of the data storage drives, wherein each of the first and second subsets contains at least one of the data storage drives,
wherein the data storage drives comprise hard disk drives, and wherein the system comprises multiple groups, wherein each group comprises multiple subsets of data storage drives.
3. The system of claim 2 , wherein the system comprises one or more RAID sets of data storage drives and wherein each of the one or more RAID sets of data storage drives comprises data storage drives from at least two of the groups.
4. The system of claim 2 , wherein the controller comprises a rack controller connected to a plurality of shelf controllers, wherein each shelf controller is configured to control a set of data storage drives.
5. The system of claim 2 , wherein the data storage drives are contained in a single physical enclosure.
6. A system comprising:
a plurality of data storage drives;
a controller coupled to each of the data storage drives, wherein the controller is configured to power on a first subset of the data storage drives and to power off a second subset of the data storage drives, wherein each of the first and second subsets contains at least one of the data storage drives; and
one or more parity drives, each of which is associated with a corresponding RAID set of the plurality of data storage drives, wherein the one or more parity drives are always powered on.
7. A system comprising:
a plurality of data storage drives;
a controller coupled to each of the data storage drives, wherein the controller is configured to power on a first subset of the data storage drives and to power off a second subset of the data storage drives, wherein each of the first and second subsets contains at least one of the data storage drives; and
one or more metadata drives, each of which is associated with a corresponding group of the plurality of data storage drives, wherein the system is configured to store metadata information on the metadata drive, wherein the metadata comprises a mapping of logical addresses for the system to physical addresses for the corresponding group of data storage drives.
8. A system comprising:
a plurality of data storage drives;
a controller coupled to each of the data storage drives, wherein the controller is configured to power on a first subset of the data storage drives and to power off a second subset of the data storage drives, wherein each of the first and second subsets contains at least one of the data storage drives, wherein the system is configured to store metadata information on the metadata drive, wherein the metadata comprises health information for the corresponding group of data storage drives.
9. A system comprising:
a plurality of data storage drives;
a controller coupled to each of the data storage drives, wherein the controller is configured to power on a first subset of the data storage drives and to power off a second subset of the data storage drives, wherein each of the first and second subsets contains at least one of the data storage drives, wherein the system is configured to store metadata information on the metadata drive, wherein the metadata comprises data which duplicates a portion of each of the corresponding group of data storage drives.
10. A system comprising:
a plurality of data storage drives;
a controller coupled to each of the data storage drives, wherein the controller is configured to power on a first subset of the data storage drives and to power off a second subset of the data storage drives, wherein each of the first and second subsets contains at least one of the data storage drives, wherein the one or more metadata drives are always powered on.
11. A method comprising:
providing a data storage system having a plurality of data storage drives;
performing data accesses to the data storage system, wherein the data accesses involve accesses to a first subset of the data storage drives, wherein the first subset of the data storage drives is powered on; and
powering down a second subset of the data storage drives, wherein the data accesses do not involve accesses to the second subset of the data storage drives, wherein the first subset comprises at least one data storage drive in a first RAID set and the second subset comprises at least one data storage drive in the first RAID set.
12. A method comprising:
providing a data storage system having a plurality of data storage drives;
performing data accesses to the data storage system, wherein the data accesses involve accesses to a first subset of the data storage drives, wherein the first subset of the data storage drives is powered on; and
powering down a second subset of the data storage drives, wherein the data accesses do not involve accesses to the second subset of the data storage drives, wherein performing data accesses to the data storage system comprises accessing a block of storage that spans a first data storage drive and a second data storage drive, wherein as the first data storage drive is accessed, the first data storage drive is powered on and the second data storage drive is powered off, and as the second data storage drive is accessed, the second data storage drive is powered on and the first data storage drive is powered off.
13. The method of claim 12 , further comprising, if the data accesses comprise writes, caching data for the second data storage drive as the second data storage drive is transitioned from a powered off state to a powered on state.
14. The method of claim 12 , further comprising, if the data accesses comprise reads, retrieving data corresponding to the second data storage drive from a metadata volume as the second data storage drive is transitioned from a powered off state to a powered on state.
15. A method comprising:
providing a data storage system having a plurality of data storage drives;
performing data accesses to the data storage system, wherein the data accesses involve accesses to a first subset of the data storage drives, wherein the first subset of the data storage drives is powered on; and
powering down a second subset of the data storage drives, wherein the data accesses do not involve accesses to the second subset of the data storage drives, wherein performing data accesses to the data storage system comprises accessing one or more data storage drives and corresponding metadata drives, and wherein accessing the metadata drives comprises storing metadata information on the metadata drive, wherein the metadata comprises health information for the corresponding group of data storage drives.
16. A method comprising:
providing a data storage system having a plurality of data storage drives;
performing data accesses to the data storage system, wherein the data accesses involve accesses to a first subset of the data storage drives, wherein the first subset of the data storage drives is powered on; and
powering down a second subset of the data storage drives, wherein the data accesses do not involve accesses to the second subset of the data storage drives, wherein performing data accesses to the data storage system comprises accessing one or more data storage drives and corresponding metadata drives, and wherein accessing the metadata drives comprises storing metadata information on the metadata drive, wherein the metadata comprises data which duplicates a portion of each of the corresponding group of data storage drives.