Reconfigurable storage system
The embodiments provide for a method and system for dynamic configuration of a storage system to facilitate independent scaling of resources. The method and system include detecting a change to a topology of a storage system consisting of different sets of storage nodes, where at least one of the different sets of storage nodes has solid-state memory having differing storage capacities. Responsive to detecting the change, the storage system reconfigures to change an allocation of resources to one or more authorities that control a range of identifiers.
1 . A method, comprising:
detecting a change to a topology of a storage system comprising different sets of blades configured within one of a plurality of chassis, wherein a blade of at least one of the different sets of blades has solid-state memory having differing storage capacities within the blade; and
responsive to detecting the change to the topology of the storage system, reconfiguring the storage system to change an allocation of resources to one or more authorities executed by computing resources of one or more of the different sets of blades, wherein the one or more authorities control a range of inode numbers assigned to data owned by a corresponding authority.
2 . The method of claim 1 , wherein the one or more authorities are configured to determine an erasure coding scheme to be applied to data stored within the system and wherein reconfiguring the storage system further comprises executing the one or more authorities on a second set of blades.
3 . The method of claim 1 , further comprising:
associating storage on a first set of blades with a write group, and wherein reconfiguring the storage system further comprises associating, in dependence upon a write group formation policy, storage on a second set of blades with the write group.
4 . The method of claim 1 , wherein detecting the change to the topology of the storage system further comprises:
detecting that an amount of processing resources within the storage system has changed.
5 . The method of claim 4 , wherein reconfiguring the storage system further comprises:
modifying an amount of storage associated with one or more write groups.
6 . The method of claim 1 , wherein detecting the change to the topology of the storage system further comprises:
detecting that a utilization of a particular resource has reached a utilization threshold.
7 . The method of claim 1 , wherein the one or more authorities is located through a hash algorithm and wherein the one or more authorities is resident on a corresponding blade.
8 . An apparatus comprising:
a memory; and
one or more processors, operatively coupled to the memory, configured to:
detect a change to a topology of a storage system comprising different sets of blades configured within one of a plurality of chassis, wherein a blade of at least one of the different sets of blades has solid-state memory having differing storage capacities within the blade; and
responsive to detecting the change to the topology of the storage system, reconfigure the storage system to change an allocation of resources to one or more authorities executed by computing resources of one or more of the different sets of blades, wherein the one or more authorities control a range of inode numbers assigned to data owned by a corresponding authority.
9 . The apparatus of claim 8 , wherein the one or more authorities are configured to determine an erasure coding scheme to be applied to data stored within the system and wherein to reconfigure the storage system the one or more processors are further configured to execute the one or more authorities on a second set of blades.
10 . The apparatus of claim 8 , wherein the one or more processors are further configured to:
associate storage on a first set of blades with a write group, and wherein reconfiguring the storage system further comprises associating, in dependence upon a write group formation policy, storage on a second set of blades with the write group.
11 . The apparatus of claim 8 , wherein to detect the change to the topology of the storage system, the one or more processors are further configured to:
detect that an amount of processing resources within the storage system has changed.
12 . The apparatus of claim 11 , wherein to reconfigure the storage system, the one or more processors are further configured to:
modify an amount of storage associated with one or more write groups.
13 . The apparatus of claim 8 , wherein to detect the change to the topology of the storage system, the one or more processors are further configured to:
detect that a utilization of a particular resource has reached a utilization threshold.
14 . The apparatus of claim 8 , wherein the one or more authorities is located through a hash algorithm and wherein the one or more authorities is resident on a corresponding blade.
15 . A non-transitory computer readable storage medium storing instructions that, when executed, cause one or more processors to:
detect a change to a topology of a storage system consisting of different sets of blades configured within one of a plurality of chassis, wherein a blade of at least one of the different sets of blades has solid-state memory having differing storage capacities within the blade; and
responsive to detecting the change to the topology of the storage system, reconfigure the storage system to change an allocation of resources to one or more authorities executed by one or more of the different sets of blades, wherein the one or more authorities control a range of inode numbers assigned to data owned by a corresponding authority.
16 . The non-transitory computer readable storage medium of claim 15 , wherein the one or more authorities are configured to determine an erasure coding scheme to be applied to data stored within the system and wherein to reconfigure the storage system, the one or more processors are further to execute the one or more authorities on a second set of blades.
17 . The non-transitory computer readable storage medium of claim 15 , wherein the one or more processors are further to:
associate storage on a first set of blades with a write group, and wherein to reconfigure the storage system the one or more processors are further to associate, in dependence upon a write group formation policy, storage on a second set of blades with the write group.
18 . The non-transitory computer readable storage medium of claim 15 , wherein to detect the change to the topology of the storage system, the one or more processors are further to detect that an amount of processing resources within the storage system has changed.
19 . The non-transitory computer readable storage medium of claim 15 , wherein to reconfigure the storage system, the one or more processors are further to modify an amount of storage associated with one or more write groups.
20 . The non-transitory computer readable storage medium of claim 15 , wherein the one or more authorities is located through a hash algorithm and wherein the one or more authorities is resident on a corresponding blade.