Prioritizing storage units for data retrieval operations
Methods and systems for use in a storage network to prioritize storage units for data retrieval operations. In various examples, a device obtains resource utilization information and pending resource demand information for a plurality of storage units of a storage network. The device further groups, based on the resource utilization information, the storage units into an underutilized resource group and an overutilized resource group, and further issues one or more high priority read slice access requests to the storage units of the underutilized resource group. The read slice access requests correspond to a pending resource demand for data retrieval. In response to determining that the high priority read access information does not include at least a read threshold number of read slice requests, the device further issues one or more additional read slice requests to one or more storage units of the overutilized resource group.
1 . A method for execution by one or more processing modules of a storage network, the method comprising:
obtaining resource utilization information for a plurality of storage units of the storage network;
grouping, based the resource utilization information, the plurality of storage units into an underutilized resource group and an overutilized resource group;
determining pending resource demand information relating to at least one pending resource demand for the plurality of storage units;
issuing high priority read access information to one or more storage units of the underutilized resource group, the high priority read access information including one or more read slice requests of a read threshold number of read slice requests corresponding to the pending resource demand information;
determining whether the high priority read access information includes at least the read threshold number of read slice requests; and
in response to determining that the high priority read access information does not include at least the read threshold number of read slice requests, issuing one or more additional read slice requests of the read threshold number of read slice requests to one or more storage units of the overutilized resource group.
2 . The method of claim 1 , wherein grouping the plurality of storage units includes identifying a storage unit as an underutilized resource when a resource utilization level of the storage unit is less than a utilization threshold level.
3 . The method of claim 1 , wherein grouping the plurality of storage units includes identifying a storage unit as an overutilized resource when a resource utilization level of the storage unit is greater than a utilization threshold level.
4 . The method of claim 1 , wherein the resource utilization information includes at least one of:
write availability information;
read availability information;
resource utilization by address range; or
computing processing level utilization information.
5 . The method of claim 1 , wherein obtaining resource utilization information for a plurality of storage units includes:
initiating a resources utilization request to at least some of the plurality of storage units; and
receiving responsive resource utilization information.
6 . The method of claim 1 , wherein the pending resource demand information includes tasks relating to at least one of:
data rebuilding operations;
distributed computing partial tasks;
maintenance operations;
update operations; or
data access tasks.
7 . A method for execution by one or more processing modules of a storage network, the method comprising:
obtaining cost information relating to the storage network;
obtaining resource utilization information for a plurality of storage units of the storage network;
grouping, based on at least one of the resource utilization information or the cost information, the plurality of storage units into an underutilized resource group and an overutilized resource group;
determining pending resource demand information relating to at least one pending resource demand for the plurality of storage units; and
issuing high priority read access information to one or more storage units of the underutilized resource group, the high priority read access information including one or more read slice requests of a read threshold number of read slice requests corresponding to the pending resource demand information.
8 . The method of claim 7 , further comprising:
determining whether the high priority read access information includes at least the read threshold number of read slice requests; and
in response to determining that the high priority read access information does not include at least the read threshold number of read slice requests, issuing one or more additional read slice requests of the read threshold number of read slice requests to one or more storage units of the overutilized resource group.
9 . The method of claim 7 , wherein grouping the plurality of storage units includes identifying a storage unit as an underutilized resource when a resource utilization level of the storage unit is less than a utilization threshold level, and identifying the storage unit as an overutilized resource when the resource utilization level is greater than the utilization threshold level.
10 . The method of claim 7 , wherein the cost information includes at least one of:
bandwidth costs of communication links; or
fixed capacity cost.
11 . The method of claim 7 , wherein the resource utilization information includes at least one of:
write availability information;
read availability information;
bandwidth utilization information; or
computing processing level utilization information.
12 . The method of claim 7 , wherein the pending resource demand information includes tasks relating to at least one of:
data rebuilding operations;
distributed computing partial tasks;
maintenance operations;
update operations; or
data access tasks.
13 . The method of claim 7 , wherein issuing one or more additional read slice requests includes issuing a remaining number of read slice requests to at least meet the read threshold number of read slice requests.
14 . A computing device for use in a storage network, the computing device comprises:
one or more network interfaces;
memory including operational instructions; and
a processing module operably coupled to the memory and the one or more network interfaces, the processing module configured to execute the operational instructions to:
obtain, via the one or more network interfaces, resource utilization information for a plurality of storage units of the storage network;
group, based the resource utilization information, the plurality of storage units into an underutilized resource group and an overutilized resource group;
determine pending resource demand information relating to at least one pending resource demand for the plurality of storage units;
issue, via the one or more network interfaces, high priority read access information to one or more storage units of the underutilized resource group, the high priority read access information including one or more read slice requests of a read threshold number of read slice requests corresponding to the pending resource demand information;
determine whether the high priority read access information includes at least the read threshold number of read slice requests; and
in response to determining that the high priority read access information does not include at least the read threshold number of read slice requests, issue one or more additional read slice requests of the read threshold number of read slice requests to one or more storage units of the overutilized resource group.
15 . The computing device of claim 14 , wherein grouping the plurality of storage units includes identifying a storage unit as an underutilized resource when a resource utilization level of the storage unit is less than a utilization threshold level.
16 . The computing device of claim 14 , wherein grouping the plurality of storage units includes identifying a storage unit as an overutilized resource when a resource utilization level of the storage unit is greater than a utilization threshold level.
17 . The computing device of claim 14 , wherein the resource utilization information includes at least one of:
write availability information;
read availability information;
resource utilization by address range; or
computing processing level utilization information.
18 . The computing device of claim 14 , wherein obtaining resource utilization information for a plurality of storage units includes executing the operational instructions to:
initiate a resources utilization request to at least some of the plurality of storage units; and
receive responsive resource utilization information.
19 . The computing device of claim 14 , wherein the pending resource demand information includes tasks relating to at least one of:
data rebuilding operations;
distributed computing partial tasks;
maintenance operations;
update operations; or
data access tasks.
20 . The computing device of claim 14 , wherein issuing one or more additional read slice requests includes issuing a remaining number of read slice requests to at least meet the read threshold number of read slice requests.