Adapting rebuilding of encoded data slices in a dispersed storage network
A method for execution by a storage unit of a dispersed storage network includes updating a rebuilding task list based on detecting at least one storage error associated with storage of encoded data slices in a set of storage units that includes the storage unit. An encoded data slice is rebuilt based on the rebuilding task list and an affinity with the encoded data slice. The rebuilding task list is again updated based on detecting execution of at least one task of the rebuilding task list. The rebuilding task list is further updated based on detecting expiration of an execution time frame between sequential tasks of the rebuilding task list.
1. A method for execution by a storage unit that includes a processor, the method comprises:
receiving a rebuilding task list via a network;
updating the rebuilding task list based on detecting at least one storage error associated with storage of encoded data slices in a set of storage units that includes the storage unit;
rebuilding an encoded data slice based on the rebuilding task list and an affinity with the encoded data slice;
updating the rebuilding task list based on detecting execution of at least one task of the rebuilding task list; and
updating the rebuilding task list based on detecting expiration of an execution time frame between sequential tasks of the rebuilding task list.
2. The method of claim 1 , wherein the encoded data slice is associated with at least one data segment, and wherein the data segment was dispersed storage error encoded to produce a set of encoded data slices that includes the encoded data slice for storage in the set of storage units.
3. The method of claim 1 , further comprising performing a scan for encoded data slice errors, wherein the at least one storage error is detected as a result of performing the scan.
4. The method of claim 1 , wherein updating the rebuilding task list includes modifying the rebuilding task list to include at least one task that addresses the at least one storage error.
5. The method of claim 1 , wherein updating the rebuilding task list includes generating an updated rebuilding task list, further comprising transmitting the updated rebuilding task list to the set of storage units.
6. The method of claim 1 , wherein updating the rebuilding task list includes generating an updated rebuilding task list, wherein an update notification is transmitted to the set of storage units in response to the generation of the updated rebuilding task list, and wherein at least one of the set of storage units accesses the updated rebuilding task list in response to receiving the update notification.
7. The method of claim 1 , wherein rebuilding the encoded data slice includes:
interpreting the rebuilding task list to identify a plurality of tasks associated with a rebuilding module of the storage unit;
generating a plurality of priority levels corresponding to the plurality of tasks; and
executing the plurality of tasks in accordance with the plurality of priority levels to rebuild the encoded data slice.
8. The method of claim 7 , wherein the plurality of priority levels are generated based on at least one of: a calculated severity estimate or a calculated rebuild time.
9. The method of claim 1 , wherein the encoded data slice is rebuilt in response to a plurality of tasks of the rebuilding task list indicating that no other rebuilding module is designated to rebuild the encoded data slice within a rebuilding time frame.
10. The method of claim 1 , wherein updating the rebuilding task list based on detecting the execution of the at least one task includes:
locating the at least one task in a plurality of tasks of the rebuilding task list; and
removing the at least one task from the rebuilding task list to produce an updated rebuilding task list.
11. The method of claim 1 , wherein updating the rebuilding task list based on detecting the expiration of the execution time frame includes re-prioritizing tasks of the rebuilding task list in response to determining that the execution time frame has expired from a first task of the sequential tasks.
12. A processing system of a storage unit comprises:
at least one processor;
a memory that stores operational instructions, that when executed by the at least one processor cause the processing system to:
receive a rebuilding task list via a network;
update the rebuilding task list based on detecting at least one storage error associated with storage of encoded data slices in a set of storage units that includes the storage unit;
rebuild an encoded data slice based on the rebuilding task list and an affinity with the encoded data slice;
update the rebuilding task list based on detecting execution of at least one task of the rebuilding task list; and
update the rebuilding task list based on detecting expiration of an execution time frame between sequential tasks of the rebuilding task list.
13. The processing system of claim 12 , wherein the encoded data slice is associated with at least one data segment, and wherein the data segment was dispersed storage error encoded to produce a set of encoded data slices that includes the encoded data slice for storage in the set of storage units.
14. The processing system of claim 12 , wherein the at least one storage error is detected as a result of performing a scan for encoded data slice errors.
15. The processing system of claim 12 , wherein updating the rebuilding task list includes modifying the rebuilding task list to include at least one task that addresses the at least one storage error.
16. The processing system of claim 12 , wherein updating the rebuilding task list includes generating an updated rebuilding task list, and wherein the operational instructions, when executed by the at least one processor, further cause the processing system to transmit the updated rebuilding task list to the set of storage units.
17. The processing system of claim 12 , wherein rebuilding the encoded data slice includes:
interpreting the rebuilding task list to identify a plurality of tasks associated with a rebuilding module of the storage unit;
generating a plurality of priority levels corresponding to the plurality of tasks; and
executing the plurality of tasks in accordance with the plurality of priority levels to rebuild the encoded data slice.
18. The processing system of claim 12 , wherein the encoded data slice is rebuilt in response to a plurality of tasks of the rebuilding task list indicating that no other rebuilding module is designated to rebuild the encoded data slice within a rebuilding time frame.
19. The processing system of claim 12 , wherein updating the rebuilding task list based on detecting the expiration of the execution time frame includes re-prioritizing tasks of the rebuilding task list in response to determining that the execution time frame has expired from a first task of the sequential tasks.
20. A computer readable storage medium comprises:
at least one memory section that stores operational instructions that, when executed by a processing system of a dispersed storage network (DSN) that includes a processor and a memory, causes the processing system to:
receive a rebuilding task list via a network;
update rebuilding task list based on detecting at least one storage error associated with storage of encoded data slices in a set of storage units;
rebuild an encoded data slice based on the rebuilding task list and an affinity with the encoded data slice;
update the rebuilding task list based on detecting execution of at least one task of the rebuilding task list; and
update the rebuilding task list based on detecting expiration of an execution time frame between sequential tasks of the rebuilding task list.