Prioritizing locations for error scanning in a storage network
A method includes obtaining, by a computing device of a storage network, provenance information for data associated with a set of storage units of the storage network, where the data is error encoded into a set of encoded data slices, in accordance with error encoding parameters, for storage in the set of storage units. The method further includes determining, by the computing device, probable error locations associated with the set of storage units based on the provenance information. The method further includes scanning, by the computing device, the probable error locations to determine whether an error exists for the set of encoded data slices.
1. A method for execution by one or more computing devices of a storage network, the method comprises:
error encoding a data segment of data in accordance with error encoding parameters to produce a set of encoded data slices;
storing the set of encoded data slices in a set of storage units of the storage network;
obtaining provenance information associated with the set of encoded data slices, wherein the provenance information is generated as one or more tasks for the error encoding the data segment and the storing the set of encoded data slices are being executed;
determining probable error locations associated within the set of storage units based on the provenance information; and
scanning the probable error locations to determine whether an error is associated with an encoded data slice of the set of encoded data slices.
2. The method of claim 1 , wherein the scanning is performed in accordance with a rebuild scanning schedule.
3. The method of claim 1 further comprises:
updating a rebuild scanning schedule with the probable error locations to produce an updated rebuild scanning schedule, wherein the probable error locations are prioritized within the updated rebuild scanning schedule.
4. The method of claim 1 further comprises:
generating at least a portion of the provenance information regarding a plurality of tasks that are performed for the data.
5. The method of claim 1 further comprises:
determining that the error is the encoded data slice of the set of encoded data slices needs rebuilding;
rebuilding the encoded data slice in accordance with the error encoding parameters; and
storing the encoded data slice within the set of storage units to resolve the error.
6. The method of claim 1 , wherein the obtaining the provenance information for the set of storage units is based on an error type of interest.
7. The method of claim 1 , wherein the provenance information includes a data identifier associated with the data.
8. The method of claim 7 , wherein the data identifier is an object name of a data object of the data.
9. The method of claim 7 , wherein the data identifier is an object number of a data object of the data.
10. The method of claim 1 further comprises:
scheduling the scanning to be performed during an off-peak timeframe.
11. The method of claim 1 , wherein the provenance information includes a timestamp indicating a time the data segment is written.
12. The method of claim 1 , wherein the provenance information includes a timestamp indicating a time a particular encoded data slice of the set of encoded data slices is written.
13. The method of claim 1 , wherein the provenance information includes an elapsed time for writing the set of encoded data slices.
14. The method of claim 1 , wherein the provenance information includes an identifier associated with a storage unit of the set of storage units.
15. The method of claim 1 , wherein the provenance information includes integrity information.
16. The method of claim 1 further comprises:
determining that the error is the encoded data slice of the set of encoded data slices and that the encoded data slice needs rebuilding;
rebuilding the encoded data slice in accordance with the error encoding parameters; and
storing the rebuilt encoded data slice in a storage unit of the set of storage units.
17. The method of claim 1 , wherein the determining the probable error locations further comprises:
determining a storage unit of the set of storage units was offline when potential missing slices were writing to the set of storage units; and
adding an identifier of the storage unit to the probable error locations.
18. The method of claim 1 , wherein the determining the probable error locations comprises:
determining write activity for a first storage unit of the set of storage units a vault based on the provenance information;
determining write activity for other storage units of the set of storage units based on the provenance information;
determining the write activity for the first storage unit compares unfavorably to the write activity for at least one of the other storage units; and
adding a namespace range associated with the first storage unit to the probable error locations.
19. The method of claim 1 further comprises:
determining an error type of interest for the set of storage units;
identifying a search attribute based on the error type of interest; and
obtaining the provenance information based on the search attribute.
20. The method of claim 1 , wherein the determining the probable error locations comprises:
comparing first provenance information of the provenance information to second provenance information of the provenance information, wherein the first provenance information is associated with a first storage unit of the set of storage units and the second provenance information is associated with a second storage unit of the set of storage units;
when the first provenance information compares unfavorably to the second provenance information, identifying a potential error; and
determining a first probable error location of the probable error locations based on the potential error.