Multi-stage slice recovery in a dispersed storage network
A method for use by a computing device in a dispersed storage network (DSN) to recover corrupt encoded data slices. In response to a request to storage units of the DSN for encoded data slices corresponding to a data segment, the computing device of a receives less than a decode threshold number of valid encoded data slices and at least one integrity error message that provides an indication of a corrupt encoded data slice. The computing device requests and receives at least one corrupt encoded data slice corresponding to the integrity error message(s). Utilizing at least one correction approach involving stored integrity data, the computing device then corrects the corrupt slice(s) to produce a decode threshold number of encoded data slices in order to decode the corresponding data segment. A variety of correction approaches may be employed, including a multi-stage approach that utilizes data from both valid and invalid slices.
1. A method for execution by one or more processing modules of one or more computing devices of a dispersed storage network (DSN), the method comprises:
in response to a request for encoded data slices, receiving less than a decode threshold number of encoded data slices and at least one integrity error message from a set of storage units of the DSN in which the encoded data slices are stored, wherein each of the encoded data slices is an encoded portion of a corresponding data segment, and the at least one integrity error message provides an indication of a corrupt encoded data slice;
requesting at least one corrupt encoded data slice from the set of storage units;
receiving the at least one corrupt encoded data slice; and
correcting the at least one corrupt encoded data slice, utilizing at least one correction approach, to produce at least the decode threshold number of encoded data slices.
2. The method of claim 1 , further comprising:
decoding the decode threshold number of encoded data slices to generate the corresponding data segment.
3. The method of claim 1 , wherein correcting the at least one corrupt encoded data slice includes:
selecting a first correction approach based on available integrity information;
attempting to correct the at least one corrupt encoded data slice using the first correction approach;
in response to determining that the first correction approach was not successful, selecting a second correction approach based on available integrity information; and
correcting the at least one corrupt encoded data slice using the second correction approach.
4. The method of claim 1 , wherein the at least one correction approach includes applying stored integrity information corresponding to the at least one corrupt encoded data slice to determine if the data of the encoded data slice is valid.
5. The method of claim 1 , the at least one correction approach utilizing slice substitution and a stored integrity value corresponding to a pre-encoded version of the data segment.
6. The method of claim 1 , wherein the at least one correction approach includes byte-by-byte recovery of the at least one corrupt encoded data slice utilizing valid bytes, in a common byte position, from a decode threshold number of encoded data slices.
7. The method of claim 1 , the at least one correction approach utilizing at least one of: stored integrity information regarding the data segment, stored integrity information generated by a dispersed storage error encoding process during encoding of the encoded data slices, or stored integrity information regarding individual ones of the encoded data slices generated prior to storage of the encoded data slices in the set of storage units.