Encoding data utilizing a zero information gain function
View Patent ↗A method begins by a dispersed storage (DS) processing module encoding data using a dispersed storage error coding function to produce a set of encoded data slices. The method continues with the DS processing module encoding a first encoded data slice of the set of encoded data slices using a zero information gain (ZIG) function based on a second encoded data slice of the set of encoded data slices to produce a ZIG encoded data slice. The method continues with the DS processing module outputting the ZIG encoded data slice and a subset of encoded data slices of the set of encoded data slices, wherein the subset of encoded data slices includes less than a decode threshold number of encoded data slices and does not include the first or the second encoded data slice.
1. A method for execution by a processing module of a computing device of a dispersed storage network (DSN), the method comprises:
dispersed storage error encoding, by the processing module and in accordance with distributed data storage parameters, a data segment to produce a set of encoded data slices and a set of zero information gain (ZIG) encoded data slices, wherein the set of encoded data slices is encoded in accordance with a dispersed storage error encoding scheme and wherein the set of ZIG encoded data slices is encoded using a ZIG function and further wherein a first ZIG encoded data slice of the set of ZIG encoded data slices is generated by matrix multiplying a first decoding matrix and a first encoded data slice of the set of encoded data slices, wherein generating the first ZIG encoded data slice includes generating a first partial encoded data slice based on the first decoding matrix, the first encoded data slice and a row of the encoding matrix corresponding to the first encoded data slice, generating a second partial encoded data slice based on a second decoding matrix, a second encoded data slice and a row of the encoding matrix corresponding to the second encoded data slice, wherein the second encoded data slice is an encoded data slice of the set of encoded data slices and not included in the subset of encoded data slices, and combining the first and second partial encoded data slices to produce the first ZIG encoded data slice;
selecting, by the processing module, a first subset of encoded data slices from the set of encoded data slices, wherein the first subset of encoded data slices includes less than a threshold number of encoded data slices, and further wherein the threshold number of encoded data slices is required to recreate the data segment;
sending, by the processing module via an interface of the computing device, the subset of encoded data slices to a first memory within the DSN for storage therein; and
sending, by the processing module via the interface, the set of ZIG encoded data slices to a second memory within the DSN for storage therein.
2. The method of claim 1 , wherein generating the first ZIG encoded data slice further comprises:
matrix multiplying the first decoding matrix and the first encoded data slice to produce a vector; and
matrix multiplying the vector by a row of the encoding matrix corresponding to the first encoded data slice to produce the first ZIG encoded data slice.
3. The method of claim 1 further comprises:
generating the first decoding matrix by:
reducing an encoding matrix to produce a square matrix that exclusively includes rows associated with the subset of encoded data slices and an encoded data slice being represented by the first ZIG encoded data slice; and
inverting the square matrix to produce the decoding matrix.
4. The method of claim 1 , wherein the sending the set of ZIG encoded data slices comprises:
prior to sending, obfuscating the first ZIG encoded data slice using an obfuscating function.
5. The method of claim 4 , wherein the obfuscating function comprises one of:
exclusive ORing the first ZIG encoded data slice with an obfuscating value;
masking the first ZIG encoded data slice;
encrypting the first ZIG encoded data slice; and
performing a deterministic function on the first ZIG encoded data slice.
6. A dispersed storage (DS) module of a dispersed storage network (DSN) comprises:
a first module, when operable within a computing device, causes the computing device to:
dispersed storage error encode in accordance with distributed data storage parameters, a data segment of data to produce a set of encoded data slices and a set of zero information gain (ZIG) encoded data slices, wherein the set of encoded data slices is encoded in accordance with a dispersed storage error encoding scheme and wherein the set of ZIG encoded data slices is encoded using a ZIG function, wherein a first ZIG encoded data slice of the set of ZIG encoded data slices is generated by matrix multiplying a first decoding matrix and a first encoded data slice of the set of encoded data slices and wherein the generating the first ZIG encoded data slice includes:
generating a first partial encoded data slice based on the first decoding matrix, the first encoded data slice and a row of the encoding matrix corresponding to the first encoded data slice;
generating a second partial encoded data slice based on a second decoding matrix, a second encoded data slice and a row of the encoding matrix corresponding to the second encoded data slice, wherein the second encoded data slice is an encoded data slice of the set of encoded data slices and not included in the subset of encoded data slices; and
combining the first and second partial encoded data slices to produce the first ZIG encoded data slice;
select a first subset of encoded data slices from the set of encoded data slices, wherein the first subset of encoded data slices includes less than a threshold number of encoded data slices, and further wherein the threshold number of encoded data slices is required to recreate the data segment; and
a second module, when operable within the computing device, causes the computing device to:
send, via an interface of the computing device, the subset of encoded data slices to a first memory within the DSN for storage therein; and
send, via the interface, the set of ZIG encoded data slices to a second memory within the DSN for storage therein.
7. The DS module of claim 6 , wherein the first module, when operable within the computing device, further causes the computing device to generate the first ZIG encoded data slice by:
matrix multiplying the first decoding matrix and the first encoded data slice to produce a vector; and
matrix multiplying the vector by a row of the encoding matrix corresponding to the first encoded data slice to produce the first ZIG encoded data slice.
8. The DS module of claim 6 , wherein the first module, when operable within the computing device, causes the computing device to generate the first decoding matrix by:
reducing an encoding matrix to produce a square matrix that exclusively includes rows associated with the subset of encoded data slices and an encoded data slice being represented by the first ZIG encoded data slice; and
inverting the square matrix to produce the decoding matrix.
9. The DS module of claim 6 , wherein the second module, when operable within the computing device, further causes the computing device to send the set of ZIG encoded data slices by:
prior to sending, obfuscating the first ZIG encoded data slice using an obfuscating function.
10. The DS module of claim 9 , wherein the obfuscating function comprises one of:
exclusive ORing the first ZIG encoded data slice with an obfuscating value;
masking the first ZIG encoded data slice;
encrypting the first ZIG encoded data slice; and
performing a deterministic function on the first ZIG encoded data slice.