Linked storage system and host system error correcting code
Systems, methods, and software are provided herein for error correction in writing and reading data to and from a data storage device. In one implementation, an encoder matrix is used to generate, for a data set, first error correcting code (ECC) parity data on a host system, and second ECC parity data for tracks on data storage device coupled to the host system. Once generated, the data storage device will store the data set and the first and second ECC parity data on storage media for the device. When a read is required, the storage device will provide a first version of the data set with the first and second ECC parity data to the host system, permitting the host system to use the parity data to generate a corrected version of the data set.
1. A computing apparatus comprising:
one or more non-transitory computer readable storage media;
a processing system operatively coupled with the one or more non-transitory computer readable storage media; and
program instructions stored on the one or more non-transitory computer readable storage media to operate a host system to manage storage of data sets that, when read and executed by the processing system, direct the processing system to at least:
in response to a read request, receive, from a data storage device, a first version of a data set, first error correcting code (ECC) parity data for the data set generated by the host system using an encoder matrix, and second ECC parity data for the data set generated by the data storage device using the encoder matrix for tracks of storage media on the data storage device;
generate a second version of the data set with one or more sector errors corrected from the first version of the data set by applying the first ECC parity data and the second ECC parity data to the first version of the data set in conjunction with the encoder matrix.
2. The computing apparatus of claim 1 wherein the program instructions further direct the processing system to:
in response to a write request for the data set, generate the first ECC parity data for the data set using the encoder matrix; and
transfer the data set and the first ECC parity data to the data storage device for storage by the data storage device.
3. The computing apparatus of claim 1 wherein the encoder matrix comprises a Cauchy Matrix.
4. The computing apparatus of claim 1 wherein the tracks correspond to storage locations for the data set.
5. The computing apparatus of claim 4 wherein each track of the tracks stores one or more sectors of the data set or the first ECC parity data.
6. The computing apparatus of claim 1 wherein the first version of the data set comprises errors uncorrectable using the second ECC parity data.
7. The computing apparatus of claim 1 wherein the program instructions further direct the processing system to receive, from the data storage device, an indication identifying at least one remaining sector with errors in the first version of the data set.
8. A computing system to manage data parity for data sets, the computing system comprising:
a data storage device; and
a host processing system communicatively coupled to the data storage device and configured to:
in response to a read request, receive, from a data storage device, a first version of a data set, first error correcting code (ECC) parity data for the data set generated by the host system using an encoder matrix, and second ECC parity data for the data set generated by the data storage device using the encoder matrix for tracks of storage media on the data storage device using the encoder matrix; and
generate a second version of the data set with one or more sector errors corrected from the first version of the data set by applying the first ECC parity data and the second ECC parity data to the first version of the data set in conjunction with the encoder matrix.
9. The computing system of claim 8 wherein the host processing system is further configured to:
in response to a write request for the data set, generate the first ECC parity data for the data set; and
transfer the data set and the first ECC parity data to the data storage device for storage by the data storage device.
10. The computing system of claim 9 wherein the data storage device is configured to:
receive the data set and the first ECC parity data;
generate the second ECC parity data for the data set; and
store the data set, the first ECC parity data, and the second ECC parity data.
11. The computing system of claim 10 wherein the data storage device configured to store the data set, the first ECC parity data, and the second ECC parity data is configured to store the data set, the first ECC parity data, and the second ECC parity data to shingled magnetic recording media of the data storage device.
12. The computing system of claim 8 wherein the matrix comprises a Cauchy Matrix.
13. The computing system of claim 8 wherein the tracks correspond to storage locations for the data set.
14. The computing system of claim 13 wherein each track of the tracks stores one or more sectors of the data set or the first ECC parity data.
15. The computing system of claim 8 wherein the first version of the data set comprises errors uncorrectable using the second ECC parity data.
16. The computing system of claim 8 wherein the host processing system is further configured to receive, from the data storage device, an indication identifying at least one remaining sector with errors in the first version of the data set.
17. A computing apparatus comprising:
one or more non-transitory computer readable storage media;
a processing system operatively coupled with the one or more non-transitory computer readable storage media; and
program instructions stored on the one or more non-transitory computer readable storage media to operate a data storage device to manage storage of data sets that, when read and executed by the processing system, direct the processing system to at least:
in response to receiving a read request for a data set stored on a storage media of a data storage device, apply second error correcting code (ECC) parity data to the data set, wherein the second ECC parity data is generated by the data storage device for tracks on the data storage device using an encoder matrix;
determine whether the second ECC parity data corrected all sectors in the data set; and
when the second ECC parity data does not correct all sectors in the data set, transfer the data set, at least a portion of the second ECC parity data, and first ECC parity data to a host system, wherein the first ECC parity data was generated by the host system using the encoder matrix.
18. The computing apparatus of claim 17 wherein the program instructions further direct the processing system to, if the second ECC parity data did correct all sectors in the data set, transfer at least the data set to the host system.
19. The computing apparatus of claim 17 wherein the encoder matrix comprises a Cauchy Matrix.
20. The computing apparatus of claim 17 wherein the storage device comprises a hard disk drive.
21. A system comprising:
a means for identifying a read request for a data set stored on storage media of a data storage device;
a means for, in response to the read request, applying second parity data to the data set, wherein the second parity data is generated by the data storage device for tracks on the data storage device using an encoder matrix;
a means for determining whether the second parity data corrected all sectors in the data set; and
a means for, if the second parity data did not correct all sectors in the data set, transferring the data set, at least a portion of the second parity data, and first parity data to a host system, wherein the first parity data was generated by the host system using the encoder matrix.
22. The system of claim 21 further comprising:
a means for receiving, from the data storage device, the data set, the first parity data, and at least the portion of the second parity data;
a means for processing the data set using the first parity data, at least the portion of the second parity data, and the encoder matrix to generate a second version of the data set with one or more sector errors corrected from the data set.