Metadata pattern to detect write loss/inconsistencies of optimized-write-once operations
Sector signature patterns with sector signature values and sector signature parity values are embedded with data slices. A new pattern is embedded with a slice each time the slice data is updated. The patterns are selected in order such that every sector signature value and sector signature parity value changes when a new pattern is embedded. A separate metadata record such as a key is maintained to indicate which pattern has been embedded with the slice. A data integrity check is performed by comparing the embedded sector signature parity values with the metadata record and/or performing a pattern-to-key lookup.
1. A method, comprising:
independently from stored data values, defining a plurality of sector signature patterns;
embedding a first one of the sector signature patterns with data stored on a slice of non-volatile storage;
separately storing a metadata record in memory indicative of the sector signature pattern embedded with the data; and
responsive to a read to the slice on which the data is stored:
performing a data integrity check using the embedded sector signature pattern and the metadata record.
2. The method of claim 1 comprising, responsive to a write to the slice, selecting a second one of the sector signature patterns and replacing the embedded sector signature pattern by embedding the second one of the sector signature patterns with the data stored on the slice as updated by the write.
3. The method of claim 1 comprising defining the plurality of sector signature patterns with an algorithm.
4. The method of claim 1 comprising defining the plurality of sector signature patterns with horizontal parity values.
5. The method of claim 4 comprising defining the plurality of sector signature patterns with an order in which each sector signature pattern and each horizontal parity value changes when a next sector signature pattern in the order is selected and embedded.
6. The method of claim 4 comprising defining the plurality of sector signature patterns with diagonal parity values.
7. The method of claim 6 comprising defining the plurality of sector signature patterns with an order in which each sector signature pattern and each horizontal parity value and each diagonal parity value changes when a next sector signature pattern in the order is selected and embedded.
8. The method of claim 1 wherein separately storing the metadata record indicative of the sector signature pattern embedded with the data comprises storing a key.
9. The method of claim 8 wherein performing the data integrity check using the embedded sector signature pattern and the metadata record comprises performing a pattern-to-key lookup.
10. An apparatus, comprising:
a storage system comprising a plurality of computing nodes and managed drives, at least one of the computing nodes comprising a sector signature transition controller comprising:
transition logic that embeds a first one of a plurality of sector signature patterns with a slice of data stored on the managed drives and separately stores a metadata record in memory indicative of the sector signature pattern embedded with the slice of data, wherein the sector signature patterns are defined independently from stored data values; and
integrity check logic responsive to a read to the slice of data to perform a data integrity check using the embedded sector signature pattern and the metadata record.
11. The apparatus of claim 10 wherein the transition logic is responsive to a write to the slice of data to select a second one of the sector signature patterns and replace the embedded sector signature pattern by embedding the second one of the sector signature patterns with the slice of data as updated by a write.
12. The apparatus of claim 10 comprising an algorithm that calculates the plurality of sector signature patterns.
13. The apparatus of claim 10 wherein the sector signature patterns comprise horizontal parity values.
14. The apparatus of claim 13 wherein the plurality of sector signature patterns comprises an order in which each sector signature pattern and each horizontal parity value changes when a next sector signature pattern in the order is selected and embedded.
15. The apparatus of claim 13 wherein the sector signature patterns comprise diagonal parity values.
16. The apparatus of claim 15 wherein the plurality of sector signature patterns comprises an order in which each sector signature pattern and each horizontal parity value and each diagonal parity value changes when a next sector signature pattern in the order is selected and embedded.
17. The apparatus of claim 10 wherein the metadata record indicative of the sector signature pattern embedded with the slice of data comprises a key.
18. The apparatus of claim 17 wherein the integrity check logic performs a pattern-to-key lookup.
19. A non-transitory computer-readable storage medium storing instructions that when executed by a computer cause the computer to perform a method for using a computer system to perform a data integrity check, the method comprising:
independently from stored data values, defining a plurality of ordered sector signature patterns comprising sector signature parity;
embedding a first one of the sector signature patterns with a slice of data in non-volatile storage;
separately storing a key in memory indicative of the sector signature pattern embedded with the slice of data; and
responsive to a read to the slice of data:
performing a data integrity check using the embedded sector signature pattern and the key.
20. The non-transitory computer-readable storage medium of claim 19 wherein the method further comprises, responsive to a write to the slice of data, selecting a second one of the sector signature patterns and replacing the embedded sector signature pattern by embedding the second one of the sector signature patterns with the slice of data as updated by the write.