Data validation checkpoint and flash memory rollback
A method, system, computer program product, and computer program for managing data in a storage system, the storage system comprising: a set of subsystems comprising: a structure comprising a set of mappings between logical and mapped addresses; and a storage device comprising a first data version at a first mapped address; the method comprising: for at least one substructure: providing, in the structure, for the first logical address, a verified pointer to the first mapped address; writing a second data version for a second mapped address, the second mapped address different from the first mapped address; providing, in the structure, for the first logical address a write-head pointer to the second mapped address; gathering the second data version to determine metadata for the second data version, the metadata associated with an indicator; in response to the indicator comprising a verify indicator; updating the verify pointer to the second mapped address.
1 . A method for managing data in a storage system, the storage system comprising: a set of subsystems, each subsystem comprising:
a structure comprising a set of mappings between logical addresses and mapped addresses; and a storage device comprising a first data version for the first logical address at a first mapped address; the method comprising:
for at least one substructure:
providing, in the structure, for the first logical address, a verified pointer to the first mapped address;
writing a second data version for the first logical address at a second mapped address, the second mapped address different from the first mapped address;
providing, in the structure, for the first logical address a write-head pointer to the second mapped address;
gathering the second data version to determine metadata for the second data version, the metadata associated with an indicator; and
in response to the indicator comprising a verify indicator, updating the verify pointer to the second mapped address.
2 . The method of claim 1 , further comprising, in response to the indicator comprising a non-verify indicator, reading the first data version and the second data version.
3 . The method of claim 1 , further comprising, in response to the indicator comprising a non-verify indicator, updating the write-head pointer to the first mapped address.
4 . The method of claim 1 , wherein the storage device comprises a set of further data versions at respective further addresses, the method further comprising, in response to the indicator comprising a verify indicator, adding the first data version at the first mapped address to the set of further data versions.
5 . The method of claim 4 further comprising, in response to the indicator comprising a non-verify indicator, adding the second data version at the second mapped address to the set of further data versions.
6 . The method of claim 4 further comprising garbage collecting the set of further data versions by deleting the set of further data versions.
7 . The method of claim 1 , wherein the mapped address comprises a physical address of the storage device.
8 . The method of claim 1 , wherein the storage device is one of a list, the list comprising: a storage controller; Flash memory; a disk drive; and other writable storage devices that allow for logical to physical mappings.
9 . The method of claim 1 , wherein the structure is a log structured array.
10 . The method of claim 1 , wherein the storage device is operable for storing data sequentially.
11 . The method of claim 1 , further comprising:
identifying a set of first logical addresses identified with a storage volume;
for each subsystem associated with the storage volume;
analysing the second data version to determine a collated metadata set;
analysing the collated metadata set to determine the indicator for the storage volume; and
providing the indicator to each of the subsystems associated with the storage volume.
12 . The method of claim 11 , wherein analysing the collated metadata set comprises performing a Shannon entropy analysis.
13 . The method of claim 11 , wherein in response to the indicator comprising a non-verify indicator, for each subsystem associated with the storage volume reading the first data version and the second data version;
collating each of the first data versions into a first volume version;
collating each of the second data versions to a second volume version; and
comparing the first volume version with the second volume version to select a chosen volume version.
14 . The method of claim 13 , wherein in response to the chosen volume version being the first volume version, for each of the storage devices associated with the storage volume, updating the write-head pointer to the first mapped address.
15 . The method of claim 13 , wherein in response to the chosen volume version being the second volume version, for each of the storage devices associated with the storage volume, updating the verify pointer to the second mapped address.
16 . A system for managing data in a storage system, the storage system comprising: a set of subsystems, each subsystem comprising:
a structure comprising a set of mappings between logical addresses and mapped addresses; and a storage device comprising a first data version for the first logical address at a first mapped address; the system comprising:
for at least one substructure:
providing, in the structure, for the first logical address, a verified pointer to the first mapped address;
writing a second data version for the first logical address at a second mapped address, the second mapped address different from the first mapped address;
providing, in the structure, for the first logical address a write-head pointer to the second mapped address;
gathering the second data version to determine metadata for the second data version, the metadata associated with an indicator; and
responsive to the indicator comprising a verify indicator; updating the verify pointer to the second mapped address.
17 . The system of claim 16 , further comprising, responsive to the indicator comprising a non-verify indicator, reading the first data version and the second data version.
18 . The system of claim 16 , further comprising, responsive to the indicator comprising a non-verify indicator, updating the write-head pointer to the first mapped address.
19 . The system of claim 16 , wherein the storage device comprises
a set of further data versions at respective further addresses, the system further comprising, responsive to the indicator comprising a verify indicator, adding the first data version at the first mapped address to the set of further data versions.
20 . The system of claim 19 further comprising, responsive to the indicator comprising a non-verify indicator, adding the second data version at the second mapped address to the set of further data versions.
21 . The system of claim 19 further comprising garbage collecting the set of further data versions by deleting the set of further data versions.
22 . The system of claim 16 , further comprising:
identifying a set of first logical addresses identified with a storage volume;
for each subsystem associated with the storage volume:
analysing the second data version to determine a collated metadata set; and
analysing the collated metadata set to determine the indicator for the storage volume; and
providing the indicator to each of the subsystems associated with the storage volume.
23 . The system of claim 22 , wherein analysing the collated metadata set comprises performing a Shannon entropy analysis.
24 . A computer program product for managing a storage system,
the storage system comprising: a set of subsystems, each subsystem comprising,
a structure comprising a set of mappings between logical addresses and mapped addresses; and a computer readable storage medium comprising a first data version for the first logical address at a first mapped address; the computer program product comprising:
for at least one substructure:
providing, in the structure, for the first logical address, a verified pointer to the first mapped address;
writing a second data version for the first logical address at a second mapped address, the second mapped address different from the first mapped address;
providing, in the structure, for the first logical address a write-head pointer to the second mapped address;
gathering the second data version to determine metadata for the second data version, the metadata associated with an indicator; and
in response to the indicator comprising a verify indicator, updating the verify pointer to the second mapped address.