Checkpoint based technique for bootstrapping forward map under constrained memory for flash devices
A system comprising a processor and a memory storing instructions that, when executed, cause the system to determine a first value of a first checkpoint associated with a first snapshot, receive a second value of a second checkpoint associated with a translation table entry from an additional source, determine whether the second value of the second checkpoint is after the first value of the first checkpoint, in response to determining that the second value of the second checkpoint is after the first value of the first checkpoint, retrieve the translation table entry associated with the second checkpoint from the additional source, and reconstruct the translation table using the translation table entry associated with the second checkpoint.
1. A method comprising:
identifying a first snapshot from a storage device, wherein the first snapshot is associated with a translation table, wherein the first snapshot includes at least one snapshot selected from the group consisting of (i) a snapshot that includes a free running counter denoting a timestamp of sufficient granularity, (ii) a snapshot that includes a counter associated with an update of a reverse translation map, wherein the counter is incremented each time the reverse translation map is persisted, (iii) a snapshot that includes a counter associated with a meta-log entry, wherein the counter is incremented each time a new meta-log entry is created, and (iv) a snapshot associated with the translation table that includes a plurality of translation table entries, the plurality of translation table entries comprising a plurality of dirty entries;
determining a first value of a first checkpoint associated with the first snapshot;
receiving a second value of a second checkpoint associated with a translation table entry from an additional source;
determining whether the second value of the second checkpoint is after the first value of the first checkpoint;
in response to determining that the second value of the second checkpoint is after the first value of the first checkpoint, retrieving the translation table entry associated with the second checkpoint from the additional source; and
reconstructing the translation table using the translation table entry associated with the second checkpoint.
2. The method of claim 1 , further comprising:
reconstructing translation table statistics using a subset of dump groups associated with the translation table.
3. The method of claim 1 , further comprising:
writing a plurality of translation table entries consecutively in a log-format, the plurality of translation table entries associated with the translation table.
4. An apparatus comprising:
a storage device; and
a processor coupled to the storage device and configured to:
determine a first value of a first checkpoint associated with a first snapshots,
wherein the first snapshot is associated with a translation table that includes a plurality of translation table entries,
wherein the plurality of translation table entries includes a plurality of dirty entries,
wherein a dirty entry from the plurality of dirty entries includes a non-persisted map;
receive a second value of a second checkpoint associated with a translation table entry from an additional source;
determine whether the second value of the second checkpoint is after the first value of the first checkpoint;
in response to determining that the second value of the second checkpoint after the first value of the first checkpoint, retrieve the translation table entry associated with the second checkpoint from the additional source; and
reconstruct the translation table using the translation table entry associated with the second checkpoint.
5. The apparatus of claim 4 , wherein the first snapshot includes a free running counter denoting a timestamp of sufficient granularity.
6. The apparatus of claim 4 , wherein the first snapshot includes a counter associated with an update of a reverse translation map, wherein the counter is incremented each time the reverse translation map is persisted.
7. The apparatus of claim 4 , wherein the first snapshot includes a counter associated with a meta-log entry, wherein the counter is incremented each time a new meta-log entry is created.
8. The apparatus of claim 4 , further comprising:
reconstructing translation table statistics using a subset of dump groups associated with the translation table.
9. The apparatus of claim 4 , further comprising:
writing a plurality of translation table entries consecutively in a log-format, the plurality of translation table entries associated with the translation table.
10. The apparatus of claim 4 , wherein the processor configured to determine whether the second value of the second checkpoint is after the first value of the first checkpoint comprises a processor configured to determine whether the second value of the second checkpoint is greater than the first value of the first checkpoint.
11. The apparatus of claim 10 , wherein the processor configured to, in response to determining that the second value of the second checkpoint after the first value of the first checkpoint, retrieve the translation table entry associated with the second checkpoint from the additional source comprises a processor configured to, in response to determining that the second value of the second checkpoint is greater than the first value of the first checkpoint, retrieve the translation table entry associated with the second checkpoint from the additional source.
12. An apparatus comprising:
a storage device; and
a processor coupled to the storage device and configured to:
determine a first value of a first checkpoint associated with a first snapshot, wherein the first snapshot is the most recent snapshot associated with a translation table;
receive a second value of a second checkpoint associated with a translation table entry from an additional source, wherein the additional source includes chunks of a reverse translation table and mega-log entries;
determine whether the second value of the second checkpoint is after the first value of the first checkpoint;
in response to determining that the second value of the second checkpoint is after the first value of the first checkpoint, retrieve the translation table entry associated with the second checkpoint from the additional source; and
reconstruct the translation table using the translation table entry associated with the second checkpoint.
13. The apparatus of claim 12 , wherein the first snapshot includes a counter associated with an update of a reverse translation map, wherein the counter is incremented each time the reverse translation map is persisted.
14. The apparatus of claim 12 , wherein the first snapshot associated with the translation table includes a plurality of translation table entries, the plurality of translation table entries being dirty entries.