System data storage mechanism providing coherency and segmented data loading
A data storage subsystem is disclosed that implements a process for storing and/or reconstructing system data, such as a system mapping table. In certain embodiments, table pages are systematically copied, or flushed, to non-volatile memory in a progressive manner, according to a fixed ratio of flushed table pages per table update trigger, thereby facilitating write and/or load efficiency. Full or partial reconstruction of a table may be performed within a bounded number of operations based on the size of the table, the ratio implemented, and/or other characteristics.
1. A machine-implemented method, comprising:
updating at least one portion of a plurality of portions of a segmented system data in one or more volatile memories;
responsive to the at least one portion of the plurality of portions of the segmented system data being updated, flushing each of the updated at least one portion and a corresponding one further portion of the plurality of portions of the segmented system data per system data update trigger event, from the one or more volatile memories to one or more non-volatile memories; and
reconstructing the segmented system data to the one or more volatile memories from the one or more non-volatile memories,
wherein the reconstructing comprises:
loading one or more segments of the segmented system data from the one or more non-volatile memories to the one or more volatile memories, wherein the plurality of portions of the segmented system data in the one or more non-volatile memories are separated into the one or more segments; and
recovering the segmented system data as fully constructed using a number of operations not less than twice a size of the segmented system data measured in segments.
2. The machine-implemented method of claim 1 , wherein the reconstructing comprises:
reconstructing the segmented system data to the one or more volatile memories, using not greater than a threshold count of read operations,
wherein the threshold count of read operations is less than or equal to T*((R+1)/R),
wherein T is a total count of the plurality of portions in the segmented system data, and
wherein R is an integer value.
3. The machine-implemented method of claim 2 , wherein flushing the each of the updated at least one portion and the corresponding one further portion of the plurality of portions of the segmented system data per system data update trigger event comprising: flushing the updated at least one portion and one or more further portions of the plurality of portions of the segmented system data, wherein R is a predetermined ratio of a predetermined count of flushed portions per system data update trigger event.
4. The machine-implemented method of claim 1 , wherein content of the one or more segments has not been previously loaded to the one or more volatile memories.
5. The machine-implemented method of claim 4 , wherein the reconstructing comprises:
determining whether a data access request, accessing an address within a yet-to-be loaded segment of the segmented system data, is pending; and
processing a segment of the segmented system data associated with the address of the data access request, in response to the data access request being determined to be pending,
wherein the processing comprises:
determining that content of the segment has not been previously loaded to the one or more volatile memories; and
loading the segment to the one or more volatile memories.
6. The machine-implemented method of claim 1 , wherein responsive to no data access request being pending, a first of the one or more segments loaded to the one or more volatile memories comprises a segment associated with an oldest valid portion stored in the one or more non-volatile memories.
7. The machine-implemented method of claim 1 , wherein responsive to no data access request being pending, a first of the one or more segments loaded to the one or more volatile memories comprises a segment associated with one or more portions of the plurality of portions that have been most recently stored to the one or more non-volatile memories.
8. The machine-implemented method of claim 1 , wherein a total number of the updated at least one portion and the corresponding one further portion being flushed is equal to or less than a predetermined count of flushed portions per system data update trigger event.
9. The machine-implemented method of claim 1 , wherein:
the corresponding one further portion is different from the updated at least one portion,
and a total count of the further portions corresponding to the updated at least one portion does not exceed a total count of the plurality of portions of the segmented system data in the one or more volatile memories.
10. The machine-implemented method of claim 1 , wherein the flushing comprises flushing each of the updated at least one portion and the corresponding one further portion, in response to one system data update trigger initiated by a request from a machine, wherein the machine does not comprise the one or more volatile memories or the one or more non-volatile memories.
11. The machine-implemented method of claim 1 , wherein the flushing comprises flushing using a predetermined ratio of a predetermined count of flushed pages per system data update trigger event.
12. A data storage system, comprising:
one or more volatile memories;
one or more non-volatile memories; and
one or more controllers configured to cause:
updating at least one portion of a plurality of portions of a segmented system data in the one or more volatile memories;
responsive to the at least one portion of the plurality of portions of the segmented system data being updated, flushing each of the updated at least one portion and a corresponding one further portion of the plurality of portions of the segmented system data per system data update trigger event, from the one or more volatile memories to one or more non-volatile memories; and
reconstructing the segmented system data to the one or more volatile memories from the one or more non-volatile memories,
wherein the reconstructing comprises:
loading one or more segments of the segmented system data from the one or more non-volatile memories to the one or more volatile memories, wherein the plurality of portions of the segmented system data in the one or more non-volatile memories are separated into the one or more segments; and
recovering the segmented system data as fully constructed using a number of operations not less than twice a size of the segmented system data measured in segments.
13. The data storage system of claim 12 ,
wherein the reconstructing comprises reconstructing the segmented system data to the one or more volatile memories, using not greater than a threshold count of read operations,
wherein the threshold count of read operations is less than or equal to T*((R+1)/R),
wherein T is a total count of the plurality of portions in the segmented system data,
and
wherein R is a predetermined ratio of a predetermined count of flushed portions per system data update trigger event.
14. The data storage system of claim 13 , wherein the reconstructing comprises:
determining whether a data access request, accessing an address within a yet-to-be loaded segment of the segmented system data, is pending; and
processing a segment of the segmented system data associated with the address of the data access request, in response to the data access request being determined to be pending,
wherein the processing comprises:
determining that content of the segment has not been previously loaded to the one or more volatile memories; and
loading the segment to the one or more volatile memories.
15. The data storage system of claim 12 , wherein the flushing comprises flushing using a predetermined ratio of a predetermined count of flushed pages per system data update trigger event.
16. An apparatus, comprising:
means for updating at least one portion of a plurality of portions of a segmented system data in one or more volatile memories;
responsive to the at least one portion of the plurality of portions of the segmented system data being updated, means for flushing each of the updated at least one portion and a corresponding one further portion of the plurality of portions of the segmented system data per system data update trigger event, from the one or more volatile memories to one or more non-volatile memories; and
means for reconstructing the segmented system data to the one or more volatile memories from the one or more non-volatile memories,
wherein the means for reconstructing comprises:
means for loading one or more segments of the segmented system data from the one or more non-volatile memories to the one or more volatile memories, wherein the plurality of portions of the segmented system data in the one or more non-volatile memories are for being separated into the one or more segments; and
means for recovering the segmented system data as fully constructed using a number of operations not less than twice a size of the segmented system data measured in segments.
17. The apparatus of claim 16 , wherein the means for reconstructing comprises:
means for reconstructing the segmented system data to the one or more volatile memories, using not greater than a threshold count of read operations,
wherein the threshold count of read operations is less than or equal to T*((R+1)/R),
wherein T is a total count of the plurality of portions in the segmented system data, and
wherein R is an integer value.
18. The apparatus of claim 16 , wherein the means for flushing comprises means for flushing using a predetermined ratio of a predetermined count of flushed pages per system data update trigger event.