Storage network having metadata storage trees
A method includes error encoding data to produce a plurality of data slices. Metadata is determined for a data slice of the plurality of data slices. The metadata is stored in a metadata storage tree. The data slice is stored in a slice storage location indicated by the metadata. Based on determining to access the data slice, the metadata for the data slice is accessed in the metadata storage tree to determine the slice storage location for the data slice, and the data slice is accessed in the slice storage location based on determining the slice storage location for the data slice via accessing the metadata storage tree.
1 . A method comprises:
determining metadata for a data slice of a plurality of data slices;
storing the metadata in a metadata storage tree, wherein the metadata storage tree is stored via a first plurality of memory devices of a first memory type;
storing the data slice in a slice storage location indicated by the metadata, within a second plurality of memory devices of a second memory type;
receiving an access request corresponding to the data slice;
retrieving the slice storage location for the data slice from the metadata storage tree by accessing the metadata for the data slice in the metadata storage tree; and
accessing the data slice in the slice storage location.
2 . The method of claim 1 , wherein the first plurality of memory devices corresponds to a plurality of solid-state memory devices.
3 . The method of claim 1 , wherein the data is encoded via erasure encoding.
4 . The method of claim 1 , wherein the data is error encoded via an encoding process to produce the plurality of data slices in accordance with a width parameter of the encoding process.
5 . The method of claim 4 , wherein a corresponding decoding process can accommodate a number of failures equal to the width parameter minus an error coding parameter of the encoding process.
6 . The method of claim 1 , further comprising:
generating an initial metadata storage tree structure in at least one of the first plurality of memory devices.
7 . The method of claim 1 , wherein the metadata stored in the metadata storage tree includes an address indicating the slice storage location of the data slice in the second plurality of memory devices.
8 . The method of claim 1 , wherein the metadata further indicates a data object identifier.
9 . The method of claim 8 , wherein the metadata further indicates a revision number.
10 . The method of claim 1 , further comprising:
receiving access information from a plurality of storage units that include at least one of: at least one of the first plurality of memory devices, or at least one of the second plurality of memory devices.
11 . The method of claim 10 , further comprising:
configuring the plurality of storage units based on receiving the access information.
12 . The method of claim 1 , further comprising:
expanding the metadata storage tree to accommodate further storage.
13 . The method of claim 1 , wherein the data is error encoded based on receiving the data for storage.
14 . The method of claim 1 , wherein the first memory type has a different performance level from the second memory type.
15 . The method of claim 14 , wherein the first memory type has a higher performance level than the second memory type.
16 . A processing system of a storage system comprises:
at least one processor;
a memory that stores operational instructions that, when executed by the at least one processor, cause the processing system to:
determining metadata for a data slice of a plurality of data slices;
storing the metadata in a metadata storage tree, wherein the metadata storage tree is stored via a first plurality of memory devices of a first memory type;
storing the data slice in a slice storage location indicated by the metadata, within a second plurality of memory devices of a second memory type;
receiving an access request corresponding to the data slice;
retrieving the slice storage location for the data slice from the metadata storage tree by accessing the metadata for the data slice in the metadata storage tree; and
accessing the data slice in the slice storage location.
17 . The processing system of claim 16 , wherein the first plurality of memory devices corresponds to a plurality of solid-state memory devices.
18 . The processing system of claim 16 , wherein the data is encoded via erasure encoding.
19 . The processing system of claim 16 , wherein the data is error encoded via an encoding process to produce the plurality of data slices in accordance with a width parameter of the encoding process.
20 . A non-transitory computer readable storage medium comprises:
at least one memory section that stores operational instructions that, when executed by a processing system that includes a processor and a memory, causes the processing system to:
determining metadata for a data slice of a plurality of data slices;
storing the metadata in a metadata storage tree, wherein the metadata storage tree is stored via a first plurality of memory devices of a first memory type;
storing the data slice in a slice storage location indicated by the metadata, within a second plurality of memory devices of a second memory type;
receiving an access request corresponding to the data slice;
retrieving the slice storage location for the data slice from the metadata storage tree by accessing the metadata for the data slice in the metadata storage tree; and
accessing the data slice in the slice storage location.