VIRTUALIZATION OF STORAGE UNITS IN A DISPERSED STORAGE NETWORK
Methods and devices for use in a dispersed storage network (DSN) to emulate storage units. In various examples, a storage unit or other computing device of the DSN receives a set of write slice requests including a set of encoded data slices for storage in the DSN and a set of slice names corresponding to the encoded data slices. The storage unit identifies a set of storage devices for storage of the set of encoded data slices using various described criteria. The identified storage devices include one or more memory devices of the storage unit and one or more temporary memory devices accessible by the storage unit. The storage unit stores the encoded data slices in the identified set of storage devices, generates a set of write slice responses relating to the set of encoded data slices and outputs the set of write slice responses to a requesting entity.
1 . A method for execution by one or more processing modules of a computing device of a dispersed storage network (DSN), the method comprises:
receiving, by the computing device of the DSN, a set of write slice requests including a set of encoded data slices to be stored in the DSN and further including a set of slice names corresponding to the set of encoded data slices, wherein at least a decode threshold number of encoded data slices of the set of encoded data slices is required to recover a corresponding data segment;
identifying a set of storage devices of a plurality of storage devices for storage of the set of encoded data slices, wherein the plurality of storage devices includes one or more memory devices of the computing device and one or more temporary memory devices accessible by the computing device;
storing the set of encoded data slices in the identified set of storage devices;
generating, by the computing device, a set of write slice responses relating to the set of encoded data slices; and
outputting the set of write slice responses to a requesting entity.
2 . The method of claim 1 , wherein identifying a set of storage devices of a plurality of storage devices for storage of the set of encoded data slices is based on at least one of:
a storage device current level of availability indicator relating to one or more storage devices of the plurality of storage devices;
an estimated storage device future level of availability indicator relating to one or more storage devices of the plurality of storage devices;
a storage device performance level indicator relating to one or more storage devices of the plurality of storage devices; or
an estimated access frequency level of the set of encoded data slices.
3 . The method of claim 1 , wherein the set of slice names identifies a set of storage units of the DSN, and wherein storing the set of encoded data slices in the identified set of storage devices includes emulating storage of the set of encoded data slices in the set of storage units.
4 . The method of claim 3 , wherein emulating storage of the set of encoded data slices in the set of storage units includes generating the set of write slice responses to include emulated storage unit identifiers.
5 . The method of claim 1 , wherein each write slice response of the set of write slice responses includes a status indication relating to execution of a corresponding write slice request of the set of write slice requests.
6 . The method of claim 1 , wherein storing the set of encoded data slices in the identified set of storage devices includes:
storing at least a decode threshold number of encoded data slices in the one or more memory devices of the computing device; and
storing less than the decode threshold number of encoded data slices in the one or more temporary memory devices.
7 . The method of claim 1 , further comprising:
receiving, by the computing device of the DSN, a set of read slice requests relating to the set of encoded data slices;
identifying a set of storage devices associated with storage of the set of encoded data slices;
retrieving a plurality of encoded data slices, of the set of encoded data slices, from the identified set of storage devices;
generating, by the computing device, a set of read slice responses including the plurality of encoded data slices; and
outputting the set of read slice responses.
8 . The method of claim 1 , wherein identifying a set of storage devices associated with storage of the set of encoded data slices includes at least one of performing a lookup, initiating a query of one or more memory devices and receiving a query response, or initiating a query of one or more temporary memory devices and receiving a query response.
9 . The method of claim 1 , further comprising:
detecting a slice error associated with at least one encoded data slice of the set of encoded data slices stored in the identified set of storage devices;
selecting a decode threshold number of encoded data slices of the set of encoded data slices, wherein the decode threshold number of encoded data slices does not include the at least one encoded data slice;
retrieving the decode threshold number of encoded data slices from a corresponding decode threshold number of storage devices of the identified set of storage devices;
decoding the decode threshold number of encoded data slices using a dispersed storage error encoding function to reproduce the corresponding data segment; and
encoding the reproduced data segment using the dispersed storage error encoding function to reproduce the at least one encoded data slice.
10 . The method of claim 1 , wherein the computing device comprises a storage unit.
11 . A storage unit for use in a dispersed storage network (DSN), the storage unit comprises:
a network interface;
at least one connection interface;
a memory comprising instructions; and
one or more processing modules in communication with the network interface, the at least one connection interface, and the memory, wherein the one or more processing modules execute the instructions to:
receive, via the network interface, a set of write slice requests including a set of encoded data slices to be stored in the DSN and further including a set of slice names corresponding to the set of encoded data slices, wherein at least a decode threshold number of encoded data slices of the set of encoded data slices is required to recover a corresponding data segment;
identify a set of storage devices of a plurality of storage devices for storage of the set of encoded data slices, wherein the plurality of storage devices includes one or more memory devices of the storage unit and one or more temporary memory devices accessible by the storage unit via the at least one connection interface;
store the set of encoded data slices in the identified set of storage devices;
generate a set of write slice responses relating to the set of encoded data slices; and
output, via the network interface, the set of write slice responses for receipt by a requesting entity.
12 . The storage unit of claim 11 , wherein identifying a set of storage devices of a plurality of storage devices for storage of the set of encoded data slices is based on at least one of:
a storage device current level of availability indicator relating to one or more storage devices of the plurality of storage devices;
an estimated storage device future level of availability indicator relating to one or more storage devices of the plurality of storage devices;
a storage device performance level indicator relating to one or more storage devices of the plurality of storage devices; or
an estimated access frequency level of the set of encoded data slices.
13 . The storage unit of claim 11 , wherein the set of slice names identifies a set of storage units of the DSN, and wherein the set of write slice responses include emulated storage unit identifiers.
14 . The storage unit of claim 11 , wherein each write slice response of the set of write slice responses includes a status indication relating to execution of a corresponding write slice request of the set of write slice requests.
15 . The storage unit of claim 11 , wherein storing the set of encoded data slices in the identified set of storage devices includes:
storing at least a decode threshold number of encoded data slices in the one or more memory devices of the storage unit; and
storing less than the decode threshold number of encoded data slices in the one or more temporary memory devices.
16 . The storage unit of claim 11 , wherein the one or more processing modules further execute the instructions to:
receive, via the network interface, a set of read slice requests relating to the set of encoded data slices;
identify a set of storage devices associated with storage of the set of encoded data slices;
retrieve a plurality of encoded data slices, of the set of encoded data slices, from the identified set of storage devices;
generate a set of read slice responses including the plurality of encoded data slices; and
output, via the network interface, the set of read slice responses.
17 . The storage unit of claim 11 , wherein the one or more processing modules further execute the instructions to:
detect a slice error associated with at least one encoded data slice of the set of encoded data slices stored in the identified set of storage devices;
select a decode threshold number of encoded data slices of the set of encoded data slices, wherein the decode threshold number of encoded data slices does not include the at least one encoded data slice;
retrieve the decode threshold number of encoded data slices from a corresponding decode threshold number of storage devices of the identified set of storage devices;
decode the decode threshold number of encoded data slices using a dispersed storage error encoding function to reproduce the corresponding data segment;
encode the reproduced data segment using the dispersed storage error encoding function to reproduce the at least one encoded data slice; and
store the reproduced at least one encoded data slice in at least one storage device of the plurality of storage devices.
18 . A non-transitory computer readable storage medium comprises:
at least one memory section that stores operational instructions that, when executed by one or more processing modules of a storage unit of a dispersed storage network (DSN), causes the one or more processing modules to:
receive a set of write slice requests including a set of encoded data slices to be stored in the DSN and further including a set of slice names corresponding to the set of encoded data slices, wherein at least a decode threshold number of encoded data slices of the set of encoded data slices is required to recover a corresponding data segment;
identify a set of storage devices of a plurality of storage devices for storage of the set of encoded data slices, wherein the plurality of storage devices includes one or more memory devices of the storage unit and one or more temporary memory devices accessible by the storage unit;
store the set of encoded data slices in the identified set of storage devices;
generate a set of write slice responses relating to the set of encoded data slices; and
output the set of write slice responses for receipt by a requesting entity.
19 . The non-transitory computer readable storage medium of claim 18 , wherein the at least one memory section stores further operational instructions that, when executed by the one or more processing modules of the storage unit, causes the one or more processing modules to:
receive a set of read slice requests relating to the set of encoded data slices;
identify a set of storage devices associated with storage of the set of encoded data slices;
retrieve a plurality of encoded data slices, of the set of encoded data slices, from the identified set of storage devices;
generate a set of read slice responses including the plurality of encoded data slices; and
output the set of read slice responses.
20 . The non-transitory computer readable storage medium of claim 18 , wherein the at least one memory section stores further operational instructions that, when executed by the one or more processing modules of the storage unit, causes the one or more processing modules to:
detect a slice error associated with at least one encoded data slice of the set of encoded data slices stored in the identified set of storage devices;
select a decode threshold number of encoded data slices of the set of encoded data slices, wherein the decode threshold number of encoded data slices does not include the at least one encoded data slice;
retrieve the decode threshold number of encoded data slices from a corresponding decode threshold number of storage devices of the identified set of storage devices;
decode the decode threshold number of encoded data slices using a dispersed storage error encoding function to reproduce the corresponding data segment;
encode the reproduced data segment using the dispersed storage error encoding function to reproduce the at least one encoded data slice; and
store the reproduced at least one encoded data slice in at least one storage device of the plurality of storage devices.