Virtualization in a dispersed storage network utilizing local and remote memory
A method for a storage network computing device includes receiving a request to store a data object and generating a plurality of write slice requests, where the plurality of write slice requests includes a set of encoded data slices to be stored in the storage network and at least a decode threshold number of encoded data slices of the set of encoded data slices is required to recover a corresponding portion of a data object. The method continues by identifying a set of storage devices (from a plurality) for storage of the set of encoded data slices, where the plurality of storage devices includes one or more first memory devices local to the computing device and one or more second memory devices that are remote from the computing device. The method then continues, by storing the set of encoded data slices in the identified set of storage devices, generating a set of write slice responses relating to the set of encoded data slices and outputting the set of write slice responses.
1 . A method for execution by one or more processing modules of a computing device of a storage network, the method comprises:
receiving, from a requesting entity, a request to store a data object;
generating, by the computing device, a plurality of write slice requests, wherein the plurality of write slice requests includes a set of encoded data slices to be stored in the storage network, wherein at least a decode threshold number of encoded data slices of the set of encoded data slices is required to recover a corresponding portion of a data object;
identifying a set of storage devices of a plurality of storage devices for storage of the set of encoded data slices, wherein the plurality of storage devices includes one or more first memory devices and one or more second memory devices, wherein the first one or more first memory devices are local to the computing device and the second memory devices are remote from the computing device;
storing the set of encoded data slices in the identified set of storage devices;
generating, by the computing device, a set of write slice responses relating to the set of encoded data slices; and
outputting the set of write slice responses.
2 . The method of claim 1 , wherein identifying a set of storage devices of a plurality of storage devices for storage of the set of encoded data slices is based on at least one of:
a storage device current level of availability indicator relating to one or more storage devices of the plurality of storage devices;
an estimated storage device future level of availability indicator relating to one or more storage devices of the plurality of storage devices;
a storage device performance level indicator relating to one or more storage devices of the plurality of storage devices; or
an estimated access frequency level of the set of encoded data slices.
3 . The method of claim 1 , wherein storing the set of encoded data slices in the identified set of storage devices includes emulating storage of the set of encoded data slices in the set of storage units.
4 . The method of claim 3 , wherein emulating storage of the set of encoded data slices in the set of storage units includes generating the set of write slice responses to include emulated storage unit identifiers.
5 . The method of claim 1 , wherein each write slice response of the set of write slice responses includes a status indication relating to execution of a corresponding write slice request of the set of write slice requests.
6 . The method of claim 1 , wherein storing the set of encoded data slices in the identified set of storage devices includes:
storing at least a decode threshold number of encoded data slices in the first memory devices; and
storing less than the decode threshold number of encoded data slices in the second memory devices.
7 . The method of claim 1 , further comprising:
receiving, by the computing device, a set of read slice requests relating to the set of encoded data slices;
identifying a set of storage devices associated with storage of the set of encoded data slices;
retrieving a plurality of encoded data slices, of the set of encoded data slices, from the identified set of storage devices;
generating, by the computing device, a set of read slice responses including the plurality of encoded data slices; and
outputting the set of read slice responses.
8 . The method of claim 1 , wherein identifying a set of storage devices associated with storage of the set of encoded data slices includes at least one of performing a lookup, initiating a query of one or more memory devices and receiving a query response, or initiating a query of one or more temporary memory devices and receiving a query response.
9 . The method of claim 1 , further comprising:
detecting a slice error associated with at least one encoded data slice of the set of encoded data slices stored in the identified set of storage devices;
selecting a decode threshold number of encoded data slices of the set of encoded data slices, wherein the decode threshold number of encoded data slices does not include the at least one encoded data slice;
retrieving the decode threshold number of encoded data slices from a corresponding decode threshold number of storage devices of the identified set of storage devices;
decoding the decode threshold number of encoded data slices using a dispersed storage error encoding function to reproduce the corresponding data segment; and
encoding the reproduced data segment using the dispersed storage error encoding function to reproduce the at least one encoded data slice.
10 . The method of claim 1 , wherein the computing device comprises a storage unit.
11 . A storage unit for use in a storage network, the storage unit comprises:
a network interface;
at least one connection interface;
a memory comprising instructions; and
one or more processing modules in communication with the network interface, the at least one connection interface, and the memory, wherein the one or more processing modules execute the instructions to:
receive, via the network interface, a request to store a data object;
generate, a set of write slice requests including a set of encoded data slices to be stored in the storage network and further including a set of slice names corresponding to the set of encoded data slices, wherein at least a decode threshold number of encoded data slices of the set of encoded data slices is required to recover a corresponding data segment;
identify a set of storage devices of a plurality of storage devices for storage of the set of encoded data slices, wherein the plurality of storage devices includes one or more first memory devices and one or more second memory devices, wherein the first one or more first memory devices are local to the computing device and the second memory devices are remote from the computing device;
store the set of encoded data slices in the identified set of storage devices;
generate a set of write slice responses relating to the set of encoded data slices; and
output, via the network interface, the set of write slice responses for receipt by a requesting entity.
12 . The storage unit of claim 11 , wherein the set of storage devices is identified based on at least one of:
a storage device current level of availability indicator relating to one or more storage devices of the plurality of storage devices;
an estimated storage device future level of availability indicator relating to one or more storage devices of the plurality of storage devices;
a storage device performance level indicator relating to one or more storage devices of the plurality of storage devices; or
an estimated access frequency level of the set of encoded data slices.
13 . The storage unit of claim 11 , wherein the set of write slice responses include emulated storage unit identifiers.
14 . The storage unit of claim 11 , wherein each write slice response of the set of write slice responses includes a status indication relating to execution of a corresponding write slice request of the set of write slice requests.
15 . The storage unit of claim 11 , wherein the set of encoded data slices in the identified set of storage devices is stored by:
storing at least a decode threshold number of encoded data slices in the first memory devices; and
storing less than the decode threshold number of encoded data slices in the second memory devices.
16 . The storage unit of claim 11 , wherein the one or more processing modules further execute the instructions to:
receive, via the network interface, a set of read slice requests relating to the set of encoded data slices;
identify a set of storage devices associated with storage of the set of encoded data slices;
retrieve a plurality of encoded data slices, of the set of encoded data slices, from the identified set of storage devices;
generate a set of read slice responses including the plurality of encoded data slices; and
output, via the network interface, the set of read slice responses.
17 . The storage unit of claim 11 , wherein the one or more processing modules further execute the instructions to:
detect a slice error associated with at least one encoded data slice of the set of encoded data slices stored in the identified set of storage devices;
select a decode threshold number of encoded data slices of the set of encoded data slices, wherein the decode threshold number of encoded data slices does not include the at least one encoded data slice;
retrieve the decode threshold number of encoded data slices from a corresponding decode threshold number of storage devices of the identified set of storage devices;
decode the decode threshold number of encoded data slices using a dispersed storage error encoding function to reproduce the corresponding data segment;
encode the reproduced data segment using the dispersed storage error encoding function to reproduce the at least one encoded data slice; and
store the reproduced at least one encoded data slice in at least one storage device of the plurality of storage devices.
18 . A non-transitory computer readable storage medium comprises:
at least one memory section that stores operational instructions that, when executed by one or more processing modules of a storage unit of a dispersed storage network (DSN), causes the one or more processing modules to:
receive, via the network interface, a request to store a data object;
generate, a set of write slice requests including a set of encoded data slices to be stored in the storage network and further including a set of slice names corresponding to the set of encoded data slices, wherein at least a decode threshold number of encoded data slices of the set of encoded data slices is required to recover a corresponding data segment;
identify a set of storage devices of a plurality of storage devices for storage of the set of encoded data slices, wherein the plurality of storage devices includes one or more first memory devices and one or more second memory devices, wherein the first one or more first memory devices are local to the computing device and the second memory devices are remote from the computing device;
store the set of encoded data slices in the identified set of storage devices;
generate a set of write slice responses relating to the set of encoded data slices; and
output, via the network interface, the set of write slice responses for receipt by a requesting entity.
19 . The non-transitory computer readable storage medium of claim 18 , wherein the at least one memory section stores further operational instructions that, when executed by the one or more processing modules of the storage unit, causes the one or more processing modules to:
receive a set of read slice requests relating to the set of encoded data slices;
identify a set of storage devices associated with storage of the set of encoded data slices;
retrieve a plurality of encoded data slices, of the set of encoded data slices, from the identified set of storage devices;
generate a set of read slice responses including the plurality of encoded data slices; and
output the set of read slice responses.
20 . The non-transitory computer readable storage medium of claim 18 , wherein the at least one memory section stores further operational instructions that, when executed by the one or more processing modules of the storage unit, causes the one or more processing modules to:
detect a slice error associated with at least one encoded data slice of the set of encoded data slices stored in the identified set of storage devices;
select a decode threshold number of encoded data slices of the set of encoded data slices, wherein the decode threshold number of encoded data slices does not include the at least one encoded data slice;
retrieve the decode threshold number of encoded data slices from a corresponding decode threshold number of storage devices of the identified set of storage devices;
decode the decode threshold number of encoded data slices using a dispersed storage error encoding function to reproduce the corresponding data segment;
encode the reproduced data segment using the dispersed storage error encoding function to reproduce the at least one encoded data slice; and
store the reproduced at least one encoded data slice in at least one storage device of the plurality of storage devices.