PROVISIONING DS UNITS ON THE FLY IN A DSN MEMORY IN RESPONSE TO LOAD
A computing device includes an interface configured to interface and communicate with a dispersed or distributed storage network (DSN), a memory that stores operational instructions, and a processing module operably coupled to the interface and memory such that the processing module, when operable within the computing device based on the operational instructions, is configured to perform various operations including to DSN traffic and storage usage among storage units (SUs) that distributedly store encoded data slices (EDSs) associated with a data object based on a Decentralized, or Distributed, Agreement Protocol (DAP) system configuration. For some instances of the DSN traffic, the computing device configures and deploys additional computing device(s) to service EDS data access operations. For some instances of the storage usage among the SUs, the computing device configures and deploys additional SU(s) to store distributedly the set of EDSs and updates the DAP system configuration.
1 . A computing device comprising:
an interface configured to interface and communicate with a dispersed or distributed storage network (DSN);
memory that stores operational instructions; and
a processing module operably coupled to the interface and to the memory, wherein the processing module, when operable within the computing device based on the operational instructions, is configured to:
determine DSN traffic and storage usage among a plurality of storage units (SUs) that distributedly stores a set of encoded data slices (EDSs) associated with a data object based on a first system configuration of a Decentralized, or Distributed, Agreement Protocol (DAP), wherein the data object is segmented into a plurality of data segments, wherein a data segment of the plurality of data segments is dispersed error encoded in accordance with dispersed error encoding parameters to produce the set of EDSs, and wherein the DSN traffic is associated with data access operations for at least some EDSs of the set of EDSs as performed by at least one other computing device;
when the DSN traffic compares unfavorably with a DSN traffic threshold, configure and deploy at least one additional computing device to service the data access operations for the at least some EDSs of the set of EDSs in cooperation with the at least one other computing device; and
when the storage usage among the plurality of SUs compares unfavorably with a storage usage threshold:
configure and deploy at least one additional SU to store distributedly the set of EDSs in cooperation with the plurality of SUs;
determine a second system configuration of the DAP that corresponds to storage of the set of EDSs cooperatively by the at least one additional SU and the plurality of SUs; and
direct the at least one additional SU and the plurality of SUs to operate based on the second system configuration of the DAP and transmit the second system configuration of the DAP to other computing devices within the DSN.
2 . The computing device of claim 1 , wherein the processing module, when operable within the computing device based on the operational instructions, is further configured to:
when the DSN traffic compares favorably with another DSN traffic threshold and when the at least one other computing device includes at least two computing devices, decommission one of the at least two computing devices from servicing the data access operations for the at least some EDSs of the set of EDSs.
3 . The computing device of claim 1 , wherein the processing module, when operable within the computing device based on the operational instructions, is further configured to:
when the storage usage among the plurality of SUs compares favorably with another storage usage threshold:
determine a third system configuration of the DAP that corresponds to storage of the set of EDSs by a subset of the plurality of SUs that includes fewer than all of the plurality of SUs to store distributedly the set of EDSs; and
direct the subset of the plurality of SUs to operate based on the third system configuration of the DAP to perform the storage of the set of EDSs and transmit the third system configuration of the DAP to other computing devices within the DSN.
4 . The computing device of claim 1 , wherein the processing module, when operable within the computing device based on the operational instructions, is further configured to:
when the storage usage among the plurality of SUs compares unfavorably with a storage usage threshold and the at least one additional SU is configured and deployed to store distributedly the set of EDSs in cooperation with the plurality of SUs, perform a first EDS balancing operation for the set of EDSs such that each SU of the at least one additional SU and the plurality of SUs stores an approximately same number of EDSs of the set of EDSs; and
when the DSN traffic compares favorably with another DSN traffic threshold and when the at least one other computing device includes at least two computing devices and when the one of the at least two computing devices is decommissioned from servicing the data access operations for the at least some EDSs of the set of EDSs, perform a second EDS balancing operation for the set of EDSs such that each SU of the at least two computing devices excluding the one of the at least two computing devices is decommissioned from the at least two computing devices stores an approximately same number of EDSs of the set of EDSs.
5 . The computing device of claim 1 , wherein:
a decode threshold number of EDSs are needed to recover the data segment;
a read threshold number of EDSs provides for reconstruction of the data segment; and
a write threshold number of EDSs provides for a successful transfer of the set of EDSs from a first at least one location in the DSN to a second at least one location in the DSN.
6 . The computing device of claim 1 , wherein the computing device is located at a first premises that is remotely located from at least one SU of the plurality of SUs within the DSN.
7 . The computing device of claim 1 further comprising:
a SU of the plurality of SUs within the DSN, a wireless smart phone, a laptop, a tablet, a personal computers (PC), a work station, or a video game device.
8 . The computing device of claim 1 , wherein the DSN includes at least one of a wireless communication system, a wire lined communication systems, a non-public intranet system, a public internet system, a local area network (LAN), or a wide area network (WAN).
9 . A computing device comprising:
an interface configured to interface and communicate with a dispersed or distributed storage network (DSN);
memory that stores operational instructions; and
a processing module operably coupled to the interface and to the memory, wherein the processing module, when operable within the computing device based on the operational instructions, is configured to:
determine DSN traffic and storage usage among a plurality of storage units (SUs) that distributedly stores a set of encoded data slices (EDSs) associated with a data object based on a first system configuration of a Decentralized, or Distributed, Agreement Protocol (DAP), wherein the data object is segmented into a plurality of data segments, wherein a data segment of the plurality of data segments is dispersed error encoded in accordance with dispersed error encoding parameters to produce the set of EDSs, wherein the DSN traffic is associated with data access operations for at least some EDSs of the set of EDSs as performed by at least one other computing device, wherein a decode threshold number of EDSs are needed to recover the data segment, wherein a read threshold number of EDSs provides for reconstruction of the data segment, and wherein a write threshold number of EDSs provides for a successful transfer of the set of EDSs from a first at least one location in the DSN to a second at least one location in the DSN;
when the DSN traffic compares unfavorably with a DSN traffic threshold, configure and deploy at least one additional computing device to service the data access operations for the at least some EDSs of the set of EDSs in cooperation with the at least one other computing device;
when the DSN traffic compares favorably with another DSN traffic threshold and when the at least one other computing device includes at least two computing devices, decommission one of the at least two computing devices from servicing the data access operations for the at least some EDSs of the set of EDSs;
when the storage usage among the plurality of SUs compares unfavorably with a storage usage threshold:
configure and deploy at least one additional SU to store distributedly the set of EDSs in cooperation with the plurality of SUs;
determine a second system configuration of the DAP that corresponds to storage of the set of EDSs cooperatively by the at least one additional SU and the plurality of SUs; and
direct the at least one additional SU and the plurality of SUs to operate based on the second system configuration of the DAP and transmit the second system configuration of the DAP to other computing devices within the DSN.
10 . The computing device of claim 9 , wherein the processing module, when operable within the computing device based on the operational instructions, is further configured to:
when the storage usage among the plurality of SUs compares favorably with another storage usage threshold:
determine a third system configuration of the DAP that corresponds to storage of the set of EDSs by a subset of the plurality of SUs that includes fewer than all of the plurality of SUs to store distributedly the set of EDSs; and
direct the subset of the plurality of SUs to operate based on the third system configuration of the DAP to perform the storage of the set of EDSs and transmit the third system configuration of the DAP to other computing devices within the DSN.
11 . The computing device of claim 9 , wherein the processing module, when operable within the computing device based on the operational instructions, is further configured to:
when the storage usage among the plurality of SUs compares unfavorably with a storage usage threshold and the at least one additional SU is configured and deployed to store distributedly the set of EDSs in cooperation with the plurality of SUs, perform a first EDS balancing operation for the set of EDSs such that each SU of the at least one additional SU and the plurality of SUs stores an approximately same number of EDSs of the set of EDSs; and
when the DSN traffic compares favorably with another DSN traffic threshold and when the at least one other computing device includes at least two computing devices and when the one of the at least two computing devices is decommissioned from servicing the data access operations for the at least some EDSs of the set of EDSs, perform a second EDS balancing operation for the set of EDSs such that each SU of the at least two computing devices excluding the one of the at least two computing devices is decommissioned from the at least two computing devices stores an approximately same number of EDSs of the set of EDSs.
12 . The computing device of claim 9 further comprising:
a SU of the plurality of SUs within the DSN, a wireless smart phone, a laptop, a tablet, a personal computers (PC), a work station, or a video game device.
13 . The computing device of claim 9 , wherein the DSN includes at least one of a wireless communication system, a wire lined communication systems, a non-public intranet system, a public internet system, a local area network (LAN), or a wide area network (WAN).
14 . A method for execution by a computing device, the method comprising:
determining dispersed or distributed storage network (DSN) traffic and storage usage among a plurality of storage units (SUs) that distributedly stores a set of encoded data slices (EDSs) associated with a data object based on a first system configuration of a Decentralized, or Distributed, Agreement Protocol (DAP), wherein the data object is segmented into a plurality of data segments, wherein a data segment of the plurality of data segments is dispersed error encoded in accordance with dispersed error encoding parameters to produce the set of EDSs, and wherein the DSN traffic is associated with data access operations for at least some EDSs of the set of EDSs as performed by at least one other computing device;
when the DSN traffic compares unfavorably with a DSN traffic threshold, configuring and deploying, via an interface of the computing device that is configured to interface and communicate with the DSN, at least one additional computing device to service the data access operations for the at least some EDSs of the set of EDSs in cooperation with the at least one other computing device; and
when the storage usage among the plurality of SUs compares unfavorably with to a storage usage threshold:
configuring and deploying, via the interface of the computing device, at least one additional SU to store distributedly the set of EDSs in cooperation with the plurality of SUs;
determining a second system configuration of the DAP that corresponds to storage of the set of EDSs cooperatively by the at least one additional SU and the plurality of SUs; and
via the interface of the computing device, directing the at least one additional SU and the plurality of SUs to operate based on the second system configuration of the DAP and transmitting the second system configuration of the DAP to other computing devices within the DSN.
15 . The method of claim 14 further comprising:
when the DSN traffic compares favorably with another DSN traffic threshold and when the at least one other computing device includes at least two computing devices, decommissioning one of the at least two computing devices from servicing the data access operations for the at least some EDSs of the set of EDSs.
16 . The method of claim 14 further comprising:
when the storage usage among the plurality of SUs compares favorably with another storage usage threshold:
determining a third system configuration of the DAP that corresponds to storage of the set of EDSs by a subset of the plurality of SUs that includes fewer than all of the plurality of SUs to store distributedly the set of EDSs; and
via the interface of the computing device, directing the subset of the plurality of SUs to operate based on the third system configuration of the DAP to perform the storage of the set of EDSs and transmitting the third system configuration of the DAP to other computing devices within the DSN.
17 . The method of claim 14 further comprising:
when the storage usage among the plurality of SUs compares unfavorably with a storage usage threshold and the at least one additional SU is configured and deployed to store distributedly the set of EDSs in cooperation with the plurality of SUs, performing a first EDS balancing operation for the set of EDSs such that each SU of the at least one additional SU and the plurality of SUs stores an approximately same number of EDSs of the set of EDSs; and
when the DSN traffic compares favorably with another DSN traffic threshold and when the at least one other computing device includes at least two computing devices and when the one of the at least two computing devices is decommissioned from servicing the data access operations for the at least some EDSs of the set of EDSs, performing a second EDS balancing operation for the set of EDSs such that each SU of the at least two computing devices excluding the one of the at least two computing devices is decommissioned from the at least two computing devices stores an approximately same number of EDSs of the set of EDSs.
18 . The method of claim 14 , wherein the computing device is located at a first premises that is remotely located from at least one SU of the plurality of SUs within the DSN.
19 . The method of claim 14 , wherein the computing device is a SU of the plurality of SUs within the DSN, a wireless smart phone, a laptop, a tablet, a personal computers (PC), a work station, or a video game device.
20 . The method of claim 14 , wherein the DSN includes at least one of a wireless communication system, a wire lined communication systems, a non-public intranet system, a public internet system, a local area network (LAN), or a wide area network (WAN).