Prioritizing dispersed storage network memory operations during a critical juncture
View Patent ↗A method for prioritizing dispersed storage network memory (DSN) operations during a critical juncture. The method begins by a device of the DSN, during a data access request, determining when a DSN memory operation related to the data access request is at a critical juncture. A decode threshold number of encoded data slices is required to recover the data segment, a write threshold number of encoded data slices is required for a successful write operation, and the critical juncture includes the DSN memory operation being within one of a first offset of the decode threshold number and a second offset of the write threshold number. When the DSN memory operation is at the critical juncture, the method continues with detecting an outstanding action with respect to the DSN memory operation, suspending execution of non-critical DSN operations and prioritizing execution of the outstanding action.
1. A method comprises:
for a data access request, determining, by a device of devices of the dispersed storage network (DSN), when a DSN memory operation related to the data access request is at a critical juncture, wherein the data access request is regarding a set of encoded data slices that are stored or to be stored in a set of storage units of the DSN, wherein a data segment is dispersed storage error encoded to produce the set of encoded data slices, wherein a decode threshold number of encoded data slices of the set of encoded data slices is required to recover the data segment, wherein a write threshold number of encoded data slices of the set of encoded data slices is required for a successful write operation, wherein the critical juncture includes the DSN memory operation being within one of a first offset of the decode threshold number and a second offset of the write threshold number; and
when the DSN memory operation is at the critical juncture:
detecting, by one or more of the devices, an outstanding action with respect to the DSN memory operation;
suspending, by the one or more of the devices, execution of non-critical DSN operations; and
prioritizing, by the one or more of the devices, execution of the outstanding action.
2. The method of claim 1 , wherein the devices comprise:
the set of storage units; and
one or more dispersed storage (DS) processing units.
3. The method of claim 1 , wherein the determining the DSN memory operation is at the critical juncture comprises:
receiving, by a storage unit of the set of storage units as one of the devices, a message indicated the DSN memory operation is at the critical juncture.
4. The method of claim 1 , wherein the determining the DSN memory operation is at the critical juncture comprises:
receiving, by a dispersed storage (DS) processing unit of the DSN as one of the devices, data read responses from some of the set of storage units, wherein the DSN memory operation is a read operation; and
when the number of data read responses is equal to the decode threshold number less the first offset, indicating the DSN memory operation is in the critical juncture.
5. The method of claim 1 , wherein the determining the DSN memory operation is at the critical juncture comprises:
receiving, by a dispersed storage (DS) processing unit of the DSN as one of the devices, data write responses from some of the set of storage units, wherein the DSN memory operation is a write operation; and
when the number of data write responses is equal to the write threshold number less the second offset, indicating the DSN memory operation is in the critical juncture.
6. The method of claim 1 , wherein the non-critical DSN operations comprises one or more of:
lower priority DSN memory operations;
garbage collection;
disk rebalancing;
bin file compaction;
thread dumps; and
rebuilding.
7. The method of claim 1 further comprises:
after execution of the outstanding action, resuming, by the one or more of the devices, the execution of the non-critical DSN operations.
8. A computer readable storage device comprises:
a first memory section for storing operational instructions that, when executed by a device of devices of a dispersed storage network (DSN), causes the device to:
for a data access request, determine, when a DSN memory operation related to the data access request is at a critical juncture, wherein the data access request is regarding a set of encoded data slices that are stored or to be stored in a set of storage units of the DSN, wherein a data segment is dispersed storage error encoded to produce the set of encoded data slices, wherein a decode threshold number of encoded data slices of the set of encoded data slices is required to recover the data segment, wherein a write threshold number of encoded data slices of the set of encoded data slices is required for a successful write operation, wherein the critical juncture includes the DSN memory operation being within one of a first offset of the decode threshold number and a second offset of the write threshold number; and
a second memory section for storing operational instructions that, when executed by one or more of the devices of a dispersed storage network (DSN), causes the one or more of the devices to:
when the DSN memory operation is at the critical juncture:
detecting an outstanding action with respect to the DSN memory operation;
suspending execution of non-critical DSN operations; and
prioritizing execution of the outstanding action.
9. The computer readable storage device of claim 8 , wherein the devices comprise:
the set of storage units; and
one or more dispersed storage (DS) processing units.
10. The computer readable storage device of claim 8 further comprises:
a third memory section for storing operational instructions that, when executed by a storage unit of the set of storage units as one of the devices of the dispersed storage network (DSN), causes the storage unit to determine the DSN memory operation is at the critical juncture by:
receiving a message indicated the DSN memory operation is at the critical juncture.
11. The computer readable storage device of claim 8 further comprises:
a fourth memory section for storing operational instructions that, when executed by a dispersed storage (DS) processing unit of the dispersed storage network (DSN), causes the dispersed storage (DS) processing unit to determine the DSN memory operation is at the critical juncture by:
receiving data read responses from some of the set of storage units, wherein the DSN memory operation is a read operation; and
when the number of data read responses is equal to the decode threshold number less the first offset, indicating the DSN memory operation is in the critical juncture.
12. The computer readable storage device of claim 8 further comprises:
a fourth memory section for storing operational instructions that, when executed by a dispersed storage (DS) processing unit of the dispersed storage network (DSN), causes the dispersed storage (DS) processing unit to determine the DSN memory operation is at the critical juncture by:
receiving data write responses from some of the set of storage units, wherein the DSN memory operation is a write operation; and
when the number of data write responses is equal to the write threshold number less the second offset, indicating the DSN memory operation is in the critical juncture.
13. The computer readable storage device of claim 8 , wherein the non-critical DSN operations comprises one or more of:
lower priority DSN memory operations;
garbage collection;
disk rebalancing;
bin file compaction;
thread dumps; and
rebuilding.
14. The computer readable storage device of claim 8 , further comprises:
a fifth memory section for storing operational instructions that, when executed by one or more of the devices of a dispersed storage network (DSN), causes the one or more of the devices to:
after execution of the outstanding action, resume the execution of the non-critical DSN operations.