Pro-actively preparing a dispersed storage network memory for higher-loads
A method for execution by one or more processing modules of one or more computing devices of a dispersed storage network (DSN), the method begins by maintaining dispersed storage network (DSN) storage and maintenance loading information. The method continues by estimating a future data access task rate and determining a probability level of potential future data loss based on the estimated future data access task rate. The method continues, when the probability level of the potential future data loss compares unfavorably to a maximum probability of data loss threshold level, by facilitating execution of a preventative data loss mitigation process and when a current data access task rate is greater than a maximum task rate level, suspending the execution of the preventative data loss mitigation process.
1. A method for execution by one or more processing modules of one or more computing devices of a distributed storage network (DSN), the method comprises:
maintaining distributed storage network (DSN) storage and maintenance loading information, wherein data is stored as sets of encoded data slices;
estimating a future data access task rate;
determining a probability level of potential future data loss based on the estimated future data access task rate;
facilitating, upon the probability level of potential future data loss comparing unfavorably to a maximum probability of data loss threshold level, execution of a preventative data loss mitigation process, wherein the facilitating includes one or more of: storing additional encoded data slices of each set of newly stored encoded data slices, prioritizing maintenance tasks, or de-prioritizing data access tasks; and
suspending, upon a current data accesstask rate being greater than a maximum task rate level, the execution of the preventative data loss mitigation process.
2. The method of claim 1 , wherein the storage and maintenance loading information include storage rates of data access and maintenance tasks versus time in a local memory.
3. The method of claim 1 , wherein the estimating includes generating the future data access task rate based on one or more of: the DSN loading information, interpreting a task queue, interpreting current loading rates, interpreting a schedule, or interpreting a message.
4. The method of claim 1 , wherein the determining includes at least one of: estimating a future capacity for execution of maintenance tasks based on the estimated future data access rate or estimating a data retrieval reliability level based on an estimated future capacity for execution of maintenance tasks.
5. The method of claim 1 , wherein the storing additional slices of each set of newly stored encoded data slices includes increasing a write threshold number.
6. The method of claim 1 , wherein the data is stored as sets of encoded data slices and the suspending includes one or more of: storing fewer slices of each set of newly stored encoded data slices, or prioritizing data access tasks.
7. The method of claim 6 , wherein the storing fewer slices of each set of newly stored encoded data slices includes decreasing a read threshold number.
8. A computing device of a group of computing devices of a distributed storage network (DSN), the computing device comprises:
an interface;
a local memory; and
a processing module operably coupled to the interface and the local memory, wherein the processing module functions to:
maintain distributed storage network (DSN) storage and maintenance loading information, wherein data is stored as sets of encoded data slices;
estimate a future data access task rate;
determine a probability level of potential future data loss based on the estimated future data access task rate; and
facilitate, upon the probability level of potential future data loss comparing unfavorably to a maximum probability of data loss threshold level, execution of a preventative data loss mitigation process, wherein the facilitation includes one or more of: storing additional slices of each set of newly stored encoded data slices, prioritizing maintenance tasks, or de-prioritizing data access tasks; and
suspend, upon a current data access task rate being greater than a maximum task rate level, the execution of the preventative data loss mitigation process.
9. The computing device of claim 8 , wherein the storage and maintenance loading information include storage rates of data access and maintenance tasks versus time in a local memory.
10. The computing device of claim 8 , wherein the estimate a future data access task rate includes generating the future data access task rate based on one or more of: the DSN loading information, interpreting a task queue, interpreting current loading rates, interpreting a schedule, or interpreting a message.
11. The computing device of claim 8 , wherein the determine a probability level of potential future data loss based on the estimated future data access task rate includes at least one of: estimating a future capacity for execution of maintenance tasks based on the estimated future data access rate or estimating a data retrieval reliability level based on an estimated future capacity for execution of maintenance tasks.
12. The computing device of claim 8 , wherein the storing additional slices of each set of newly stored encoded data slices includes increasing a write threshold number.
13. The computing device of claim 8 , wherein the data is stored as sets of encoded data slices and the suspend, upon a current data access task rate being greater than a maximum task rate level, the execution of the preventative data loss mitigation process includes one or more of: storing fewer slices of each set of newly stored encoded data slices, or prioritizing data access tasks.
14. The computing device of claim 13 , wherein the storing fewer slices of each set of newly stored encoded data slices includes decreasing a read threshold number.
15. A system comprises:
an interface;
a local memory; and
a processing module operably coupled to the interface and the local memory, wherein the processing module functions to:
maintain distributed storage network (DSN) storage and maintenance loading information, wherein data is stored as sets of encoded data slices;
estimate a future data access task rate;
determine a probability level of potential future data loss based on the estimated future data access task rate; and
facilitate, when the probability level of potential future data loss compares unfavorably to a maximum probability of data loss threshold level, execution of a preventative data loss mitigation process, wherein the facilitating includes one or more of: storing additional encoded data slices of each set of newly stored encoded data slices, prioritizing maintenance tasks, or de-prioritizing data access tasks; and
suspend, when a current data access task rate is greater than a maximum task rate level, the execution of the preventative data loss mitigation process.
16. The system of claim 15 , wherein the storage and maintenance loading information include storage rates of data access and maintenance tasks versus time in a local memory.
17. The system of claim 15 , wherein the estimate a future data access task rate includes generating the future data access task rate based on one or more of: the DSN loading information, interpreting a task queue, interpreting current loading rates, interpreting a schedule, or interpreting a message.
18. The system of claim 15 , wherein the determine a probability level of potential future data loss based on the estimated future data access task rate includes at least one of: estimating a future capacity for execution of maintenance tasks based on the estimated future data access rate or estimating a data retrieval reliability level based on an estimated future capacity for execution of maintenance tasks.