Dynamic data storage based on estimated update frequency
A method for execution by a computing device to adjust efficiency of storing data in a storage network includes processing a data segment based on a storage approach to produce a processed data segment, where the storage approach is based on an estimated update frequency for the data segment. The method continues by storing the data segment in the memory of the storage network in accordance with the storage approach.
1. A method for execution by a computing device to adjust efficiency of storing data in a storage network, the method comprises:
obtaining a data segment of the data for storage in memory of the storage network;
obtaining access level information regarding the data segment, wherein the access level information includes an estimated update frequency for the data segment;
processing the data segment based on a storage approach to produce a processed data segment, wherein the storage approach is based on the estimated update frequency of the data segment; and
storing the data segment in memory of the storage network in accordance with the storage approach.
2. The method of claim 1 , wherein the storing the data segment further comprises:
error encoding the processed data segment to produce a set of encoded data slices, wherein a decode threshold number of encoded data slices is needed to recover the processed data segment; and
storing the set of encoded data slices in the memory of the storage network in accordance with the storage approach.
3. The method of claim 1 further comprises:
when the estimated update frequency is less than an update frequency threshold:
determining a cost of decompression factor for the data segment, wherein the cost of decompression factor includes one or more of an estimated incremental processing resource level, and an estimated incremental network utilization reduction level as a result of decompressing the data segment; and
determining the storage approach based on the cost of decompression factor.
4. The method of claim 3 , wherein when the cost of decompression factor is less than or equal to a decompression factor threshold, the storage approach comprises a compression storage approach.
5. The method of claim 3 , wherein when the cost of decompression factor is greater than a decompression factor threshold, the storage approach comprises a non-compression storage approach.
6. The method of claim 1 further comprises:
obtaining access level information regarding the data segment, wherein the access level information includes an estimated retrieval frequency level for the data segment.
7. The method of claim 6 further comprises:
when the estimated retrieval frequency level for the data segment is less than or equal to a retrieval frequency threshold:
determining a cost of compression factor based on resource information, wherein the cost of compression factor includes one or more of an estimated incremental processing resource level, and an estimated incremental network utilization increase level as a result of compressing the data segment; and
determining the storage approach based on the cost of compression factor.
8. The method of claim 6 further comprises:
when the estimated retrieval frequency level for the data segment is greater than a retrieval frequency threshold:
determining a cost of compression factor based on resource information, wherein the cost of compression factor includes one or more of an estimated incremental processing resource level, and an estimated incremental network utilization reduction level as a result of compressing the data segment; and
determining the storage approach based on the cost of compression factor and the access level information.
9. The method of claim 8 , wherein the determining the cost of compression factor comprises one of:
determining the cost of compression factor is less than an average cost of compression factor when the resource information indicates a utilization level of the computing device is less than average; and
determining the cost of compression factor is greater than the average cost of compression factor when the resource information indicates the utilization level of the computing device is greater than average.
10. A computing device of a storage network configured to adjust efficiency of storing data in the storage network, the computing device comprises:
one or more non-transitory memories;
an interface; and
a processing module operably coupled to the one or more non-transitory memories and the interface, wherein the processing module is operable to:
obtain a data segment of the data for storage in memory of the storage network;
obtain access level information regarding the data segment, wherein the access level information includes an estimated update frequency for the data segment;
process the data segment based on a storage approach to produce a processed data segment, wherein the storage approach is based on the estimated update frequency of the data segment; and
store the data segment in the memory of the storage network in accordance with the storage approach.
11. The computing device of claim 10 , wherein the processing module is further operable to store the data segment by:
error encoding the processed data segment to produce a set of encoded data slices, wherein a decode threshold number of encoded data slices is needed to recover the processed data segment; and
sending, via the interface, the set of encoded data slices to the memory of the storage network for storage therein in accordance with the storage approach.
12. The computing device of claim 10 , wherein the processing module is further operable to:
when the estimated update frequency is less than an update frequency threshold:
determine a cost of decompression factor for the data segment, wherein the cost of decompression factor includes one or more of an estimated incremental processing resource level, and an estimated incremental network utilization reduction level as a result of decompressing the data segment; and
determine the storage approach based on the cost of decompression factor.
13. The computing device of claim 12 , wherein when the cost of decompression factor is less than or equal to a decompression factor threshold, the processing module is further operable to determine the storage approach comprises a compression storage approach.
14. The computing device of claim 12 , wherein when the cost of decompression factor is greater than a decompression factor threshold, the processing module is further operable to determine the storage approach comprises a non-compression storage approach.
15. The computing device of claim 10 , wherein the processing module is further operable to:
obtain access level information regarding the data segment, wherein the access level information includes an estimated retrieval frequency level for the data segment.
16. The computing device of claim 15 , wherein the processing module is further operable to:
when the estimated retrieval frequency level for the data segment is less than or equal to a retrieval frequency threshold:
determine a cost of compression factor based on resource information, wherein the cost of compression factor includes one or more of an estimated incremental processing resource level, and an estimated incremental network utilization increase level as a result of compressing the data segment; and
determine the storage approach based on the cost of compression factor.
17. The computing device of claim 15 , wherein the processing module is further operable to:
when the estimated retrieval frequency level for the data segment is greater than a retrieval frequency threshold:
determine a cost of compression factor based on resource information, wherein the cost of compression factor includes one or more of an estimated incremental processing resource level, and an estimated incremental network utilization reduction level as a result of compressing the data segment; and
determine the storage approach based on the cost of compression factor and the access level information.
18. The computing device of claim 17 , wherein the processing module is further operable to determine the cost of compression factor by one of:
determining the cost of compression factor is less than an average cost of compression factor when the resource information indicates a utilization level of the computing device is less than average; and
determining the cost of compression factor is greater than the average cost of compression factor when the resource information indicates the utilization level of the computing device is greater than average.