IP Library › Patent Application 18660590

Patent Application

App. No. 18/660,590

Incremental Scrubbing of Data in a Distributed Storage Network

Loading inventors, assignments & file history…

Monitor This Case

Get email alerts when status or documents change.

Order Certified Copies

Most orders are placed with the USPTO same day — all within 24 business hours.

Order via The Patent Place →

Pre-filled with this patent's details

Quick Facts

Patent No.: US None
App. No.: 18/660,590

External Links

USPTO Patent Center↗ Full Patent PDF↗

Abstract

A storage network method begins by determining to initiate periodic integrity checks for a plurality of data objects stored in the storage network, where a data object is dispersed error encoded in accordance with dispersed error encoding parameters to produce a plurality of sets of encoded data slices. The method continues by determining a frequency for performing the periodic integrity checks and determining, based on the frequency for performing the periodic integrity checks, a portion of a data object for a first integrity check, where the portion includes one or more encoded data slices of the plurality of sets of encoded data slices. The method then continues by issuing a list data request for the portion of the data object, receiving a list data response for the portion of the one or more data objects and determining whether the list data response indicates a data error for the portion of the one or more data objects. Finally, the method concludes by indicating a data error and updating an error log associated with the plurality of data objects.

Claims (50)

1 . A method for execution by one or more modules of one or more processors of a storage network comprises:

determining to initiate periodic integrity checks for a plurality of data objects stored in the storage network, wherein a data object is dispersed error encoded in accordance with dispersed error encoding parameters to produce a plurality of sets of encoded data slices;

determining, for one or more data objects of the plurality of data objects, a frequency for performing the periodic integrity checks;

determining, based on the frequency for performing the periodic integrity checks, a portion of the one or more data objects for a first integrity check of the periodic integrity checks, wherein a portion includes one or more encoded data slices of the plurality of sets of encoded data slices;

issuing a list data request for the portion of the one or more data objects;

receiving a list data response for the portion of the one or more data objects;

determining whether the list data response indicates a data error for the portion of the one or more data objects; and

in response to the list data response indicating a data error, updating an error log associated with the plurality of data objects.

2 . The method of claim 1 , wherein the frequency for performing the periodic integrity checks is determined based on a historical error rate for the one or more data objects.

3 . The method of claim 2 , wherein the frequency for performing the periodic integrity checks is modified based on a historical error rate for the one or more data objects.

4 . The method of claim 2 , wherein the frequency for performing the periodic integrity checks is increased when the historical error rate for the one or more data objects is higher than a previously determined average error rate.

5 . The method of claim 1 , wherein the frequency for performing the periodic integrity checks is determined based on a data type.

6 . The method of claim 5 , wherein the frequency for performing the periodic integrity checks is modified based on a data type.

7 . The method of claim 5 , wherein the frequency for performing the periodic integrity checks is increased when the data type includes database files.

8 . The method of claim 5 , wherein the frequency for performing the periodic integrity checks is decreased when the data type includes at least one of backup files, log files or unstructured data.

9 . The method of claim 1 , further comprising:

in response to the list data response indicating a data error, scheduling a rebuilding function for the portion of the one or more data objects.

10 . The method of claim 1 , further comprising:

in response to the list data response indicating a data error, transmitting a hardware failure notification to another storage network entity.

11 . A computing device comprises:

an interface configured to interface and communicate with a storage network;

memory that stores operational instructions; and

a processing module operably coupled to the interface and to the memory, wherein the processing module, when operable within the computing device based on the operational instructions, is configured to:

determine to initiate periodic integrity checks for a plurality of data objects stored in the storage network, wherein a data object is dispersed error encoded in accordance with dispersed error encoding parameters to produce a plurality of sets of encoded data slices;

determine, for one or more data objects of the plurality of data objects, a frequency for performing the periodic integrity checks;

determine, based on the frequency for performing the periodic integrity checks, a portion of the one or more data objects for a first integrity check of the periodic integrity checks, wherein a portion includes one or more encoded data slices of the plurality of sets of encoded data slices;

issue a list data request for the portion of the one or more data objects;

receive a list data response for the portion of the one or more data objects;

determine whether the list data response indicates a data error for the portion of the one or more data objects; and

in response to the list data response indicating a data error, update an error log associated with the plurality of data objects.

12 . The computing device of claim 11 , wherein the frequency for performing the periodic integrity checks is determined based on a historical error rate for the one or more data objects.

13 . The computing device of claim 12 , wherein the frequency for performing the periodic integrity checks is modified based on a historical error rate for the one or more data objects.

14 . The computing device of claim 12 , wherein the frequency for performing the periodic integrity checks is increased when the historical error rate for the one or more data objects is higher than a previously determined average error rate.

15 . The computing device of claim 11 , wherein the frequency for performing the periodic integrity checks is determined based on a data type.

16 . The computing device of claim 15 , wherein the frequency for performing the periodic integrity checks is modified based on a data type.

17 . The computing device of claim 15 , wherein the frequency for performing the periodic integrity checks is increased when the data type includes database files.

18 . The computing device of claim 15 , wherein the frequency for performing the periodic integrity checks is decreased when the data type includes at least one of backup files, log files or unstructured data.

19 . The computing device of claim 11 , further comprising: