Storing raid data as encoded data slices in a dispersed storage network
View Patent ↗A method begins by a processing module receiving data for storage and interpreting the data to identify the data as redundant array of independent disks (RAID) data. The method continues with the processing module interpreting the RAID data to identify at least one of RAID block data and RAID parity data. When the RAID data includes RAID block data and RAID parity data the method continues with the processing module encoding the RAID block data in accordance with error coding dispersal storage function parameters to produce at least one set of encoded data slices and outputting the at least one set of encoded data slices to a dispersed storage network memory.
1. A method for execution by a processing module in a distributed storage (DS) unit, the method comprising:
receiving a request to retrieve data;
identifying a set of redundant array of independent disks (RAID) data blocks and corresponding RAID parity blocks that correspond to the data within RAID memory;
when the set of RAID data blocks is error-free or includes correctable errors:
retrieving the data based on the set of RAID data blocks; and
outputting, via a communication interface of the DS unit, the data based on the set of RAID data blocks; and
when the set of RAID data blocks includes more errors than are correctable based on the RAID parity blocks:
retrieving the data based on a backup copy of the data from a dispersed storage network (DSN) memory by:
retrieving a decode threshold number of error coded (EC) data slices of a set of EC data slices from the DSN memory, wherein a data segment of the backup copy of the data is dispersed error encoded to produce the set of EC data slices;
reconstructing the data segment of the backup copy of the data using the decode threshold number of EC data slices; and
reconstructing the backup copy of the data using the data segment; and
outputting, via the communication interface of the DS unit, the data based on the backup copy of the data.
2. The method of claim 1 further comprising:
when the set of RAID data blocks includes more errors than are correctable based on the RAID parity blocks:
generating a copy of the set of RAID data blocks based on the backup copy of the data; and
outputting, via the communication interface of the DS unit, the copy of the set of RAID data blocks.
3. The method of claim 1 further comprising:
when the set of RAID data blocks includes more errors than are correctable based on the RAID parity blocks:
generating a copy of the set of RAID data blocks based on the backup copy of the data; and
transmitting, via the communication interface of the DS unit, a store command accompanied with the copy of the set of RAID data blocks to the RAID memory.
4. The method of claim 1 , wherein:
other data is stored within the DSN memory based on first distributed data storage parameters having a first pillar width number and a first decode threshold number; and
the backup copy of the data is stored within the DSN memory based on second distributed data storage parameters having a second pillar width number and a second decode threshold number, wherein a difference between the second pillar width number and the second decode threshold number is less than a difference between the first pillar width number and the first decode threshold number.
5. The method of claim 1 further comprising:
calculating other RAID parity blocks based on the set of RAID data blocks;
comparing the other RAID parity blocks with the RAID parity blocks;
determining that the set of RAID data blocks is error-free when the other RAID parity blocks compare favorably with the RAID parity blocks; and
determining that the set of RAID data blocks includes one or more errors when the other RAID parity blocks compare unfavorably with the RAID parity blocks.
6. The method of claim 1 , wherein the DSN memory is local DSN memory that is located within local proximity to the DS unit.
7. The method of claim 1 , wherein the DSN memory is remote DSN memory that is included within another at least one DS unit that is located outside of local proximity to the DS unit.
8. A distributed storage (DS) processing unit comprises:
a communication interface; and
a processing module configured to:
receive a request to retrieve data;
identify a set of redundant array of independent disks (RAID) data blocks and corresponding RAID parity blocks that correspond to the data within RAID memory; and
when the set of RAID data blocks is error-free:
retrieve the data based on the set of RAID data blocks; and
output, via the communication interface, the data based on the set of RAID data blocks; and
when the set of RAID data blocks includes more errors than are correctable based on the RAID parity blocks:
retrieve the data based on a backup copy of the data from a dispersed storage network (DSN) memory by:
retrieving a decode threshold number of error coded (EC) data slices of a set of EC data slices from the DSN memory, wherein a data segment of the backup copy of the data is dispersed error encoded to produce the set of EC data slices;
reconstructing the data segment of the backup copy of the data using the decode threshold number of EC data slices; and
reconstructing the backup copy of the data using the data segment; and
output, via the communication interface, the data based on the backup copy of the data.
9. The DS processing unit of claim 8 , wherein the processing module is further configured, when the set of RAID data blocks includes more errors than are correctable based on the RAID parity blocks, to:
generate a copy of the set of RAID data blocks based on the backup copy of the data; and
output, via the communication interface of the DS unit, the copy of the set of RAID data blocks.
10. The DS processing unit of claim 8 , wherein the processing module is further configured, when the set of RAID data blocks includes more errors than are correctable based on the RAID parity blocks, to:
generate a copy of the set of RAID data blocks based on the backup copy of the data; and
transmit, via the communication interface of the DS unit, a store command accompanied with the copy of the set of RAID data blocks to the RAID memory.
11. The DS processing unit of claim 8 , wherein:
other data is stored within the DSN memory based on first distributed data storage parameters having a first pillar width number and a first decode threshold number; and
the backup copy of the data is stored within the DSN memory based on second distributed data storage parameters having a second pillar width number and a second decode threshold number, wherein a difference between the second pillar width number and the second decode threshold number is less than a difference between the first pillar width number and the first decode threshold number.
12. The DS processing unit of claim 8 , wherein the processing module is further configured to:
calculate other RAID parity blocks based on the set of RAID data blocks;
compare the other RAID parity blocks with the RAID parity blocks;
determine that the set of RAID data blocks is error-free when the other RAID parity blocks compare favorably with the RAID parity blocks; and
determine that the set of RAID data blocks includes one or more errors when the other RAID parity blocks compare unfavorably with the RAID parity blocks.
13. The DS processing unit of claim 8 , wherein the DSN memory is local DSN memory that is located within local proximity to the DS unit.
14. The DS processing unit of claim 8 , wherein the DSN memory is remote DSN memory that is included within another at least one DS unit that is located outside of local proximity to the DS unit.
15. A non-transitory computer readable medium having instructions causing a processing module in a distributed storage (DS) unit to execute a method comprising:
receiving a request to retrieve data;
identifying a set of redundant array of independent disks (RAID) data blocks and corresponding RAID parity blocks that correspond to the data within RAID memory;
when the set of RAID data blocks is error-free:
retrieving the data based on the set of RAID data blocks; and
outputting, via a communication interface of the DS unit, the data based on the set of RAID data blocks; and
when the set of RAID data blocks includes more errors than are correctable based on the RAID parity blocks:
retrieving the data based on a backup copy of the data from a dispersed storage network (DSN) memory by:
retrieving a decode threshold number of error coded (EC) data slices of a set of EC data slices from the DSN memory, wherein a data segment of the backup copy of the data is dispersed error encoded to produce the set of EC data slices;
reconstructing the data segment of the backup copy of the data using the decode threshold number of EC data slices; and
reconstructing the backup copy of the data using the data segment; and
outputting, via the communication interface of the DS unit, the data based on the backup copy of the data.
16. The non-transitory computer readable medium having instructions causing the processing module to execute the method of claim 15 further comprising:
when the set of RAID data blocks includes more errors than are correctable based on the RAID parity blocks:
generating a copy of the set of RAID data blocks based on the backup copy of the data; and
outputting, via the communication interface of the DS unit, the copy of the set of RAID data blocks.
17. The non-transitory computer readable medium having instructions causing the processing module to execute the method of claim 15 further comprising:
when the set of RAID data blocks includes more errors than are correctable based on the RAID parity blocks:
generating a copy of the set of RAID data blocks based on the backup copy of the data; and
transmitting, via the communication interface of the DS unit, a store command accompanied with the copy of the set of RAID data blocks to the RAID memory.
18. The non-transitory computer readable medium having instructions causing the processing module to execute the method of claim 15 , wherein:
other data is stored within the DSN memory based on first distributed data storage parameters having first pillar width number and a first decode threshold number; and
the backup copy of the data is stored within the DSN memory based on second distributed data storage parameters having a second pillar width number and a second decode threshold number, wherein a difference between the second pillar width number and the second decode threshold number is less than a difference between the first pillar width number and the first decode threshold number.
19. The non-transitory computer readable medium having instructions causing the processing module to execute the method of claim 15 further comprising:
calculating other RAID parity blocks based on the set of RAID data blocks;
comparing the other RAID parity blocks with the RAID parity blocks;
determining that the set of RAID data blocks is error-free when the other RAID parity blocks compare favorably with the RAID parity blocks; and
determining that the set of RAID data blocks includes one or more errors when the other RAID parity blocks compare unfavorably with the RAID parity blocks.
20. The non-transitory computer readable medium having instructions causing the processing module to execute the method of claim 15 , wherein the DSN memory is local DSN memory that is located within local proximity to the DS unit.
21. The non-transitory computer readable medium having instructions causing the processing module to execute the method of claim 15 , wherein the DSN memory is remote DSN memory that is included within another at least one DS unit that is located outside of local proximity to the DS unit.