Storing RAID data as encoded data slices in a dispersed storage network
View Patent ↗A method begins by a processing module receiving data for storage and interpreting the data to identify the data as redundant array of independent disks (RAID) data. The method continues with the processing module interpreting the RAID data to identify at least one of RAID block data and RAID parity data. When the RAID data includes RAID block data and RAID parity data the method continues with the processing module encoding the RAID block data in accordance with error coding dispersal storage function parameters to produce at least one set of encoded data slices and outputting the at least one set of encoded data slices to a dispersed storage network memory.
1. A method for execution by a processing module in a distributed storage (DS) unit, the method comprising:
identifying data that is stored within local redundant array of independent disks (RAID) memory as a set of RAID data blocks and corresponding RAID parity blocks, wherein the local RAID memory is located within local proximity to the DS unit;
partitioning the data into plurality of data segments;
dispersed error encoding a data segment of the plurality of data segments to generate a plurality of error coded (EC) data slices; and
storing the plurality of EC data slices among local dispersed storage network (DSN) memory that is located within the local proximity to the DS unit and remote DSN memory that is located outside of the local proximity to the DS unit.
2. The method of claim 1 further comprising:
storing first one or more EC data slices of the plurality of EC data slices within the local DSN memory that is located within the local proximity to the DS unit; and
storing second one or more EC data slices of the plurality of EC data slices within the remote DSN memory that is located outside of the local proximity to the DS unit.
3. The method of claim 2 , wherein:
the first one or more EC data slices of the plurality of EC data slices includes a decode threshold number of EC data slices of the plurality of EC data slices that is needed to reconstruct the data; and
the second one or more EC data slices of the plurality of EC data slices includes remaining EC data slices of the plurality of EC data slices that are not included in the decode threshold number of EC data slices of the plurality of EC data slices that is needed to reconstruct the data.
4. The method of claim 1 further comprising:
storing no more than a decode threshold number of EC data slices of the plurality of EC data slices that is needed to reconstruct the data within the local DSN memory that is located within the local proximity to the DS unit; and
storing all of the plurality of EC data slices within the remote DSN memory that is located outside of the local proximity to the DS unit.
5. The method of claim 1 further comprising:
storing all of the plurality of EC data slices within the local DSN memory that is located within the local proximity to the DS unit; and
storing all of the plurality of EC data slices within the remote DSN memory that is located outside of the local proximity to the DS unit.
6. The method of claim 1 further comprising:
dispersed error encoding the data segment of the plurality of data segments to generate another plurality of EC data slices, wherein the plurality of EC data slices is based on a first error coding dispersal storage function and the other plurality of EC data slices is based on a second error coding dispersal storage function.
7. The method of claim 1 , wherein:
the DS unit, the RAID memory, and the local DSN memory are located at a first site; and
the remote DSN memory is located at a second site that is geographically different than the first site and that is coupled to the first site via at least one communication network.
8. A distributed storage (DS) processing unit comprises:
a communication interface; and
a processing module configured to:
identify data that is stored within local redundant array of independent disks (RAID) memory as a set of RAID data blocks and corresponding RAID parity blocks, wherein the local RAID memory is located within local proximity to the DS unit;
partition the data into plurality of data segments;
dispersed error encode a data segment of the plurality of data segments to generate a plurality of error coded (EC) data slices; and
store the plurality of EC data slices among local dispersed storage network (DSN) memory that is located within the local proximity to the DS unit and remote DSN memory that is located outside of the local proximity to the DS unit via the communication interface.
9. The DS processing unit of claim 8 , wherein the processing module is further configured to:
store first one or more EC data slices of the plurality of EC data slices within the local DSN memory that is located within the local proximity to the DS unit; and
store, via the communication interface, second one or more EC data slices of the plurality of EC data slices within the remote DSN memory that is located outside of the local proximity to the DS unit.
10. The DS processing unit of claim 9 , wherein:
the first one or more EC data slices of the plurality of EC data slices includes a decode threshold number of EC data slices of the plurality of EC data slices that is needed to reconstruct the data; and
the second one or more EC data slices of the plurality of EC data slices includes remaining EC data slices of the plurality of EC data slices that are not included in the decode threshold number of EC data slices of the plurality of EC data slices that is needed to reconstruct the data.
11. The DS processing unit of claim 8 , wherein the processing module is further configured to:
store no more than a decode threshold number of EC data slices of the plurality of EC data slices that is needed to reconstruct the data within the local DSN memory that is located within the local proximity to the DS unit; and
store, via the communication interface, all of the plurality of EC data slices within the remote DSN memory that is located outside of the local proximity to the DS unit.
12. The DS processing unit of claim 8 , wherein the processing module is further configured to:
store all of the plurality of EC data slices within the local DSN memory that is located within the local proximity to the DS unit; and
store, via the communication interface, all of the plurality of EC data slices within the remote DSN memory that is located outside of the local proximity to the DS unit.
13. The DS processing unit of claim 8 , wherein the processing module is further configured to:
dispersed error encode the data segment of the plurality of data segments to generate another plurality of EC data slices, wherein the plurality of EC data slices is based on a first error coding dispersal storage function and the other plurality of EC data slices is based on a second error coding dispersal storage function.
14. The DS processing unit of claim 8 , wherein:
the DS unit, the RAID memory, and the local DSN memory are located at a first site; and
the remote DSN memory is located at a second site that is geographically different than the first site and that is coupled to the first site via at least one communication network.
15. A non-transitory computer readable medium having instructions causing a processing module in a distributed storage (DS) unit to execute a method comprising:
identifying data that is stored within local redundant array of independent disks (RAID) memory as a set of RAID data blocks and corresponding RAID parity blocks, wherein the local RAID memory is located within local proximity to the DS unit;
partitioning the data into plurality of data segments;
dispersed error encoding a data segment of the plurality of data segments to generate a plurality of error coded (EC) data slices; and
storing the plurality of EC data slices among local dispersed storage network (DSN) memory that is located within the local proximity to the DS unit and remote DSN memory that is located outside of the local proximity to the DS unit.
16. The non-transitory computer readable medium having instructions causing the processing module to execute the method of claim 15 further comprising:
storing first one or more EC data slices of the plurality of EC data slices within the local DSN memory that is located within the local proximity to the DS unit; and
storing second one or more EC data slices of the plurality of EC data slices within the remote DSN memory that is located outside of the local proximity to the DS unit.
17. The non-transitory computer readable medium having instructions causing the processing module to execute the method of claim 16 , wherein:
the first one or more EC data slices of the plurality of EC data slices includes a decode threshold number of EC data slices of the plurality of EC data slices that is needed to reconstruct the data; and
the second one or more EC data slices of the plurality of EC data slices includes remaining EC data slices of the plurality of EC data slices that are not included in the decode threshold number of EC data slices of the plurality of EC data slices that is needed to reconstruct the data.
18. The non-transitory computer readable medium having instructions causing the processing module to execute the method of claim 15 further comprising:
storing no more than a decode threshold number of EC data slices of the plurality of EC data slices that is needed to reconstruct the data within the local DSN memory that is located within the local proximity to the DS unit; and
storing all of the plurality of EC data slices within the remote DSN memory that is located outside of the local proximity to the DS unit.
19. The non-transitory computer readable medium having instructions causing the processing module to execute the method of claim 15 further comprising:
storing all of the plurality of EC data slices within the local DSN memory that is located within the local proximity to the DS unit; and
storing all of the plurality of EC data slices within the remote DSN memory that is located outside of the local proximity to the DS unit.
20. The non-transitory computer readable medium having instructions causing the processing module to execute the method of claim 15 further comprising:
dispersed error encoding the data segment of the plurality of data segments to generate another plurality of EC data slices, wherein the plurality of EC data slices is based on a first error coding dispersal storage function and the other plurality of EC data slices is based on a second error coding dispersal storage function.
21. The non-transitory computer readable medium having instructions causing the processing module to execute the method of claim 15 , wherein:
the DS unit, the RAID memory, and the local DSN memory are located at a first site; and the remote DSN memory is located at a second site that is geographically different than the first site and that is coupled to the first site via at least one communication network.