Efficient computation of parity data in storage system implementing data striping
In an information processing system including a set of data storage devices for storing data blocks arranged in respective columns on each data storage device and rows across the set of data storage devices to form at least one data stripe, and a set of parity storage devices for storing parity blocks computed via one or more parity operations based on the data blocks of the at least one data stripe, at least one of the data storage devices includes a processing device configured to: receive from the information processing system an instruction to perform at least a portion of a parity operation; perform the portion of the parity operation; and send a result of the performed portion of the parity operation to the information processing system, wherein the result is useable by the information processing system for performing another portion of the parity operation.
1. An apparatus comprising:
in an information processing system implementing data striping, wherein the information processing system comprises a set of data storage devices for storing data blocks arranged in respective columns on each data storage device and rows across the set of data storage devices to form at least one data stripe; and a set of parity storage devices for storing parity blocks computed via one or more parity operations based on the data blocks of the at least one data stripe;
at least one of the data storage devices comprising a processing device configured to:
receive an instruction from the information processing system to perform at least a portion of a parity operation;
perform the portion of the parity operation in response to the instruction; and
send a result of the performed portion of the parity operation to the information processing system, wherein the result is useable by the information processing system for performing another portion of the parity operation.
2. The apparatus of claim 1 , wherein the portion of the parity operation performed by the processing device of the at least one data storage device comprises performing a column parity operation.
3. The apparatus of claim 2 , wherein the column parity operation comprises performing an XOR operation on at least a portion of the column of data blocks stored in the at least one data storage device to generate column parity data.
4. The apparatus of claim 3 , wherein the column parity data is the result sent to the information processing system.
5. The apparatus of claim 4 , wherein the column parity data is combinable with other forms of parity data storable on at least one of the set of parity storage devices.
6. The apparatus of claim 5 , wherein the column parity data is combinable with diagonal parity data computed for the at least one data stripe.
7. The apparatus of claim 1 , wherein the set of data storage devices and the set of parity storage devices are part of a Redundant Array of Independent Disks (RAID) storage system.
8. The apparatus of claim 7 , wherein the number of data storge devices in the RAID storage system comprises a prime number k, and wherein a column of the RAID storage system comprises k−1 blocks.
9. The apparatus of claim 7 , wherein the RAID storage system implements RAID 6 with the number of data storage devices being k and the number of parity storage devices being n, where n is greater than one.
10. The apparatus of claim 1 , wherein the set of data storage devices and the set of parity storage devices comprise solid state drives (SSDs).
11. The apparatus of claim 10 , wherein the processing device associated with the at least one data storage device comprising one or more of a central processing unit and a hardware accelerator internal to the SSD.
12. A method comprising:
in an information processing system implementing data striping, wherein the information processing system comprises a set of data storage devices for storing data blocks arranged in respective columns on each data storage device and rows across the set of data storage devices to form at least one data stripe; and a set of parity storage devices for storing parity blocks computed via one or more parity operations based on the data blocks of the at least one data stripe;
receiving by at least one of the data storage devices comprising a processing device configured to an instruction from the information processing system to perform at least a portion of a parity operation;
performing by the processing device of the at least one data storage device the portion of the parity operation in response to the instruction; and
sending a result of the performed portion of the parity operation from the at least one data storage device to the information processing system, wherein the result is useable by the information processing system for performing another portion of the parity operation.
13. The method of claim 12 , wherein the portion of the parity operation performed by the processing device of the at least one data storage device comprises performing a column parity operation.
14. The method of claim 13 , wherein the column parity operation comprises performing an XOR operation on at least a portion of the column of data blocks stored in the at least one data storage device to generate column parity data.
15. The method of claim 14 , wherein the column parity data is the result sent to the information processing system.
16. The method of claim 15 , wherein the column parity data is combinable with other forms of parity data storable on at least one of the set of parity storage devices.
17. The method of claim 16 , wherein the column parity data is combinable with diagonal parity data computed for the at least one data stripe.
18. The method of claim 12 , wherein the set of data storage devices and the set of parity storage devices are part of a Redundant Array of Independent Disks (RAID) storage system.
19. The method of claim 11 , wherein the processing device associated with the at least one data storage device comprises one or more of a central processing unit and a hardware accelerator internal to the SSD.
20. A computer program product comprising a non-transitory processor-readable storage medium having stored therein program code of one or more software programs wherein:
in an information processing system implementing data striping, wherein the information processing system comprises a set of data storage devices for storing data blocks arranged in respective columns on each data storage device and rows across the set of data storage devices to form at least one data stripe; and a set of parity storage devices for storing parity blocks computed via one or more parity operations based on the data blocks of the at least one data stripe, the program code when executed by a processing device associated with at least one of the data storage devices causes said at least one data storage device to:
receive an instruction from the information processing system to perform at least a portion of a parity operation;
perform the portion of the parity operation in response to the instruction; and
send a result of the performed portion of the parity operation to the information processing system, wherein the result is useable by the information processing system for performing another portion of the parity operation.