Providing for increased flexibility for large scale parity
Providing for increased flexibility for large scale parity, the including: writing data to a storage system, including utilizing a first data protection scheme; identifying, for storage media in the storage system, characteristics of the storage media; identifying, in dependence up the characteristics for the storage media, a second data protection scheme to use for the data; and writing the data to the to the storage system utilizing the second data protection scheme.
1. A method comprising:
identifying, for storage media in a storage system, characteristics of the storage media, wherein the storage system includes data stored utilizing a first data protection scheme;
identifying, in dependence upon the characteristics for the storage media, a second data protection scheme to use for the data, wherein the second data protection scheme uses a plurality of distinct data protection groups for the data with cross-group parity information; and
writing the data to the storage system utilizing the second data protection scheme.
2. The method of claim 1 wherein each distinct data protection group includes a locally repairable code.
3. The method of claim 2 wherein writing the data to the to the storage system utilizing the second data protection scheme further comprises creating global parity blocks without re-writing one or more already written data blocks.
4. The method of claim 1 wherein identifying characteristics of the storage media further comprises identifying failure characteristics of the storage media.
5. The method of claim 4 wherein identifying failure characteristics of the storage media further comprises identifying a likelihood of failure for a plurality of storage component domains within a storage medium.
6. The method of claim 1 wherein writing the data to the to the storage system utilizing the second data protection scheme occurs during a garbage collection process.
7. The method of claim 1
wherein the second data protection scheme to use for the data is identified in further dependence of one or more access characteristics for the data.
8. The method of claim 1 wherein the second data protection scheme to use for the data is identified in further dependence of a desired level of service for the data.
9. A storage system comprising a plurality of solid-state storage devices, a computer processor, a computer memory operatively coupled to the computer processor, the computer memory having disposed within it computer program instructions that, when executed by the computer processor, cause the storage system to carry out the steps of:
identifying, for storage media in the storage system, characteristics of the storage media, wherein the storage system includes data stored utilizing a first data protection scheme;
identifying, in dependence upon the characteristics for the storage media, a second data protection scheme to use for the data, wherein the second data protection scheme uses a plurality of distinct data protection groups for the data with cross-group parity information; and
writing the data to at least one of the solid-state storage devices utilizing the second data protection scheme.
10. The storage system of claim 9 wherein each distinct data protection group includes a locally repairable code.
11. The storage system of claim 10 wherein writing the data to at least one of the solid-state storage devices utilizing the second data protection scheme further comprises creating global parity blocks without re-writing one or more already written data blocks.
12. The storage system of claim 9 wherein identifying characteristics of the storage media further comprises identifying failure characteristics of the storage media.
13. The storage system of claim 12 wherein identifying failure characteristics of the storage media further comprises identifying a likelihood of failure for a plurality of storage component domains within a storage device.
14. The storage system of claim 9 wherein writing the data to at least one of the solid-state storage devices utilizing the second data protection scheme occurs during a garbage collection process.
15. A computer program product disposed upon a computer storage readable medium, the computer program product comprising computer program instructions that, when executed, cause a computer to carry out the steps of:
identifying, for storage media in a storage system, characteristics of the storage media, wherein the storage system includes data stored utilizing a first data protection scheme;
identifying, in dependence upon the characteristics for the storage media, a second data protection scheme to use for the data, wherein the second data protection scheme uses a plurality of distinct data protection groups for the data with cross-group parity information; and
storing the data in the storage system utilizing the second data protection scheme.
16. The computer program product of claim 15 wherein each distinct data protection group includes a locally repairable code.
17. The computer program product of claim 16 wherein storing the data in the storage system utilizing the second data protection scheme further comprises creating global parity blocks without re-writing one or more already written data blocks.
18. The computer program product of claim 15 wherein identifying characteristics of the storage media further comprises identifying failure characteristics of the storage media.
19. The computer program product of claim 18 wherein identifying failure characteristics of the storage media further comprises identifying a likelihood of failure for a plurality of storage component domains within a storage medium.
20. The computer program product of claim 15 wherein storing the data in the storage system utilizing the second data protection scheme occurs during a garbage collection process.