Method and system for detecting and correcting data errors using checksums and replication

1. A method for servicing a read request for a data block stored on a storage device, comprising:

obtaining a first indirect block,

wherein the first indirect block comprises an indirect block location of a second indirect block and a first indirect block checksum for the second indirect block,

wherein the first indirect block and the second indirect block form a hierarchy for obtaining the data block, and

wherein the second indirect comprises a data block location of the data block;

calculating a second indirect block checksum for the second indirect block;

determining that the second indirect block is corrupted when the first indirect block checksum does not equal the second indirect block checksum;

retrieving data from the data block using a copy of the second indirect block when the second indirect block is corrupted; and

repairing the second indirect block using the copy of the second indirect block when the second indirect block is corrupted.

2. A computer system, comprising:

a processor;

a memory;

a storage device; and

software instructions stored in the memory for enabling the computer system, under control of the processor, to:

obtain a first indirect block,

wherein the first indirect block comprises an indirect block location of a second indirect block and a first indirect block checksum for the second indirect block,

wherein the first indirect block and the second indirect block form a hierarchy for obtaining the data block, and

wherein the second indirect comprises a data block location of the data block;

calculate a second indirect block checksum for the second indirect block;

determine that the second indirect block is corrupted when the first indirect block checksum does not equal the second indirect block checksum;

retrieve data from the data block using a copy of the second indirect block when the second indirect block is corrupted; and

repair the second indirect block using the copy of the second indirect block when the second indirect block is corrupted.

3. The method of claim 1 , further comprising:

calculating a third indirect block checksum for the copy of the indirect block;

determining that the copy of the second indirect block is corrupted when the third indirect block checksum does not equal the first indirect block checksum; and

performing an appropriate action when the copy of the second indirect block is corrupted.

4. The method of claim 3 , wherein performing the appropriate action comprises generating an error message.

5. The method of claim 1 , wherein the second indirect block further comprises a first data block checksum for the data block, the method further comprising:

calculating a second data block checksum for the data block;

determining that the data block is corrupted when the first data block checksum does not equal the second data block checksum; and

retrieving data from a copy of the data block when the data block is corrupted.

6. The method of claim 5 , further comprising:

repairing the data block using the copy of the data block when the data block is corrupted.

7. The method of claim 5 , further comprising:

calculating a third data block checksum for the copy of the data block;

determining that the copy of the data block is corrupted when the third data block checksum does not equal the first data block checksum; and

performing an appropriate action when the copy of the data block is corrupted.

8. The method of claim 7 , wherein performing the appropriate action comprises generating an error message.

9. The method of claim 1 , wherein the second indirect block is stored on a first storage device, the copy of the second indirect block is stored on a second storage device, and the second storage device is a mirror of the first storage device.

10. The computer system of claim 2 , further comprising software instructions for enabling the computer system to:

calculate a third indirect block checksum for the copy of the indirect block;

determine that the copy of the second indirect block is corrupted when the third indirect block checksum does not equal the first indirect block checksum; and

perform an appropriate action when the copy of the second indirect block is corrupted.

11. The computer system of claim 10 , wherein software instructions to perform the appropriate action comprise software instructions to generate an error message.

12. The computer system of claim 2 , wherein the second indirect block comprises further a first data block checksum for the data block, the computer system further comprising software instructions for enabling the computer system to:

calculate a second data block checksum for the data block;

determine that the data block is corrupted when the first data block checksum does not equal the second data block checksum; and

retrieve data from a copy of the data block when the data block is corrupted.

13. The computer system of claim 12 , further comprising software instructions for enabling the computer system to:

repair the data block using the copy of the data block when the data block is corrupted.

14. The computer system of claim 12 , further comprising software instructions for enabling the computer system to:

calculate a third data block checksum for the copy of the data block;

determine that the copy of the data block is corrupted when the third data block checksum does not equal the first data block checksum; and

perform an appropriate action when the copy of the data block is corrupted.

15. The computer system of claim 14 , wherein software instructions to perform the appropriate action comprise software instructions to generate an error message.

16. The computer system of claim 2 , wherein the second indirect block is stored on a first storage device, the copy of the second indirect block is stored on a second storage device, and the second storage device is a mirror of the first storage device.

17. A system comprising:

a storage pool comprising:

a data block,

a first indirect block,

a second indirect block, and

a copy of the second indirect block,

wherein the first indirect block comprises an indirect block location of the second indirect block and a first indirect block checksum for the second indirect block,

wherein the first indirect block and the second indirect block form a hierarchy for obtaining the data block, and

wherein the second indirect comprises a data block location of the data block; and

a file system configured to:

obtain the first indirect block,

calculate a second indirect block checksum for the second indirect block, determine that the second indirect block is corrupted when the first indirect block checksum does not equal the second indirect block checksum,

retrieve data from the data block using the copy of the second indirect block when the second indirect block is corrupted, and

repair the second indirect block using the copy of the second indirect block when the second indirect block is corrupted.

18. The system of claim 17 , wherein the file system is further configured to:

calculate a third indirect block checksum for the copy of the indirect block;

determine that the copy of the second indirect block is corrupted when the third indirect block checksum does not equal the first indirect block checksum; and

perform an appropriate action when the copy of the second indirect block is corrupted.

19. The computer system of claim 18 , wherein the file system is configured to perform the appropriate action by generating an error message.

20. The system of claim 17 ,

wherein the second indirect block further comprises a first data block checksum for the data block,

wherein the storage pool further comprises a copy of the data block, and

wherein the file system is further configured to:

calculate a second data block checksum for the data block,

determine that the data block is corrupted when the first data block checksum does not equal the second data block checksum, and

retrieve data from a copy of the data block when the data block is corrupted.

21. The system of claim 20 , wherein the file system is further configured to:

repair the data block using the copy of the data block when the data block is corrupted.

22. The system of claim 20 , wherein the file system is further configured to:

calculate a third data block checksum for the copy of the data block;

determine that the copy of the data block is corrupted when the third data block checksum does not equal the first data block checksum; and

perform an appropriate action when the copy of the data block is corrupted.

23. The system of claim 22 , wherein the file system is configured to perform the appropriate action by generating an error message.

24. The system of claim 17 , wherein the second indirect block is stored on a first storage device, the copy of the second indirect block is stored on a second storage device, and the second storage device is a mirror of the first storage device.