Data re-protection in a distributed replicated data storage system
Data re-protection in a distributed replicated data storage system is disclosed. The method may be implemented on a server or controller. A method includes storing first data in a first zone and storing a replica of the first data in a second zone. The zones are at different, separate locations. When an actual or impending failure with the first data in the first zone is detected, the system automatically initiates transitioning to a copy of impacted data at the first zone obtained from the second zone. The transitioning includes creating a remote copy of the impacted data at the second zone within a local area network before transferring the copy to the first zone over a wide area network. The methods allow the system to return to a fully protected state faster than if the impacted data was transferred from the second zone to the first zone without making a copy at the second zone.
1. A method of re-protecting data included in a storage zone of a distributed replicated data storage system, the method comprising:
storing first data in a first storage zone at a first location of the distributed replicated data storage system
storing a replica of the first data as replicated data in a second storage zone at a remote location as replicated data, wherein the remote location is different from and separate from the first location
detecting an actual or impending failure or problem with a portion of the first data or a storage device included in the first storage zone including designating an at risk portion of the first data, a missing portion of the first data or an impaired portion of the first data as impacted data
automatically transitioning to a replacement copy of the impacted data at the first storage zone in response to the detecting, the transitioning including
creating a remote copy of the impacted data from the replicated data at the second storage zone at the remote location within a local area network
transferring the remote copy from the second storage zone at the remote location to the first storage zone at the first location over the wide area network
reconfiguring the first location so that the copy of the impacted data is accessed in place of the impacted data.
2. The method of claim 1 wherein the first storage zone and the second storage zone each include a plurality of storage nodes.
3. The method of claim 2 wherein the plurality of storage nodes each include a plurality of storage media.
4. The method of claim 3 wherein the plurality of storage media include at least one of hard disk drives and silicon storage devices.
5. The method of claim 1 further comprising:
removing the remote copy from the second storage zone at the remote location after the reconfiguring is completed.
6. The method of claim 1 wherein the first data, the impacted data, the replicated data, the missing data, and the remote copy are all stored as and accessed as a plurality of objects.
7. The method of claim 1 wherein the distributed replicated data storage system is configured as a fully active system in which the first data and replicated are accessed regularly.
8. The method of claim 1 wherein the distributed replicated data storage system is configured as an active-passive system in which the first data is a primary data and the replicated data is accessed for backup purposes.
9. The method of claim 1 wherein an effective data transfer speed over a wide area network is slow in comparison to a local area network data transfer speed over the local area network of the second storage zone.
10. The method of claim 1 wherein a wide area network data transfer speed over the wide area network is in the range from 10 to 500 Mbps and a local area network data transfer speed over the local area network of the secondary storage zone is in the range from 1 to 100 Gbps.
11. A storage medium having instructions stored thereon which when executed by a processor cause the processor to perform actions comprising:
storing first data in a first storage zone at a first location of a distributed replicated data storage system
storing a replica of the first data as replicated data in a second storage zone at a remote location as replicated data, wherein the remote location is different from and separate from the first location
detecting an actual or impending failure or problem with a portion of the first data or a storage device included in the first storage zone, including designating an at risk portion of the first data, a missing portion of the first data or an impaired portion of the first data as impacted data
automatically transitioning to a replacement copy of the impacted data at the first storage zone in response to the detecting, the transitioning including
creating a remote copy of the impacted data from the replicated data at the second zone at the remote location within a local area network
transferring the remote copy from the second storage zone at the remote location to the first storage zone at the first location over the wide area network
reconfiguring the first location so that the copy of the impacted data is accessed in place of the impacted data.
12. The storage medium of claim 11 wherein the first storage zone and the second storage zone each include a plurality of storage nodes.
13. The storage medium of claim 12 wherein the plurality of storage nodes each include a plurality of storage media.
14. The storage medium of claim 13 wherein the plurality of storage media include at least one of hard disk drives and silicon storage devices.
15. The storage medium of claim 11 having further instructions which when executed cause the processor to perform further actions comprising:
removing the remote copy from the second storage zone at the remote location after the reconfiguring is completed.
16. The storage medium of claim 11 wherein the first data, the impacted data, the replicated data, the missing data, and the remote copy are all stored as and accessed as a plurality of objects.
17. The storage medium of claim 11 wherein the distributed replicated data storage system is configured as a fully active system in which the first data and replicated data are accessed regularly.
18. The storage medium of claim 11 wherein the distributed replicated data storage system is configured as an active-passive system in which the first data is accessed as primary data and the replicated data is accessed for backup purposes.
19. The storage medium of claim 11 wherein an effective data transfer speed over a wide area network is slow in comparison to a local area network data transfer speed over the local area network of the second storage zone.
20. The storage medium of claim 11 wherein a wide area network data transfer speed over the wide area network is in the range from 10 to 500 Mbps and a local area network data transfer speed over the local area network of the secondary storage zone is in the range from 1 to 100 Gbps.
21. A computing device to manage a plurality of storage nodes of storage devices arranged as two or more storage zones in a distributed replicated data storage system, the computing device comprising:
a processor;
a memory coupled with the processor;
a computer readable storage medium having instructions stored thereon which when executed cause the computing device to perform actions comprising:
storing first data in a first storage zone at a first location of the distributed replicated data storage system
storing a replica of the first data as replicated data in a second storage zone at a remote location as replicated data, wherein the remote location is different from and separate from the first location
detecting an actual or impending failure or problem with a portion of the first data or a storage device included in the first storage zone, including designating an at risk portion of the first data, a missing portion of the first data or an impaired portion of the first data as impacted data
automatically transitioning to a replacement copy of the impacted data at the first storage zone in response to the detecting, the transitioning including
creating a remote copy of the impacted data from the replicated data at the second zone at the remote location within a local area network
transferring the remote copy from the second storage zone at the remote location to the first storage zone at the first location over the wide area network
reconfiguring the first location so that the copy of the impacted data is accessed in place of the impacted data.
22. The computing device of claim 21 wherein the first storage zone and the second storage zone each include a plurality of storage nodes.
23. The computing device of claim 22 wherein the plurality of storage nodes each include a plurality of storage media.
24. The computing device of claim 23 wherein the plurality of storage media include at least one of hard disk drives and silicon storage devices.
25. The computing device of claim 21 wherein the computer readable storage medium has further instructions which when executed cause the computing device to perform further actions comprising:
removing the remote copy from the second storage zone at the remote location after the reconfiguring is completed.
26. The computing device of claim 21 wherein the first data, the replicated data, the impacted data, the missing data, and the remote copy are all stored as and accessed as a plurality of objects.
27. The computing device of claim 21 wherein the distributed replicated data storage system is configured as a fully active system in which the first data and replicated data are accessed regularly.
28. The computing device of claim 21 wherein the distributed replicated data storage system is configured as an active-passive system in which the first data is accessed as primary data and the replicated data is accessed for backup purposes.
29. The computing device of claim 21 wherein an effective data transfer speed over a wide area network is slow in comparison to a local area network data transfer speed over the local area network of the second storage zone.
30. The computing device of claim 21 wherein a wide area network data transfer speed over the wide area network is in the range from 10 to 500 Mbps and a local area network data transfer speed over the local area network of the secondary storage zone is in the range from 1 to 100 Gbps.