System and method for data replication using a single master failover protocol
A system that implements a data storage service may store data on behalf of storage service clients. The system may maintain data in multiple replicas of various partitions that are stored on respective computing nodes in the system. The system may employ a single master failover protocol, usable when a replica attempts to become the master replica for a replica group of which it is a member. Attempting to become the master replica may include acquiring a lock associated with the replica group, and gathering state information from the other replicas in the group. The state information may indicate whether another replica supports the attempt (in which case it is included in a failover quorum) or stores more recent data or metadata than the replica attempting to become the master (in which case synchronization may be required). If the failover quorum includes enough replicas, the replica may become the master.
1. A system, comprising:
one or more processors and corresponding memory configured to implement a plurality of replicas that collectively form a replica group, wherein the plurality of replicas store data on respective computing nodes of a plurality of computing nodes that collectively implement a data store;
wherein the data store is configured to:
detect a change in membership of the replica group;
determine, based at least in part on the change in membership of the replica group detected by the data store, a corresponding update to a quorum requirement used to perform access requests to the data at the replica group; and
perform an access request to the data at the replica group according to the updated quorum requirement.
2. The system of claim 1 , wherein the data store is further configured to communicate the update to the quorum requirement via a write to metadata replicated amongst the replica group.
3. The system of claim 2 , wherein the write to the metadata includes a membership version number, different than a prior membership version number used before the detected change in membership of the replica group.
4. The system of claim 1 , wherein the update to the quorum requirement causes a change to a write quorum used to perform write requests to the data.
5. The system of claim 1 , wherein the update to the quorum requirement causes a change to a read quorum used to perform read requests to the data.
6. The system of claim 1 , wherein the detected change in membership is an increase or decrease in a number of replicas in the replica group.
7. The system of claim 1 , wherein the data store is a Web based storage service that hosts the data as a non-relational database.
8. A method, comprising:
detecting, by a data store, a change in membership of a replica group, wherein the replica group comprises a plurality of replicas that store data on respective computing nodes of a plurality of computing nodes that collectively implement the data store;
determining, by the data store and based at least in part on the change in membership of the replica group detected by the data store, a corresponding update to a quorum requirement used to perform access requests to the data at the replica group; and
performing, by the data store, an access request to the data at the replica group according to the updated quorum requirement.
9. The method of claim 8 , further comprising communicating, by the data store, the update to the quorum requirement via a write to metadata replicated amongst the replica group.
10. The method of claim 9 , wherein the write to the metadata includes a membership version number, different than a prior membership version number used before the detected change in membership of the replica group.
11. The method of claim 8 , wherein the update to the quorum requirement causes a change to a write quorum used to perform write requests to the data.
12. The method of claim 8 , wherein the update to the quorum requirement causes a change to a read quorum used to perform read requests to the data.
13. The method of claim 8 , wherein the detected change in membership is an increase or decrease in a number of replicas in the replica group.
14. The method of claim 8 , wherein the data store is a Web based storage service that hosts the data as a non-relational database.
15. One or more non-transitory computer-readable storage media storing program instructions that, when executed on or across one or more computing devices, cause the one or more computing devices to implement:
detecting, by a data store, a change in a membership of a replica group, wherein the replica group comprises a plurality of replicas that store data on respective computing nodes of a plurality of computing nodes that collectively implement the data store;
determining, by the data store and based at least in part on the change in membership of the replica group, a corresponding update to a quorum requirement used to perform access requests to the data at the replica group; and
performing, by the data store, an access request to the data at the replica group according to the updated quorum requirement.
16. The one or more non-transitory computer-readable storage media of claim 15 , storing further instructions that when executed on or across the one or more computing devices, cause the one or more computing devices to further implement communicating, by the data store, the update to the quorum requirement via a write to metadata replicated amongst the replica group.
17. The one or more non-transitory computer-readable storage media of claim 16 , wherein the write to the metadata includes a membership version number, different than a prior membership version number used before the detected change in membership of the replica group.
18. The one or more non-transitory computer-readable storage media of claim 15 , wherein the update to the quorum requirement causes a change to a write quorum used to perform write requests to the data.
19. The one or more non-transitory computer-readable storage media of claim 15 , wherein the update to the quorum requirement causes a change to a read quorum used to perform read requests to the data.
20. The one or more non-transitory computer-readable storage media of claim 15 , wherein the detected change in membership is an increase or decrease in a number of replicas in the replica group.