Database system with designated leader and methods for use therewith
A networked database management system (DBMS) is disclosed. In particular, the disclosed DBMS includes a plurality of nodes, one of which is elected as a designated leader. The designated leader is elected using a consensus algorithm, such as tabulated random votes, RAFT or PAXOS. The designated leader is responsible for managing open coding lines, and determining when to close an open coding line.
1. A database management system comprising:
a plurality of coding clusters for storing data, wherein a coding cluster of the plurality of coding clusters includes a plurality of nodes, wherein each node of the plurality of nodes includes:
a server having a network interface; and
a hardware switch coupled to the network interface, wherein the hardware switch allows each node to communicate with other nodes of the plurality of nodes;
wherein the plurality of nodes include a designated leader node and at least two other nodes, wherein the designated leader node performs operations that include maintaining a collection of coding lines associated with the plurality of nodes, the collection of coding lines including an inventory of open coding lines of the collection of coding lines having at least one open coding block and wherein the maintaining the collection of coding lines maintains at least one open coding line for each node of the plurality of nodes; and
wherein, in response to an election event, a majority of the plurality of nodes select, via a consensus protocol, a new designated leader node to replace the designated leader node.
2. The database management system of claim 1 , wherein the consensus protocol includes nodes of the plurality of nodes randomly voting for any node of the plurality of nodes.
3. The database management system of claim 1 , wherein the designated leader node maintains at least one open coding line for each node of the plurality of nodes by creating a new open coding line to add to the collection of coding lines when the inventory of the open coding lines for a node is empty.
4. The database management system of claim 1 , wherein the election event includes the majority of the plurality of nodes losing contact with the designated leader node.
5. The database management system of claim 1 ., wherein the election event includes a verified failure of the designated leader node.
6. The database management system of claim 1 , wherein the election event includes a system startup.
7. The database management system of claim 1 , wherein the operations further include:
assigning one of the at least two other nodes to be an aggregation node that collects and aggregates performance data associated with the plurality of nodes.
8. The database management system of claim 7 , wherein the performance data for a node of the plurality of nodes includes a percentage of storage utilized.
9. The database management system of claim 7 , wherein the performance data for a node of the plurality of nodes includes an amount of data read in a time period.
10. The database management system of claim 7 , wherein the performance data for a node of the plurality of nodes includes a total data rate in a time period.
11. The database management system of claim 7 , wherein the performance data for a node of the plurality of nodes includes an amount of input transactions in a time period.
12. The database management system of claim 7 , wherein the performance data for a node of the plurality of nodes includes an amount of output transactions in a time period.
13. The database management system of claim 7 , wherein the performance data for a node of the plurality of nodes includes an amount of total transactions in a time period.
14. A method comprising:
providing a plurality of coding clusters for storing data, wherein a coding cluster of the plurality of coding clusters includes a plurality of nodes, wherein each node of the plurality of nodes includes:
a server having a network interface; and
a hardware switch coupled to the network interface, wherein the hardware switch allows each node to communicate with other nodes of the plurality of nodes;
wherein the plurality of nodes include a designated leader node and at least two other nodes;
maintaining, via the designated leader node, a collection of coding lines associated with the plurality of nodes, the collection of coding lines including an inventory of open coding lines of the collection of coding lines having at least one open coding block and wherein the maintaining the collection of coding lines maintains at least one open coding line for each node of the plurality of nodes; and
facilitating, in response to an election event, replacing the designated leader node with a new designated leader node, wherein a majority of the plurality of nodes select, via a consensus protocol, the new designated leader node to replace the designated leader node.
15. The method of claim 14 , wherein the consensus protocol includes nodes of the plurality of nodes randomly voting for any node of the plurality of nodes.
16. The method of claim 14 , wherein the designated leader node maintains at least one open coding line for each node of the plurality of nodes by creating a new open coding line to add to the collection of coding lines when the inventory of the open coding lines for a node is empty.
17. The method of claim 14 , wherein the election event includes the majority of the plurality of nodes losing contact with the designated leader node.
18. The method of claim 14 , wherein the election event includes a verified failure of the designated leader node.
19. The method of claim 14 , wherein the election event includes a system startup.
20. The method of claim 14 , further comprising:
assigning, via the designated leader node, one of the at least two other nodes to be an aggregation node that collects and aggregates performance data associated with the plurality of nodes.