Database management system and methods for use therewith
A networked database management system (DBMS) is disclosed. In particular, the disclosed DBMS includes a plurality of nodes, one of which is elected as a designated leader. The designated leader is elected using a consensus algorithm, such as tabulated random votes, RAFT or PAXOS. The designated leader is responsible for managing open coding lines, and determining when to close an open coding line.
1. A database management system comprising:
a plurality of coding clusters for storing data, wherein a coding cluster of the plurality of coding clusters includes:
a plurality of nodes, wherein each node of the plurality of nodes includes a server having a network interface; and
a high-speed hardware switch coupled to the network interface of each node of the plurality of nodes, wherein the high-speed hardware switch allows each node to communicate with other nodes of the plurality of nodes;
wherein the plurality of nodes include a designated leader node and at least two other nodes, wherein the designated leader node performs operations that include:
creating a collection of coding lines that are associated with the plurality of nodes;
maintaining the collection of coding lines including an inventory of open coding lines of the collection of coding lines;
creating, in response to a request from one of the at least two other nodes, a new open coding line to add to the collection of coding lines; and
maintaining a minimum number of open coding lines of the collection of coding lines;
wherein, in response to an election event, a majority of the plurality of nodes elect a new designated leader node to become the designated leader node using a consensus protocol.
2. The database management system of claim 1 , wherein the consensus protocol includes nodes of the plurality of nodes randomly voting for any node of the plurality of nodes.
3. The database management system of claim 1 , wherein the designated leader node creates the new open coding line to add to the collection of coding lines when the inventory of the open coding lines is empty.
4. The database management system of claim 1 . wherein the election event includes the majority of the plurality of nodes losing contact with the designated leader node.
5. The database management system of claim 1 , wherein the election event includes a verified failure of the designated leader node.
6. The database management system of claim 1 , wherein the election event includes a system startup.
7. The database management system of claim 1 , wherein the operations further include:
assigning one of the at least two other nodes to be an aggregation node that collects and aggregates performance data associated with the plurality of nodes.
8. The database management system of claim 7 , wherein the performance data for a node of the plurality of nodes includes a percentage of storage utilized.
9. The database management system of claim 7 , wherein the performance data for a node of the plurality of nodes includes an amount of data read in a time period.
10. The database management system of claim 7 , wherein the performance data for a node of the plurality of nodes includes a total data rate in a time period.
11. The database management system of claim 7 , wherein the performance data for a node of the plurality of nodes includes an amount of input transactions in a time period.
12. The database management system of claim 7 , wherein the performance data for a node of the plurality of nodes includes an amount of output transactions in a time period.
13. The database management system of claim 7 , wherein the performance data for a node of the plurality of nodes includes an amount of total transactions in a time period.
14. A method comprising:
providing a plurality of coding clusters for storing data, wherein a coding cluster of the plurality of coding clusters includes:
a plurality of nodes, wherein each node of the plurality of nodes includes a server having a network interface; and
a high-speed hardware switch coupled to the network interface of each node of the plurality of nodes, wherein the high-speed hardware switch allows each node to communicate with other nodes of the plurality of nodes;
wherein the plurality of nodes include a designated leader node and at least two other nodes, wherein the designated leader node performs operations that include:
creating, via the designated leader node, a collection of coding lines that are associated with the plurality of nodes;
maintaining, via the designated leader node, the collection of coding lines including an inventory of open coding lines of the collection of coding lines;
creating, via the designated leader node and in response to a request from one of the at least two other nodes, a new open coding line to add to the collection of coding lines;
maintaining, via the designated leader node, a minimum number of open coding lines of the collection of coding lines; and
electing, via a majority of the plurality of nodes and in response to an election event, a new designated leader node to become the designated leader node using a consensus protocol.
15. The method of claim 14 , wherein the consensus protocol includes nodes of the plurality of nodes randomly voting for any node of the plurality of nodes.
16. The method of claim 14 , wherein the designated leader node creates the new open coding line to add to the collection of coding lines when the inventory of the open coding lines is empty.
17. The method of claim 14 , wherein the election event includes the majority of the plurality of nodes losing contact with the designated leader node.
18. The method of claim 14 , wherein the election event includes a verified failure of the designated leader node.
19. The method of claim 14 , wherein the election event includes a system startup.
20. The method of claim 14 , further comprising:
assigning, via the designated leader node, one of the at least two other nodes to be an aggregation node that collects and aggregates performance data associated with the plurality of nodes.