Data management and indexing across a distributed database
View Patent ↗In one embodiment, a distributed database system supporting flexible configuration of data clusters is disclosed. The system includes a cluster manager, an index, and a dataset distributed over one or more database clusters. Where the nodes of the clusters may report ownership of a particular range, the index contains an alternate range. The cluster manager receives requests to access a range of data within database and queries the index to determine the appropriate nodes and/or clusters with which to connect. The cluster manager then directs the requestor to connect to the specified nodes and/or clusters.
1. A database system comprising:
one or more processors;
a cluster manager, implemented on the one or more processors;
an index;
a first database cluster containing one or more database nodes including a first database node, the first database cluster configured to operate according to a first database protocol; and
a data set distributed amongst the one or more database nodes of the first database cluster;
wherein the first database node reports a first data range within the first database cluster;
wherein the index contains a second data range associated with the first database node, the second data range different from the first data range;
wherein, responsive to a received request having a target data value from a requesting process, the cluster manager performs a query of the index in response to the request, and communicably directs the requesting process to access the first database cluster based on a determination that the target data value falls within the second data range.
2. The database system of claim 1 ,
the database system further comprising a second database cluster containing one or more database nodes and configured to operate according to a second database protocol;
wherein the data set is further distributed among the second database cluster.
3. The database system of claim 2 ,
wherein the first database cluster is a complete and conforming independent cluster as specified by the first database protocol; and
wherein the second database cluster is a complete and conforming independent cluster as specified by the second database protocol.
4. The database system of claim 1 ,
wherein the data set is structured to store data under a database hierarchy, the database hierarchy having a first set of levels;
wherein the first database protocol supports distributing data at a set of hierarchy levels within the database hierarchy, wherein the set of hierarchy levels is a subset of the first set of levels; and
wherein the index is structured to distribute data at a level of the database hierarchy not contained in the set of hierarchy levels.
5. The database system of claim 1 ,
wherein the index includes a first entry and a second entry, the first entry referencing the second entry; and
wherein the cluster manager performs a second query of the index in response to the first entry referencing the second entry.
6. The database system of claim 1 , the database system further comprising an index cluster containing one or more index nodes, wherein the index is distributed among the one or more index nodes of the index cluster.
7. The database system of claim 6 , wherein the index cluster is configured to operate according to an index database protocol different from the first database protocol.
8. The database system of claim 6 ,
wherein the index cluster is a first index cluster;
wherein the database system further comprises a second index cluster containing one or more index nodes; and
wherein the index is further distributed among the one or more index nodes of the second index cluster.
9. The database system of claim 8 ,
wherein the index includes a first entry distributed among the first index cluster and a second entry distributed among the second index cluster, the first entry referencing the second entry; and
wherein the cluster manager performs a second query of the index in response to the first entry referencing the second entry.
10. The database system of claim 9 ,
wherein the first entry further references one or more of the first database cluster and the first database node.