Methods and systems for garbage deletion in a document database
Disclosed herein are exemplary systems and methods for garbage collection and/or deletion in a document database. The methods may include, for each change in a first change set, determining whether a first characteristic of the change is superseded by a second characteristic of a corresponding change in a second change set. The change of the first change set and the change of the second change set can pertain to a document attribute. The method may include determining whether the first change set is redundant with the second change set if each change of the first change set is superseded by a corresponding change of the second change set, and eliminating the first change set from the document database when the first change set is redundant with second change set.
1. A system for garbage deletion in a document database, the system comprising:
at least one memory for storing computer-executable instructions; and
at least one processor for executing the instructions stored on the memory, wherein execution of the instructions programs the at least one processor to perform operations comprising:
detecting one or more changes in a first change set in a first node of a cluster of nodes and one or more changes in a second change set in a second node of the cluster of nodes, the cluster of nodes being responsible for storage of the document database;
comparing a first characteristic of the change to a second characteristic of a corresponding change in the second change set, wherein the change of the first change set and the change of the second change set pertain to a same attribute of a document in the document database, and wherein comparing the first characteristic and the second characteristic comprises comparing one or more of a node identifier, lexicographical order, or change type associated with the change of the first change set with one or more of a node identifier, lexicographical order, or change type associated with the second change set, and
determining that the change of the first change set is superseded by the change of the second change set when one or more of (i) a node identifier associated with the change of the second change set is greater than a node identifier associated with the change of the first change set, (ii) a lexicographical order associated with the change of the second change set is greater than a lexicographical order associated with the change of the first change set, or (iii) a change type associated with the change of the second change set is an update and a change type associated with the change of the first change set is a remove;
determining that the first change set is redundant with the second change set when each change of the first change set is superseded by a corresponding change of the second change set; and
eliminating the first change set from the document database to free up storage space in the cluster of nodes.
2. The system of claim 1 , wherein the operations are executed for a plurality of document attributes including the attribute.
3. The system of claim 1 , wherein the first change is concurrent with the second change.
4. The system of claim 1 , wherein the document database is configured to operate over a plurality of data centers.
5. The system of claim 4 , wherein the data centers are configured to each replicate the document database.
6. A computer-implemented method for garbage deletion in a document database, the method comprising:
detecting, by a processor of a computer, one or more changes in a first change set in a first node of a cluster of nodes and one or more changes in a second change set in a second node of the cluster of nodes, the cluster of nodes being responsible for storage of the document database;
comparing, by the processor, a first characteristic of the change to a second characteristic of a corresponding change in the second change set, wherein the change of the first change set and the change of the second change set pertain to a same attribute of a document in the document database, and wherein comparing the first characteristic and the second characteristic comprises comparing one or more of a node identifier, lexicographical order, or change type associated with the change of the first change set with one or more of a node identifier, lexicographical order, or change type associated with the second change set, and
determining, by the processor, that the change of the first change set is superseded by the change of the second change set when one or more of (i) a node identifier associated with the change of the second change set is greater than a node identifier associated with the change of the first change set, (ii) a lexicographical order associated with the change of the second change set is greater than a lexicographical order associated with the change of the first change set, or (iii) a change type associated with the change of the second change set is an update and a change type associated with the change of the first change set is a remove;
determining, by the processor, that the first change set is redundant with the second change set when each change of the first change set is superseded by a corresponding change of the second change set; and
eliminating, by the processor, the first change set from the document database to free up storage space in the cluster of nodes.
7. The method of claim 6 , wherein the method is executed for a plurality of document attributes including the attribute.
8. The method of claim 6 , wherein the first change is concurrent with the second change.
9. The method of claim 6 , wherein the document database is configured to operate over a plurality of data centers.
10. The method of claim 9 , wherein the data centers are configured to each replicate the document database.
11. A non-transitory computer-readable medium having instructions stored thereon that, when executed by one or more computer processors, cause the computer processors to perform operations comprising:
detecting, by a processor, one or more changes in a first change set in a first node of a cluster of nodes and one or more changes in a second change set in a second node of the cluster of nodes, the cluster of nodes being responsible for storage of the document database;
comparing a first characteristic of the change to a second characteristic of a corresponding change in the second change set, wherein the change of the first change set and the change of the second change set pertain to a same attribute of a document in the document database, and wherein comparing the first characteristic and the second characteristic comprises comparing one or more of a node identifier, lexicographical order, or change type associated with the change of the first change set with one or more of a node identifier, lexicographical order, or change type associated with the second change set, and
determining that the change of the first change set is superseded by the change of the second change set when one or more of (i) a node identifier associated with the change of the second change set is greater than a node identifier associated with the change of the first change set, (ii) a lexicographical order associated with the change of the second change set is greater than a lexicographical order associated with the change of the first change set, or (iii) a change type associated with the change of the second change set is an update and a change type associated with the change of the first change set is a remove;
determining that the first change set is redundant with the second change set when each change of the first change set is superseded by a corresponding change of the second change set; and
eliminating the first change set from the document database to free up storage space in the cluster of nodes.