Defragmentation for log structured merge tree to improve read and write amplification
Techniques are provided for implementing a defragmentation process during a merge operation performed by a re-compaction process upon a log structured merge tree. The log structured merge tree is used to store keys of key-value pairs within a key-value store. As the log structured merge tree fills with keys over time, the re-compaction process is performed to merge keys down to lower levels of the log structured merge tree to re-compact the keys. Re-compaction can result in fragmentation because there is a lack of spatial locality of where the re-compaction operations re-writes the keys within storage. Fragmentation increases read and write amplification when accessing the keys stored in different locations within the storage. Accordingly, the defragmentation process is performed during a last merge operation of the re-compaction process in order to store keys together within the storage, thus reducing read and write amplification when accessing the keys.
1 . A method, comprising:
storing keys of key-value pairs within a log structured merge tree associated with a key-value store, wherein the keys of the key-value pairs are assigned to bins within distributed storage based upon prefixes of the keys;
merging keys down to lower levels of the log structured merge tree to re-compact the keys; and
during a rebalancing process that rebalances the keys across the bins based upon the prefixes, defragmenting a set of keys within a level of the log structured merge tree to store the set of keys together within a region of the distributed storage.
2 . The method of claim 1 , comprising:
creating a key-value pair comprising a value and a key used to reference the value, wherein the key corresponds to a content hash of the value;
storing the value within the distributed storage and the key into the log structured merge tree separate from the value; and
defragmenting the key during a last merge operation of a re-compaction process that merges the keys to re-compact the keys.
3 . The method of claim 1 , comprising:
modifying, during a defragmentation process that defragments the set of keys, physical volume block numbers pointing to blocks within the distributed storage storing the set of keys and refraining from modifying virtual volume block numbers representing locations of the blocks within the distribute storage.
4 . The method of claim 1 , comprising:
utilizing multiple bytes of prefixes of the keys to rebalance the keys across the bins by the rebalancing process.
5 . The method of claim 1 , comprising:
determining that an amount of fragmentation of the keys within the log structured merge tree exceeds a threshold; and
triggering a defragmentation process to defragment the level of the log structured merge tree based upon the threshold being exceeded.
6 . The method of claim 1 , comprising:
triggering the defragmentation of the set of keys based upon execution of a first prefixed based movement operation by the rebalancing process to rebalance keys across bins of nodes to store the set of keys together within a region of the distributed storage; and
implementing a second prefixed based movement operation of the rebalancing process to read the set of keys from the region.
7 . The method of claim 1 , comprising:
during the defragmentation of the set of keys, executing I/O operations against user blocks within the distributed storage, wherein a defragmentation process modifies physical volume block numbers within a redirection layer to point to defragmented locations of the set of keys in the distributed storage.
8 . The method of claim 1 , comprising:
implement a defragmentation process upon a container file implemented as a redirection layer for accessing the keys within the distributed storage, wherein the defragmentation process modifies physical volume block numbers within the redirection layer to point to defragmented locations of the set of keys in the distributed storage.
9 . A non-transitory machine readable medium comprising instructions, which when executed by a machine, causes the machine to:
store keys of key-value pairs within a log structured merge tree associated with a key-value store, wherein the keys of the key-value pairs are assigned to bins within distributed storage based upon prefixes of the keys;
merge keys down to lower levels of the log structured merge tree to re-compact the keys; and
during a rebalancing process that rebalances the keys across the bins based upon the prefixes, defragment a set of keys within a level of the log structured merge tree to store the set of keys together within a region of the distributed storage.
10 . The non-transitory machine readable medium of claim 9 , wherein the instructions cause the machine to:
trigger the defragmentation of the set of keys based upon an amount of fragmentation of keys within the log structured merge tree exceeding a threshold, otherwise, the defragmentation of the set of keys is skipped during a last merge operation of a re-compaction process.
11 . The non-transitory machine readable medium of claim 9 , wherein the instructions cause the machine to:
evaluate levels of logs within the log structured merge tree to identify a level as storing the set of keys having longer lifespans than keys within other levels of the log structured merge tree; and
defragment the set of keys within the level, but not upon the keys within the other levels, based upon the level being identified as storing the set of keys having longer lifespans than the keys within other the levels of the log structured merge tree.
12 . The non-transitory machine readable medium of claim 9 , wherein the instructions cause the machine to:
store keys within a sorted log of the log structured merge tree; and
implement a defragmentation process to defragment the set of keys within the level of the log structured merge tree without modifying the sorted log.
13 . The non-transitory machine readable medium of claim 9 , wherein the instructions cause the machine to:
skip defragmenting one or more levels of the log structured merge tree based upon a determination that keys within the one or more levels of the log structured merge tree have shorter lifespans than the set of keys within the level of the log structured merge tree.
14 . The non-transitory machine readable medium of claim 9 , wherein the instructions cause the machine to:
selectively defragment keys within a lowest level of the log structured merge tree based upon a determination that the set of keys within the lowest level of the log structured merge tree have longer lifespans within the distributed storage than keys within other levels of the log structured merge tree.
15 . A system, comprising:
a memory comprising machine executable code; and
a processor coupled to the memory, the processor configured to execute the machine executable code to cause the machine to:
store keys of key-value pairs within a log structured merge tree associated with a key-value store, wherein the keys of the key-value pairs are assigned to bins within distributed storage based upon prefixes of the keys;
merge keys down to lower levels of the log structured merge tree to re-compact the keys; and
during a rebalancing process that rebalances the keys across the bins based upon the prefixes, defragment a set of keys within a level of the log structured merge tree to store the set of keys together within a region of the distributed storage.
16 . The system of claim 15 , wherein the machine executable code causes the machine to:
modify, during a defragmentation process that defragments the set of keys, physical volume block numbers pointing to blocks within the distributed storage storing the set of keys and refraining from modifying virtual volume block numbers representing locations of the blocks within the distribute storage.
17 . The system of claim 15 , wherein the machine executable code causes the machine to:
utilize multiple bytes of prefixes of the keys to rebalance the keys across the bins by the rebalancing process.
18 . The system of claim 15 , wherein the machine executable code causes the machine to:
determine that an amount of fragmentation of the keys within the log structured merge tree exceeds a threshold; and
trigger a defragmentation process to defragment the level of the log structured merge tree based upon the threshold being exceeded.
19 . The system of claim 15 , wherein the machine executable code causes the machine to:
trigger the defragmentation of the set of keys based upon execution of a first prefixed based movement operation by the rebalancing process to rebalance keys across bins of nodes to store the set of keys together within a region of the distributed storage; and
implement a second prefixed based movement operation of the rebalancing process to read the set of keys from the region.
20 . The system of claim 15 , wherein the machine executable code causes the machine to:
during the defragmentation of the set of keys, execute I/O operations against user blocks within the distributed storage, wherein a defragmentation process modifies physical volume block numbers within a redirection layer to point to defragmented locations of the set of keys in the distributed storage.