Freeing pages within persistent memory
Techniques are provided for utilizing a log to free pages from persistent memory. A log is maintained to comprise a list of page block numbers of pages within persistent memory of a node to free. A page block number, of a page, within the log is identified for processing. A reference count, corresponding to a number of references to the page block number, is identified. In response to the reference count being greater than 1, the reference count is decremented and the page block number is removed from the log. In response to the reference count being 1, the page is freed from the persistent memory and the page block number is removed from the log.
1. A computing device comprising:
a persistent memory file system;
a persistent memory into which the persistent memory file system stores data according to a byte-addressable format;
a frontend process that processes client operations directed to the data stored within the persistent memory, wherein the frontend process utilizes an application programming interface to:
insert, into a log, page block numbers of pages within the persistent memory based upon the pages storing data targeted by a delete operation, wherein the page block numbers are inserted into the log while the pages store the data to be deleted by the delete operation; and
in response to inserting the page block numbers into the log and before the pages have been freed from the persistent memory, transmit a response to a client that the delete operation was successfully performed, wherein the response is transmitted while the pages still store the data to be deleted by the delete operation; and
a backend worker that utilizes the log to determine whether to retain or free the pages from the persistent memory.
2. The computing device of claim 1 , wherein the frontend process:
in response to the computing device recovering from a failure, traverse a file system tree to reconstruct a current list of page block numbers of pages to free; and
utilize the current list of page block numbers to rebuild the log.
3. The computing device of claim 1 , wherein the frontend process:
implement the log as a doubly-linked list of page block numbers to be freed.
4. The computing device of claim 1 , wherein the frontend process:
inserts, into the log, a root page block number of a page in response to the root page block number being unlinked from an inofile.
5. The computing device of claim 1 , wherein the frontend process:
in response to a root page block number being unlinked from a file system information entry, inserts the root page block number of a page into the log.
6. The computing device of claim 1 , wherein the computing device hosts a persistent memory storage tier for managing the persistent memory and a storage file system tier for managing storage different than the persistent memory.
7. The computing device of claim 1 , wherein the frontend process:
in response to a root page block number being unlinked from a file system information entry, inserts the root page block number of a page into the log.
8. The computing device of claim 1 , wherein the frontend process:
inserts, into the log utilizing the API, a root page block number of a page in response to the root page block number being unlinked by a first node.
9. The computing device of claim 1 , wherein the frontend process:
inserts, into the log utilizing the API, a root page block number of a page in response to the root page block number being unlinked by a first node and an unlink command being mirrored to a second node for unlinking a corresponding root page block number within a filesystem maintained by the second node.
10. A method, comprising:
managing, by a persistent memory file system, a persistent memory for storing data according to a byte-addressable format; and
processing client operations directed to the data stored within the persistent memory by:
inserting, into a log, page block numbers of pages within the persistent memory based upon the pages storing data targeted by a delete operation, wherein the page block numbers are inserted into the log while the pages store the data to be deleted by the delete operation; and
in response to inserting the page block numbers into the log and before the pages have been freed from the persistent memory, transmitting a response to a client that the delete operation was successfully performed, wherein the response is transmitted while the pages still store the data to be deleted by the delete operation
utilizing the log to determine whether to retain or free the pages from the persistent memory.
11. The method of claim 10 , further comprising:
rebuilding the log by traversing a file system tree to reconstruct a current list of page block numbers of pages to free.
12. The method of claim 10 , further comprising:
inserting a batch of page block numbers into the log based upon the batch of page block numbers corresponding to pages of data targeted by an overwrite operation.
13. The method of claim 10 , further comprising:
inserting, into the log, a root page block number of a page in response to the root page block number being unlinked from an inofile.
14. The method of claim 10 , further comprising:
in response to a root page block number being unlinked from a file system information entry, inserting the root page block number of a page into the log.
15. The method of claim 10 , further comprising:
in response to a root page block number being unlinked, inserting the root page block number of a page into the log.
16. The method of claim 10 , further comprising:
inserting, into the log, a root page block number of a page in response to the root page block number being unlinked by a first node.
17. The method of claim 10 , further comprising:
inserting, into the log, a root page block number of a page in response to the root page block number being unlinked by a first node and an unlink command being mirrored to a second node for unlinking a corresponding root page block number within a filesystem maintained by the second node.
18. A non-transitory machine readable medium comprising instructions for performing a method, which when executed by a machine, causes the machine to:
manage a persistent memory for storing data according to a byte-addressable format; and
insert, into a log, page block numbers of pages within the persistent memory based upon the pages storing data targeted by a delete operation, wherein the page block numbers are inserted into the log while the pages store the data to be deleted by the delete operation; and
in response to inserting the page block numbers into the log and before the pages have been freed from the persistent memory, transmit a response to a client that the delete operation was successfully performed, wherein the response is transmitted while the pages still store the data to be deleted by the delete operation; and
determine, using the log, whether to retain or free the pages from the persistent memory.
19. The non-transitory machine readable medium of claim 18 , wherein the instructions cause the machine to:
insert, into the log, a root page block number of a page in response to the root page block number being unlinked by a first node and an unlink command being mirrored to a second node for unlinking a corresponding root page block number within a filesystem maintained by the second node.
20. The non-transitory machine readable medium of claim 18 , wherein the instructions cause the machine to:
implement the log as a doubly-linked list of page block numbers to be freed.