Cascading PID controller for metadata page eviction
In a storage system that implements metadata paging, the page free pool is replenished in the background to reduce foreground evictions and associated latency on page-in. A two-level page eviction controller with cascaded proportional, integral, derivative (PID) controllers optimizes the size of the free page pool and optimizes the rate at which pages are freed in the background. By optimizing these two parameters the page eviction controller dynamically maximizes used pages (minimizing free pages) to increase the metadata cache hit ratio. Optimizing the parameters also reduces the chances of foreground page evictions, thereby reducing IO latency, during both steady state and burst page-in requests.
1. An apparatus, comprising:
at least one computing node comprising a processor and memory;
at least one non-volatile drive managed by the at least one computing node;
a data set maintained on the at least one non-volatile drive;
metadata for the data set, the metadata maintained on the at least one non-volatile drive; and
a metadata paging controller configured to:
copy pages of the metadata from the at least one non-volatile drive to free pages of a free pool in the memory as needed;
evict pages of metadata from the memory in the background based on a difference between a target size of the free pool and an actual size of the free pool; and
adjust the target size of the free pool based on a difference between a free pool relative minimum setpoint for a time period and an actual free pool relative minimum for the time period and a combination of the actual free pool relative minimum for the time period and a number of foreground evictions occurring in the time period, wherein the free pool relative minimum setpoint represents desired smallest size that the free pool becomes during the time period.
2. The apparatus of claim 1 wherein the metadata paging controller comprises cascaded proportional-integral-derivative (PID) controllers.
3. The apparatus of claim 2 wherein the pages of metadata and the free pages of the free pool are in a dedicated portion of the memory.
4. A method, comprising:
in a storage system comprising at least one computing node comprising a processor and memory, at least one non-volatile drive managed by the at least one computing node, a data set maintained on the at least one non-volatile drive, and metadata for the data set, the metadata maintained on the at least one non-volatile drive:
copying pages of the metadata from the at least one non-volatile drive to free pages of a free pool in the memory as needed;
evicting pages of metadata from the memory in the background based on a page eviction rate calculated based on a difference between a target size of the free pool and actual size of the free pool; and
adjusting the target size of the free pool based on a difference between a free pool relative minimum setpoint for a time period and an actual free pool relative minimum for the time period and a combination of the actual free pool relative minimum for the time period and a number of foreground evictions occurring in the time period, wherein the free pool relative minimum setpoint represents desired smallest size that the free pool becomes during the time period.
5. The method of claim 4 comprising adjusting with cascaded proportional-integral-derivative (PID) controllers.
6. The method of claim 5 comprising maintaining the pages of metadata and the free pages of the free pool in a dedicated portion of the memory.
7. A non-transitory computer-readable storage medium storing instructions that when executed by a computer cause the computer to perform a method for using a computer system to evict pages of metadata from memory, the method comprising:
copying pages of the metadata from a non-volatile drive to free pages of a free pool in the memory as needed; and
evicting pages of metadata from the memory in the background based on a page eviction rate calculated based on a difference between a target size of the free pool and actual size of the free pool; and
adjusting the target size of the free pool based on a difference between a free pool relative minimum setpoint for a time period and an actual free pool relative minimum for the time period and a combination of the actual free pool relative minimum for the time period and a number of foreground evictions occurring in the time period, wherein the free pool relative minimum setpoint represents desired smallest size that the free pool becomes during the time period.
8. The non-transitory computer-readable storage medium of claim 7 wherein the method further comprises adjusting with cascaded proportional-integral-derivative (PID) controllers.