Local cache pre-warming
Caching metadata that identify hot blocks at a per local cache level are tracked. Tracked caching metadata are maintained so as to be persistent and shared across nodes of the cluster. Local caches are pre-warmed by using maintained caching metadata, responsive to detecting specific node level events. Such events can result in hot blocks being absent from a local cache, such as a failover between nodes or an unexpected failure local to a specific node. Another event example is the access of shared storage content, such as opening a file or mounting a file system by a specific node, in response to which the associated local cache can be pre-warmed using the tracked caching metadata for the specific file, or for each file of the file system. To pre-warm a local cache, hot blocks of stored content identified by corresponding caching metadata are loaded into the local cache.
1. A computer implemented method for cache pre-warming in a cluster of nodes, each node having an associated non-shared, local cache, wherein the cluster further comprises shared storage, the method comprising the steps of:
nodes of the cluster using associated local caches to cache hot blocks of shared storage content, wherein each local cache is accessible only to the node with which it is associated, and wherein the shared storage is accessible by each node of the cluster;
tracking caching metadata by nodes of the cluster, wherein the tracked caching metadata identifies hot blocks at a per local cache level;
maintaining caching metadata tracked by each node of the cluster, wherein the maintained caching metadata is persistent and shared across the nodes of the cluster; and
pre-warming local caches by nodes of the cluster by using maintained caching metadata, responsive to detecting specific node level events.
2. The method of claim 1 wherein tracking caching metadata by a node further comprises:
monitoring caching activity on the node.
3. The method of claim 1 wherein tracking caching metadata by a node further comprises:
tracking specific blocks of shared storage content present in the local cache on the node.
4. The method of claim 1 wherein tracking caching metadata by a node further comprises:
tracking which specific blocks of shared storage content are added to and evicted from the local cache on the node over time.
5. The method of claim 1 wherein tracking caching metadata further comprises:
monitoring application level access of specific content on the shared storage.
6. The method of claim 1 wherein tracking caching metadata further comprises:
tracking caching metadata identifying specific blocks of shared storage content, in response to the blocks being accessed at a specific threshold level within a given time period.
7. The method of claim 1 wherein maintaining caching metadata further comprises:
storing caching metadata concerning each specific one of multiple files with corresponding file system level metadata concerning the specific file.
8. The method of claim 1 wherein maintaining caching metadata further comprises:
storing the tracked caching metadata on the shared storage, such that the stored caching metadata is persistent and shared across the nodes of the cluster.
9. The method of claim 1 wherein maintaining caching metadata further comprises:
storing the tracked caching metadata on a remote, cloud-based server computer, such that the stored caching metadata is persistent and shared across the nodes of the cluster.
10. The method of claim 1 wherein maintaining caching metadata further comprises:
using cluster-level inter-node communication to maintain the tracked caching metadata.
11. The method of claim 1 wherein pre-warming a local cache by using maintained caching metadata responsive to detecting a specific node level event further comprises:
in response to detecting a specific file being opened by a node, pre-warming the local cache associated with the node using the tracked caching metadata for the specific file, wherein the tracked caching metadata for the specific file identifies hot blocks for the specific file.
12. The method of claim 1 wherein pre-warming a local cache by using maintained caching metadata responsive to detecting a specific node level event further comprises:
in response to detecting a file system being mounted by a node, pre-warming the local cache associated with the node using the tracked caching metadata for each specific file of the file system, wherein the tracked caching metadata for each specific file identifies hot blocks for the specific file.
13. The method of claim 1 wherein pre-warming a local cache by using maintained caching metadata further comprises:
loading hot blocks of stored content identified by corresponding caching metadata into the local cache.
14. The method of claim 1 further comprising:
detecting events that warrant pre-warming of at least one local cache.
15. The method of claim 14 wherein detecting an event that warrants pre-warming of a local cache further comprises:
detecting an event resulting in hot blocks being absent from the local cache.
16. The method of claim 14 wherein detecting an event that warrants pre-warming of a local cache further comprises:
detecting a failover from a first node to a second node.
17. The method of claim 14 wherein detecting an event that warrants pre-warming of a local cache further comprises:
detecting an unexpected failure local to a specific node.
18. The method of claim 14 wherein detecting an event that warrants pre-warming of a local cache further comprises:
detecting access of shared storage content by a specific node.
19. At least one non-transitory computer readable-storage medium for cache pre-warming in a cluster of nodes, each node having an associated non-shared, local cache, wherein the cluster further comprises shared storage, the at least one non-transitory computer readable-storage medium storing computer executable instructions that, when loaded into computer memory and executed by at least one processor of a computing device, cause the computing device to perform the following steps:
nodes of the cluster using associated local caches to cache hot blocks of shared storage content, wherein each local cache is accessible only to the node with which it is associated, and wherein the shared storage is accessible by each node of the cluster;
tracking caching metadata by nodes of the cluster, wherein the tracked caching metadata identifies hot blocks at a per local cache level;
maintaining caching metadata tracked by each node of the cluster, wherein the maintained caching metadata is persistent and shared across the nodes of the cluster; and
pre-warming local caches by nodes of the cluster by using maintained caching metadata, responsive to detecting specific node level events.
20. A computer system for cache pre-warming in a cluster of nodes, each node having an associated non-shared, local cache, wherein the cluster further comprises shared storage, wherein nodes of the cluster using associated local caches to cache hot blocks of shared storage content, wherein each local cache is accessible only to the node with which it is associated, and wherein the shared storage is accessible by each node of the cluster, the computer system comprising:
system memory;
a caching metadata tracking module residing in the system memory, the caching metadata tracking module being programmed to track caching metadata by nodes of the cluster, wherein the tracked caching metadata identifies hot blocks at a per local cache level;
a caching metadata maintaining module residing in the system memory, the caching metadata maintaining module being programmed to maintain caching metadata tracked by each node of the cluster, wherein the maintained caching metadata is persistent and shared across the nodes of the cluster; and
a cache pre-warming module residing in the system memory, the cache pre-warming module being programmed to pre-warm local caches by nodes of the cluster by using maintained caching metadata, responsive to detecting specific node level events.