Cache sharing in virtual clusters
Shared memory caching resolves latency issues in computing nodes associated with a cluster in a virtual computing environment. A portion of random access memory in one or more of the computing nodes is allocated for shared use by the cluster. Whenever local cache memory is unable in one of the computing nodes, a cluster neighbor cache allocated in a different computing node may be utilized as remote cache memory. Neighboring computing nodes may thus share their resources for the benefit of the cluster.
1. A method executed by a hardware server for sharing hardware resources associated with a computing cluster of nodes, comprising:
receiving, by the hardware server associated with the computing cluster of nodes, a disk block associated with a hard disk drive;
receiving, by the hardware server associated with the computing cluster of nodes, a hash value representing the disk block;
determining, by the hardware server, a lack of memory capacity available from a local random-access memory for a storage of the disk block;
determining, based on multiple neighbor cache reports, a current available size of each of multiple respective neighbor cache memories, wherein the current available size of each of the multiple respective neighbor cache memories is determined based on corresponding timestamps in the neighbor cache reports;
determining, by the hardware server and based on the current available size of each of the multiple respective neighbor cache memories, a neighbor cache memory operating in a neighbor node associated with the computing cluster of nodes having the memory capacity for the storage of the disk block by polling the computing cluster of the nodes;
transferring, by the hardware server, the disk block to an Internet protocol destination address assigned to the neighbor cache memory having the memory capacity for the storage of the disk block; and
adding, by the hardware server, a storage entry to an electronic database that tracks the transferring and the storage of the disk block to the neighbor cache memory, the entry electronically associating the disk block to the Internet protocol destination address assigned to the neighbor cache memory having the memory capacity for the storage of the disk block.
2. The method of claim 1 , further comprising sizing the neighbor cache memory.
3. The method of claim 1 , further comprising associating the hash value representing the disk block to the Internet protocol destination address.
4. The method of claim 1 , further comprising associating the hash value representing the disk block to the neighbor cache memory.
5. The method of claim 1 , further comprising storing the disk block.
6. An information handling system associated with a cluster in a virtual computing environment, the information handling system comprising:
a hardware processor; and
a local random-access memory accessible to the hardware processor, the local random-access memory storing instructions that when executed by the hardware processor perform operations, the operations including:
receiving a disk block associated with a hard disk drive;
receiving a hash value representing the disk block;
determining the local random-access memory lacks a memory capacity for a storage of the disk block;
determining, based on multiple neighbor cache reports, a current available size of each of multiple respective neighbor cache memories, wherein the current available size of each of the multiple respective neighbor cache memories is determined based on corresponding timestamps in the neighbor cache reports;
determining, based on the current available size of each of the multiple respective neighbor cache memories, a neighbor cache memory operating in a neighbor node associated with the cluster having the memory capacity for the storage of the disk block by polling computing nodes associated with the cluster;
transferring the disk block to an Internet protocol destination address assigned to the neighbor cache memory operating in the neighbor node having the memory capacity for the storage of the disk block; and
adding a storage entry to an electronic database that tracks the transferring and the storage of the disk block, the entry electronically associating the disk block to the Internet protocol destination address assigned to the neighbor cache memory having the memory capacity for the storage of the disk block.
7. The information handling system of claim 6 , wherein the operations further include sizing the neighbor cache memory.
8. The information handling system of claim 6 , wherein the operations further include logging the hash value in the electronic database in an association with the disk block.
9. The information handling system of claim 6 , wherein the operations further include logging the hash value in the electronic database in an association with the neighbor cache memory.
10. The information handling system of claim 6 , wherein the operations further include logging the disk block in the electronic database in an association with the neighbor cache memory.
11. The information handling system of claim 6 , wherein the operations further include storing the disk block.
12. A non-transitory memory device storing instructions that when executed by a hardware processor perform operations, the operations comprising:
receiving a disk block associated with a hard disk drive;
receiving a hash value representing the disk block;
determining a local random-access memory lacks a memory capacity for a storage of the disk block;
determining, based on multiple neighbor cache reports, a current available size of each of multiple respective neighbor cache memories, wherein the current available size of each of the multiple respective neighbor cache memories is determined based on corresponding timestamps in the neighbor cache reports;
determining, based on the current available size of each of the multiple respective neighbor cache memories, a neighbor cache memory operating in a neighbor node associated with a computing cluster having the memory capacity for the storage of the disk block by polling computing nodes associated with the computing cluster;
transferring the disk block to the neighbor cache memory operating in the neighbor node having the memory capacity for the storage of the disk block; and
adding a storage entry to an electronic database that tracks the transferring and the storage of the disk block, the entry electronically associating the disk block to the neighbor node having the memory capacity for the storage of the disk block.
13. The non-transitory memory device of claim 12 , wherein the operations further include logging the hash value in the electronic database in an association with the disk block.
14. The non-transitory memory device of claim 12 , wherein the operations further include logging the hash value in the electronic database in an association with the neighbor cache memory.
15. The non-transitory memory device of claim 12 , wherein the operations further include logging the disk block in the electronic database in an association with the neighbor cache memory.
16. The non-transitory memory device of claim 12 , wherein the operations further include storing the disk block.