Systems and methods for intelligent content aware caching
Methods and systems to intelligently cache content in a virtualization environment using virtualization software such as VMWare ESX or Citrix XenServer or Microsoft HyperV or Redhat KVM or their variants are disclosed. Storage IO operations (reads from and writes to disk) are analyzed (or characterized) for their overall value and pinned to cache if their value exceeds a certain defined threshold based on criteria specific to the New Technology File System (NTFS) file-system. Analysis/characterization of NTFS file systems for intelligent dynamic caching include analyzing storage block data associated with a Virtual Machine of interest in accordance with a pre-determined data model to determine the value of the block under analysis for long term or short term caching. Integer values assigned to different types of NTFS objects in a white list data structure called a catalog that can be used to analyze the storage block data.
1. A system, comprising:
a plurality of virtual machines, each running an image of an operating system (OS);
a virtual machine (VM) hypervisor in network communication with the plurality of virtual machines and with a storage network;
a plurality of storage devices in network communication with the VM hypervisor through the storage network;
an intelligent content aware caching application running on the VM hypervisor and in network communication with the plurality of storage devices through the storage network; and
a cache including a plurality of sets and a plurality of slots in each set, and content in the cache controlled by intelligent content aware caching application based on new technology file system (NTFS) object types and assigned integer values stored in a catalog accessed by the intelligent content aware caching application.
2. The system of claim 1 and further comprising:
at least one processor configured to execute the VM hypervisor and the intelligent content aware caching application.
3. The system of claim 2 , wherein the at least one processor is a component of a computer system.
4. The system of claim 1 , wherein the plurality of storage devices comprise a storage media selected from the group consisting of hard disk drive (HDD), a solid state disk drive (SSD), a RAID storage system, a SAN storage system, and a NAS storage system.
5. The system of claim 1 , wherein two or more of the plurality of virtual machines each run images of different OSs.
6. The system of claim 1 , wherein the intelligent content aware caching application evicts one or more items of content in the cache based on the assigned integer values in the catalog corresponding to the evicted one or more items of content.
7. The system of claim 6 , wherein the assigned integer values comprise a first integer value assigned to content items that are not to be stored in the cache, a second integer value indicative assigned to content items that are to be stored in the cache and are subject to replacement, and a third integer value assigned to content items that are not to be replaced or evicted from the cache.
8. A method comprising:
running images of operating systems (OSs) on a plurality of virtual machines;
exchanging network communications between a virtual machine (VM) hypervisor, a plurality of virtual machines, a storage network, and a plurality of storage devices in network communication with the VM hypervisor through a storage network;
executing, with a computer processing system, an intelligent content aware caching application on the VM hypervisor and in network communication with the plurality of storage devices through the storage network; and
managing a cache including a plurality of sets and a plurality of slots in each set, wherein content in the cache is managed by the intelligent content aware caching application based on new technology file system (NTFS) object types and assigned integer values stored in a catalog accessed by the intelligent content aware caching application.
9. The method of claim 8 , wherein the plurality of storage devices comprise a storage media selected from the group consisting of hard disk drive (HDD), a solid state disk drive (SSD), a RAID storage system, a SAN storage system, and a NAS storage system.
10. The method of claim 8 , wherein two or more of the plurality of virtual machines each run images of different OSs.
11. The method of claim 8 , further comprising:
evicting, by the intelligent content aware caching application, one or more items of content in the cache based on the assigned integer values in the catalog corresponding to the evicted one or more items of content.
12. The system of claim 11 , wherein the assigned integer values comprise a first integer value assigned to content items that are not to be stored in the cache, a second integer value indicative assigned to content items that are to be stored in the cache and are subject to replacement, and a third integer value assigned to content items that are not to be replaced or evicted from the cache.
13. A non-transitory computer readable storage medium including instructions that, when executed on a computer system cause the computer system to perform a method comprising:
running images of operating systems (OSs) on a plurality of virtual machines;
exchanging network communications between a virtual machine (VM) hypervisor, a plurality of virtual machines, a storage network, and a plurality of storage devices in network communication with the VM hypervisor through a storage network;
executing, with a computer processing system, an intelligent content aware caching application on the VM hypervisor and in network communication with the plurality of storage devices through the storage network; and
managing a cache including a plurality of sets and a plurality of slots in each set, wherein content in the cache is managed by the intelligent content aware caching application based on new technology file system (NTFS) object types and assigned integer values stored in a catalog accessed by the intelligent content aware caching application.
14. The non-transitory computer readable storage medium of claim 13 , wherein the plurality of storage devices comprise a storage media selected from the group consisting of hard disk drive (HDD), a solid state disk drive (SSD), a RAID storage system, a SAN storage system, and a NAS storage system.
15. The non-transitory computer readable storage medium of claim 13 , wherein two or more of the plurality of virtual machines each run images of different OSs.
16. The non-transitory computer readable storage medium of claim 13 , further comprising:
evicting, by the intelligent content aware caching application, one or more items of content in the cache based on the assigned integer values in the catalog corresponding to the evicted one or more items of content.
17. The non-transitory computer readable storage medium of claim 16 , wherein the assigned integer values comprise a first integer value assigned to content items that are not to be stored in the cache, a second integer value indicative assigned to content items that are to be stored in the cache and are subject to replacement, and a third integer value assigned to content items that are not to be replaced or evicted from the cache.