Virtualization of metadata for file optimization
Mechanisms are provided for optimizing files while allowing application servers access to metadata associated with preoptimized versions of the files. During file optimization involving compression and/or compaction, file metadata changes. In order to allow file optimization in a manner transparent to application servers, the metadata associated with preoptimized versions of the files is maintained in a metadata database as well as in an optimized version of the files themselves.
1. A method comprising:
receiving, at a computing device having memory and a processor, a read directory request associated with a directory including a plurality of files optimized using deduplication;
accessing, via a communications interface, a metadata database maintained using a storage device;
evaluating timestamps by using the processor to determine whether an entry in the metadata database is valid, wherein if the entry is not valid, a suitcase file is accessed to obtain the metadata needed to respond to the read directory request, and wherein the suitcase file comprises an optimized file that includes a plurality of compressed files.
2. The method of claim 1 , wherein the metadata database is accessed if the metadata needed to respond to the read directory request is not available in a client side cache.
3. The method of claim 1 , wherein the metadata database includes file identifiers, access times, and metadata.
4. The method of claim 3 , wherein file identifiers include user identifiers, group identifiers, and inode numbers.
5. The method of claim 3 , wherein timestamps are associated with access times corresponding to when the plurality of files were last accessed.
6. The method of claim 3 , wherein metadata includes file names and file sizes associated with preoptimized versions of the plurality of files.
7. The method of claim 1 , wherein the metadata database resides at the application server.
8. The method of claim 1 , wherein the plurality of files are optimized using deduplication and compression.
9. The method of claim 1 , wherein the metadata database need not be synchronized with a directory hierarchy.
10. The method of claim 1 , wherein the suitcase file includes metadata and compressed data for the plurality of files optimized using deduplication and compression.
11. A system comprising:
an interface operable to receive a read directory request associated with a directory including a plurality of files optimized using deduplication; and
a processor operable to access a metadata database and evaluate timestamps to determine whether an entry in the metadata database is valid;
wherein if the entry is not valid, a suitcase file is accessed to obtain the metadata needed to respond to the read directory request, and wherein the suitcase file comprises an optimized file that includes a plurality of compressed files.
12. The system of claim 11 , wherein the metadata database is accessed if the metadata needed to respond to the read directory request is not available in a client side cache.
13. The system of claim 11 , wherein the metadata database includes file identifiers, access times, and metadata.
14. The system of claim 13 , wherein file identifiers include user identifiers, group identifiers, and inode numbers.
15. The system of claim 13 , wherein timestamps are associated with access times corresponding to when the plurality of files were last accessed.
16. The system of claim 13 , wherein metadata includes file names and file sizes associated with preoptimized versions of the plurality of files.
17. The system of claim 11 , wherein the metadata database resides at the application server.
18. The system of claim 11 , wherein the plurality of files are optimized using deduplication and compression.
19. The system of claim 11 , wherein the metadata database need not be synchronized with a directory hierarchy.
20. A non-transitory computer readable medium comprising:
computer code for receiving a read directory request associated with a directory including a plurality of files optimized using deduplication;
computer code for accessing a metadata database;
computer code for evaluating timestamps to determine whether an entry in the metadata database is valid, wherein if the entry is not valid, a suitcase file is accessed to obtain the metadata needed to respond to the read directory request, and wherein the suitcase file comprises an optimized file that includes a plurality of compressed files.