Virtualization of metadata for file optimization
View Patent ↗Mechanisms are provided for optimizing files while allowing application servers access to metadata associated with preoptimized versions of the files. During file optimization involving compression and/or compaction, file metadata changes. In order to allow file optimization in a manner transparent to application servers, the metadata associated with preoptimized versions of the files is maintained in a metadata database as well as in an optimized version of the files themselves.
1. A method comprising:
receiving, at a computing device having memory and a processor, a read directory request associated with a directory including a plurality of files optimized using deduplication;
accessing, via a communications interface, a metadata database maintained using a storage device;
evaluating timestamps by using the processor to determine whether an entry in the metadata database is valid, wherein if the entry is not valid, a suitcase file is accessed to obtain the metadata needed to respond to the read directory request, and wherein the suitcase file comprises an optimized file that includes a plurality of compressed files.
2. The method of claim 1 , wherein the metadata database is accessed if the metadata needed to respond to the read directory request is not available in a client side cache.
3. The method of claim 1 , wherein the metadata database includes file identifiers, access times, and metadata.
4. The method of claim 3 , wherein file identifiers include user identifiers, group identifiers, and inode numbers.
5. The method of claim 3 , wherein timestamps are associated with access times corresponding to when the plurality of files were last accessed.
6. The method of claim 3 , wherein metadata includes file names and file sizes associated with preoptimized versions of the plurality of files.
7. The method of claim 1 , wherein the metadata database resides at the application server.
8. The method of claim 1 , wherein the plurality of files are optimized using deduplication and compression.
9. The method of claim 1 , wherein the metadata database need not be synchronized with a directory hierarchy.
10. The method of claim 1 , wherein the suitcase file includes metadata and compressed data for the plurality of files optimized using deduplication and compression.
11. A system comprising:
an interface operable to receive a read directory request associated with a directory including a plurality of files optimized using deduplication; and
a processor operable to access a metadata database and evaluate timestamps to determine whether an entry in the metadata database is valid;
wherein if the entry is not valid, a suitcase file is accessed to obtain the metadata needed to respond to the read directory request, and wherein the suitcase file comprises an optimized file that includes a plurality of compressed files.
12. The system of claim 11 , wherein the metadata database is accessed if the metadata needed to respond to the read directory request is not available in a client side cache.
13. The system of claim 11 , wherein the metadata database includes file identifiers, access times, and metadata.
14. The system of claim 13 , wherein file identifiers include user identifiers, group identifiers, and inode numbers.
15. The system of claim 13 , wherein timestamps are associated with access times corresponding to when the plurality of files were last accessed.
16. The system of claim 13 , wherein metadata includes file names and file sizes associated with preoptimized versions of the plurality of files.
17. The system of claim 11 , wherein the metadata database resides at the application server.
18. The system of claim 11 , wherein the plurality of files are optimized using deduplication and compression.
19. The system of claim 11 , wherein the metadata database need not be synchronized with a directory hierarchy.
20. A non-transitory computer readable medium comprising:
computer code for receiving a read directory request associated with a directory including a plurality of files optimized using deduplication;
computer code for accessing a metadata database;
computer code for evaluating timestamps to determine whether an entry in the metadata database is valid, wherein if the entry is not valid, a suitcase file is accessed to obtain the metadata needed to respond to the read directory request, and wherein the suitcase file comprises an optimized file that includes a plurality of compressed files.