Application transparent deduplication data
Mechanisms are provided to allow for application transparent deduplication data. A mail database associated with a mail application can be analyzed to identify attachments meeting particular administrator criteria. The attachments are analyzed and replaced with stubs to allow continued mail application interaction with the mail database. The attachments may be optimized with deduplication and/or compression.
1. A method, comprising:
analyzing an electronic mail database to identify a plurality of electronic mail attachments included in the electronic mail database, the plurality of electronic mail attachments including a first electronic mail attachment and a second electronic mail attachment;
substituting a first stub for a first electronic mail attachment and a second stub for the second electronic mail attachment;
deduplicating, using a datastore suitcase and a dictionary, the first electronic mail attachment and the second electronic mail attachment, wherein the first stub and the second stub allow an electronic mail application to both access and perform operations on the first electronic mail attachment and the second electronic mail attachment as though the first electronic mail attachment and the second electronic mail attachment are not deduplicated;
wherein the first electronic mail attachment is rehydrated upon receiving a request from the electronic mail application for the first electronic mail attachment, wherein the request is received at the first stub.
2. The method of claim 1 , wherein deduplicating the first electronic mail attachment comprises delineating the first electronic mail attachment into a first plurality of chunks.
3. The method of claim 1 , wherein deduplicating the first electronic mail attachment comprises generating a first chunk identifier corresponding to a first chunk, the first chunk identifier used to access a deduplication dictionary.
4. The method of claim 1 , wherein deduplicating the first electronic mail attachment comprises determining whether the first chunk is already stored in a deduplication system using the first chunk identifier and the deduplication dictionary.
5. The method of claim 1 , wherein the first electronic mail attachment is further separated into a first plurality of subcomponents.
6. The method of claim 1 , wherein the electronic mail database is maintained by the electronic mail application in an application native file format.
7. The method of claim 6 , wherein the first stub is accessed by the application without adversely affecting application operation.
8. The method of claim 1 , wherein the first chunk identifier is a hash of the first chunk.
9. The method of claim 1 , wherein the deduplication dictionary maintains a plurality of chunk identifiers and corresponding chunk locations.
10. The method of claim 1 , wherein the first chunk is maintained in a datastore suitcase.
11. The method of claim 1 , wherein the first stub is substituted for the first electronic mail attachment if the first electronic mail attachment exceeds a predetermined size.
12. A server, comprising:
a processor configured to analyze an electronic mail database to identify a plurality of electronic mail attachments included in the electronic mail database, the plurality of electronic mail attachments including a first electronic mail attachment and a second electronic mail attachment, wherein a first stub is substituted for a first electronic mail attachment and a second stub is substituted for the second electronic mail attachment;
deduplication logic configured to deduplicate, using a datastore suitcase and a dictionary, the first electronic mail attachment and the second electronic mail attachment, wherein the first stub and the second stub allow an electronic mail application to both access and perform operations on the first electronic mail attachment and the second electronic mail attachment as though the first electronic mail attachment and the second electronic mail attachment are not deduplicated;
wherein the first electronic mail attachment is rehydrated upon receiving a request from the electronic mail application for the first electronic mail attachment, wherein the request is received at the first stub.
13. The server of claim 12 , wherein deduplicating the first electronic mail attachment comprises delineating the first electronic mail attachment into a first plurality of chunks.
14. The server of claim 12 , wherein deduplicating the first electronic mail attachment comprises generating a first chunk identifier corresponding to a first chunk, the first chunk identifier used to access a deduplication dictionary.
15. The server of claim 12 , wherein deduplicating the first electronic mail attachment comprises determining whether the first chunk is already stored in a deduplication system using the first chunk identifier and the deduplication dictionary.
16. The server of claim 12 , wherein the first electronic mail attachment is further separated into a first plurality of subcomponents.
17. The server of claim 12 , wherein the electronic mail database is maintained by the electronic mail application in an application native file format.
18. The server of claim 17 , wherein the first stub is accessed by the application without adversely affecting application operation.
19. The server of claim 12 , wherein the first chunk identifier is a hash of the first chunk.
20. A non-transitory computer readable medium having computer code embodied therein, the computer readable medium comprising:
computer code for analyzing an electronic mail database to identify a plurality of electronic mail attachments included in the electronic mail database, the plurality of electronic mail attachments including a first electronic mail attachment and a second electronic mail attachment;
computer code for substituting a first stub for a first electronic mail attachment and a second stub for the second electronic mail attachment;
computer code for deduplicating, using a datastore suitcase and a dictionary, the first electronic mail attachment and the second electronic mail attachment, wherein the first stub and the second stub allow an electronic mail application to both access and perform operations on the first electronic mail attachment and the second electronic mail attachment as though the first electronic mail attachment and the second electronic mail attachment are not deduplicated;
wherein the first electronic mail attachment is rehydrated upon receiving a request from the electronic mail application for the first electronic mail attachment, wherein the request is received at the first stub.