Adaptable multi-layered storage for deduplicating electronic messages
Methods and systems for improving data back-up, recovery, and search across different cloud-based applications, services, and platforms are described. A data management and storage system may direct compute and storage resources within a customer's cloud-based data storage account to back-up and restore data while the customer retains full control of their data. The data management and storage system may direct the compute and storage resources within the customer's cloud-based data storage account to generate and store secondary layers that are used for generating search indexes, to generate and store shared space layers and user specific layers to facilitate the deduplication of email attachments and text blocks, to perform a controlled restoration of email snapshots such that sensitive information (e.g., restricted keywords) located within stored snapshots remains protected, and to detect and preserve emails that were received or transmitted and then deleted between two consecutive snapshots.
1. A method, comprising:
acquiring a first snapshot that represents a set of electronic messages as of a first time;
storing, after acquiring the first snapshot, a representation of a first electronic message associated with a transmission or reception time subsequent to the first time;
acquiring, after storing the representation of the first electronic message, a second snapshot that represents the set of electronic messages as of a second time subsequent to the first time;
detecting that the second snapshot of the set of electronic messages does not reflect the first electronic message; and
generating, based at least in part on the stored representation of the first electronic message and in response to detecting that the second snapshot of the set of electronic messages does not reflect the first electronic message, a third snapshot that reflects the first electronic message.
2. The method of claim 1 , further comprising:
detecting that the first electronic message is transmitted or received after the first time, wherein storing the representation of the first electronic message is in response to detecting that that the first electronic message is transmitted or received after the first time.
3. The method of claim 1 , further comprising:
comparing electronic messages stored within a storage repository with electronic messages reflected by the second snapshot, wherein detecting that the second snapshot does not reflect the first electronic message is based at least in part on the comparing.
4. The method of claim 1 , further comprising:
comparing electronic messages transmitted or received by an email mailbox with electronic messages reflected by the second snapshot, wherein detecting that the second snapshot does not reflect the first electronic message is based at least in part on the comparing.
5. The method of claim 1 , wherein generating the third snapshot comprises:
generating a snapshot of a storage repository in which the representation of the first electronic message is stored.
6. The method of claim 5 , further comprising:
deleting the first electronic message from the storage repository after generating the snapshot of the storage repository.
7. The method of claim 1 , wherein the set of electronic messages comprises electronic messages associated with one or more email mailboxes.
8. The method of claim 1 , further comprising:
determining whether a size of the first electronic message satisfies a threshold size, wherein the third snapshot reflects the first electronic message based at least in part on the size of the first electronic message satisfying the threshold size.
9. The method of claim 1 , further comprising:
determining whether the first electronic message includes a keyword, wherein the third snapshot reflects the first electronic message based at least in part on the first electronic message not including the keyword.
10. The method of claim 1 , further comprising:
determining whether the first electronic message includes a keyword, wherein the third snapshot reflects the first electronic message based at least in part on the first electronic message including the keyword.
11. The method of claim 1 , further comprising:
determining whether the first electronic message includes a word associated with a prior search operation, wherein the third snapshot reflects the first electronic message based at least in part on the first electronic message including the word associated with the prior search operation.
12. The method of claim 1 , wherein the third snapshot reflects the first electronic message based at least in part on an email address associated with the first electronic message.
13. A system, comprising:
memory; and
one or more processors coupled with the memory, the one or more processors configured to cause the system to:
acquire a first snapshot that represents a set of electronic messages as of a first time;
store, after acquiring the first snapshot, a representation of a first electronic message associated with a transmission or reception time subsequent to the first time;
acquire, after storing the representation of the first electronic message, a second snapshot that represents the set of electronic messages as of a second time subsequent to the first time;
detect that the second snapshot of the set of electronic messages does not reflect the first electronic message; and
generate, based at least in part on the stored representation of the first electronic message and in response to detecting that the second snapshot of the set of electronic messages does not reflect the first electronic message, a third snapshot that reflects the first electronic message.
14. The system of claim 13 , wherein the one or more processors are further configured to cause the system to:
detect that the first electronic message is transmitted or received after the first time, wherein the one or more processors are configured to cause the system to store the representation of the first electronic message in response to detecting that that the first electronic message is transmitted or received after the first time.
15. The system of claim 13 , wherein the one or more processors are further configured to cause the system to:
compare electronic messages stored within a storage repository with electronic messages reflected by the second snapshot, wherein the one or more processors are configured to cause the system to detect that the second snapshot does not reflect the first electronic message based at least in part on the comparing.
16. The system of claim 13 , wherein the one or more processors are further configured to cause the system to:
compare electronic messages transmitted or received by an email mailbox with electronic messages reflected by the second snapshot, wherein the one or more processors are configured to cause the system to detect that the second snapshot does not reflect the first electronic message based at least in part on the comparing.
17. The system of claim 13 , wherein, to generate the third snapshot, the one or more processors are configured to cause the system to:
generate a snapshot of a storage repository in which the representation of the first electronic message is stored.
18. The system of claim 17 , wherein the one or more processors are further configured to cause the system to:
delete the first electronic message from the storage repository after generating the snapshot of the storage repository.
19. The system of claim 13 , wherein the set of electronic messages comprises electronic messages associated with one or more email mailboxes.
20. A non-transitory, computer-readable medium storing code comprising instructions executable by one or more processors of an electronic system to cause the electronic system to:
acquire a first snapshot that represents a set of electronic messages as of a first time;
store, after acquiring the first snapshot, a representation of a first electronic message associated with a transmission or reception time subsequent to the first time;
acquire, after storing the representation of the first electronic message, a second snapshot that represents the set of electronic messages as of a second time subsequent to the first time;
detect that the second snapshot of the set of electronic messages does not reflect the first electronic message; and
generate, based at least in part on the stored representation of the first electronic message and in response to detecting that the second snapshot of the set of electronic messages does not reflect the first electronic message, a third snapshot that reflects the first electronic message.