Caching of backup chunks
Contents of a plurality of backups that share a common characteristic are profiled. A portion of the plurality of backups is selected as a base backup reference data to be distributed. A first copy of the base backup reference data is stored at a storage of a backup server. A second copy of the base backup reference data is provided for storage at a storage of a client that shares the common characteristic. The client is located remotely from the backup server.
1. A system, comprising:
a hardware processor configured to:
identify data associated with a remote client that is to be restored;
identify one or more data chunks of the identified data to be restored;
determine whether one of the one or more data chunks is included in a base backup reference dataset based on a comparison of a hash value associated with the one of the one or more data chunks and corresponding hash values associated with a plurality of data chunks included in the base backup reference dataset, wherein the base backup reference dataset includes a subset of data chunks that were selected from a set of data chunks that were included in a plurality of backups of a plurality of clients, wherein the data chunks included in the subset were selected based on a number of times each of the data chunks included in the subset was included in the plurality of backups of the plurality of clients; and
restore the one of the one or more data chunks to the remote client based on a determination that the one of the one or more data chunks is not included in the base backup reference dataset; and
a memory coupled to the hardware processor and configured to provide the hardware processor with instructions.
2. The system of claim 1 , wherein the data associated with the remote client that is to be restored is identified by a client system that desires to restore the data.
3. The system of claim 1 , wherein the remote client is to be restored in the event the remote client has encountered an error with the data associated with the remote client that is to be restored.
4. The system of claim 1 , wherein to determine whether one of the one or more data chunks is included in a base backup reference dataset, the hardware processor is further configured to:
hash the one of the one or more data chunks using a hash function; and
determine whether a result of the hash function matches an identifier of a data chunk included in the base backup reference dataset.
5. The system of claim 4 , wherein to determine whether a result of the hash function matches an identifier of a data chunk included in the base backup reference dataset, the hardware processor is further configured to determine whether the result of the hash function is included in a hash table of the base backup reference dataset.
6. The system of claim 1 , wherein in response to a determination that the one of the one or more data chunks is included in the base backup reference dataset, the one of the one or more data chunks is not restored to the remote client.
7. The system of claim 6 , wherein an identifier of the one of the one or more data chunks is provided instead of one of the one or more data chunks.
8. The system of claim 1 , wherein the hardware processor is further configured to determine whether an unprocessed data chunk of the one or more data chunks exists.
9. The system of claim 8 , wherein in response to determining that an unprocessed data chunk of the one or more data chunks exists, the hardware processor is further configured to determine whether the unprocessed data chunk is included in the base backup reference dataset.
10. The system of claim 8 , wherein in response to determining that an unprocessed data chunk of the one or more data chunks does not exist, the hardware processor is further configured to provide the one or more data chunks that were determined not to be included in the base backup reference dataset.
11. A method, comprising:
identifying data associated with a remote client that is to be restored;
identifying one or more data chunks of the identified data to be restored;
determining whether one of the one or more data chunks is included in a base backup reference dataset based on comparing a hash value associated with the one of the one or more data chunks and corresponding hash values associated with a plurality of data chunks included in the base backup reference dataset, wherein the base backup reference dataset includes a subset of data chunks that were selected from a set of data chunks that were included in a plurality of backups of a plurality of clients, wherein the data chunks included in the subset were selected based on a number of times each of the data chunks included in the subset was included in the plurality of backups of the plurality of clients; and
restoring the one of the one or more data chunks to the remote client based on determining that the one of the one or more data chunks is not included in the base backup reference dataset.
12. The method of claim 11 , wherein determining whether one of the one or more data chunks is included in the base backup reference dataset comprises:
hashing the one of the one or more data chunks using a hash function; and
determining whether a result of the hash function matches an identifier of a data chunk included in the base backup reference dataset.
13. The method of claim 12 , wherein determining whether a result of the hash function matches an identifier of a data chunk included in the base backup reference dataset includes determining whether the result of the hash function is included in a hash table of the base backup reference dataset.
14. The method of claim 11 , wherein in response to determining that the one of the one or more data chunks is included in the base backup reference dataset, a copy of the one of the one or more data chunks is not provided to the remote client.
15. The method of claim 14 , wherein an identifier of the one of the one or more data chunks is provided instead of one of the one or more data chunks.
16. The method of claim 11 , further comprising determining whether an unprocessed data chunk of the one or more data chunks exists.
17. The method of claim 16 , wherein in response to determining that an unprocessed data chunk of the one or more data chunks exists, determining whether the unprocessed data chunk is included in the base backup reference dataset.
18. A computer program product, the computer program product being embodied on a non-transitory computer readable medium comprising instructions for:
identifying data associated with a remote client that is to be restored;
identifying one or more data chunks of the identified data to be restored;
determining whether one of the one or more data chunks is included in a base backup reference dataset based on a comparison of a hash value associated with the one of the one or more data chunks and corresponding hash values associated with a plurality of data chunks included in the base backup reference dataset, wherein the base backup reference dataset includes a subset of data chunks that were selected from a set of data chunks that were included in a plurality of backups of a plurality of clients, wherein the data chunks included in the subset were selected based on a number of times each of the data chunks included in the subset was included in the plurality of backups of the plurality of clients; and
restoring the one of the one or more data chunks to the remote client based on determining that the one of the one or more data chunks is not included in the base backup reference dataset.