Processes and methods for client-side fingerprint caching to improve deduplication system backup performance
A system and method for caching fingerprints in a client cache is provided. A data object that comprises a set of data segments and describes a backup process is identified. Thereafter, a request referencing the data object is made to a deduplication server to request that a task identifier be added to the data object. If the deduplication server is able to successfully add the task identifier to the data object, then an active identifier is added to each data segment from the set of data segments in a cache that is within a client system.
1. A method comprising:
identifying a data object, wherein
the data object comprises a set of data segments, and
the data object describes a backup process;
sending a request to a deduplication server, wherein
the request is a request for the deduplication server to add a task identifier to a copy of the data object stored at the deduplication server,
the request comprises a reference to the data object, and
addition of the task identifier to the copy of the data object protects the copy of the data object and a copy of the set of data segments stored at the deduplication server from being deleted from the deduplication server during the backup process; and
in response to a determination that the deduplication server has successfully added the task identifier to the copy of the data object stored at the deduplication server, adding an active identifier to each data segment in the set of data segments stored in a cache, wherein
the cache is at a client system, and
addition of the active identifier to the each data segment indicates that a corresponding copy of the each data segment stored at the deduplication sever will be maintained at the deduplication server during the backup process.
2. The method of claim 1 , further comprising:
receiving the data object, wherein
the data object is received from the deduplication server, in response to a query from the client system,
the query comprises a query for a data object that includes a fingerprint match for the set of data segments, and
the query is performed prior to performing an initial full backup of the client system.
3. The method of claim 1 , further comprising:
adding an active identifier to a reference list corresponding to the each data segment in the set of data segments.
4. The method of claim 1 , further comprising:
performing the backup process for the client system, after the adding the active identifier to the each data segment.
5. The method of claim 4 , further comprising:
determining whether another data segment referenced by the backup process needs to be sent to the deduplication server, wherein the determining comprises:
determining whether a fingerprint for the another data segment is in the cache, and
determining whether the cache has an active identifier for the another data segment.
6. The method of claim 4 , further comprising:
creating a record of the backup process on the cache, upon successful completion of the backup process, wherein
the record comprises at least one of:
backup policy information,
a list of the set of data segments referenced by the backup process,
a fingerprint of the data object, and
a backup type indicator.
7. The method of claim 4 , further comprising:
upon successful completion of the backup process:
receiving the data object describing the backup process from the client system,
adding a data object fingerprint to a reference list corresponding to the each data segment in the data object, and
removing the task identifier from the copy of the data object.
8. A non-transitory computer readable storage medium comprising instructions executable to:
identify a data object, wherein
the data object comprises a set of data segments, and
the data object describes a backup process;
send a request to a deduplication server, wherein
the request is a request for the deduplication server to add a task identifier to a copy of the data object stored at the deduplication server,
the request comprises a reference to the data object, and
addition of the task identifier to the copy of the data object protects the copy of the data object and a copy of the set of data segments stored at the deduplication server from being deleted from the deduplication server during the backup process; and
add an active identifier to each data segment in the set of data segments stored in a cache, in response to a determination that the deduplication server has successfully added the task identifier to the copy of the data object stored at the deduplication server, wherein
the cache is at a client system, and
addition of the active identifier to the each data segment indicates that a corresponding copy of the each data segment stored at the deduplication sever will be maintained at the deduplication server during the backup process.
9. The non-transitory computer readable storage medium of claim 8 , wherein the program instructions are further executable to:
receive the data object, wherein
the data object is received from the deduplication server, in response to a query from the client system,
the query comprises a query for a data object that includes a fingerprint match for the set of data segments, and
the query is performed prior to performing an initial full backup of the client system.
10. The non-transitory computer readable storage medium of claim 8 , wherein the program instructions are further executable to:
add an active identifier to a reference list corresponding to the each data segment in the set of data segments.
11. The non-transitory computer readable storage medium of claim 8 , wherein the program instructions are further executable to:
perform the backup process for the client system, after the active identifier is added to the each data segment.
12. The non-transitory computer readable storage medium of claim 11 , wherein the program instructions are further executable to:
determine whether another data segment referenced by the backup process needs to be sent to the deduplication server by:
determining whether a fingerprint for the another data segment is in the cache, and
determining whether the cache has an active identifier for the another data segment.
13. The non-transitory computer readable storage medium of claim 11 , wherein the program instructions are further executable to:
create a record of the backup process on the cache, upon successful completion of the backup process, wherein
the record comprises at least one of:
backup policy information,
a list of the set of data segments referenced by the backup process,
a fingerprint of the data object, and
a backup type indicator.
14. The non-transitory computer readable storage medium of claim 11 , wherein the program instructions are further executable to:
receive the data object describing the backup process from the client system,
add a data object fingerprint to a reference list corresponding to the each data segment in the data object, and
remove the task identifier from the copy of the data object.
15. A system comprising:
one or more processors; and
memory coupled to the one or more processors, wherein the memory stores program instructions executable by the one or more processors to:
identify a data object, wherein
the data object comprises a set of data segments, and
the data object describes a backup process,
send a request to a deduplication server, wherein
the request is a request for the deduplication server to add a task identifier to a copy of the data object stored at the deduplication server,
the request comprises a reference to the data object, and
addition of the task identifier to the copy of the data object protects the copy of the data object and a copy of the set of data segments stored at the deduplication server from being deleted from the deduplication server during the backup process, and
add an active identifier to each data segment in the set of data segments stored in a cache, in response to a determination that the deduplication server has successfully added the task identifier to the copy of the data object stored at the deduplication server, wherein
the cache is at a client system, and
addition of the active identifier to the each data segment indicates that a corresponding copy of the each data segment stored at the deduplication sever will be maintained at the deduplication server during the backup process.
16. The system of claim 15 , wherein the program instructions are further executable to:
receive the data object, wherein
the data object is received from the deduplication server, in response to a query from the client system,
the query comprises a query for a data object that includes a fingerprint match for the set of data segments, and
the query is performed prior to performing an initial full backup of the client system.
17. The system of claim 15 , wherein the program instructions are further executable to:
add an active identifier to a reference list corresponding to the each data segment in the set of data segments.
18. The system of claim 15 , wherein the program instructions are further executable to:
perform the backup process for the client system, after the active identifier is added to the each data segment.
19. The system of claim 18 , wherein the program instructions are further executable to:
determine whether another data segment referenced by the backup process needs to be sent to the deduplication server by:
determining whether a fingerprint for the another data segment is in the cache, and
determining whether the cache has an active identifier for the another data segment.
20. The system of claim 18 , wherein the program instructions are further executable to:
create a record of the backup process on the cache, upon successful completion of the backup process, wherein
the record comprises at least one of:
backup policy information,
a list of the set of data segments referenced by the backup process,
a fingerprint of the data object, and
a backup type indicator.