IP Library Granted Patent US 9,639,274
Granted Patent B2
US 9,639,274 · App. 14/686,038 · Granted May 2, 2017

Efficient deduplication database validation

View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,639,274
App. No.
14/686,038
Granted
May 2, 2017
Kind
B2
Abstract

According to certain aspects, a method can include receiving an indication that a restoration of a deduplication database using a secondary copy of a file associated with a secondary copy job is complete; retrieving a first data fingerprint from a data storage database, wherein the first data fingerprint is associated with the secondary copy job used to restore the deduplication database; retrieving a second data fingerprint from a deduplication database media agent, wherein the second data fingerprint is associated with the secondary copy job used to restore the deduplication database; comparing the first data fingerprint with the second data fingerprint to determine whether the first data fingerprint and the second data fingerprint match; and transmitting an instruction to the deduplication database media agent to rebuild the restored deduplication database in response to a determination that the first data fingerprint and the second data fingerprint do not match.

Claims (54)

1. A networked information management system configured to validate a deduplication database, the networked information management system comprising:

a deduplication database including information about a set of deduplication data blocks, wherein the deduplication data blocks are used to create deduplicated secondary copies on one or more secondary storage devices in the information management system;

a data storage database associated with a storage management computer, wherein the data storage database comprises a first data fingerprint corresponding to a secondary copy job, wherein the first data fingerprint comprises an indication of a count of unique data blocks stored in a first secondary copy of a first file and an indication of a count of references stored in the first secondary copy of the first file that reference data blocks stored in other secondary copies, wherein execution of the secondary copy job resulted in generation of the first secondary copy of the first file, the first secondary copy of the first file and a secondary copy of the deduplication database residing in the one or more secondary storage devices; and

one or more computing devices each having one or more hardware processors and configured to:

if the deduplication database is determined to be invalid, restore the deduplication database using the secondary copy of the deduplication database;

retrieve the first data fingerprint from the data storage database;

generate a second data fingerprint using the restored version of the deduplication database;

compare the first data fingerprint with the second data fingerprint; and

rebuild the restored version of the deduplication database using the first secondary copy of the first file in response to a determination that the first data fingerprint and the second data fingerprint do not match.

2. The networked information management system of claim 1 , wherein the first data fingerprint further comprises at least one of an identification of a total size of the unique data blocks or an identification of a total size of the references.

3. The networked information management system of claim 2 , wherein the one or more computing devices are further configured to:

generate, at a time that the secondary copy of the deduplication database is created, the first data fingerprint; and

transmit the first data fingerprint to the storage management computer.

4. The networked information management system of claim 2 , wherein the second data fingerprint comprises an indication of a second count of unique data blocks stored in the first secondary copy of the first file, and wherein the one or more computing devices are further configured to:

compare the count of the unique data blocks stored in the first secondary copy of the first file with the second count of the unique data blocks stored in the first secondary copy of the first file; and

rebuild the restored version of the deduplication database in response to a determination that the count of the unique data blocks stored in the first secondary copy of the first file and the second count of the unique data blocks stored in the first secondary copy of the first file do not match.

5. The networked information management system of claim 1 , wherein the secondary copy of the deduplication database is a backup copy of the deduplication database.

6. A computer-implemented method for validating a deduplication database, the computer-implemented method comprising:

retrieving, in response to a restoration of the deduplication database using a secondary copy of the deduplication database, a first data fingerprint from a data storage database, wherein the first data fingerprint corresponds with a secondary copy job, wherein the first data fingerprint comprises an indication of a count of unique data blocks stored in a first secondary copy of a first file and an indication of a count of references stored in the first secondary copy of the first file that reference data blocks stored in other secondary copies, wherein execution of the secondary copy job resulted in generation of the first secondary copy of the first file;

generating a second data fingerprint using the restored version of the deduplication database, wherein the second data fingerprint corresponds with the secondary copy of the deduplication database;

comparing the first data fingerprint with the second data fingerprint to determine whether the first data fingerprint and the second data fingerprint match; and

rebuilding the restored version of the deduplication database using the first secondary copy of the first file in response to a determination that the first data fingerprint and the second data fingerprint do not match.

7. The computer-implemented method of claim 6 , wherein the first data fingerprint further comprises at least one of an identification of a total size of the unique data blocks or an identification of a total size of the references.

8. The computer-implemented method of claim 7 , further comprising:

generating, at a time that the secondary copy of the deduplication database is created, the first data fingerprint; and

transmitting the first data fingerprint to a data storage computer for storage in the data storage database.

9. The computer-implemented method of claim 7 , wherein the second data fingerprint comprises an indication of a second count of unique data blocks stored in the first secondary copy of the first file.

10. The computer-implemented method of claim 9 , wherein comparing the first data fingerprint with the second data fingerprint further comprises:

comparing the count of the unique data blocks stored in the first secondary copy of the first file with the second count of the unique data blocks stored in the first secondary copy of the first file; and

rebuilding the restored version of the deduplication database in response to a determination that the count of the unique data blocks stored in the first secondary copy of the first file and the second count of the unique data blocks stored in the first secondary copy of the first file do not match.

11. The computer-implemented method of claim 6 , wherein the secondary copy of the deduplication database is a backup copy of the deduplication database.

12. The computer-implemented method of claim 6 , wherein the deduplication database comprises information about a set of deduplication data blocks, and wherein the deduplication data blocks are used to create deduplicated secondary copies on one or more secondary storage devices in an information management system.

13. The computer-implemented method of claim 6 , further comprising restoring, if the deduplication database is determined to be invalid, the deduplication database using the secondary copy of the deduplication database.

14. A networked information management system configured to validate a deduplication database, the networked information management system comprising:

a storage manager comprising a storage manager database, wherein the storage manager database comprises a plurality of data fingerprints;

a deduplication database media agent comprising an electronically stored deduplication database; and

a media agent comprising computer hardware configured to:

receive an indication that a restoration of the deduplication database using a secondary copy of the deduplication database is complete;

retrieve a first data fingerprint in the plurality of data fingerprints from the storage manager database, wherein the first data fingerprint is associated with a secondary copy job used to restore the deduplication database, wherein the first data fingerprint comprises an indication of a count of unique data blocks stored in a first secondary copy of a first file and an indication of a count of references stored in the first secondary copy of the first file that reference data blocks stored in other secondary copies, wherein execution of the secondary copy job resulted in generation of the first secondary copy of the first file;

retrieve a second data fingerprint from the deduplication database media agent, wherein the second data fingerprint is associated with the secondary copy job used to restore the deduplication database;

compare the first data fingerprint with the second data fingerprint to determine whether the first data fingerprint and the second data fingerprint match; and

transmit an instruction to the deduplication database media agent to rebuild the restored deduplication database using the first secondary copy of the first file in response to a determination that the first data fingerprint and the second data fingerprint do not match.

15. The networked information management system of claim 14 , wherein the first data fingerprint further comprises at least one of an identification of a total size of the unique data blocks or an identification of a total size of the references.

16. The networked information management system of claim 15 , wherein the media agent is further configured to:

generate, at a time that the secondary copy job is being performed, the first data fingerprint; and

transmit the first data fingerprint to the data storage computer.

17. The networked information management system of claim 15 , wherein the second data fingerprint comprises an indication of a second count of unique data blocks stored in the first secondary copy of the first file, and wherein the media agent is further configured to:

compare the count of the unique data blocks stored in the first secondary copy of the first file with the second count of the unique data blocks stored in the first secondary copy of the first file; and

transmit the instruction to the deduplication database media agent to rebuild the restored deduplication database in response to a determination that the count of the unique data blocks stored in the first secondary copy of the first file and the second count of the unique data blocks stored in the first secondary copy of the first file do not match.

18. The networked information management system of claim 14 , wherein the deduplication database media agent is configured to:

process entries in the deduplication database associated with the secondary copy job in response to completion of the restoration of the deduplication database; and

generate the second data fingerprint based on the processing of the entries in the deduplication database associated with the secondary copy job.

19. The networked information management system of claim 18 , wherein each entry in the deduplication database associated with the secondary copy job corresponds to a data block.

20. The networked information management system of claim 14 , wherein the deduplication database media agent is configured to rebuild the restored deduplication database based on data blocks stored in a secondary storage device that are associated with the secondary copy job.

Assignments (3)
SUPPLEMENTAL CONFIRMATORY GRANT OF SECURITY INTEREST IN UNITED STATES PATENTS Recorded Apr 16, 2025
From: COMMVAULT SYSTEMS, INC.
To: JPMORGAN CHASE BANK, N.A., AS ADMINISTRATIVE AGENT
Reel/Frame 070864/0344 →
SECURITY INTEREST Recorded Dec 13, 2021
From: COMMVAULT SYSTEMS, INC.
To: JPMORGAN CHASE BANK, N.A., AS ADMINISTRATIVE AGENT
Reel/Frame 058496/0836 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 14, 2015
From: MARANNA, CHANDRASHEKAR; VIJAYAN, MANOJ KUMAR; NARULKAR, ABHISHEK; ATTARDE, DEEPAK RAGHUNATH; AGRAWAL, SAURABH
To: COMMVAULT SYSTEMS, INC.
Reel/Frame 035425/0056 →