Method and system for adaptive incrementally updated backups with dynamic data file detection

1. A method for performing backup operations, comprising:

generating a full backup of a user asset at a first point in time;

generating an incremental backup after the full backup is generated;

applying the incremental backup to the full backup to generate a second full backup;

making a determination that a portion of data files included in the user asset was deleted after the generation of the full backup;

in response to the determination:

identifying a first set of distinct data files using a first control file associated with the user asset, wherein the first control file specifies the data files included in the user asset;

identifying a second set of distinct data files using a second control file associated with the second full backup, wherein the second control file specifies data files included in the second full backup;

obtaining a distinct data files subset associated with the second full backup by comparing the first set of distinct data files and the second set of distinct data files, wherein the distinct data files subset specifies the portion of the data files;

deleting the distinct data files subset from the second full backup to obtain a third full backup; wherein the incremental backup is stored in an incremental directory on a backup storage and wherein the third full backup is stored in a working directory;

cloning the third full backup to generate a set of pointers to data in the third full backup; and

storing the set of pointers in a snapshot directory, wherein a recovery catalogue is updated using the set of pointers.

2. The method of claim 1 , further comprising:

generating a fourth full backup of the user asset at a second point in time;

obtaining a second distinct data files subset associated with the fourth full backup;

generating a fifth full backup of the second distinct data files subset;

applying the fifth full backup to the fourth full backup to generate a sixth full backup;

generating a second incremental backup after the sixth full backup is generated; and

applying the second incremental backup to the sixth full backup to generate a seventh full backup.

3. The method of claim 2 , wherein the second distinct data files subset specifies files added to the user asset since the fourth full backup.

4. A system, comprising:

a client device comprising a client storage array, wherein the client storage array comprises a user asset;

a computer processor of the client device, wherein the computer processor is configured to:

generate a full backup of the user asset at a first point in time;

generate an incremental backup after the full backup is generated;

apply the incremental backup to the full backup to generate a second full backup;

make a determination that a portion of data files data files included in the user asset was deleted after the generation of the full backup;

in response to the determination:

identify a first set of distinct data files using a first control file associated with the user asset, wherein the first control file specifies the data files included in the user asset;

identify a second set of distinct data files using a second control file associated with the second full backup, wherein the second control file specifies data files included in the second full backup;

obtain a distinct data files subset associated with the second full backup by comparing the first set of distinct data files and the second set of distinct data files, wherein the distinct data files subset specifies the portion of the data files;

deleting the distinct data files subset from the second full backup to obtain a third full backup; wherein the incremental backup is stored in an incremental directory on a backup storage and wherein the third full backup is stored in a working directory;

clone the third full backup to generate a set of pointers to data in the third full backup; and

store the set of pointers in a snapshot directory, wherein a recovery catalogue is updated using the set of pointers.

5. The system of claim 4 , wherein the computer processor is further configured to:

generate a fourth full backup of the user asset at a second point in time;

obtain a second distinct data files subset associated with the fourth full backup;

generate a fifth full backup of the second distinct data files subset;

apply the fifth full backup to the fourth full backup to generate a sixth full backup;

generate a second incremental backup after the sixth full backup is generated; and

apply the second incremental backup to the sixth full backup to generate a seventh full backup.

6. The system of claim 5 , wherein the second distinct data files subset specifies files added to the user asset since the fourth full backup.

7. A non-transitory computer readable medium comprising computer readable program code, which when executed by a computer processor enables the computer processor to perform a method, the method comprising:

generating a full backup of a user asset at a first point in time;

generating an incremental backup after the full backup is generated;

applying the incremental backup to the full backup to generate a second full backup;

making a determination that a portion of data files included in the user asset was deleted after the generation of the full backup;

in response to the determination:

identifying a first set of distinct data files using a first control file associated with the user asset, wherein the first control file specifies the data files included in the user asset;

identifying a second set of distinct data files using a second control file associated with the second full backup, wherein the second control file specifies data files included in the second full backup;

obtaining a distinct data files subset associated with the second full backup by comparing the first set of distinct data files and the second set of distinct data files, wherein the distinct data files subset specifies the portion of the data files;

deleting the distinct data files subset from the second full backup to obtain a third full backup; wherein the incremental backup is stored in an incremental directory on a backup storage and wherein the third full backup is stored in a working directory;

cloning the third full backup to generate a set of pointers to data in the third full backup; and

storing the set of pointers in a snapshot directory, wherein a recovery catalogue is updated using the set of pointers.

8. The non-transitory computer readable medium of claim 7 , wherein the method further comprising:

generating a fourth full backup of the user asset at a second point in time;

obtaining a second distinct data files subset associated with the fourth full backup;

generating a fifth full backup of the second distinct data files subset;

applying the fifth full backup to the fourth full backup to generate a sixth full backup;

generating a second incremental backup after the sixth full backup is generated; and

applying the second incremental backup to the sixth full backup to generate a seventh full backup.