SYSTEM AND METHOD FOR DEDUPLICATION OPTIMIZATION
A method, computer program product, and computer system for identifying, at a block level of a file, a duplicate block of a plurality of blocks within the file. Granularity of a block size used for deduplication of the file at the block level may be adjusted. A type of deduplication may be adjusted for the file. Deduplication of the file at the block level within the file may be executed based upon, at least in part, the granularity of the block size used for deduplication of the file at the block level.
1 . A computer-implemented method comprising:
identifying, at a block level of a file, a duplicate block of a plurality of blocks within the file;
adjusting granularity of a block size used for deduplication of the file at the block level;
adjusting a type of deduplication for the file; and
executing deduplication of the file at the block level within the file based upon, at least in part, the granularity of the block size used for deduplication of the file at the block level.
2 . The computer-implemented method of claim 1 further comprising storing hashes of the plurality of blocks.
3 . The computer-implemented method of claim 2 wherein the hashes of the plurality of blocks are stored as part of file metadata of the file.
4 . The computer-implemented method of claim 3 wherein the hashes of the plurality of blocks are stored as part of the file metadata of the file as extended attributes sent to a block array to a NAS file system.
5 . The computer-implemented method of claim 4 wherein the extended attributes are sent to the block array to the NAS file system using an Application Programming Interface (API) call.
6 . The computer-implemented method of claim 1 wherein the granularity is adjusted on a file by file basis.
7 . The computer-implemented method of claim 6 wherein execution of the granularity is based upon, at least in part, available resources.
8 . A computer program product residing on a computer readable storage medium having a plurality of instructions stored thereon which, when executed across one or more processors, causes at least a portion of the one or more processors to perform operations comprising:
identifying, at a block level of a file, a duplicate block of a plurality of blocks within the file;
adjusting granularity of a block size used for deduplication of the file at the block level;
adjusting a type of deduplication for the file; and
executing deduplication of the file at the block level within the file based upon, at least in part, the granularity of the block size used for deduplication of the file at the block level.
9 . The computer program product of claim 8 wherein the operations further comprise storing hashes of the plurality of blocks.
10 . The computer program product of claim 9 wherein the hashes of the plurality of blocks are stored as part of file metadata of the file.
11 . The computer program product of claim 10 wherein the hashes of the plurality of blocks are stored as part of the file metadata of the file as extended attributes sent to a block array to a NAS file system.
12 . The computer program product of claim 11 wherein the extended attributes are sent to the block array to the NAS file system using an Application Programming Interface (API) call.
13 . The computer program product of claim 8 wherein the granularity is adjusted on a file by file basis.
14 . The computer program product of claim 13 wherein execution of the granularity is based upon, at least in part, available resources.
15 . A computing system including one or more processors and one or more memories configured to perform operations comprising:
identifying, at a block level of a file, a duplicate block of a plurality of blocks within the file;
adjusting granularity of a block size used for deduplication of the file at the block level;
adjusting a type of deduplication for the file; and
executing deduplication of the file at the block level within the file based upon, at least in part, the granularity of the block size used for deduplication of the file at the block level.
16 . The computing system of claim 15 wherein the operations further comprise storing hashes of the plurality of blocks.
17 . The computing system of claim 16 wherein the hashes of the plurality of blocks are stored as part of file metadata of the file.
18 . The computing system of claim 17 wherein the hashes of the plurality of blocks are stored as part of the file metadata of the file as extended attributes sent to a block array to a NAS file system.
19 . The computing system of claim 18 wherein the extended attributes are sent to the block array to the NAS file system using an Application Programming Interface (API) call.
20 . The computing system of claim 15 wherein the granularity is adjusted on a file by file basis and based upon, at least in part, available resources.