Optimized simultaneous storing of data into deduplicated and non-deduplicated storage pools
View Patent ↗One aspect of the present invention includes an optimized simultaneous storage operation for data objects onto a combination of deduplicated and non-deduplicated storage pools. In one embodiment, a data object is provided for storage onto destination storage pools in a storage management system, and placed into a source buffer. The data object is first divided into data chunks if the data object has not previously been chunked within the storage management system. The data object is then simultaneously copied from the source buffer to each destination storage pool (deduplicating and non-deduplicating) with the following operation. If the destination pool utilizes deduplication, then the individual data chunks are only transferred if copies of the individual data chunks do not already exist on the destination storage pool. If the destination pool does not utilize deduplication, then all chunks of the data object are transferred to the destination storage pool.
1. A method for optimizing the simultaneous storage of data into deduplicated and non-deduplicated storage pools, comprising:
placing a data object into a source buffer;
copying the data object to a temporary buffer if the data object has not been previously divided into data chunks;
dividing the data object within the temporary buffer into data chunks if the data object has not been previously divided into data chunks;
copying a data chunk into a target buffer for a deduplicated destination storage pool if a copy of the data chunk does not exist within the deduplicated destination storage pool and copying the data chunk into a target buffer for a non-deduplicated destination storage pool, wherein control data is embedded in the data chunk and the data chunk is compressed during the copy;
copying the data chunk in the target buffer for the deduplicated destination storage pool to the deduplicated destination storage pool;
copying the data chunk in the target buffer for the non-deduplicated destination storage pool to the non-deduplicated destination storage pool; and
repeating the copying for each data chunk of the data chunks.
2. The method of claim 1 , wherein the data object is divided into data chunks using a Rabin fingerprinting algorithm.
3. The method of claim 1 , wherein a Secure Hash Algorithm digest is generated for each data chunk.
4. The method of claim 1 , further comprising cataloging the data chunk in the destination storage pool as a base chunk responsive to determining the destination storage pool is a deduplicating storage pool and a copy of the data chunk does not exist in the destination storage pool.
5. The method of claim 1 , further comprising cataloging the data chunk to point to a copy of the data chunk in the destination storage pool responsive to determining the destination storage pool is a deduplicating storage pool and a copy of the data chunk exists in the destination storage pool.
6. A system, comprising:
at least one processor; and
at least one memory storing instructions operable with the at least one processor for optimizing the simultaneous storage of data into deduplicated and non-deduplicated storage pools, the instructions being executed for:
placing a data object into a source buffer;
copying the data object to a temporary buffer if the data object has not been previously divided into data chunks;
dividing the data object within the temporary buffer into data chunks if the data object has not been previously divided into data chunks;
copying a data chunk into a target buffer for a deduplicated destination storage pool if a copy of the data chunk does not exist within the deduplicated destination storage pool and copying the data chunk into a target buffer for a non-deduplicated destination storage pool, wherein control data is embedded in the data chunk and the data chunk is compressed during the copy;
copying the data chunk in the target buffer for the deduplicated destination storage pool to the deduplicated destination storage pool; and
copying the data chunk in the target buffer for the non-deduplicated destination storage pool to the non-deduplicated destination storage pool; and
repeating the copying for each data chunk of the data chunks.
7. The system of claim 6 , wherein the data object is divided into data chunks using a Rabin fingerprinting algorithm.
8. The system of claim 6 , wherein a Secure Hash Algorithm digest is generated for each data chunk.
9. The system of claim 6 , further comprising cataloging the data chunk in the destination storage pool as a base chunk responsive to determining the destination storage pool is a deduplicating storage pool and a copy of the data chunk does not exist in the destination storage pool.
10. The system of claim 6 , further comprising cataloging the data chunk to point to a copy of the data chunk in the destination storage pool responsive to determining the destination storage pool is a deduplicating storage pool and a copy of the data chunk exists in the destination storage pool.
11. A computer program product comprising a tangible computer readable storage medium storing a computer readable program for optimizing the simultaneous storage of data into deduplicated and non-deduplicated storage pools, wherein the computer readable program when executed on a computer causes the computer to:
place a data object into a source buffer;
copying the data object to a temporary buffer if the data object has not been previously divided into data chunks;
divide the data object within the temporary buffer into data chunks if the data object has not been previously divided into data chunks;
copying a data chunk into a target buffer for a deduplicated destination storage pool if a copy of the data chunk does not exist within the deduplicated destination storage pool and copying the data chunk into a target buffer for a non-deduplicated destination storage pool, wherein control data is embedded in the data chunk and the data chunk is compressed during the copy;
copying the data chunk in the target buffer for the deduplicated destination storage pool to the deduplicated destination storage pool; and
copying the data chunk in the target buffer for the non-deduplicated destination storage pool to the non-deduplicated destination storage pool; and
repeating the copying for each data chunk of the data chunks.
12. The computer program product of claim 10 , wherein the data object is divided into data chunks using a Rabin fingerprinting algorithm.
13. The computer program product of claim 11 , wherein a Secure Hash Algorithm digest is generated for each data chunk.
14. The computer program product of claim 11 , further comprising cataloging the data chunk to point to a copy of the data chunk in the destination storage pool responsive to determining the destination storage pool is a deduplicating storage pool and a copy of the data chunk exists in the destination storage pool.
15. The computer program product of claim 11 , further comprising cataloging the data chunk to point to a copy of the data chunk in the destination storage pool responsive to determining the destination storage pool is a deduplicating storage pool and a copy of the data chunk exists in the destination storage pool.