System and method for optimal order migration into a cache based deduplicated storage array
A method, computer program product, and computer system for preparing, by a computing device, for migration of data from a source to a target. Hash values of the data may be sorted at the source. The data may be migrated from the source to the target according to how the data was sorted at the source.
1. A computer-implemented method comprising:
preparing, by a computing device, for migration of data from a source storage system to a target storage system;
sorting hash values of the data at the source storage system, wherein sorting the hash values of the data at the source storage system includes:
querying the source storage system to effectuate providing a comparison of volumes of data that deduplicate together with volumes of data that do not deduplicate together;
migrating the data from the source storage system to the target storage system according to how the data was sorted at the source storage system;
receiving, at the source storage system, a plurality of commands to migrate the data until all of the data is migrated, wherein each of the plurality of commands is a READ NEXT PAGE command;
in response to an initial READ NEXT PAGE command of the plurality of commands being received by the source storage system, the source storage system organizes all of the data identified by the initial READ NEXT PAGE command of the plurality of commands so that pages sharing a hash are grouped together; and
in response to subsequent READ NEXT PAGE commands of the plurality of commands, sequentially sending pages with shared hashes from the source storage system.
2. The computer-implemented method of claim 1 wherein the source storage system and the target storage system use different deduplication techniques.
3. The computer-implemented method of claim 1 wherein each of the plurality of READ NEXT PAGE commands includes an input, wherein the input includes a volume, a page size, and a session ID associated with the data migration.
4. The computer-implemented method of claim 1 wherein each of the plurality of READ NEXT PAGE commands includes an output, wherein the output includes a volumes, an offset, and a full page associated with the data migration.
5. The computer-implemented method of claim 1 wherein a page size of the source storage system is larger than a page size of the target storage system.
6. The computer-implemented method of claim 1 wherein sorting the hash values of the data at the source storage system includes: querying the source storage system to effectuate providing an exact deduplication of the data.
7. A computer program product residing on a non-transitory computer readable storage medium having a plurality of instructions stored thereon which, when executed across one or more processors, causes at least a portion of the one or more processors to perform operations comprising:
preparing for migration of data from a source storage system to a target storage system;
sorting hash values of the data at the source storage system, wherein sorting the hash values of the data at the source storage system includes:
querying the source storage system to effectuate providing a comparison of volumes of data that deduplicate together with volumes of data that do not deduplicate together;
migrating the data from the source storage system to the target storage system according to how the data was sorted at the source storage system;
receiving, at the source storage system, a plurality of commands to migrate the data until all of the data is migrated, wherein each of the plurality of commands is a READ NEXT PAGE command;
in response to an initial READ NEXT PAGE command of the plurality of commands being received by the source storage system, the source storage system organizes all of the data identified by the initial READ NEXT PAGE command of the plurality of commands so that pages sharing a hash are grouped together; and
in response to subsequent READ NEXT PAGE commands of the plurality of commands, sequentially sending pages with shared hashes from the source storage system.
8. The computer program product of claim 7 wherein each of the plurality of READ NEXT PAGE commands includes an input, wherein the input includes a volume, a page size, and a session ID associated with the data migration.
9. The computer program product of claim 7 wherein each of the plurality of READ NEXT PAGE commands includes an output, wherein the output includes a volumes, an offset, and a full page associated with the data migration.
10. The computer program product of claim 7 wherein a page size of the source storage system is larger than a page size of the target storage system.
11. A computing system including one or more processors and one or more memories configured to perform operations comprising:
preparing for migration of data from a source storage system to a target storage system;
sorting hash values of the data at the source storage system, wherein sorting the hash values of the data at the source storage system includes:
querying the source storage system to effectuate providing a comparison of volumes of data that deduplicate together with volumes of data that do not deduplicate together;
migrating the data from the source storage system to the target storage system according to how the data was sorted at the source storage system;
receiving, at the source storage system, a plurality of commands to migrate the data until all of the data is migrated, wherein each of the plurality of commands is a READ NEXT PAGE command;
in response to an initial READ NEXT PAGE command of the plurality of commands being received by the source storage system, the source storage system organizes all of the data identified by the initial READ NEXT PAGE command of the plurality of commands so that pages sharing a hash are grouped together; and
in response to subsequent READ NEXT PAGE commands of the plurality of commands, sequentially sending pages with shared hashes from the source storage system.
12. The computing system of claim 11 wherein each of the plurality of READ NEXT PAGE commands includes an input, wherein the input includes a volume, a page size, and a session ID associated with the data migration.
13. The computing system of claim 11 wherein each of the plurality of READ NEXT PAGE commands includes an output, wherein the output includes a volumes, an offset, and a full page associated with the data migration.
14. The computing system of claim 11 wherein a page size of the source storage system is larger than a page size of the target storage system.