Technique for efficient migration of live virtual disk across storage containers of a cluster
A technique efficiently migrates a live virtual disk (vdisk) across storage containers of a cluster having a plurality of nodes deployed in a virtualization environment. Each node is embodied as a physical computer with hardware resources, such as processor, memory, network and storage resources, that are virtualized to provide support for one or more user virtual machines (UVM) executing on the node. The storage resources include storage devices embodied as a storage pool that is logically segmented into the storage containers configured to store one or more vdisks. The storage containers include a source container having associated storage policies and a destination container having different (new) storage policies. The technique enables migration of the live vdisk from the source container to the destination container without powering down the UVM and halting input/output accesses to the vdisk, and while maintaining uninterrupted servicing of data from the live vdisk during the migration transparent to the executing UVM.
1. A method of virtual disk (vdisk) migration comprising:
organizing a storage pool of storage devices coupled to nodes into source and destination storage containers configured to store one or more virtual disks (vdisks);
hydrating data from a source vdisk on the source storage container having a first storage policy to a target vdisk on the destination storage container having a second storage policy different from the first storage policy;
creating a live vdisk on the destination storage container as a mutable point-in-time copy of the target vdisk, the live vdisk configured to service an input/output (I/O) access to the data; and
redirecting servicing of the I/O access from the source vdisk to the live vdisk without interrupting the servicing of the I/O access during the vdisk migration.
2. The method of claim 1 wherein the target vdisk is a mirror vdisk configured as a backing store for the live vdisk.
3. The method of claim 2 wherein the mirror vdisk is a read-only snapshot.
4. The method of claim 1 wherein hydrating data comprises fetching the data on-demand from the source vdisk to the target vdisk as the target vdisk is hydrated.
5. The method of claim 1 wherein the mutable point-in-time copy is a read/write snapshot.
6. The method of claim 1 wherein creating a live vdisk comprises:
linking the live vdisk to a user virtual machine (UVM) executing on a node; and
continuing service of the data from the live vdisk without powering down the UVM and halting the I/O access during the vdisk migration.
7. The method of claim 1 wherein the target vdisk is a mirror vdisk created in accordance with a scanner configured to eliminate copying data overwritten in the live vdisk from the hydration of data from the source vdisk to the mirror vdisk as a background process.
8. The method of claim 7 wherein hydrating data further comprises applying the second storage policy of the destination container to the mirror vdisk as scanned data is written from the source vdisk to the mirror vdisk.
9. A non-transitory computer readable medium including program instructions executable on a processor of a node of a plurality of nodes to enable virtual disk (vdisk) migration, the program instructions configured to:
organize a storage pool of storage devices coupled to the nodes into source and destination storage containers configured to store one or more virtual disks (vdisks);
hydrate data from a source vdisk on the source storage container having a first storage policy to a target vdisk on the destination storage container having a second storage policy different from the first storage policy;
create a live vdisk on the destination storage container as a mutable point-in-time copy of the target vdisk, the live vdisk configured to service an input/output (I/O) access to the data; and
redirect servicing of the I/O access from the source vdisk to the live vdisk without interrupting the servicing of the I/O access during the vdisk migration.
10. The non-transitory computer readable medium of claim 9 , wherein the target vdisk is a mirror vdisk configured as a backing store for the live vdisk.
11. The non-transitory computer readable medium of claim 10 , wherein the mirror vdisk is a read-only snapshot.
12. The non-transitory computer readable medium of claim 9 , wherein the program instructions configured to hydrate data are further configured to fetch the data on-demand from the source vdisk to the target vdisk as the target vdisk is hydrated.
13. The non-transitory computer readable medium of claim 9 , wherein the mutable point-in-time copy is a read/write snapshot.
14. The non-transitory computer readable medium of claim 9 , wherein the program instructions configured to create a live vdisk are further configured to:
link the live vdisk to a user virtual machine (UVM) executing on the node; and
continue service of the data from the live vdisk without powering down the UVM and halting the I/O access during the vdisk migration.
15. The non-transitory computer readable medium of claim 9 , wherein the target vdisk is a mirror vdisk created in accordance with a scanner configured to eliminate copying data overwritten in the live vdisk from the hydration of data from the source vdisk to the mirror vdisk as a background process.
16. The non-transitory computer readable medium of claim 15 , wherein the program instructions configured to hydrate data are further configured to apply the second storage policy of the destination container to the mirror vdisk as scanned data is written from the source vdisk data to the mirror vdisk.
17. An apparatus comprising:
a node having a processor; and
a source virtual disk (vdisk) configured to service input/output (I/O) accesses across source and destination storage containers of the node, the processor configured to migrate the vdisk across the storage containers by executing program instructions to:
organize a storage pool of storage devices coupled to a plurality of nodes into source and destination storage containers configured to store one or more virtual disks (vdisks);
hydrate data from a source vdisk on the source storage container having a first storage policy to a target vdisk on the destination storage container having a second storage policy different from the first storage policy;
create a live vdisk on the destination storage container as a mutable point-in-time copy of the target vdisk, the live vdisk configured to service an input/output (I/O) access to the data; and
redirect servicing of the I/O access from the source vdisk to the live vdisk without interrupting the servicing of the I/O access during the vdisk migration.
18. The apparatus of claim 17 wherein the target vdisk is a mirror vdisk configured as a backing store for the live vdisk.
19. The apparatus of claim 18 wherein the mirror vdisk is a read-only snapshot.
20. The apparatus of claim 17 wherein the processor configured to execute program instructions to hydrate data is further configured to fetch the data on-demand from the source vdisk to the target vdisk as the target vdisk is hydrated.
21. The apparatus of claim 17 wherein the mutable point-in-time copy is a read/write snapshot.
22. The apparatus of claim 17 wherein the processor configured to execute program instructions to create a live vdisk is further configured to:
link the live vdisk to a user virtual machine (UVM) executing on the node; and
continue service of the data from the live vdisk without powering down the UVM and halting the I/O access during the vdisk migration.
23. The apparatus of claim 17 , wherein the target vdisk is a mirror vdisk created in accordance with a scanner configured to eliminate copying data overwritten in the live vdisk from the hydration of data from the source vdisk to the mirror vdisk as a background process.
24. The apparatus of claim 23 , wherein the processor configured to execute program instructions to hydrate data is further configured to apply the second storage policy of the destination container to the mirror vdisk as scanned data is written from the source vdisk data to the mirror vdisk.