Redirect-on-write snapshot mechanism with delayed data movement
Techniques include receiving a backup request for backing up data on a production VVOL, to which is assigned physical space from storage devices in a first storage tier. When the production VVOL and a snapshot VVOL exist, and a write request is received to a data block on the production VVOL that is shared between the production VVOL and the snapshot VVOL, then the techniques include capturing a snapshot of the production VVOL by redirecting the write request to newly allocated space on the production VVOL, writing new data to the newly allocated space, and storing metadata referring to the original block(s) on the production VVOL. Based on an IO workload threshold, the techniques include copying, in a background process, the original version of the modified block from the production VVOL to a snapshot VVOL, to which is assigned physical storage space from storage devices in a second storage tier.
1. A method of performing a backup operation in a data storage system, comprising:
receiving, from a virtualization administrator, a first storage policy profile and a second storage policy profile, the first storage policy profile specifying a first service level objective (SLO) for data stored on a production virtual volume (VVOL), the second storage policy profile specifying a second SLO for data stored on a derivative VVOL;
assigning, to the production VVOL, storage space from at least one storage device in a first storage tier based on the first SLO specified by the first storage policy profile received from the virtualization administrator, the production VVOL including a first data element and a second data element;
assigning, to the derivative VVOL, storage space from at least one storage device in a second storage tier based on the second SLO specified by the second storage policy profile received from the virtualization administrator;
sharing the first data element included in the production VVOL in the first storage tier with the derivative VVOL in the second storage tier, the first data element containing original data;
receiving a write request to write new data to the first data element on the production VVOL in the first storage tier;
in response to receiving the write request to write new data to the first data element on the production VVOL in the first storage tier, redirecting the write request to the second data element on the production VVOL in the first storage tier;
in response to redirecting the write request, writing the new data to the second data element on the production VVOL;
monitoring an input/output (IO) workload of the data storage system; and
continuing monitoring the IO workload and sharing the first data element until the IO workload of the data storage system is less than a predetermined threshold.
2. The method of claim 1 wherein the derivative VVOL includes a third data element, and wherein the method further comprises:
in response to determining, from the monitoring of the IO workload, that the IO workload is less than the predetermined threshold:
discontinuing sharing the first data element; and
demoting the original data contained in the first data element on the production VVOL from the first storage tier to the third data element on the derivative VVOL in the second storage tier.
3. The method of claim 2 further comprising:
storing, in a block map for the derivative VVOL, metadata that refers to the third data element on the derivative VVOL in the second storage tier.
4. The method of claim 2 further comprising:
prior to determining that the IO workload of the data storage system is less than the predetermined threshold, storing first metadata in a block map for the derivative VVOL, the first metadata referring to the original data contained in the first data element on the production VVOL; and
having determined that the IO workload of the data storage system is less than the predetermined threshold, storing second metadata in the block map for the derivative VVOL, the second metadata referring to the original data contained in the third data element on the derivative VVOL.
5. The method of claim 2 wherein demoting the original data includes copying, in a background process, the original data contained in the first data element on the production VVOL to the third data element on the derivative VVOL in response to determining that the IO workload of the data storage system is less than the predetermined threshold.
6. The method of claim 1 further comprising:
storing, in a block map for the production VVOL, metadata that refers to the second data element on the production VVOL in the first storage tier.
7. The method of claim 1 further comprising:
receiving a backup request for performing an incremental backup of the data stored on the production VVOL in the first storage tier.
8. A data storage system, comprising:
a memory; and
processing circuitry configured to execute program instructions out of the memory to:
receive, from a virtualization administrator, a first storage policy profile and a second storage policy profile, the first storage policy profile specifying a first service level objective (SLO) for data stored on a production virtual volume (VVOL), the second storage policy profile specifying a second SLO for data stored on a derivative VVOL;
assign, to the production VVOL, storage space from at least one storage device in a first storage tier based on the first SLO specified by the first storage policy profile received from the virtualization administrator, the production VVOL including a first data element and a second data element;
assign, to the derivative VVOL, storage space from at least one storage device in a second storage tier based on the second SLO specified by the second storage policy profile received from the virtualization administrator;
share the first data element included in the production VVOL in the first storage tier with the derivative VVOL in the second storage tier, the first data element containing original data;
receive a write request to write new data to the first data element on the production VVOL in the first storage tier;
in response to receipt of the write request to write new data to the first data element on the production VVOL in the first storage tier, redirect the write request to the second data element on the production VVOL in the first storage tier;
in response to redirecting the write request, write the new data to the second data element on the production VVOL;
monitor an input/output (IO) workload of the data storage system; and
continue to monitor the IO workload and to share the first data element until the IO workload of the data storage system is less than a predetermined threshold.
9. The data storage system of claim 8 wherein the derivative VVOL includes a third data element, and wherein the processing circuitry is further configured to execute the program instructions out of the memory to:
in response to determining, from the monitoring of the IO workload, that the IO workload is less than the predetermined threshold:
discontinuing sharing the first data element; and
demoting the original data contained in the first data element on the production VVOL from the first storage tier to the third data element on the derivative VVOL in the second storage tier; and
store, in a block map for the derivative VVOL, metadata that refers to the third data element on the derivative VVOL in the second storage tier.
10. The data storage system of claim 8 wherein the processing circuitry is further configured to execute the program instructions out of the memory to store, in a block map for the production VVOL, metadata that refers to the second data element on the production VVOL in the first storage tier.
11. The data storage system of claim 8 wherein the derivative VVOL is one of a snapshot VVOL, a full clone VVOL, and a fast clone VVOL.
12. A computer program product including a set of non-transitory, computer-readable media having instructions that, when executed by control circuitry of a computerized apparatus, cause the control circuitry to perform a method of performing a backup operation in a data storage system, the method comprising:
receiving, from a virtualization administrator, a first storage policy profile and a second storage policy profile, the first storage policy profile specifying a first service level objective (SLO) for data stored on a production virtual volume (VVOL), the second storage policy profile specifying a second SLO for data stored on a derivative VVOL;
assigning, to the production VVOL, storage space from at least one storage device in a first storage tier based on the first SLO specified by the first storage policy profile received from the virtualization administrator, the production VVOL including a first data element and a second data element;
assigning, to the derivative VVOL, storage space from at least one storage device in a second storage tier based on the second SLO specified by the second storage policy profile received from the virtualization administrator, the derivative VVOL including a third data element;
sharing the first data element included in the production VVOL in the first storage tier with the derivative VVOL in the second storage tier, the first data element containing original data;
receiving a write request to write new data to the first data element on the production VVOL in the first storage tier;
in response to receiving the write request to write new data to the first data element on the production VVOL in the first storage tier, redirecting the write request to the second data element on the production VVOL in the first storage tier;
in response to redirecting the write request, writing the new data to the second data element on the production VVOL;
monitoring an input/output (IO) workload of the data storage system; and
continuing monitoring the IO workload and sharing the first data element until the IO workload of the data storage system is less than a predetermined threshold.