Determining data to store in retention storage
In one aspect, a method includes generating a protection file system in a deduplication storage array, generating a snapshot of a production volume in the deduplication storage array including hashes of data in the snapshot, generating a first file hierarchy for the hashes of the data in the snapshot in the protection file system and adding a retention indicator to each hash in the first file hierarchy.
1. A method comprising:
generating a protection file system in a deduplication storage array;
generating a snapshot of a production volume in the deduplication storage array, the snapshot including the data and hashes of the data in the snapshot;
generating a first file hierarchy for the hashes of the data in the snapshot in the protection file system;
adding a retention indicator to each hash in the first file hierarchy, the retention indicator denoting retaining the hash even when a reference count for the hash is zero; and
recovering the production volume comprising:
generating a virtual volume;
after receiving a read command to read data from the virtual volume:
reading the data from the protection file system when the hash of the data exists in the deduplication storage array;
reading the data from the retention storage when the hash of the data does not exist in the deduplication storage array;
after receiving a write command to write data to the virtual volume:
writing the data to be written to the production volume;
marking the hash of the data to be written with a retention indicator; and
updating a pointer of the hash of the data to be written in the protection file system.
2. The method of claim 1 , further comprising moving a hash in the first file hierarchy from the deduplication storage array to a retention storage if the deduplication storage array no longer uses the hash and if the retention indicator indicates retention.
3. The method of claim 1 , further comprising:
generating a second snapshot of the production volume; and
generating a second file hierarchy indicating changes from the first file hierarchy.
4. The method of claim 1 , further comprising determining if the deduplication storage array no longer uses the hash in an address-to-hash mapping,
wherein determining if the deduplication storage array no longer uses the hash comprises determining if a reference count is zero.
5. The method of claim 1 , further comprising adding a retention indicator for each new hash generated.
6. An apparatus, comprising:
electronic hardware circuitry configured to:
generate a protection file system in a deduplication storage array;
generate a snapshot of a production volume in the deduplication storage array including the data and hashes of the data in the snapshot;
generate a first file hierarchy for the hashes of the data in the snapshot in the protection file system;
add a retention indicator to each hash in the first file hierarchy, the retention indicator denoting retaining the hash even when a reference count for the hash is zero; and
recover the production volume, comprising:
generate a virtual volume;
after receiving a read command to read data from the virtual volume:
read the data from the protection file system when the hash of the data exists in the deduplication storage array; or
read the data from the retention storage when the hash of the data does not exist in the deduplication storage array;
after receiving a write command to write data to the virtual volume:
write the data to be written to the production volume;
mark the hash of the data to be written with a retention indicator; and
update a pointer of the hash of the data to be written in the protection file system.
7. The apparatus of claim 6 , further comprising circuitry configured to move a hash in the first file hierarchy from the deduplication storage array to a retention storage if the deduplication storage array no longer uses the hash and if the retention indicator indicates retention.
8. The apparatus of claim 6 , further comprising circuitry configured to:
generate a second snapshot of the production volume; and
generate a second file hierarchy indicating changes from the first file hierarchy.
9. The apparatus of claim 6 , further comprising circuitry configured to determine if the deduplication storage array no longer uses the hash,
wherein the circuitry configured to determine if the deduplication storage array no longer uses the hash comprises circuitry configured to determine if a reference count is zero.
10. The apparatus of claim 6 , further comprising circuitry configured to add a retention indicator for each new hash generated.
11. An article comprising:
a non-transitory computer-readable medium that stores computer-executable instructions, the instructions causing a machine to:
generate a protection file system in a deduplication storage array;
generate a snapshot of a production volume in the deduplication storage array including the data and hashes of the data in the snapshot;
generate a first file hierarchy for the hashes of the data in the snapshot in the protection file system;
add a retention indicator to each hash in the first file hierarchy, the retention indicator denoting retaining the hash even when a reference count for the hash is zero; and
recover the production volume comprising:
after receiving a read command to read data from the virtual volume:
read the data from the protection file system if the hash of the data exists in the deduplication storage array; or
read the data from the retention storage if the hash of the data does not exist in the deduplication storage array;
after receiving a write command to write data to the virtual volume:
write the data to be written to the production volume;
mark the hash of the data to be written with a retention indicator, the retention indicator denoting retaining the hash even when a reference count for the hash is zero; and
update a pointer of the hash of the data to be written in the protection file system.
12. The article of claim 11 , further comprising instructions causing the machine to move a hash in the first file hierarchy from the deduplication storage array to a retention storage if the deduplication storage array no longer uses the hash and if the retention indicator indicates retention.
13. The article of claim 11 , further comprising instructions causing the machine to:
generate a second snapshot of the production volume;
generate a second file hierarchy indicating changes from the first file hierarchy; and
add a retention indicator for each new hash generated.
14. The article of claim 11 , further comprising instructions causing the machine to determine if the deduplication storage array no longer uses the hash,
wherein the instructions causing the machine to determine if the deduplication storage array no longer uses the hash comprises instructions causing the machine to determine if a reference count is zero.