Optimized inline deduplication
Methods, computer systems, and computer readable medium are described. In a particular embodiment, a storage controller is configured to receive, from a host computing device, a request to perform a bulk array task and in response to receiving the request, store an indication relating old keys of a mapping table to new keys, wherein both the old keys and the new keys correspond to the request. The storage controller is also configured to convey a response indicating completing of the request without prior access of user data and update the mapping table to replace the old keys with the new keys.
1. A method comprising:
receiving a request to write data to a storage system;
generating, based on the request, a hash value associated with the request to write data;
based upon a determination that a sub-portion of a deduplication data structure is cached, determining whether the generated hash value matches an entry in the cached sub-portion of the deduplication data structure, wherein the deduplication data structure also includes a non-cached sub-portion that is not searched; and
responsive to determining that the generated hash value matches an entry in the deduplication data structure, discarding the data and updating the entry in the deduplication data structure.
2. The method of claim 1 further comprising:
responsive to determining that the generated hash value does not match an entry in the deduplication data structure:
writing the data to the storage system; and
adding an entry to the deduplication data structure that includes the generated hash value.
3. The method of claim 1 wherein updating the entry in the deduplication data structure includes moving the entry to a highest level in the deduplication data structure.
4. The method of claim 2 wherein the added entry to the deduplication data structure is included in a highest level in the deduplication data structure.
5. The method of claim 1 further comprising:
responsive to determining that the generated hash value does not match an entry in the cached sub-portion of the deduplication data structure:
writing the data to the storage system; and
adding an entry to the cached sub-portion of the deduplication data structure that includes the generated hash value.
6. The method of claim 1 further comprising:
receiving a read request;
identifying a query value corresponding to a read request;
selecting, based on the query value, from a plurality of levels within a mapping table, the youngest level associated with the query value; and
searching the selected youngest level for an entry that maps the query value to a value corresponding to a location within the storage system.
7. A computing system comprising:
a storage controller coupled to at least one storage device, wherein the storage controller is configured for:
receiving a request to write data to a storage system;
generating, based on the request, a hash value associated with the request to write data;
based upon a determination that a sub-portion of the deduplication data structure is cached, determining whether the generated hash value matches an entry in the cached sub-portion of the deduplication data structure, wherein the deduplication data structure also includes a non-cached sub-portion that is not searched; and
responsive to determining that the generated hash value matches an entry in the deduplication data structure, discarding the data and updating the entry in the deduplication data structure.
8. The computing system of claim 7 wherein the storage controller is further configured for:
responsive to determining that the generated hash value does not match an entry in the deduplication data structure:
writing the data to the storage system; and
adding an entry to the deduplication data structure that includes the generated hash value.
9. The computing system of claim 7 wherein updating the entry in the deduplication data structure includes moving the entry to a highest level in the deduplication data structure.
10. The computing system of claim 8 wherein the added entry to the deduplication data structure is included in a highest level in the deduplication data structure.
11. The computing system of claim 7 wherein the storage controller is further configured for:
responsive to determining that the generated hash value does not match an entry in the cached sub-portion of the deduplication data structure:
writing the data to the storage system; and
adding an entry to the cached sub-portion of the deduplication data structure that includes the generated hash value.
12. The computing system of claim 7 wherein the storage controller is further configured for:
receiving a read request;
identifying a query value corresponding to a read request;
selecting, based on the query value, from a plurality of levels within a mapping table, the youngest level associated with the query value; and
searching the selected youngest level for an entry that maps the query value to a value corresponding to a location within the storage system.
13. A computer readable storage medium that is non-transitory storing program instruction executable by a processor for:
receiving a request to write data to a storage system;
generating, based on the request, a hash value associated with the request to write data;
based upon a determination that a sub-portion of the deduplication data structure is cached, determining whether the generated hash value matches an entry in the cached sub-portion of the deduplication data structure, wherein the deduplication data structure also includes a non-cached sub-portion that is not searched; and
responsive to determining that the generated hash value matches an entry in the deduplication data structure, discarding the data and updating the entry in the deduplication data structure.
14. The computer readable storage medium of claim 13 further comprising program instructions executable by a processor for:
responsive to determining that the generated hash value does not match an entry in the deduplication data structure:
writing the data to the storage system; and
adding an entry to the deduplication data structure that includes the generated hash value.
15. The computer readable storage medium of claim 13 wherein updating the entry in the deduplication data structure includes moving the entry to a highest level in the deduplication data structure.
16. The computer readable storage medium of claim 14 wherein the added entry to the deduplication data structure is included in a highest level in the deduplication data structure.
17. The computer readable storage medium of claim 13 further comprising program instructions executable by a processor for:
responsive to determining that the generated hash value does not match an entry in the cached sub-portion of the deduplication data structure:
writing the data to the storage system; and
adding an entry to the cached sub-portion of the deduplication data structure that includes the generated hash value.