Metadata representation for enabling partial page duplication
An aspect includes providing a metadata structure having a logical level that points to a virtual level and a physical level to which the virtual level points. The method also includes storing, at the virtual level, a reference counter for each of a plurality of virtual-level type storage address entries in the metadata structure, and providing a pointer in the metadata structure between each pair of a number of pairs of virtual level address entries in which corresponding pages share a set of common sectors. The reference counter tracks a number of instances in which a corresponding pointer points to a corresponding virtual level address entry. An aspect further includes storing a single instance of the common sectors at the physical level.
1. A method, comprising:
providing a metadata structure having multiple levels of indirection of data storage, the multiple levels of indirection including a logical level that points to a virtual level, and a physical level to which the virtual level points;
storing, at the virtual level, a reference counter for each of a plurality of virtual-level type storage address entries in the metadata structure;
providing a pointer in the metadata structure between each pair of a number of pairs of virtual level address entries in which corresponding pages share a set of common sectors, the pointer indicating a partial match between the corresponding pages, the partial match occurring when the set of common sectors includes fewer than all sectors in any of the corresponding pages,
wherein the reference counter tracks a number of instances in which a corresponding pointer points to a corresponding virtual level address entry; and
storing a single instance of the common sectors at the physical level.
2. The method of claim 1 , wherein a virtual-level type storage address entry that points to the page that stores the common sectors maintains ownership of the page with respect to deduplication operations.
3. The method of claim 2 , wherein a virtual-level type storage address entry that does not point to the page storing the common sectors is dependent on the virtual-level type storage address that points to the page storing the common sectors.
4. The method of claim 1 , further comprising:
storing, in a hash table, a listing of the virtual-level type storage addresses and hashed values for pages corresponding to the virtual-level type storage addresses.
5. The method of claim 4 , wherein the virtual-level type storage addresses point to a physical-level type storage address at the physical level in which data is stored.
6. The method of claim 1 , wherein when the reference count for the virtual-level type storage address of the matching page is not equal to zero, the method includes performing a partial deduplication operation.
7. A system comprising:
a memory comprising computer-executable instructions; and
a processor executing the computer-executable instructions, the computer-executable instructions when executed by the processor cause the processor to perform operations comprising:
providing a metadata structure having multiple levels of indirection of data storage, the multiple levels of indirection including a logical level that points to a virtual level, and a physical level to which the virtual level points;
storing, at the virtual level, a reference counter for each of a plurality of virtual-level type storage address entries in the metadata structure;
providing a pointer in the metadata structure between each pair of a number of pairs of virtual level address entries in which corresponding pages share a set of common sectors, the pointer indicating a partial match between the corresponding pages, the partial match occurring when the set of common sectors includes fewer than all sectors in any of the corresponding pages,
wherein the reference counter tracks a number of instances in which a corresponding pointer points to a corresponding virtual level address entry; and
storing a single instance of the common sectors at the physical level.
8. The system of claim 7 , wherein a virtual-level type storage address entry that points to the page that stores the common sectors maintains ownership of the page with respect to deduplication operations.
9. The system of claim 8 , wherein a virtual-level type storage address entry that does not point to the page storing the common sectors is dependent on the virtual-level type storage address that points to the page storing the common sectors.
10. The system of claim 7 , wherein the operations further comprise:
storing, in a hash table, a listing of the virtual-level type storage addresses and hashed values for pages corresponding to the virtual-level type storage addresses.
11. The system of claim 10 , wherein the virtual-level type storage addresses point to physical-level type storage address at the physical level in which data is stored.
12. The system of claim 7 , wherein when the reference count for the virtual-level type storage address of the matching page is not equal to zero, the operations include performing a partial deduplication operation.
13. A computer program product embodied on a non-transitory computer readable medium, and the computer program product including instructions that, when executed by a computer, causes the computer to perform operations, the operations including:
providing a metadata structure having multiple levels of indirection for storing data, the multiple levels of indirection including a logical level that points to a virtual level, and a physical level to which the virtual level points;
storing, at the virtual level, a reference counter for each of a plurality of virtual-level type storage address entries in the metadata structure;
providing a pointer in the metadata structure between each pair of a number of pairs of virtual level address entries in which corresponding pages share a set of common sectors, the pointer indicating a partial match between the corresponding pages, the partial match occurring when the set of common sectors includes fewer than all sectors in any of the corresponding pages,
wherein the reference counter tracks a number of instances in which a corresponding pointer points to a corresponding virtual level address entry; and
storing a single instance of the common sectors at the physical level.
14. The computer program product of claim 13 , wherein the virtual level address entry that points to the page that stores the common sectors maintains ownership of the page with respect to deduplication operations.
15. The computer program product of claim 14 , wherein a virtual-level type storage address entry that does not point to the page storing the common sectors is dependent on the virtual-level type storage address that points to the page storing the common sectors.
16. The computer program product of claim 13 , wherein the operations further include:
storing, in a hash table, a listing of the virtual-level type storage addresses and hashed values for pages corresponding to the virtual-level type storage addresses.
17. The computer program product of claim 16 , wherein the virtual-level type storage addresses point to physical-level type storage address in which data is stored.
18. The computer program product of claim 13 , wherein when the reference count for the virtual-level type storage address of the matching page is not equal to zero, the operations further comprise performing a partial deduplication operation.