IP Library › Granted Patent US 11,216,388
Granted Patent B2
US 11,216,388 · App. 16/398,595 · Granted Jan 4, 2022

Tiering between storage media in a content aware storage system

Inventors: Anton Kucherov (Dudley, MA); David Meiri (Somerville, MA)
Assignee: EMC IP Holding Company LLC
G06F12/124G06F3/065G06F3/0608G06F3/0652G06F3/0659G06F3/0685G06F2212/1044
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,216,388
App. No.
16/398,595
Filed
Apr 30, 2019
Granted
Jan 4, 2022
Kind
B2
Art Unit
2132
USPC
711/136
Abstract

Tiering data between storage media in a content aware storage system is provided. An aspect includes, for each metadata page (MP) of a plurality of MPs: storing a first copy of the MP in a high tier storage, a second copy in an intermediate tier storage, and a third copy in low tier storage. Upon determining, in response to monitoring available space in the high tier storage, usage of the high tier storage exceeds a threshold value, an aspect includes identifying a least recently used (LRU) MP, deleting the LRU MP from the high tier storage, and destaging active entries of a metadata journal for the LRU MP. An aspect further includes receiving a request to read one of the plurality of MPs and, upon determining one of the MPs is the LRU metadata page, an aspect includes reading MP from the intermediate tier storage.

Claims (86)

1. A method for tiering data between storage media in a content aware storage system, comprising:

for each metadata page of a plurality of metadata pages in the content aware storage system:

storing a first copy of the metadata page in a high tier storage;

storing a second copy of the metadata page in an intermediate tier storage; and

storing a third copy of the metadata page in low tier storage;

maintaining a per region delta log for changes to the active journal entries of the metadata pages in the low tier storage;

upon determining, in response to monitoring available space in the high tier storage, usage of the high tier storage exceeds a threshold value:

identifying a least recently used (LRU) metadata page of the plurality of metadata pages;

deleting the LRU metadata page from the high tier storage; and

destaging active entries of a metadata journal for the LRU metadata page;

receiving a request to read one of the plurality of metadata pages; and

upon determining the one of the plurality of metadata pages is the LRU metadata page that was deleted from the high tier storage, reading the one of the plurality of metadata pages from the intermediate tier storage.

2. The method of claim 1 , further comprising:

upon determining the one of the plurality of metadata pages is not the LRU metadata page, reading the one of the plurality of metadata pages from the high tier storage.

3. The method of claim 1 , wherein destaging the active entries of the metadata journal for the LRU metadata page includes writing changes corresponding to the active entries to second and third copies of the LRU metadata page.

4. The method of claim 1 , wherein destaging the active entries of the metadata journal for the LRU metadata page includes writing changes corresponding to the active entries only to a second copy of the LRU metadata page, the method further comprising:

monitoring amortization of write activities of the metadata pages; and

upon determining a threshold value of the amortization has been reached for one of the metadata pages in the low tier storage, writing the changes from the per region delta log with respect to the one of the metadata pages to the corresponding one of the metadata pages in the low tier storage.

5. The method of claim 1 , further comprising:

writing user data corresponding to the metadata page of the plurality of metadata pages to the low tier storage;

upon determining read activity for the metadata page has exceeded a threshold frequency value:

copying the user data to the intermediate tier storage;

maintaining an existing copy of the user data in the low tier storage; and

marking a copy of the user data in the intermediate tier storage in cache; and

upon receiving a request to read the user data, reading the copy of the user data from the intermediate tier storage.

6. The method of claim 5 , further comprising:

upon determining the read activity for the metadata page has not reached or exceeded the threshold frequency value, reading a copy of the user data from the low tier storage.

7. The method of claim 6 , wherein the high tier storage is random access memory, the intermediate storage is storage class memory, and the low tier storage is a solid state drive.

8. A system for tiering data between storage media, the system comprising:

a memory comprising computer-executable instructions; and

a processor operable by a storage system, the processor executing the computer-executable instructions, the computer-executable instructions when executed by the processor cause the processor to perform operations comprising:

for each metadata page of a plurality of metadata pages in a content aware storage system:

storing a first copy of the metadata page in a high tier storage;

storing a second copy of the metadata page in an intermediate tier storage; and

storing a third copy of the metadata page in low tier storage;

maintaining a per region delta log for changes to the active journal entries of the metadata pages in the low tier storage;

upon determining, in response to monitoring available space in the high tier storage, usage of the high tier storage exceeds a threshold value:

identifying a least recently used (LRU) metadata page of the plurality of metadata pages;

deleting the LRU metadata page from the high tier storage; and

destaging active entries of a metadata journal for the LRU metadata page;

receiving a request to read one of the plurality of metadata pages; and

upon determining the one of the plurality of metadata pages is the LRU metadata page that was deleted from the high tier storage, reading the one of the plurality of metadata pages from the intermediate tier storage.

9. The system of claim 8 , wherein the operations further comprise:

upon determining the one of the plurality of metadata pages is not the LRU metadata page, reading the one of the plurality of metadata pages from the high tier storage.

10. The system of claim 8 , wherein destaging the active entries of the metadata journal for the LRU metadata page includes writing changes corresponding to the active entries to second and third copies of the LRU metadata page.

11. The system of claim 8 , wherein destaging the active entries of the metadata journal for the LRU metadata page includes writing changes corresponding to the active entries only to a second copy of the LRU metadata page, the operations further comprising:

monitoring amortization of write activities of the metadata pages; and

upon determining a threshold value of the amortization has been reached for one of the metadata pages in the low tier storage, writing the changes from the per region delta log with respect to the one of the metadata pages to the corresponding one of the metadata pages in the low tier storage.

12. The system of claim 8 , wherein the operations further comprise:

writing user data corresponding to the metadata page of the plurality of metadata pages to the low tier storage;

upon determining read activity for the metadata page has exceeded a threshold frequency value:

copying the user data to the intermediate tier storage;

maintaining an existing copy of the user data in the low tier storage; and

marking a copy of the user data in the intermediate tier storage in cache; and

upon receiving a request to read the user data, reading the copy of the user data from the intermediate tier storage.

13. The system of claim 12 , wherein the operations further comprise:

upon determining the read activity for the metadata page has not reached or exceeded the threshold frequency value, reading a copy of the user data from the low tier storage.

14. The system of claim 13 , wherein the high tier storage is random access memory, the intermediate storage is storage class memory, and the low tier storage is a solid state drive.

15. A computer program product embodied on a non-transitory computer readable medium, the computer program product including instructions that, when executed by a computer, causes the computer to perform operations comprising:

for each metadata page of a plurality of metadata pages in a content aware storage system:

storing a first copy of the metadata page in a high tier storage;

storing a second copy of the metadata page in an intermediate tier storage; and

storing a third copy of the metadata page in low tier storage;

maintaining a per region delta log for changes to the active journal entries of the metadata pages in the low tier storage;

upon determining, in response to monitoring available space in the high tier storage, usage of the high tier storage exceeds a threshold value:

identifying a least recently used (LRU) metadata page of the plurality of metadata pages;

deleting the LRU metadata page from the high tier storage; and

destaging active entries of a metadata journal for the LRU metadata page;

receiving a request to read one of the plurality of metadata pages; and

upon determining the one of the plurality of metadata pages is the LRU metadata page that was deleted from the high tier storage, reading the one of the plurality of metadata pages from the intermediate tier storage.

16. The computer program product of claim 15 , wherein the operations further comprise:

upon determining the one of the plurality of metadata pages is not the LRU metadata page, reading the one of the plurality of metadata pages from the high tier storage.

17. The computer program product of claim 15 , wherein destaging the active entries of the metadata journal for the LRU metadata page includes writing changes corresponding to the active entries to second and third copies of the LRU metadata page.

18. The computer program product of claim 15 , wherein destaging the active entries of the metadata journal for the LRU metadata page includes writing changes corresponding to the active entries only to a second copy of the LRU metadata page, the operations further comprising:

monitoring amortization of write activities of the metadata pages; and

upon determining a threshold value of the amortization has been reached for one of the metadata pages in the low tier storage, writing the changes from the per region delta log with respect to the one of the metadata pages to the corresponding one of the metadata pages in the low tier storage.

19. The computer program product of claim 15 , wherein the operations further comprise:

writing user data corresponding to the metadata page of the plurality of metadata pages to the low tier storage;

upon determining read activity for the metadata page has exceeded a threshold frequency value:

copying the user data to the intermediate tier storage;

maintaining an existing copy of the user data in the low tier storage; and

marking a copy of the user data in the intermediate tier storage in cache; and

upon receiving a request to read the user data, reading the copy of the user data from the intermediate tier storage.

20. The computer program product of claim 19 , wherein the operations further comprise:

upon determining the read activity for the metadata page has not reached or exceeded the threshold frequency value, reading a copy of the user data from the low tier storage; and

wherein the high tier storage is random access memory, the intermediate storage is storage class memory, and the low tier storage is a solid state drive.

Assignments (9)
RELEASE OF SECURITY INTEREST IN PATENTS PREVIOUSLY RECORDED AT REEL/FRAME (050724/0466) Recorded Jun 23, 2022
From: THE BANK OF NEW YORK MELLON TRUST COMPANY, N.A., AS NOTES COLLATERAL AGENT
To: DELL PRODUCTS L.P.; EMC CORPORATION; EMC IP HOLDING COMPANY LLC; DELL MARKETING CORPORATION (SUCCESSOR-IN-INTEREST TO WYSE TECHNOLOGY L.L.C.)
Reel/Frame 060753/0486 →
RELEASE OF SECURITY INTEREST IN PATENTS PREVIOUSLY RECORDED AT REEL/FRAME (053546/0001) Recorded Jun 23, 2022
From: THE BANK OF NEW YORK MELLON TRUST COMPANY, N.A., AS NOTES COLLATERAL AGENT
To: DELL MARKETING L.P. (ON BEHALF OF ITSELF AND AS SUCCESSOR-IN-INTEREST TO CREDANT TECHNOLOGIES, INC.); DELL INTERNATIONAL L.L.C.; DELL PRODUCTS L.P.; DELL USA L.P.; EMC CORPORATION; DELL MARKETING CORPORATION (SUCCESSOR-IN-INTEREST TO FORCE10 NETWORKS, INC. AND WYSE TECHNOLOGY L.L.C.); EMC IP HOLDING COMPANY LLC
Reel/Frame 071642/0001 →
RELEASE OF SECURITY INTEREST IN PATENTS PREVIOUSLY RECORDED AT REEL/FRAME (053311/0169) Recorded Jun 23, 2022
From: THE BANK OF NEW YORK MELLON TRUST COMPANY, N.A., AS NOTES COLLATERAL AGENT
To: DELL PRODUCTS L.P.; EMC CORPORATION; EMC IP HOLDING COMPANY LLC
Reel/Frame 060438/0742 →
RELEASE OF SECURITY INTEREST AT REEL 050405 FRAME 0534 Recorded Nov 2, 2021
From: CREDIT SUISSE AG, CAYMAN ISLANDS BRANCH
To: DELL PRODUCTS L.P.; EMC CORPORATION; EMC IP HOLDING COMPANY LLC; WYSE TECHNOLOGY L.L.C.
Reel/Frame 058001/0001 →
SECURITY INTEREST Recorded Jun 5, 2020
From: DELL PRODUCTS L.P.; EMC CORPORATION; EMC IP HOLDING COMPANY LLC
To: THE BANK OF NEW YORK MELLON TRUST COMPANY, N.A., AS COLLATERAL AGENT
Reel/Frame 053311/0169 →
SECURITY AGREEMENT Recorded Apr 22, 2020
From: CREDANT TECHNOLOGIES INC.; DELL INTERNATIONAL L.L.C.; DELL MARKETING L.P.; DELL PRODUCTS L.P.; DELL USA L.P.; EMC CORPORATION; FORCE10 NETWORKS, INC.; WYSE TECHNOLOGY L.L.C.; EMC IP HOLDING COMPANY LLC
To: THE BANK OF NEW YORK MELLON TRUST COMPANY, N.A.
Reel/Frame 053546/0001 →
PATENT SECURITY AGREEMENT (NOTES) Recorded Oct 15, 2019
From: DELL PRODUCTS L.P.; EMC CORPORATION; EMC IP HOLDING COMPANY LLC; WYSE TECHNOLOGY L.L.C.
To: THE BANK OF NEW YORK MELLON TRUST COMPANY, N.A., AS COLLATERAL AGENT
Reel/Frame 050724/0466 →
SECURITY AGREEMENT Recorded Sep 17, 2019
From: DELL PRODUCTS L.P.; EMC CORPORATION; EMC IP HOLDING COMPANY LLC; WYSE TECHNOLOGY L.L.C.
To: CREDIT SUISSE AG, CAYMAN ISLANDS BRANCH
Reel/Frame 050405/0534 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 16, 2019
From: KUCHEROV, ANTON; MEIRI, DAVID
To: EMC IP HOLDING COMPANY LLC
Reel/Frame 049197/0830 →
Continuity (1)
Related Publication 20200349087A1 · Nov 5, 2020