IP Library Granted Patent US 10,133,513
Granted Patent B1
US 10,133,513 · App. 14/821,388 · Granted Nov 20, 2018

Cache management system and method

Inventors: David J. Agans (Wilton, NH); David W. Harvey (Newton Center, MA); Gregory S. Schaffer (Berlin, MA); Mark J. Cariddi (Merrimack, NH); Long Zhang (Beijing, CN); Henry Austin Spang, IV (Hopkinton, MA)
Assignee: EMC IP Holding Company LLC
G06F3/0659G06F3/0611G06F3/0683
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,133,513
App. No.
14/821,388
Granted
Nov 20, 2018
Kind
B1
Abstract

A method, computer program product, and computing system for determining a queue depth and a flush rate for each of a plurality of pending data queues associated with a cache system, thus defining a queue depth/flush rate pair for each of the plurality of pending data queues. A predicted drain time is determined for each of the plurality of pending data queues based, at least in part, upon the queue depth/flush rate pair, thus defining a plurality of predicted drain times that are respectively associated with the plurality of pending data queues.

Claims (21)

1. A computer-implemented method, executed on a computing device, comprising:

determining a queue depth and a flush rate for each of a plurality of pending data queues associated with a cache system of a backend system, thus defining a queue depth/flush rate pair for each of the plurality of pending data queues, wherein each of the plurality of pending data queues is associated with, and configured to temporarily store all data to be written to, a respective volume group chosen from the plurality of volume groups, thus defining a plurality of pending data queue volume group pairs, and wherein the queue depth is based upon, at least in part, an amount of data temporarily stored within the respective pending data queue of each pending data queue volume group pair and the flush rate is based upon, at least in part, the rate at which the data is written to the respective volume group of each pending data queue volume group pair;

determining a predicted drain time for each of the plurality of pending data queues based, at least in part, upon the queue depth/flush rate pair, thus defining a plurality of predicted drain times that are respectively associated with the plurality of pending data queue volume group pairs;

comparing the plurality of predicted drain times to one another to identify a high-utilization volume group, chosen from the plurality of volume groups, wherein the high-utilization volume group utilizes a higher-than-average portion of the cache system based upon, at least in part, the predicted drain times for each of the plurality of pending data queues; and

regulating the rate at which data is allowed to enter a high-utilization pending data queue based, at least in part, upon the queue depth/flush rate pair defined for the high-utilization pending data queue including delaying the issuance of write acknowledgements for write requests associated with data entering the high-utilization pending data queue and not delaying the issuance of write acknowledgements for write requests associated with data entering a non-high-utilization pending data queue.

2. The computer implemented method of claim 1 wherein regulating the rate at which data is allowed to enter the high-utilization pending data queue includes:

throttling the issuance of write acknowledgements to a host that is providing the data to the high-utilization pending data queue so that the rate at which data is entering the high-utilization pending data queue is equal to the rate at which data is leaving the high-utilization pending data queue.

3. A computer program product residing on a non-transitory computer readable medium having a plurality of instructions stored thereon which, when executed by a processor, cause the processor to perform operations comprising:

determining a queue depth and a flush rate for each of a plurality of pending data queues associated with a cache system of a backend system, thus defining a queue depth/flush rate pair for each of the plurality of pending data queues, wherein each of the plurality of pending data queues is associated with, and configured to temporarily store all data to be written to, a respective volume group chosen from the plurality of volume groups, thus defining a plurality of pending data queue volume group pairs, and wherein the queue depth is based upon, at least in part, an amount of data temporarily stored within the respective pending data queue of each pending data queue volume group pair and the flush rate is based upon, at least in part, the rate at which the data is written to the respective volume group of each pending data queue volume group pair;

determining a predicted drain time for each of the plurality of pending data queues based, at least in part, upon the queue depth/flush rate pair, thus defining a plurality of predicted drain times that are respectively associated with the plurality of pending data queue volume group pairs;

comparing the plurality of predicted drain times to one another to identify a high-utilization volume group, chosen from the plurality of volume groups, wherein the high-utilization volume group utilizes a higher-than-average portion of the cache system based upon, at least in part, the predicted drain times for each of the plurality of pending data queues; and

regulating the rate at which data is allowed to enter a high-utilization pending data queue based, at least in part, upon the queue depth/flush rate pair defined for the high-utilization pending data queue including delaying the issuance of write acknowledgements for write requests associated with data entering the high-utilization pending data queue and not delaying the issuance of write acknowledgements for write requests associated with data entering a non-high-utilization pending data queue.

4. The computer program product of claim 3 wherein regulating the rate at which data is allowed to enter the high-utilization pending data queue includes:

throttling the issuance of write acknowledgements to a host that is providing the data to the high-utilization pending data queue so that the rate at which data is entering the high-utilization pending data queue is equal to the rate at which data is leaving the high-utilization pending data queue.

5. A computing system including a processor and memory configured to perform operations comprising:

determining a queue depth and a flush rate for each of a plurality of pending data queues associated with a cache system of a backend system, thus defining a queue depth/flush rate pair for each of the plurality of pending data queues, wherein each of the plurality of pending data queues is associated with, and configured to temporarily store all data to be written to, a respective volume group chosen from the plurality of volume groups, thus defining a plurality of pending data queue volume group pairs, and wherein the queue depth is based upon, at least in part, an amount of data temporarily stored within the respective pending data queue of each pending data queue volume group pair and the flush rate is based upon, at least in part, the rate at which the data is written to the respective volume group of each pending data queue volume group pair;

determining a predicted drain time for each of the plurality of pending data queues based, at least in part, upon the queue depth/flush rate pair, thus defining a plurality of predicted drain times that are respectively associated with the plurality of pending data queue volume group pairs;

comparing the plurality of predicted drain times to one another to identify a high-utilization volume group, chosen from the plurality of volume groups, wherein the high-utilization volume group utilizes a higher-than-average portion of the cache system based upon, at least in part, the predicted drain times for each of the plurality of pending data queues; and

regulating the rate at which data is allowed to enter a high-utilization pending data queue based, at least in part, upon the queue depth/flush rate pair defined for the high-utilization pending data queue including delaying the issuance of write acknowledgements for write requests associated with data entering the high-utilization pending data queue and not delaying the issuance of write acknowledgements for write requests associated with data entering a non-high-utilization pending data queue.

6. The computing system of claim 5 wherein regulating the rate at which data is allowed to enter the high-utilization pending data queue includes:

throttling the issuance of write acknowledgements to a host that is providing the data to the high-utilization pending data queue so that the rate at which data is entering the high-utilization pending data queue is equal to the rate at which data is leaving the high-utilization pending data queue.

Assignments (7)
RELEASE OF SECURITY INTEREST IN PATENTS PREVIOUSLY RECORDED AT REEL/FRAME (053546/0001) Recorded Jun 23, 2022
From: THE BANK OF NEW YORK MELLON TRUST COMPANY, N.A., AS NOTES COLLATERAL AGENT
To: DELL MARKETING L.P. (ON BEHALF OF ITSELF AND AS SUCCESSOR-IN-INTEREST TO CREDANT TECHNOLOGIES, INC.); DELL INTERNATIONAL L.L.C.; DELL PRODUCTS L.P.; DELL USA L.P.; EMC CORPORATION; DELL MARKETING CORPORATION (SUCCESSOR-IN-INTEREST TO FORCE10 NETWORKS, INC. AND WYSE TECHNOLOGY L.L.C.); EMC IP HOLDING COMPANY LLC
Reel/Frame 071642/0001 →
RELEASE OF SECURITY INTEREST AT REEL 048825 FRAME 0489 Recorded Nov 2, 2021
From: CREDIT SUISSE AG, CAYMAN ISLANDS BRANCH
To: DELL PRODUCTS L.P.; EMC CORPORATION; EMC IP HOLDING COMPANY LLC
Reel/Frame 058000/0916 →
SECURITY AGREEMENT Recorded Apr 22, 2020
From: CREDANT TECHNOLOGIES INC.; DELL INTERNATIONAL L.L.C.; DELL MARKETING L.P.; DELL PRODUCTS L.P.; DELL USA L.P.; EMC CORPORATION; FORCE10 NETWORKS, INC.; WYSE TECHNOLOGY L.L.C.; EMC IP HOLDING COMPANY LLC
To: THE BANK OF NEW YORK MELLON TRUST COMPANY, N.A.
Reel/Frame 053546/0001 →
SECURITY AGREEMENT Recorded Apr 8, 2019
From: DELL PRODUCTS L.P.; EMC CORPORATION; EMC IP HOLDING COMPANY LLC
To: CREDIT SUISSE AG, CAYMAN ISLANDS BRANCH
Reel/Frame 048825/0489 →
SECURITY AGREEMENT Recorded Mar 21, 2019
From: CREDANT TECHNOLOGIES, INC.; DELL INTERNATIONAL L.L.C.; DELL MARKETING L.P.; DELL PRODUCTS L.P.; DELL USA L.P.; EMC CORPORATION; FORCE10 NETWORKS, INC.; WYSE TECHNOLOGY L.L.C.; EMC IP HOLDING COMPANY LLC
To: THE BANK OF NEW YORK MELLON TRUST COMPANY, N.A.
Reel/Frame 049452/0223 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Nov 6, 2018
From: HARVEY, DAVID W
To: EMC CORPORATION
Reel/Frame 047425/0090 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 16, 2017
From: AGANS, DAVID J.; SCHAFFER, GREGORY S; CARIDDDI, MARK J.; SPANG, HENRY AUSTIN, IV
To: EMC IP HOLDING COMPANY LLC
Reel/Frame 042730/0073 →