IP Library Granted Patent US 9,940,024
Granted Patent B1
US 9,940,024 · App. 15/358,408 · Granted Apr 10, 2018

Techniques for determining workload skew

View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,940,024
App. No.
15/358,408
Granted
Apr 10, 2018
Kind
B1
Abstract

Determining cumulative workload skew is described. Measurements for one or more logical devices are determined. The set of measurements include, for each of N storage tiers, a workload measurement identifying workload directed to the single tier, and a capacity measurement identifying an amount of data stored in the single tier. N points may be determined using the measurements. Each point corresponds to a different storage tier and has a first coordinate identifying a cumulative percentage of data portions stored in the storage tier and all other tiers having a higher performance ranking than the one storage tier, and a second coordinate denoting an aggregated percentage of total workload directed to the foregoing cumulative percentage of data portions. A curve representing a cumulative workload skew may be determined using these N points and a point of origin.

Claims (35)

1. A method of determining and using skew for workload comprising:

performing, using a processor and for a time period in a data storage system having a first data storage configuration including N storage tiers of physical storage devices, data movement optimizations that move data portions of logical devices between the N storage tiers;

receiving, using a processor, a set of measurements for the logical devices for the time period, the set of measurements for said logical devices including N workload measurements and N capacity measurements;

determining, using a processor and said set of measurements, a set of N points denoting capacity boundaries and associated workloads for data portions of the logical devices stored on the N storage tiers of the first data storage configuration;

determining, using a processor and said set of N points and a point of origin, a curve representing a cumulative workload skew for said logical devices in the first data storage configuration; and

modeling, using a processor and the cumulative workload skew, performance of a second data storage configuration, wherein said modeling includes determining, in accordance with the cumulative workload skew, a second set of points for the second data storage configuration, wherein each point of the second set is included in the cumulative workload skew, the second set of points denoting modeled capacity boundaries and associated modeled workloads for storage tiers of the second data storage configuration, wherein said modeling performance of the second data storage configuration includes determining, in accordance with the cumulative workload skew and the second set of points, a value of a performance metric for the second data storage configuration.

2. The method of claim 1 , wherein said determining said curve includes performing curve fitting to fit said N points of the curve.

3. The method of claim 2 , wherein said curve approximates an exponential function.

4. The method of claim 1 , wherein the second data storage configuration includes M storage tiers.

5. The method of claim 4 , wherein the second data storage configuration is a revised version of the first data storage configuration wherein the second data storage configuration includes at least one of: an increase in storage capacity to at least one of the N storage tiers of the first data storage configuration, and a decrease in storage capacity to at least one of the N storage tiers of the first data storage configuration.

6. The method of claim 4 , wherein the second data storage configuration includes at least one additional storage tier not included in the first data storage configuration.

7. The method of claim 4 , wherein the first data storage configuration includes at least one storage tier not included in the second data storage configuration whereby the second data storage configuration removes the at least one storage tier.

8. The method of claim 4 , wherein N is equal to M whereby the first data storage configuration and the second data storage configuration include a same number of storage tiers.

9. The method of claim 1 , wherein said determining said curve uses only said set of N points and the point of origin to determine remaining data points of the curve.

10. The method of claim 1 , wherein the data movement optimizations are performed in accordance with workloads of the data portions and include moving a first data portion from one of the logical devices from a first of the N storage tiers to a second of the N storage tiers.

11. The method of claim 10 , wherein the first data portion is demoted due to a decrease in workload directed to the first data portion, the first storage tier having a higher performance ranking than the second storage tier.

12. The method of claim 10 , wherein the first data portion is promoted due to an increase in workload directed to the first data potion, the first storage tier having a lower performance ranking than the second storage tier.

13. The method of claim 10 , wherein the data movement optimizations place data portions having a highest relative workload on a highest ranked one of the N storage tiers.

14. The method of claim 1 , wherein the second set of points includes a number of points equal to a number of tiers in the second data storage system configuration.

15. The method of claim 1 , wherein a total capacity indicates an aggregated capacity of data portions of the logical devices stored on the N storage tiers and a total workload indicates an aggregated workload directed to said total capacity during said time period, each point in said set of N points corresponds to a single one of the N storage tiers, said each point for said single one storage tier of the N storage tiers having a first coordinate identifying a first percentage of the total capacity and a second coordinate identifying a second percentage of the total workload, said first percentage denoting a percentage of the total capacity of the data portions of the logical devices stored in said single one storage tier of the N storage tiers and all others of said plurality of storage tiers having a higher performance ranking than said single one storage tier of the N storage tiers, said second coordinate denoting an aggregated percentage of the total workload directed to said first percentage of the total capacity.

16. The method of claim 15 , wherein each point in said second set corresponds to a single storage tier of the second data storage configuration, said each point in said second set having a third coordinate identifying a third percentage of the total capacity and a fourth coordinate identifying a fourth percentage of the total workload, said third percentage denoting a percentage of the total capacity of the data portions of the logical devices stored in said single storage tier of the second data storage configuration and all other tiers of the second storage configuration having a higher performance ranking than said single storage tier, said fourth coordinate denoting an aggregated percentage of the total workload directed to said third percentage of the total capacity.

17. A non-transitory computer readable medium comprising code stored thereon that, when executed, performs a method of determining skew for workload comprising:

performing, for a time period in a data storage system having a first data storage configuration including N storage tiers of physical storage devices, data movement optimizations that move data portions of logical devices between the N storage tiers;

receiving a set of measurements for the logical devices for the time period, the set of measurements for said logical devices including N workload measurements and N capacity measurements;

determining, using said set of measurements, a set of N points denoting capacity boundaries and associated workloads for data portions of the logical devices stored on the N storage tiers of the first data storage configuration;

determining, using said set of N points and a point of origin, a curve representing a cumulative workload skew for said logical devices in the first data storage configuration; and

modeling, using the cumulative workload skew, performance of a second data storage configuration, wherein said modeling includes determining, in accordance with the cumulative workload skew, a second set of points for the second data storage configuration, wherein each point of the second set is included in the cumulative workload skew, the second set of points denoting modeled capacity boundaries and associated modeled workloads for storage tiers of the second data storage configuration, wherein said modeling performance of the second data storage configuration includes determining, in accordance with the cumulative workload skew and the second set of points, a value of a performance metric for the second data storage configuration.

18. A system comprising:

at least one processor; and

a memory comprising code stored thereon that, when executed by the at least one processor, performs a method of determining skew for workload comprising:

performing, for a time period in a data storage system having a first data storage configuration including N storage tiers of physical storage devices, data movement optimizations that move data portions of logical devices between the N storage tiers;

receiving a set of measurements for the logical devices for the time period, the set of measurements for said logical devices including N workload measurements and N capacity measurements;

determining, using said set of measurements, a set of N points denoting capacity boundaries and associated workloads for data portions of the logical devices stored on the N storage tiers of the first data storage configuration;

determining, using said set of N points and a point of origin, a curve representing a cumulative workload skew for said logical devices in the first data storage configuration; and

modeling, using the cumulative workload skew, performance of a second data storage configuration, wherein said modeling includes determining, in accordance with the cumulative workload skew, a second set of points for the second data storage configuration, wherein each point of the second set is included in the cumulative workload skew, the second set of points denoting modeled capacity boundaries and associated modeled workloads for storage tiers of the second data storage configuration, wherein said modeling performance of the second data storage configuration includes determining, in accordance with the cumulative workload skew and the second set of points, a value of a performance metric for the second data storage configuration.

Assignments (9)
RELEASE OF SECURITY INTEREST IN PATENTS PREVIOUSLY RECORDED AT REEL/FRAME (053546/0001) Recorded Jun 23, 2022
From: THE BANK OF NEW YORK MELLON TRUST COMPANY, N.A., AS NOTES COLLATERAL AGENT
To: DELL MARKETING L.P. (ON BEHALF OF ITSELF AND AS SUCCESSOR-IN-INTEREST TO CREDANT TECHNOLOGIES, INC.); DELL INTERNATIONAL L.L.C.; DELL PRODUCTS L.P.; DELL USA L.P.; EMC CORPORATION; DELL MARKETING CORPORATION (SUCCESSOR-IN-INTEREST TO FORCE10 NETWORKS, INC. AND WYSE TECHNOLOGY L.L.C.); EMC IP HOLDING COMPANY LLC
Reel/Frame 071642/0001 →
RELEASE OF SECURITY INTEREST IN PATENTS PREVIOUSLY RECORDED AT REEL/FRAME (046366/0014) Recorded May 20, 2022
From: THE BANK OF NEW YORK MELLON TRUST COMPANY, N.A., AS NOTES COLLATERAL AGENT
To: DELL PRODUCTS L.P.; EMC CORPORATION; EMC IP HOLDING COMPANY LLC
Reel/Frame 060450/0306 →
RELEASE OF SECURITY INTEREST AT REEL 046286 FRAME 0653 Recorded Nov 2, 2021
From: CREDIT SUISSE AG, CAYMAN ISLANDS BRANCH
To: DELL PRODUCTS L.P.; EMC CORPORATION; EMC IP HOLDING COMPANY LLC
Reel/Frame 058298/0093 →
SECURITY AGREEMENT Recorded Apr 22, 2020
From: CREDANT TECHNOLOGIES INC.; DELL INTERNATIONAL L.L.C.; DELL MARKETING L.P.; DELL PRODUCTS L.P.; DELL USA L.P.; EMC CORPORATION; FORCE10 NETWORKS, INC.; WYSE TECHNOLOGY L.L.C.; EMC IP HOLDING COMPANY LLC
To: THE BANK OF NEW YORK MELLON TRUST COMPANY, N.A.
Reel/Frame 053546/0001 →
SECURITY AGREEMENT Recorded Mar 21, 2019
From: CREDANT TECHNOLOGIES, INC.; DELL INTERNATIONAL L.L.C.; DELL MARKETING L.P.; DELL PRODUCTS L.P.; DELL USA L.P.; EMC CORPORATION; FORCE10 NETWORKS, INC.; WYSE TECHNOLOGY L.L.C.; EMC IP HOLDING COMPANY LLC
To: THE BANK OF NEW YORK MELLON TRUST COMPANY, N.A.
Reel/Frame 049452/0223 →
PATENT SECURITY AGREEMENT (NOTES) Recorded Jun 1, 2018
From: DELL PRODUCTS L.P.; EMC CORPORATION; EMC IP HOLDING COMPANY LLC
To: THE BANK OF NEW YORK MELLON TRUST COMPANY, N.A., AS COLLATERAL AGENT
Reel/Frame 046366/0014 →
PATENT SECURITY AGREEMENT (CREDIT) Recorded Jun 1, 2018
From: DELL PRODUCTS L.P.; EMC CORPORATION; EMC IP HOLDING COMPANY LLC
To: CREDIT SUISSE AG, CAYMAN ISLANDS BRANCH, AS COLLATERAL AGENT
Reel/Frame 046286/0653 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Nov 22, 2016
From: EMC CORPORATION
To: EMC IP HOLDING COMPANY LLC
Reel/Frame 040669/0001 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Nov 22, 2016
From: AHARONI, DAN; WANG, HUI; RATSABY, GIL; DAGAN, HAGAY; NAAMAD, AMNON
To: EMC CORPORATION
Reel/Frame 040400/0556 →