IP Library › Granted Patent US 10,528,098
Granted Patent B2
US 10,528,098 · App. 15/197,410 · Granted Jan 7, 2020

Thermal aware workload scheduling

Inventors: Darya Amin-Shahidi (San Jose, CA); Abhishek Dhanda (San Jose, CA); Toshiki Hirano (San Jose, CA)
Assignee: Western Digital Technologies, Inc.
G06F1/206G06F1/3206G06F1/329G06F9/5094G06F11/3058G06F11/3433G06F2201/81Y02D10/124Y02D10/24
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,528,098
App. No.
15/197,410
Granted
Jan 7, 2020
Kind
B2
Abstract

Systems, software, devices, and methods of distributing a workload among available data storage devices in a thermal aware manner are described herein. More specifically, the examples herein discuss distributing the workload among the available data storage devices in a thermal aware manner that optimizes collective IOPs of the data storage devices in an enclosure. The thermal aware distribution of the storage operations is determined by a thermal model that predicts thermal characteristics of the data storage system based on inlet air characteristics of the enclosure, performance characteristics and thermal constraints of the data storage devices, and constraints of the workload.

Claims (55)

1. A data storage system, comprising:

multiple data storage devices, each configured to store data;

an enclosure configured to encase and physically support the multiple data storage devices; and

a control system configured to:

model thermal characteristics of the data storage system based on inlet air characteristics of the enclosure, performance characteristics and thermal constraints of the data storage devices, and constraints of a workload;

identify, based on the thermal model, a thermal-aware allocation of the workload among the data storage devices; and

distribute the workload among the data storage devices in accordance with the thermal-aware allocation.

2. A method of distributing a workload among data storage devices encased in an enclosure of a data storage system, the method comprising:

identifying performance characteristics and thermal constraints associated with the data storage devices;

identifying inlet air characteristics of the enclosure;

identifying constraints associated with the workload;

modeling thermal characteristics of the data storage system based on the inlet air characteristics of the enclosure, the performance characteristics and thermal constraints of the data storage devices, and the constraints associated with the workload;

identifying, based on the thermal model, a thermal-aware allocation of the workload among the data storage devices; and

distributing the workload among the data storage devices in accordance with the thermal-aware allocation.

3. The method of claim 2 , wherein the thermal-aware allocation maximizes collective Input/Output Operations Per Second (IOPS) of the multiple data storage devices relative to other allocations of the workload while maintaining the multiple data storage devices within the thermal constraints of the data storage devices.

4. The method of claim 2 , wherein identifying the inlet air characteristics of the enclosure comprises estimating one or more of the inlet air characteristics based on fan drive signal characteristics.

5. The method of claim 2 , wherein:

identifying the inlet air characteristics of the enclosure comprises monitoring air temperature sensors and/or air speed sensors to determine one or more of the inlet air characteristics; and

the inlet air characteristics comprise one or more of air temperature and/or air speed.

6. The method of claim 2 , wherein the performance characteristics of the data storage devices comprise power versus performance operating curves of each of the data storage devices.

7. The method of claim 2 , wherein the thermal constraints of the data storage devices comprise one or more safe operating temperature thresholds.

8. The method of claim 2 , wherein the constraints of the workload comprise a breakdown of read operations and write operations.

9. A computer-readable storage medium having instructions stored thereon which, when executed by one or more processors, cause the one or more processors to:

identify performance characteristics and thermal constraints associated with data storage devices encased in an enclosure of a data storage system;

identify inlet air characteristics of the enclosure;

identify constraints associated with a workload;

model thermal characteristics of the data storage system based on the inlet air characteristics of the enclosure, the performance characteristics and thermal constraints of the data storage devices, and the constraints associated with the workload;

identify, based on the thermal model, a thermal-aware allocation of the workload among the data storage devices; and

distribute the workload in accordance with the thermal-aware allocation.

10. A control system for a data storage system, wherein the data storage system comprises an enclosure and data storage devices encased within the enclosure, the control system comprising:

means for modeling thermal characteristics of the data storage system based on inlet air characteristics of the enclosure, performance characteristics and thermal constraints of the data storage devices, and constraints of a workload;

means for identifying, based on the modeled thermal characteristics, a thermal-aware allocation of the workload among the data storage devices; and

means for distributing the workload among the data storage devices in accordance with the thermal-aware allocation.

11. A data storage assembly comprising:

an enclosure configured to encase and physically support multiple data storage devices; and

a control system configured to:

identify a thermal model for the data storage assembly based at least on inlet air characteristics of the enclosure, performance characteristics and thermal constraints of the data storage devices, and characteristics of a workload;

identify, based on the thermal model, a thermal-aware allocation of the workload among the data storage devices; and

distribute the workload among the data storage devices in accordance with the thermal-aware allocation.

12. The data storage assembly of claim 11 , wherein the thermal-aware allocation maximizes collective Input/Output Operations Per Second (IOPS) of the multiple data storage devices relative to other allocations of the workload while maintaining the multiple data storage devices within the thermal constraints of the data storage devices.

13. The data storage assembly of claim 11 , wherein the control system is further configured to estimate one or more of the inlet air characteristics based on fan drive signal characteristics.

14. The data storage assembly of claim 13 , wherein the fan drive signal characteristics comprise a voltage or a duty cycle.

15. The data storage assembly of claim 11 , wherein:

the control system is further configured to monitor air temperature sensors and/or air speed sensors to determine one or more of the inlet air characteristics, and

the inlet air characteristics comprise one or more of air temperature and/or air speed.

16. The data storage assembly of claim 11 , further comprising:

one or more fans configured to provide airflow within the enclosure;

thermal sensors configured to measure temperatures of each of the multiple data storage devices; and

one or more sensors configured to measure one or more of the inlet air characteristics.

17. The data storage assembly of claim 11 , wherein the performance characteristics of the data storage devices comprise power versus performance operating curves of each of the data storage devices.

18. The data storage assembly of claim 11 , wherein the data storage devices are thermally-coupled within the enclosure.

19. The data storage assembly of claim 11 , wherein the thermal constraints of the data storage devices comprise one or more safe operating temperature thresholds.

20. The data storage assembly of claim 19 , wherein the control system is further configured to:

monitor temperatures of each of the multiple data storage devices to ensure that the data storage devices do not exceed the one or more safe operating temperature thresholds.

21. The data storage assembly of claim 11 , wherein the constraints of the workload comprise a breakdown of read operations and write operations.

Assignments (8)
PATENT COLLATERAL AGREEMENT - DDTL LOAN AGREEMENT Recorded Aug 21, 2023
From: WESTERN DIGITAL TECHNOLOGIES, INC.
To: JPMORGAN CHASE BANK, N.A.
Reel/Frame 067045/0156 →
PATENT COLLATERAL AGREEMENT - A&R LOAN AGREEMENT Recorded Aug 21, 2023
From: WESTERN DIGITAL TECHNOLOGIES, INC.
To: JPMORGAN CHASE BANK, N.A.
Reel/Frame 064715/0001 →
RELEASE OF SECURITY INTEREST AT REEL 052915 FRAME 0566 Recorded Feb 8, 2022
From: JPMORGAN CHASE BANK, N.A.
To: WESTERN DIGITAL TECHNOLOGIES, INC.
Reel/Frame 059127/0001 →
SECURITY INTEREST Recorded Feb 6, 2020
From: WESTERN DIGITAL TECHNOLOGIES, INC.
To: JPMORGAN CHASE BANK, N.A., AS AGENT
Reel/Frame 052915/0566 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 18, 2019
From: HGST NETHERLANDS B.V
To: WESTERN DIGITAL TECHNOLOGIES, INC.
Reel/Frame 051325/0096 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 9, 2019
From: AMIN-SHAHIDI, DARYA; DHANDA, ABHISHEK; HIRANO, TOSHIKI
To: HGST NETHERLANDS B.V
Reel/Frame 051222/0404 →
CORRECTIVE ASSIGNMENT TO CORRECT THE INCORRECT SERIAL NO 15/025,946 PREVIOUSLY RECORDED AT REEL: 040831 FRAME: 0265. ASSIGNOR(S) HEREBY CONFIRMS THE ASSIGNMENT. Recorded Sep 15, 2017
From: HGST NETHERLANDS B.V.
To: WESTERN DIGITAL TECHNOLOGIES, INC.
Reel/Frame 043973/0762 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 6, 2016
From: HGST NETHERLANDS B.V.
To: WESTERN DIGITAL TECHNOLOGIES, INC.
Reel/Frame 040831/0265 →
Continuity (1)
Related Publication 20180004260A1 · Jan 4, 2018