IP Library › Granted Patent US 12,602,264
Granted Patent B2
US 12,602,264 · App. 17/809,284 · Granted Apr 14, 2026

Data center with energy-aware workload placement

Inventors: Asser Nasreldin Tantawi (Somers, NY); Tamar Eilam (New York, NY); Ramachandra Rao Kolluri (Cranbourne East, AU); Eun Kyung Lee (Bedford Corners, NY); Arun Vishwanath (Nunawading, AU); Alaa S. Youssef (Valhalla, NY)
Assignee: INTERNATIONAL BUSINESS MACHINES CORPORATION
G06F9/5094G06F1/3206G06F9/4893G06F11/3058G06F9/5072G06F11/3006Y02D10/00
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,602,264
App. No.
17/809,284
Granted
Apr 14, 2026
Kind
B2
Abstract

A computer-implemented method, a computer system and a computer program product for boosting efficiency through energy-aware workload placement. The method includes obtaining an energy profile for a plurality of computer servers and power consumption data for each computer server in the plurality of computer servers. The method also includes determining an optimal temperature for each computer server in the plurality of computer servers based on the energy profile. The method further includes determining a target processor utilization for each computer server in the plurality of computer servers based on the optimal temperature. In addition, the method includes calculating an efficiency rank for each computer server in the plurality of computer servers based on the target processor utilization and the power consumption data. Lastly, the method includes deploying a workload on a computer server with a highest efficiency rank.

Claims (52)

1 . A computer-implemented method for boosting efficiency through energy-aware workload placement, the method comprising:

obtaining an energy profile for a plurality of computer servers including power consumption data for each computer server in the plurality of computer servers;

determining an optimal temperature for each computer server in the plurality of computer servers based on the energy profile;

determining a target processor utilization for each computer server in the plurality of computer servers based on the optimal temperature;

calculating an efficiency rank for each computer server in the plurality of computer servers based on the target processor utilization and the power consumption data, wherein the calculated efficiency rank is further based on a combination of a facility efficiency, a server efficiency, and a compute efficiency; and

deploying a workload on a computer server with a highest efficiency rank.

2 . The computer-implemented method of claim 1 , wherein the calculating the efficiency rank for each computer server in the plurality of computer servers comprises:

identifying a current processor utilization of the computer server;

determining the facility efficiency for each computer server in the plurality of computer servers based on the current processor utilization and the target processor utilization;

determining the server efficiency for each computer server in the plurality of computer servers based on the power consumption data, wherein the server efficiency measures power consumed by the computer server in the plurality of computer servers with respect to a range of processor utilization for the computer server;

determining the compute efficiency for each computer server in the plurality of computer servers based on the current processor utilization and the power consumption data at the current processor utilization; and

combining the facility efficiency, the server efficiency, and the compute efficiency for each computer server in the plurality of computer servers.

3 . The computer-implemented method of claim 2 , wherein the facility efficiency comprises a difference between the target processor utilization and the current processor utilization.

4 . The computer-implemented method of claim 2 , wherein the compute efficiency comprises a ratio of the current processor utilization to a power consumption at the current processor utilization.

5 . The computer-implemented method of claim 1 , wherein the determining the target processor utilization for each computer server in the plurality of computer servers uses a machine learning model that predicts an optimal resource utilization from the optimal temperature of a computer server.

6 . The computer-implemented method of claim 1 , further comprising monitoring the energy profile for the plurality of computer servers and updating the efficiency rank for each computer server based on the energy profile.

7 . The computer-implemented method of claim 1 , wherein the workload is selected from a list consisting of: a virtual machine (VM) and a container.

8 . A computer system for boosting efficiency through energy-aware workload placement, the computer system comprising:

one or more processors, one or more computer-readable memories, one or more computer-readable tangible storage media, and program instructions stored on at least one of the one or more tangible storage media for execution by at least one of the one or more processors via at least one of the one or more memories, wherein the computer system is capable of performing a method comprising:

obtaining an energy profile for a plurality of computer servers including power consumption data for each computer server in the plurality of computer servers;

determining an optimal temperature for each computer server in the plurality of computer servers based on the energy profile;

determining a target processor utilization for each computer server in the plurality of computer servers based on the optimal temperature;

calculating an efficiency rank for each computer server in the plurality of computer servers based on the target processor utilization and the power consumption data, wherein the calculated efficiency rank is further based on a combination of a facility efficiency, a server efficiency, and a compute efficiency; and

deploying a workload on a computer server with a highest efficiency rank.

9 . The computer system of claim 8 , wherein the calculating the efficiency rank for each computer server in the plurality of computer servers comprises:

identifying a current processor utilization of the computer server;

determining the facility efficiency for each computer server in the plurality of computer servers based on the current processor utilization and the target processor utilization;

determining the server efficiency for each computer server in the plurality of computer servers based on the power consumption data, wherein the server efficiency measures power consumed by the computer server in the plurality of computer servers with respect to a range of processor utilization for the computer server;

determining the compute efficiency for each computer server in the plurality of computer servers based on the current processor utilization and the power consumption data at the current processor utilization; and

combining the facility efficiency, the server efficiency, and the compute efficiency for each computer server in the plurality of computer servers.

10 . The computer system of claim 9 , wherein the facility efficiency comprises a difference between the target processor utilization and the current processor utilization.

11 . The computer system of claim 9 , wherein the compute efficiency comprises a ratio of the current processor utilization to a power consumption at the current processor utilization.

12 . The computer system of claim 8 , wherein the determining the target processor utilization for each computer server in the plurality of computer servers uses a machine learning model that predicts an optimal resource utilization from the optimal temperature of a computer server.

13 . The computer system of claim 8 , further comprising monitoring the energy profile for the plurality of computer servers and updating the efficiency rank for each computer server based on the energy profile.

14 . The computer system of claim 8 , wherein the workload is selected from a list consisting of: a virtual machine (VM) and a container.

15 . A computer program product for boosting efficiency through energy-aware workload placement, the computer program product comprising:

a computer-readable storage device having program instructions embodied therewith, the program instructions executable by a processor to cause the processor to perform a method comprising:

obtaining an energy profile for a plurality of computer servers including power consumption data for each computer server in the plurality of computer servers;

determining an optimal temperature for each computer server in the plurality of computer servers based on the energy profile;

determining a target processor utilization for each computer server in the plurality of computer servers based on the optimal temperature;

calculating an efficiency rank for each computer server in the plurality of computer servers based on the target processor utilization and the power consumption data, wherein the calculated efficiency rank is further based on a combination of a facility efficiency, a server efficiency, and a compute efficiency; and

deploying a workload on a computer server with a highest efficiency rank.

16 . The computer program product of claim 15 , wherein the calculating the efficiency rank for each computer server in the plurality of computer servers comprises:

identifying a current processor utilization of the computer server;

determining the facility efficiency for each computer server in the plurality of computer servers based on the current processor utilization and the target processor utilization;

determining the server efficiency for each computer server in the plurality of computer servers based on the power consumption data, wherein the server efficiency measures power consumed by the computer server in the plurality of computer servers with respect to a range of processor utilization for the computer server;

determining the compute efficiency for each computer server in the plurality of computer servers based on the current processor utilization and the power consumption data at the current processor utilization; and

combining the facility efficiency, the server efficiency, and the compute efficiency for each computer server in the plurality of computer servers.

17 . The computer program product of claim 16 , wherein the determining the facility efficiency comprises a difference between the target processor utilization and the current processor utilization.

18 . The computer program product of claim 16 , wherein the compute efficiency comprises a ratio of the current processor utilization to a power consumption at the current processor utilization.

19 . The computer program product of claim 15 , wherein the determining the target processor utilization for each computer server in the plurality of computer servers uses a machine learning model that predicts an optimal resource utilization from the optimal temperature of a computer server.

20 . The computer program product of claim 15 , further comprising monitoring the energy profile for the plurality of computer servers and updating the efficiency rank for each computer server based on the energy profile.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 28, 2022
From: TANTAWI, ASSER NASRELDIN; EILAM, TAMAR; KOLLURI, RAMACHANDRA RAO; LEE, EUN KYUNG; VISHWANATH, ARUN; YOUSSEF, ALAA S.
To: INTERNATIONAL BUSINESS MACHINES CORPORATION
Reel/Frame 060329/0949 →
Continuity (1)
Related Publication 20230418687A1 · Dec 28, 2023
References Cited (58)
US 8037325B1 · Dalal · 2011 [cited by examiner]
US 10162397B2 · Matteson · 2018 [cited by applicant]
US 11023288B2 · Rajamani · 2021 [cited by applicant]
US 11093311B2 · Chagam Reddy · 2021 [cited by applicant]
US 11875191B1 · Plenderleith · 2024 [cited by examiner]
US 20090271141A1 · Coskun · 2009 [cited by examiner]
US 20100180275A1 · Neogi · 2010 [cited by examiner]
US 20110016342A1 · Rowan · 2011 [cited by examiner]
US 20110107126A1 · Goodrum · 2011 [cited by examiner]
US 20110245981A1 · Refai-Ahmed · 2011 [cited by examiner]
US 20150227397A1 · Gogula · 2015 [cited by examiner]
US 20170279697A1 · Katsaros · 2017 [cited by applicant]
US 20180234491A1 · Gomes De Oliveira · 2018 [cited by examiner]
US 20200026338A1 · Maddukuri · 2020 [cited by examiner]
US 20200379527A1 · Yang · 2020 [cited by examiner]
US 20210081027A1 · Park · 2021 [cited by examiner]
US 20210298191A1 · Shao · 2021 [cited by examiner]
US 20220092375A1 · Ghose · 2022 [cited by examiner]
US 20220308927A1 · Chen · 2022 [cited by examiner]
US 20220334874A1 · Katiyar · 2022 [cited by examiner]
US 20230273807A1 · Uppalapati · 2023 [cited by examiner]
Abbasi et al., “Tacoma: Server and Workload Management in Internet Data Centers Considering Cooling-Computing Power Trade-Off and Energy Proportionality”, ACM Transactions on Architecture and Code Optimization, vol. 9, … [cited by applicant]
Barroso et al., “The Datacenter as a Computer: An Introduction to the Design of Warehouse-Scale Machines”, Second Edition, Morgan & Claypool Publishers, Synthesis Lectures on Computer Architecture, 2013, pp. 1-156. [cited by applicant]
Barroso et al., “The Datacenter as a Computer: Design of Warehouse-Scale Machines”, Third Edition, Morgan & Claypool Publishers, Synthesis Lectures on Computer Architecture, 2018, pp. 1-209. [cited by applicant]
Beloglazov et al., “Energy-aware resource allocation heuristics for efficient management of data centers for Cloud computing”, http://dx.doi.org/10.1016/j.future.2011.04.017, Elsevier, SciVerse ScienceDirect, Future Gen… [cited by applicant]
Cadorel et al., “A workflow scheduling deadline-based heuristic for energy optimization in Cloud”, DOI 10.1109/Things/GreenCom/CPSCom/SmartData.2019.00135, 2019 International Conference on Internet of Things (iThings) a… [cited by applicant]
Carrasco et al., “Resource cost aware scheduling”, https://doi.org/10.1016/j.ejor.2018.02.059, Elsevier, ScienceDirect, European Journal of Operational Research, 269, 2018, pp. 621-632. [cited by applicant]
Casalicchio, “Autonomic Orchestration of Containers: Problem Definition and Research Challenges”, https://doi.org/10.4108/eai.25-10-2016.2266649, ACM, Conference '10, 2010, pp. 1-4. [cited by applicant]
Chi, et al., “Jointly Optimizing the IT and Cooling Systems for Data Center Energy Efficiency based on Multi-Agent Deep Reinforcement Learning”, https://doi.org/10.1145/3396851.3402658, e-Energy '20, Proceedings of the … [cited by applicant]
Dayarathna, et al., “Data Center Energy Consumption Modeling: A Survey”, https://ieeexplore.ieee.org/search/searchresult.jsp?newsearch=true&queryText=Data%20center%20energy%20consumption%20modeling%20A%20survey., IEEE C… [cited by applicant]
De Meyer, et al., “Optimization-Based Scheduling of Data Center Workload in Function of Outside Weather Conditions”, Symposium De Génie Électrique (SGE'16) : EF-EPF-MGE 2016, Jun. 7-8, 2016, Green-ER, France. p. 1-5. [cited by applicant]
Disclosed Anonymously, “Energy Saving Through Temperature Aware Storage Placement and Workload”, IPCOM000206737D, https://ip.com/IPCOM/000206737, May 5, 2011, pp. 1-5. [cited by applicant]
Disclosed Anonymously, “Fine-Granular Approach to Achieve Differentiated Provisioning of Virtual Machines in a Cloud Based on the Specified PER-VM Energy Policies”, IPCOM000228628D, https://ip.com/IPCOM/000228628, Jun. … [cited by applicant]
Dong et al., “Delayed best-fit task scheduling to reduce energy consumption in cloud data centers”, 2019 International Conference on Internet of Things (iThings) and IEEE Green Computing and Communications (GreenCom) an… [cited by applicant]
El-Sayed et al., “Temperature management in Data Centers: Why Some (Might) Like It Hot”, https://doi.org/10.1145/2254756.2254778, Sigmetrics '12, Jun. 2012, p. 163-174. [cited by applicant]
Fernandez-Cerero et al., “Security supportive energy-aware scheduling and energy policies for cloud environments”, https://doi.org/10.1016/j.jpdc.2018.04.015, Elsevier, ScienceDirect, J. Parallel Distrib. Comput., 119, … [cited by applicant]
Foreman, R.; “Boosting Data Center Efficiency Through Flexible Power Management”, Preprinted from Dell Power Solutions, 2012 Issue 1. Copyright © 2012 Dell Inc. pp. 1-3. [cited by applicant]
Author Unknown, “Use of Virtualization for Power/Temperature Optimization in Large Data Centers”, https://ip.com/IPCOM/000157645, IPCOM000157645D, Aug. 30, 2007, pp. 1-4. [cited by applicant]
Author Unknown, “Autonomous Learning Algorithm for Power Management”, https://ip.com/IPCOM/000185155, IPCOM000185155D; Jul. 14, 2009, pp. 1-5. [cited by applicant]
Ilager et al., “ETAS: Energy and thermal-aware dynamic virtual machine consolidation in cloud data center with proactive hotspot mitigation”, https://doi.org/10.1002/cpe.5221, Wiley, Research Article, 2019, pp. 1-15. [cited by applicant]
James et al., “A Low Carbon Kubernetes Scheduler”, CEUR-WS.org/Vol-2382/ICT4S2019_paper_28.pdf, pp. 1-10. [cited by applicant]
Kaur et al., “KEIDS: Kubernetes-Based Energy and Interfereence Driven Scheduler for Industrial IoT in Edge-Cloud Ecosystem”, https://ieeexplore.ieee.org/document/8825476, IEEE Internet of Things Journal, vol. 7, No. 5, … [cited by applicant]
Khan et al., “Handbook on Data Centers”, DOI 10.1007/978-1-4939-2092-1, Springer, 2015, pp. 1-1309. [cited by applicant]
Khokhriakov et al., “Multicore processor computing is not energy proportional: An opportunity for bi-objective optimization for energy and performance”, https://doi.org/10.1016/j.apenergy.2020.114957, ScienceDirect, Els… [cited by applicant]
Lee et al., “Proactive Thermal-Aware Resource Management in Virtualized HPC Cloud Datacenters”, https://ieeexplore.ieee.org/document/7229319, IEEE Transactions on Cloud Computing, vol. 5, No. 2, 2017, pp. 234-248. [cited by applicant]
Liu et al., “Renewable and Cooling Aware Workload Management for Sustainable Data Centers”, https://doi.org/10.1145/2254756.2254779, AMC Digital Library, Sigmetrics'12, Jun. 2012, p. 175-186. [cited by applicant]
Malla et al., “The effect of server energy proportionality on data center power oversubscription”, https://doi.org/10.1016/j.future.2019.10.021, Elsevier, ScienceDirect, Future Generation Computer Systems, 104, 2020, pp… [cited by applicant]
Mell et al., “The NIST Definition of Cloud Computing”, National Institute of Standards and Technology, Special Publication 800-145, Sep. 2011, pp. 1-7. [cited by applicant]
Moore et al., “Making Scheduling “Cool”: Temperature-Aware Workload Placement in Data Centers”, http://usenix.org/publications/library/proceedings/usenix05/tech/general/full_papers/moore/moore.pdf, USENIX Association, 2… [cited by applicant]
Pahlevan et al., “Energy Proportionality in Near-Threshold Computing Servers and Cloud Data Centers: Consolidating or Not?”, https://ieeexplore.ieee.org/document/8341994, IEEE, Design, Automation and Test in Europe, 201… [cited by applicant]
Patterson et al., “The State of Data Center Cooling”, http://download.intel.com/technology/eep/data-center-efficiency/state of-date-center-cooling, Intel Corporation, White Paper Digital Enterprise Group, Mar. 2008, pp.… [cited by applicant]
Pore et al., “Techniques to Achieve Energy Proportionality in Data Centers: A Survey”, https://link.springer.com/chapter/10.1007/978-1-4939-2092-1_4, Springer Science+Business Media New York 2015, Handbook on Data Cente… [cited by applicant]
Rocha et al., “HEATS: Heterogeneity—and Energy-Aware Task-based Scheduling”, https://www.researchgate.net/publication/334082339_HEATS_Heterogeneity-_and_Energy-Aware_Task-based_Scheduling, arXiv:1906.11321v1 [cs.DC] Jun… [cited by applicant]
Sharma, et al., “Balance of Power: Dynamic Thermal Management for Internet Data Centers”, https://ieeexplore.ieee.org/document/1407777, IEEE Internet Computing, 2005, pp. 42-49. [cited by applicant]
Townsend et al., “Improving Data Center Efficiency Through Holistic Scheduling in Kubernetes”, DOI 10.1109/SOSE.2019.00030, 2019 IEEE International Conference on Service-Oriented System Engineering (SOSE), 2019, pp. 156… [cited by applicant]
Varsamopoulos, et al., Trends and Effects of Energy Proportionality on Server Provisioning in Data Centers, https://ieeexplore.ieee.org/document/5713198, IEEE, 2010, pp. 1-11. [cited by applicant]
Villebonnet et al., “Big, Medium, Little: Reaching Energy Proportionality With Heterogeneous Computing Scheduler”, http:/dx.doi.org/10.1142/S0129626415410066, Parallel Processing Letters, vol. 25, 2015, pp. 1-31. [cited by applicant]
Wang et al., “Thermal aware workload placement with task-temperature profiles in a data center”, https://link.springer.com/article/10.1007/s11227-011-0635-z, Springer Science+Business Media, The Journal of Supercomputin… [cited by applicant]