IP Library › Granted Patent US 12,664,031
Granted Patent B2
US 12,664,031 · App. 17/970,023 · Granted Jun 23, 2026

Power and energy optimization across distributed cloud environment

Inventors: Mathews Thomas (Flower Mound, TX); Utpal Mangla (Toronto, CA); Sai Srinivas Gorti (Irving, TX); Sharath Prasad Krishna Prasad (Flower Mound, TX); Venkatesh Ashok Rao Rao (Natick, MA); Praveen Jayachandran (Bangalore, IN); Eric Lee Gose (Dallas, TX); Juel Daniel Raju (Garland, TX); Amandeep Singh (Carrollton, TX)
Assignee: International Business Machines Corporation
G06F9/5094G06F1/32G06F9/5083G06F2209/505G06F2209/508
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,664,031
App. No.
17/970,023
Filed
Oct 20, 2022
Granted
Jun 23, 2026
Kind
B2
Art Unit
2175
USPC
713/300
Abstract

An approach for managing workload deployment in a distributed network, including edge computing is provided. The approach includes deploying several modules, such as, EMM (energy management module), LDM (localized deployment manager) and EDM (edge deployment manager). These modules will be constantly monitoring and managing the energy consumption at the edge nodes under their purview and communicate with other modules to develop a holistic energy management system (e.g., energy policies, energy algorithms, energy plans, etc.) to ensure the most effective energy management of workload is implemented.

Claims (66)

1 . A computer-implemented method for power optimization across edge components in an edge environment, wherein the edge environment comprise of one or more edge nodes, the computer-implemented method comprising:

receiving, by an EDM (Edge Deployment Manager), an initial request associated with a deployment of one or more services and/or one or more workload applications and one or more energy policies, wherein the EDM is configured to monitor and manage requests across one or more edge nodes;

determining, by the EDM, whether to fulfil the initial request or send the initial request to a LDM (localized deployment manager), wherein the LDM is configured to manage deployment of the one or more workload applications and the LDM is assigned to one or more edge locations and the LDM is configured to communicate with the EDM, one or more EMMs (energy management module) to ensure an effective energy management of workload;

in responsive to having determined to send the initial request to the LDM, sending, by the EDM, the initial request to the LDM;

determining, by the LDM, an initial energy characteristics and initial energy consumptions across edge environments, wherein edge environments comprise of the one or more edge locations;

creating an initial energy plan of one or more energy plans, by the LDM, based on the initial energy characteristics, initial energy consumptions and inputs from a first EMM (energy management modules) of the one or more EMMs;

storing the initial energy plan of one or more energy plans at a first edge node of the one or more edge nodes, wherein the one or more workload applications is deployed;

monitoring, by a first EMM, subsequent energy characteristics of a first node;

creating, by the first EMM, a subsequent energy plan of one or more energy plans associated with the first node, wherein the one or more energy plans consisting of energy requirements for each hardware component associated with each of the one or more edge nodes and the one or more workload applications that is deployed across the edge environments;

managing, by the first EMM, the power optimization across the first edge node of the one or more edge nodes based on the subsequent energy plan of one or more energy plans and the one or more energy policies; and

dynamically updating, the subsequent energy plan of one or more energy plans based on changes to energy consumptions and subsequent energy characteristics associated with the first node, wherein the one or more energy plans contains one or more energy models and the one or more energy models have been trained to save power.

2 . The computer-implemented method of claim 1 , further comprising:

monitoring, by a second EMM, a second energy characteristics of a second edge node;

creating, by the second EMM, a second energy plan of one or more energy plans associated with the second edge node;

managing, by the second EMM, the power optimization across the second edge node of the one or more edge nodes based on the second energy plan of one or more energy plans; and

updating, the second energy plan of one or more energy plans based on changes to second energy consumptions and the second energy characteristics associated with the second edge node.

3 . The computer-implemented method of claim 1 , wherein the one or more EMMS is configured to utilize energy characteristics and communicate with other EMMS of the one or more EMMs to ensure effective energy management.

4 . The computer-implemented method of claim 1 , wherein the initial energy characteristics is an electrical requirement for each hardware, application and edge node components deployed across the edge environments.

5 . The computer-implemented method of claim 1 , wherein the one or more workload applications is an end solution associated with one or more software applications to be deployed on the one or more edge nodes.

6 . The computer-implemented method of claim 1 , wherein the one or more energy policies further comprises one or more energy algorithm and the one or more energy policies provide guidance for the one or more EMMs to take action wherein the action includes, turning off or changing different energy consumption mode if running low on power.

7 . The computer-implemented method of claim 6 , wherein the one or more energy algorithm further comprises of utilizing a CPU instead of GPU for inferencing and reducing the input for a training a model to save power.

8 . A computer program product for power optimization across edge components in an edge environment, wherein the edge environment comprise of one or more edge nodes, the computer program product comprising:

one or more computer readable storage media having computer-readable program instructions stored on the one or more computer readable storage media, the program instructions executes a computer-implemented method comprising steps of:

receiving, by an EDM (Edge Deployment Manager), an initial request associated with a deployment of one or more services and/or one or more workload applications and one or more energy policies, wherein the EDM is configured to monitor and manage requests across one or more edge nodes;

determining, by the EDM, whether to fulfil the initial request or send the initial request to a LDM (localized deployment manager), wherein the LDM is configured to manage deployment of the one or more workload applications and the LDM is assigned to one or more edge locations and the LDM is configured to communicate with the EDM, one or more EMMs (energy management module) to ensure an effective energy management of workload;

in responsive to having determined to send the initial request to the LDM, sending, by the EDM, the initial request to the LDM;

determining, by the LDM, an initial energy characteristics and initial energy consumptions across edge environments, wherein edge environments comprise of the one or more edge locations;

creating an initial energy plan of one or more energy plans, by the LDM, based on the initial energy characteristics, initial energy consumptions and inputs from a first EMM (energy management modules) of the one or more EMMs;

storing the initial energy plan of one or more energy plans at a first edge node of the one or more edge nodes, wherein the one or more workload applications is deployed;

monitoring, by a first EMM, subsequent energy characteristics of a first node;

creating, by the first EMM, a subsequent energy plan of one or more energy plans associated with the first node, wherein the one or more energy plans consisting of energy requirements for each hardware component associated with each of the one or more edge nodes and the one or more workload applications that is deployed across the edge environments;

managing, by the first EMM, the power optimization across the first edge node of the one or more edge nodes based on the subsequent energy plan of one or more energy plans and the one or more energy policies; and

dynamically updating, the subsequent energy plan of one or more energy plans based on changes to energy consumptions and subsequent energy characteristics associated with the first node, wherein the one or more energy plans contains one or more energy models and one or more models have been trained to save power.

9 . The computer program product of claim 8 , further comprising:

monitoring, by a second EMM, a second energy characteristics of a second edge node;

creating, by the second EMM, a second energy plan of one or more energy plans associated with the second edge node;

managing, by the second EMM, the power optimization across the second edge node of the one or more edge nodes based on the second energy plan of one or more energy plans; and

updating, the second energy plan of one or more energy plans based on changes to second energy consumptions and the second energy characteristics associated with the second edge node.

10 . The computer program product of claim 8 , wherein the one or more EMMS is configured to utilize energy characteristics and communicate with other EMMS of the one or more EMMs to ensure effective energy management.

11 . The computer program product of claim 8 , wherein the initial energy characteristics is an electrical requirement for each hardware, application and edge node components deployed across the edge environments.

12 . The computer program product of claim 8 , wherein the one or more workload application is an end solution associated with one or more software applications to be deployed on the one or more edge nodes.

13 . The computer program product of claim 8 , wherein the one or more energy policies further comprises one or more energy algorithm and the one or more energy policies provide guidance for the one or more EMMs to take action, wherein the action includes turning off or changing different energy consumption mode if running low on power.

14 . The computer program product of claim 13 , wherein the one or more energy algorithm further comprises of utilizing a CPU instead of GPU for inferencing and reducing the input for a training a model to save power.

15 . A computer system for power optimization across edge components in an edge environment, wherein the edge environment comprise of one or more edge nodes, the computer system comprising:

one or more computer processors;

one or more computer readable storage media; and

one or more computer readable storage media having computer-readable program instructions stored on the one or more computer readable storage media for execution by at least one of the one or more computer processors, the program instructions executes a computer-implemented method comprising steps of:

receiving, by an EDM (Edge Deployment Manager), an initial request associated with a deployment of one or more services and/or one or more workload applications and one or more energy policies, wherein the EDM is configured to monitor and manage requests across one or more edge nodes;

determining, by the EDM, whether to fulfil the initial request or send the initial request to a LDM (localized deployment manager), wherein the LDM is configured to manage deployment of the one or more workload applications and the LDM is assigned to one or more edge locations and the LDM is configured to communicate with the EDM, one or more EMMs (energy management module) to ensure an effective energy management of workload;

in responsive to having determined to send the initial request to the LDM, sending, by the EDM, the initial request to the LDM;

determining, by the LDM, an initial energy characteristics and initial energy consumptions across edge environments, wherein edge environments comprise of the one or more edge locations;

creating an initial energy plan of one or more energy plans, by the LDM, based on the initial energy characteristics, initial energy consumptions and inputs from a first EMM (energy management modules) of the one or more EMMs;

storing the initial energy plan of one or more energy plans at a first edge node of the one or more edge nodes, wherein the one or more workload applications is deployed;

monitoring, by a first EMM, subsequent energy characteristics of a first node;

creating, by the first EMM, a subsequent energy plan of one or more energy plans associated with the first node, wherein the one or more energy plans consisting of energy requirements for each hardware component associated with each of the one or more edge nodes and the one or more workload applications that is deployed across the edge environments;

managing, by the first EMM, the power optimization across the first edge node of the one or more edge nodes based on the subsequent energy plan of one or more energy plans and the one or more energy policies; and

dynamically updating, the subsequent energy plan of one or more energy plans based on changes to energy consumptions and subsequent energy characteristics associated with the first node, wherein the one or more energy plans contains one or more energy models and one or more models have been trained to save power.

16 . The computer system of claim 15 , further comprising:

monitoring, by a second EMM, a second energy characteristics of a second edge node;

creating, by the second EMM, a second energy plan of one or more energy plans associated with the second edge node;

managing, by the second EMM, the power optimization across the second edge node of the one or more edge nodes based on the second energy plan of one or more energy plans; and

updating, the second energy plan of one or more energy plans based on changes to second energy consumptions and the second energy characteristics associated with the second edge node.

17 . The computer system of claim 15 , wherein the one or more EMMS is configured to utilize energy characteristics and communicate with other EMMS of the one or more EMMs to ensure effective energy management.

18 . The computer system of claim 15 , wherein the initial energy characteristics is an electrical requirement for each hardware, application and edge node components deployed across the edge environments.

19 . The computer system of claim 15 , wherein the one or more workload application is an end solution associated with one or more software applications to be deployed on the one or more edge nodes.

20 . The computer system of claim 15 , wherein the one or more energy policies further comprises one or more energy algorithm and the one or more energy policies provide guidance for the one or more EMMs to take action, wherein the action includes turning off or changing different energy consumption mode if running low on power and wherein the one or more energy algorithm further comprises of utilizing a CPU instead of GPU for inferencing and reducing the input for a training a model to save power.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Oct 20, 2022
From: THOMAS, MATHEWS; MANGLA, UTPAL; GORTI, SAI SRINIVAS; KRISHNA PRASAD, SHARATH PRASAD; RAO, VENKATESH ASHOK RAO; JAYACHANDRAN, PRAVEEN; GOSE, ERIC LEE; RAJU, JUEL DANIEL; SINGH, AMANDEEP
To: INTERNATIONAL BUSINESS MACHINES CORPORATION
Reel/Frame 061483/0899 →
Continuity (2)
Related Publication 20240134717A1 · Apr 25, 2024
Related Publication 20240231954A9 · Jul 11, 2024
References Cited (22)
US 9910480B2 · Klein · 2018 [cited by applicant]
US 10175745B2 · Mandagere · 2019 [cited by applicant]
US 11159609B2 · Mcgrath · 2021 [cited by applicant]
US 11227360B2 · Koker · 2022 [cited by applicant]
US 20190056758A1 · Weaver · 2019 [cited by applicant]
US 20210136142A1 · Dong · 2021 [cited by examiner]
US 20220091901A1 · Billis · 2022 [cited by examiner]
US 20240095628A1 · Mukherjee · 2024 [cited by examiner]
US 20240231954A9 · Thomas · 2024 [cited by examiner]
US 20250119346A1 · Guo · 2025 [cited by examiner]
US 20250278313A1 · Chiba · 2025 [cited by examiner]
JP 6641044B2 · 2020 [cited by applicant]
Fang, Chao, et al. “AI-Driven Energy-Efficient Content Task Offloading in Cloud-Edge-End Cooperation Networks”. Sep. 14, 2022. IEEE Open Journal of the Computer Society. IEEE. vol. 3. pp. 162-171 (Year: 2022). [cited by examiner]
Chen, Haiming, et al. “Task partitioning and offloading in IoT cloud-edge collaborative computing framework: a survey”. Dec. 3, 2022. Journal of Cloud Computing: Advances, Systems, and Applications. Springer Nature. (Ye… [cited by examiner]
“An Intelligent Method for Optimizing Edge System Layout and Management”, An IP.com Prior Art Database Technical Disclosure, Authors et. al.: Disclosed Anonymously, IP.com No. IPCOM000267457D, IP.com Electronic Publicat… [cited by applicant]
“Intelligent Edge Analytics Distribution”, An IP.com Prior Art Database Technical Disclosure, Authors et. al.: Disclosed Anonymously, IP.com No. IPCOM000269624D, IP.com Electronic Publication Date: Apr. 29, 2022, 4 page… [cited by applicant]
“Method of Executing High-Utilization Distributed Workloads to Determine Maximum Power Consumption on Interconnected Computer Systems”, An IP.com Prior Art Database Technical Disclosure, Authors et. al.: Disclosed Anony… [cited by applicant]
Dabbagh et al., “Smart Energy Management in Data Centers”, An IP.com Prior Art Database Technical Disclosure, IP.com No. IPCOM000246061D, IP.com Electronic Publication Date: Apr. 29, 2016, 10 pages. [cited by applicant]
Mell et al., “The NIST Definition of Cloud Computing”, National Institute of Standards and Technology, Special Publication 800-145, Sep. 2011, pp. 1-7. [cited by applicant]
Rawas et al., “EEBA: Energy-Efficient and Bandwidth-Aware Workload Allocation Method for Data-Intensive Applications in Cloud Data Centers”, IAENG International Journal of Computer Science, vol. 48, Issue 3: Sep. 2021, … [cited by applicant]
Sun et al., “Eco-Friendly Powering and Delay-Aware Task Scheduling in Geo-Distributed Edge-Cloud System: a Two-Timescale Framework”, IEEE Access, vol. 4, 2016, 17 pages. [cited by applicant]
Ku et al., “A collaborative cloud-edge computing framework in distributed neural network”, ERASIP Journal on Wireless Communications and Networking (2020) 2020:211, 18 pages. [cited by applicant]