IP Library › Granted Patent US 12,353,923
Granted Patent B2
US 12,353,923 · App. 17/722,147 · Granted Jul 8, 2025

Method and system for managing a distributed multi-tiered computing environment based on load predictions

Inventors: William Jeffery White (Plano, TX); Said Tabet (Austin, TX)
Assignee: Dell Products L.P.
G06F9/5083G06F9/4881
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,353,923
App. No.
17/722,147
Granted
Jul 8, 2025
Kind
B2
Abstract

Techniques described herein relate to a method for managing a distributed multi-tiered computing (DMC) environment. The method includes identifying, by a global controller, a load management prediction event; in response to identifying the load management prediction event: obtaining offline data from local controllers associated with a plurality of DMC domains of the DMC environment; generating load management predictions using the offline data; adjusting local controller scheduling policies based on the load management predictions; adjusting global controller scheduling policies based on the load management predictions; making a first determination that the load management predictions require infrastructure adjustments; and in response to the first determination: initiating infrastructure capacity adjustment based on the load management predictions.

Claims (75)

1. A method for managing a distributed multi-tiered computing (DMC) environment, comprising:

identifying, by a global controller, a load management prediction event;

in response to identifying the load management prediction event:

obtaining offline data from local controllers associated with a plurality of DMC domains of the DMC environment;

generating load management predictions using the offline data;

adjusting local controller scheduling policies based on the load management predictions;

adjusting global controller scheduling based on the load management predictions;

making a first determination that the load management predictions require infrastructure adjustments;

in response to the first determination:

initiating infrastructure capacity adjustment based on the load management predictions

making a second determination, based on the load management predictions and adjusted local controller scheduling policies, that a future scheduling load associated with a set of local controller scheduler instances exceeds a threshold; and

in response to the second determination:

initiating an adjustment of a quantity of the set of local controller scheduler instances to satisfy the future scheduling load.

2. The method of claim 1 , wherein initiating the adjustment of local controller scheduler instances comprises increasing the quantity of the set of local controller scheduler instances.

3. The method of claim 1 , wherein the load management predictions comprise:

short-term load management predictions;

medium-term load management predictions; and

long-term load management predictions.

4. The method of claim 1 , wherein the load management predictions are generated, at least in part, using a metaheuristic algorithm.

5. The method of claim 1 , wherein the load management predictions comprise:

global controller load management predictions;

local controller load management predictions;

domain load management predictions; and

application load management predictions.

6. The method of claim 1 , wherein the plurality of DMC domains comprises:

edge domains, wherein an edge domain of the edge domains comprises an edge domain device set;

core domains, wherein a core domain of the core domain comprises a core domain device set; and

cloud domains, wherein a cloud domain of the cloud domains comprises a cloud domain device set.

7. The method of claim 1 , wherein adjusting local controller scheduling policies based on the load management predictions comprises selecting scheduling policy priorities for the local controllers.

8. The method of claim 7 , wherein the scheduling policy priorities specify which scheduling algorithms are used to schedule application tasks.

9. A non-transitory computer readable medium comprising computer readable program code, which when executed by a computer processor enables the computer processor to perform a method for managing a distributed multi-tiered computing (DMC) environment, comprising:

identifying, by a global controller, a load management prediction event;

in response to identifying the load management prediction event:

obtaining offline data from local controllers associated with a plurality of DMC domains of the DMC environment;

generating load management predictions using the offline data;

adjusting local controller scheduling policies based on the load management predictions;

adjusting global controller scheduling based on the load management predictions;

making a first determination that the load management predictions require infrastructure adjustments;

in response to the first determination:

initiating infrastructure capacity adjustment based on the load management predictions;

making a second determination, based on the load management predictions and adjusted local controller scheduling policies, that a future scheduling load associated with a set of local controller scheduler instances exceeds a threshold; and

in response to the second determination:

initiating an adjustment of a quantity of the set of local controller scheduler instances to satisfy the future scheduling load.

10. The non-transitory computer readable medium of claim 9 , wherein initiating the adjustment of local controller scheduler instances comprises increasing the quantity of the set of local controller scheduler instances.

11. The non-transitory computer readable medium of claim 9 , wherein the load management predictions comprise:

short-term load management predictions;

medium-term load management predictions; and

long-term load management predictions.

12. The non-transitory computer readable medium of claim 9 , wherein the load management predictions are generated, at least in part, using a metaheuristic algorithm.

13. The non-transitory computer readable medium of claim 9 , wherein the load management predictions comprise:

global controller load management predictions;

local controller load management predictions;

domain load management predictions; and

application load management predictions.

14. The non-transitory computer readable medium of claim 9 , wherein the plurality of DMC domains comprises:

edge domains, wherein an edge domain of the edge domains comprises an edge domain device set;

core domains, wherein a core domain of the core domain comprises a core domain device set; and

cloud domains, wherein a cloud domain of the cloud domains comprises a cloud domain device set.

15. The non-transitory computer readable medium of claim 9 , wherein adjusting local controller scheduling policies based on the load management predictions comprises selecting scheduling policy priorities for the local controllers.

16. The non-transitory computer readable medium of claim 15 , wherein the scheduling policy priorities specify which scheduling algorithms are used to schedule application tasks.

17. A system for managing a distributed multi-tiered computing (DMC) environment, the system comprising:

a DMC environment; and

a global controller of the DMC environment, comprising a processor and memory, and configured to:

identify a load management prediction event;

in response to identifying the load management prediction event:

obtain offline data from local controllers associated with a plurality of DM domains of the DMC environment;

generate load management predictions using the offline data;

adjust local controller scheduling policies based on the load management predictions;

adjust global controller scheduling based on the load management predictions;

make a first determination that the load management predictions require infrastructure adjustments;

in response to the first determination:

initiate infrastructure capacity adjustment based on the load management predictions;

make a second determination, based on the load management predictions and adjusted local controller scheduling policies, that a future scheduling load associated with a set of local controller scheduler instances exceeds a threshold; and

in response to the second determination:

initiate an adjustment of a quantity of the set of local controller scheduler instances to satisfy the future scheduling load.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 27, 2022
From: WHITE, WILLIAM JEFFERY; TABET, SAID
To: DELL PRODUCTS L.P.
Reel/Frame 059751/0445 →
Continuity (1)
Related Publication 20230333912A1 · Oct 19, 2023
References Cited (73)
US 10467036B2 · Anwar · 2019 [cited by examiner]
US 10616073B1 · Pierce · 2020 [cited by examiner]
US 11030068B1 · Agarwal · 2021 [cited by examiner]
US 11269718B1 · Chen · 2022 [cited by examiner]
US 11281577B1 · Karumbunathan · 2022 [cited by applicant]
US 11461211B1 · Harwood · 2022 [cited by applicant]
US 11539596B2 · Doshi · 2022 [cited by examiner]
US 11595243B1 · Schreiber et al. · 2023 [cited by applicant]
US 12004013B2 · Radunovic · 2024 [cited by examiner]
US 20050027480A1 · Qiao · 2005 [cited by applicant]
US 20060020629A1 · Ramani · 2006 [cited by applicant]
US 20140040702A1 · He · 2014 [cited by applicant]
US 20140297833A1 · Bedini · 2014 [cited by examiner]
US 20150222515A1 · Mimura · 2015 [cited by examiner]
US 20150302398A1 · Desai · 2015 [cited by applicant]
US 20150324234A1 · Chang · 2015 [cited by applicant]
US 20160011912A1 · Rangaraju · 2016 [cited by applicant]
US 20160277522A1 · Singh · 2016 [cited by applicant]
US 20160379125A1 · Bordawekar · 2016 [cited by applicant]
US 20170366616A1 · Rodrigues Nascimento · 2017 [cited by examiner]
US 20180027058A1 · Balle · 2018 [cited by examiner]
US 20180143860A1 · Dasu · 2018 [cited by applicant]
US 20180276263A1 · Voigt · 2018 [cited by applicant]
US 20180351355A1 · Chen · 2018 [cited by examiner]
US 20190266534A1 · Kessaci · 2019 [cited by examiner]
US 20200021537A1 · Oliveira · 2020 [cited by applicant]
US 20200136987A1 · Nakfour · 2020 [cited by examiner]
US 20200151609A1 · Ambardekar · 2020 [cited by examiner]
US 20200322367A1 · Salvat Lozano · 2020 [cited by applicant]
US 20200351337A1 · Calmon · 2020 [cited by applicant]
US 20200379837A1 · Krishnaswamy · 2020 [cited by examiner]
US 20210011765A1 · Doshi · 2021 [cited by examiner]
US 20210055933A1 · Bulut · 2021 [cited by examiner]
US 20210141900A1 · Brown · 2021 [cited by examiner]
US 20210144060A1 · Cencini · 2021 [cited by examiner]
US 20210176189A1 · Rabipour · 2021 [cited by examiner]
US 20210397500A1 · Wieder · 2021 [cited by examiner]
US 20220045929A1 · Guim Bernat · 2022 [cited by examiner]
US 20220058237A1 · Wang · 2022 [cited by applicant]
US 20220129745A1 · Wan · 2022 [cited by examiner]
US 20220164208A1 · Olmsted-Thompson · 2022 [cited by examiner]
US 20220244993A1 · MacDonald · 2022 [cited by examiner]
US 20220247618A1 · Côté · 2022 [cited by examiner]
US 20220291952A1 · Milojicic · 2022 [cited by examiner]
US 20220382614A1 · Chen · 2022 [cited by examiner]
US 20230023427A1 · Harwood · 2023 [cited by examiner]
US 20230026283A1 · Xu · 2023 [cited by examiner]
US 20230061136A1 · Abdollahian Noghabi · 2023 [cited by examiner]
US 20230108001A1 · Wong · 2023 [cited by examiner]
US 20230224943A1 · Sun · 2023 [cited by examiner]
US 20230237203A1 · Young · 2023 [cited by applicant]
US 20230319135A1 · Excoffier · 2023 [cited by examiner]
US 20230333912A1 · White · 2023 [cited by examiner]
US 20230345456A1 · Dees · 2023 [cited by applicant]
US 20230353588A1 · Geethanath · 2023 [cited by applicant]
US 20240015080A1 · Illikkal · 2024 [cited by examiner]
US 20240015520A1 · Khawer · 2024 [cited by examiner]
US 20240054382A1 · Saravanan · 2024 [cited by examiner]
CN 113961412A · 2022 [cited by applicant]
CN 115348159A · 2022 [cited by applicant]
Causal Inference Techniques for Microservice Performance Diagnosis: Evaluation and Guiding Recommendations, Li Wu, Johan Tordsson, Erik Elmroth, Odej Kao Elastisys AB, Umeå, Sweden, Email: {li.wu, johan.tordsson, Distri… [cited by applicant]
Cafaro et al., Causation Entropy From Symbolic Representations of Dynamical Systems, Department of Mathematics, Clarkson University, 8 Clarkson Ave, Potsdam, NY, 13699-5815, USA, arXiv:1507.07262v1 [physics.data-an], Ju… [cited by applicant]
Debeer and Strobl BMC Bioinformatics. Conditional Permutation Importance Revisited. (2020) 21:307 https://doi.org/10.1186/s12859-020-03622-2. [cited by applicant]
DirectLiNGAM: A Direct Method for Learning a Linear Non-Gaussian Structural Equation Model, Shohei Shimizu, Takanori Inazumi, Yasuhiro Sogawa, Aapo Hyva{umlaut over ( )}rinen, Yoshinobu Kawahara, Takashi Washio, Patrik … [cited by applicant]
FIRM: An Intelligent Fine-grained Resource Management Framework for SLO-Oriented Microservices Haoran Qiu, Subho S. Banerjee, Saurabh Jha, Zbigniew T. Kalbarczyk, and Ravishankar K. Iyer, University of Illinois at Urban… [cited by applicant]
Haoran Qiu, Subho S. Banerjee, Saurabh Jha, Zbigniew T. Kalbarczyk, and Ravishankar K. lyer, University of Illinois at Urbana—Champaign. FIRM: An Intelligent Fine-grained Resource Management Framework for SLO-Oriented M… [cited by applicant]
Juang, Huang, Chen, Wang, IEEE: Simulated Annealing for Sequential Pattern Detection and Seismic Applications, Dec. 2014 doi.org/10.1109/JSTARS.2014.2344756. [cited by applicant]
Li Wu, Jasmin Bogatinovski, Sasho Nedelkoski, Johan Tordsson, Odej Kao. Performance Diagnosis in Cloud Microservices using Deep Learning. AIOPS 2020—International Workshop Artificial Intelligence for IT Operations, Dec.… [cited by applicant]
Lin, Li, Liao, Franke, Capacity Optimization for Resource Pooling in Virtualized Data Centers with Composable Systems, DOI 10.1109/TPDS.2017.2757479 (2017). [cited by applicant]
Muhammad Tirmazi, Adam Barker, Nan Deng, Md E. Haque, Zhi-jing Gene Qin, Steven Hand, MorHarchol-Balter, and John Wilkes. 2020. Borg: the Next Generation. In Fifteenth European Conference on Computer Systems (EuroSys 20… [cited by applicant]
Stoica, INRA-Biometrie, Gregori, University Jaume I, Mateu, University Jaume I: Simulated Annealing and Object Point Processes: Tools for Analysis of Spatial Patterns, Jul. 2005. [cited by applicant]
Yihui Feng, Alibaba Group; Zhi Liu, Yunjian Zhao, Tatiana Jin, and Yidi Wu, The Chinese University of Hong Kong; Yang Zhang, Alibaba Group; James Cheng, The Chinese University of Hong Kong; Chao Li and Tao Guan, Alibaba… [cited by applicant]
Unknown, IEEE Standard for DevOps: Building Reliable and Secure Systems Including Application Build, Package, and Deployment, doi: 10.1109/IEEESTD.2021.9415476, 2021, 91 pages. [cited by applicant]