IP Library Granted Patent US 12,223,363
Granted Patent B2
US 12,223,363 · App. 17/547,944 · Granted Feb 11, 2025

Performing workload migration in a virtualized system based on predicted resource distribution

Inventors: Jie Huang (Chengdu, CN); Guoping Guan (Chengdu, CN); Yunyun Duan (Chengdu, CN)
Assignee: EMC IP Holding Company LLC
G06F9/505G06F9/45533G06F9/4875G06N3/08
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,223,363
App. No.
17/547,944
Granted
Feb 11, 2025
Kind
B2
Abstract

Techniques for managing resources of a virtualized system involve acquiring historical distribution data about a virtualized system, the historical distribution data indicating a historical distribution of resources occupied by workloads on a plurality of host machines of the virtualized system over a predetermined historical time period. The techniques further involve generating predicted distribution data based on the historical distribution data, the predicted distribution data indicating an estimated distribution of resources occupied by the workloads on the plurality of host machines over a predetermined future time period. The techniques further involve performing workload migration at least once based on the predicted distribution data, the workload migration including migrating a workload of a first host machine whose first estimated quantity of occupied resources exceeds a high threshold to a second host machine whose second estimated quantity of occupied resources is below a low threshold.

Claims (34)

1. A method, comprising:

acquiring historical distribution data about a virtualized system, the historical distribution data indicating a historical distribution of resources occupied by virtual machines on each of a plurality of host machines of the virtualized system over a predetermined historical time period;

generating predicted distribution data based on the historical distribution data, the predicted distribution data indicating an estimated distribution of resources occupied by the virtual machines on each of the plurality of host machines over a predetermined future time period, wherein a first host machine of the plurality of host machines has a first estimated quantity of occupied resources that exceeds a high threshold and a second host machine of the plurality of host machines has a second estimated quantity of occupied resources that is below a low threshold; and

when at least one virtual machine of the first host machine occupies a quantity of resources not higher than a difference between the first estimated quantity of occupied resources and the second estimated quantity of occupied resources:

migrating, at least once based on the predicted distribution data, a most appropriate virtual machine of the first host machine to the second host machine, wherein the most appropriate virtual machine comprises a virtual machine of the first host machine which results in a residual quantity of occupied resources of the second host machine after the migration that is closest to

an average of the first estimated quantity of occupied resources and the second estimated quantity of occupied resources as compared to migration of other individual virtual machines of the first host machine.

2. The method according to claim 1 , further comprising:

stopping the migrating from being initially performed when the quantity of resources occupied by each virtual machine of the first host machine occupies a quantity of resources that is higher than the difference between the first estimated quantity of occupied resources and the second estimated quantity of occupied resources.

3. The method according to claim 2 , further comprising, after the stopping of the migrating from being initially performed, subsequently migrating the most appropriate virtual machine of the first host machine to the second host machine when the quantity of resources occupied by at least one virtual machine of on the first host machine is not higher than the difference between the first estimated quantity of occupied resources and the second estimated quantity of occupied resources.

4. The method according to claim 1 , wherein generating the predicted distribution data based on the historical distribution data includes:

generating the predicted distribution data using the historical distribution data as a long short-term memory (LSTM) machine learning model.

5. The method according to claim 1 , wherein the most appropriate workload of the first host machine results in a residual quantity of occupied resources of the second host machine after the migration that is closest to the average of the first estimated quantity of occupied resources and the second estimated quantity of occupied resources based on i) the second estimated quantity of occupied resources and ii) for each virtual machine of the first machine, a quantity of resources occupied by that virtual machine.

6. The method according to claim 1 , further comprising:

receiving resource requirements of the virtual machines submitted by a user to a virtual resource manager.

7. The method according to claim 6 , wherein the virtual resource manager includes a processor, an input/output interface, a memory, and a network interface.

8. The method according to claim 7 , wherein a resource schedule associated with the virtual resource manager is based on resources of the plurality of host machines including the first host machine and the second host machine that are within a virtual resource pool, the resources of the plurality of host machines including computing resources, communication resources, and storage resources.

9. An electronic device, comprising:

a processor; and

a memory coupled to the processor, the memory having instructions stored therein that, when executed by the processor, cause the device to execute actions including:

acquiring historical distribution data about a virtualized system, the historical distribution data indicating a historical distribution of resources occupied by virtual machines on each of a plurality of host machines of the virtualized system over a predetermined historical time period;

generating predicted distribution data based on the historical distribution data, the predicted distribution data indicating an estimated distribution of resources occupied by the virtual machines on each of the plurality of host machines over a predetermined future time period, wherein a first host machine of the plurality of host machines has a first estimated quantity of occupied resources that exceeds a high threshold and a second host machine of the plurality of host machines has a second estimated quantity of occupied resources that is below a low threshold; and

when at least one virtual machine of the first host machine occupies a quantity of resources not higher than a difference between the first estimated quantity of occupied resources and the second estimated quantity of occupied resources:

migrating, at least once based on the predicted distribution data, a most appropriate virtual machine of the first host machine to the second host machine, wherein the most appropriate virtual machine comprises a virtual machine of the first host machine which results in a residual quantity of occupied resources of the second host machine after the migration that is closest to

an average of the first estimated quantity of occupied resources and the second estimated quantity of occupied resources as compared to migration of other individual virtual machines of the first host machine.

10. The electronic device according to claim 9 , wherein the electronic device is caused to execute actions further including:

stopping the migrating from being initially performed when the quantity of resources occupied by each virtual machine of the first host machine occupies a quantity of resources that is higher than the difference between the first estimated quantity of occupied resources and the second estimated quantity of occupied resources.

11. The electronic device according to claim 9 , wherein generating the predicted distribution data based on the historical distribution data includes:

generating the predicted distribution data using the historical distribution data as a long short-term memory (LSTM) machine learning model.

12. A computer program product having a non-transitory computer readable medium which stores a set of instructions, the set of instructions, when carried out by computerized circuitry, causing the computerized circuitry to perform a method of:

acquiring historical distribution data about a virtualized system, the historical distribution data indicating a historical distribution of resources occupied by virtual machines on each of a plurality of host machines of the virtualized system over a predetermined historical time period;

generating predicted distribution data based on the historical distribution data, the predicted distribution data indicating an estimated distribution of resources occupied by the virtual machines on each of the plurality of host machines over a predetermined future time period, wherein a first host machine of the plurality of host machines has a first estimated quantity of occupied resources that exceeds a high threshold and a second host machine of the plurality of host machines has a second estimated quantity of occupied resources that is below a low threshold; and

when at least one virtual machine of the first host machine occupies a quantity of resources not higher than a difference between the first estimated quantity of occupied resources and the second estimated quantity of occupied resources:

migrating, at least once based on the predicted distribution data, a most appropriate virtual machine of the first host machine to the second host machine, wherein the most appropriate virtual machine comprises a virtual machine of the first host machine which results in a residual quantity of occupied resources of the second host machine after the migration that is closest to

an average of the first estimated quantity of occupied resources and the second estimated quantity of occupied resources as compared to migration of other individual virtual machines of the first host machine.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 3, 2022
From: HUANG, JIE; GUAN, GUOPING; DUAN, YUNYUN
To: EMC IP HOLDING COMPANY LLC
Reel/Frame 058527/0580 →
Priority Claims (1)
CN 202110614177.0 · Jun 2, 2021 · national
Continuity (1)
Related Publication 20220391253A1 · Dec 8, 2022
References Cited (63)
US 6374297B1 · Wolf · 2002 [cited by examiner]
US 6442663B1 · Sun · 2002 [cited by examiner]
US 6970425B1 · Bakshi · 2005 [cited by examiner]
US 7665092B1 · Vengerov · 2010 [cited by examiner]
US 8307359B1 · Brown · 2012 [cited by examiner]
US 9438466B1 · O'Gorman · 2016 [cited by examiner]
US 9477532B1 · Hong · 2016 [cited by examiner]
US 9503310B1 · Hawkes · 2016 [cited by examiner]
US 9830192B1 · Crouchman et al. · 2017 [cited by applicant]
US 10725885B1 · Paraschiv · 2020 [cited by examiner]
US 11169835B1 · Duong · 2021 [cited by examiner]
US 11281484B2 · Bafna et al. · 2022 [cited by applicant]
US 20050108712A1 · Goyal · 2005 [cited by examiner]
US 20050215265A1 · Sharma · 2005 [cited by examiner]
US 20060168107A1 · Balan · 2006 [cited by examiner]
US 20070250929A1 · Herington · 2007 [cited by examiner]
US 20090228589A1 · Korupolu · 2009 [cited by examiner]
US 20100115049A1 · Matsunaga · 2010 [cited by examiner]
US 20100180025A1 · Kern · 2010 [cited by examiner]
US 20100242045A1 · Swamy · 2010 [cited by examiner]
US 20100262974A1 · Uyeda · 2010 [cited by examiner]
US 20110099550A1 · Shafi · 2011 [cited by examiner]
US 20110131569A1 · Heim · 2011 [cited by examiner]
US 20110314345A1 · Stern · 2011 [cited by examiner]
US 20120026870A1 · Challa · 2012 [cited by examiner]
US 20120054771A1 · Krishnamurthy · 2012 [cited by examiner]
US 20120137012A1 · Stewart · 2012 [cited by examiner]
US 20120324445A1 · Dow · 2012 [cited by examiner]
US 20130054809A1 · Urmanov · 2013 [cited by examiner]
US 20130111033A1 · Mao · 2013 [cited by examiner]
US 20130145364A1 · Yang · 2013 [cited by examiner]
US 20130145365A1 · Yang · 2013 [cited by examiner]
US 20130160003A1 · Mann · 2013 [cited by examiner]
US 20130212349A1 · Maruyama · 2013 [cited by examiner]
US 20130239119A1 · Garg · 2013 [cited by examiner]
US 20130312005A1 · Chiu · 2013 [cited by examiner]
US 20140019989A1 · Suzuki · 2014 [cited by examiner]
US 20140344337A1 · Sramka · 2014 [cited by examiner]
US 20150169369A1 · Baskaran · 2015 [cited by examiner]
US 20160094401A1 · Anwar · 2016 [cited by examiner]
US 20160212202A1 · Birkestrand · 2016 [cited by examiner]
US 20160226789A1 · Sundararajan · 2016 [cited by examiner]
US 20160378531A1 · Dow · 2016 [cited by examiner]
US 20170126795A1 · Kumar · 2017 [cited by examiner]
US 20170147399A1 · Cropper · 2017 [cited by examiner]
US 20170315836A1 · Langer · 2017 [cited by examiner]
US 20170315838A1 · Nidugala · 2017 [cited by examiner]
US 20180004425A1 · Suzuki · 2018 [cited by examiner]
US 20180060134A1 · Bianchini · 2018 [cited by examiner]
US 20180121100A1 · Auvenshine · 2018 [cited by examiner]
US 20190332276A1 · Gupta · 2019 [cited by examiner]
US 20190363905A1 · Yarvis · 2019 [cited by examiner]
US 20200004601A1 · Ahmad · 2020 [cited by examiner]
US 20200019841A1 · Shaabana · 2020 [cited by examiner]
US 20200065125A1 · Zheng · 2020 [cited by examiner]
US 20210173687A1 · Bade · 2021 [cited by examiner]
US 20210173782A1 · Krasner · 2021 [cited by examiner]
US 20210241929A1 · Vishwakarma et al. · 2021 [cited by applicant]
US 20210271504A1 · Yu et al. · 2021 [cited by applicant]
US 20210326275A1 · Anirudhan · 2021 [cited by examiner]
US 20220004941A1 · Wu · 2022 [cited by examiner]
US 20220164681A1 · Aurongzeb · 2022 [cited by applicant]
US 20230367649A1 · Wu · 2023 [cited by examiner]