IP Library Granted Patent US 12,135,629
Granted Patent B2
US 12,135,629 · App. 17/360,130 · Granted Nov 5, 2024

Workload placement based on special purpose accelerator requirements and performance metrics

Inventors: Dharmesh M. Patel (Round Rock, TX); John Kelly (Mallow, IE)
Assignee: Dell Products L.P.
G06F11/3433G06F9/5044G06F9/5083G06F11/3006
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,135,629
App. No.
17/360,130
Granted
Nov 5, 2024
Kind
B2
Abstract

An infrastructure manager for placing workloads for performance across available infrastructure including on-demand infrastructure and dedicated infrastructure includes a storage device for storing an available infrastructure repository and a processor. The processor obtains a workload placement request for a workload of the workloads; makes a determination that the workload has a special purpose hardware requirement; in response to the determination: identifies, using the available infrastructure repository, potential placement locations in the available infrastructure for the workload that each meet the special purpose hardware requirement; and places the workload at one of the potential placement locations.

Claims (57)

1. An infrastructure manager for placing workloads for performance across available infrastructure comprising a plurality of on-demand infrastructure and a plurality of dedicated infrastructure, comprising:

a storage device for storing an available infrastructure repository specifying at least types, quantities, and characteristics of different portions of the available infrastructure for placing the workloads; and

a processor programmed to:

intercept a workload placement request for a workload of the workloads, wherein the request specifies at least one selected from a group consisting of a type of the workload, resources required to perform the workload, and a prioritization parameter for performance of the workload, wherein the request is issued by a client;

identify performance metrics by matching the type of the workload to performance profiles associated with the workloads, wherein the performance metrics are used to estimate how efficient the workload will be performed using a combination of the plurality of on-demand infrastructure and the plurality of dedicated infrastructure;

make, based on the request, a determination that the workload has a special purpose hardware requirement;

in response to the determination:

identify, based on the performance metrics and the special purpose hardware requirement, a plurality of potential placement locations (PLs) in the available infrastructure for the workload that each meet the special purpose hardware requirement;

place, based on information obtained from a performance metrics repository, the workload at a first PL of the plurality of the potential PLs,

wherein the information comprises at least a first result specifying a first performance of a test workload using the dedicated infrastructure and a second result specifying a second performance of the test workload using the on-demand infrastructure;

identify, after placing the workload and while the workload is being performed, a performance metric change in the available infrastructure, wherein the workload is impacted by the performance metric change;

identify, based on the performance metric change and the special purpose hardware requirement, a second PL of the plurality of potential PLs is now available to perform the workload in a more efficient manner than the first PL, wherein the second PL is different from the first PL or the second PL is not different from the first PL;

make a second determination that the second PL is different from the first PL; and

migrate, based on the second determination, the workload to the second PL.

2. The infrastructure manager of claim 1 , wherein the available infrastructure repository specifies special purpose hardware profiles for the available infrastructure.

3. The infrastructure manager of claim 2 , wherein the special purpose hardware profiles specify special purpose hardware devices by the respective available infrastructure.

4. The infrastructure manager of claim 3 , wherein the special purpose hardware devices are adapted to perform a portion of the workloads in a more efficient manner than general purpose computational devices.

5. The infrastructure manager of claim 4 , wherein the special purpose hardware profiles further specify interconnectivity between the special purpose hardware devices and the general purpose computation devices.

6. The infrastructure manager of claim 4 , wherein the special purpose hardware profiles further specify identifiers of software components that orchestrate operation of the respective special purpose hardware devices.

7. The infrastructure manager of claim 6 , wherein the software components are firmware hosted by the respective special purpose hardware devices.

8. The infrastructure manager of claim 1 , wherein the determination is based on the type of the workload.

9. The infrastructure manager of claim 1 , wherein the determination is based on a requirement specified in the workload placement request.

10. The infrastructure manager of claim 1 , wherein the special purpose hardware requirement is presence of a hardware device that is able to perform the workload more efficiently than general purpose computing devices.

11. A method for placing workloads for placing workloads for performance across available infrastructure comprising a plurality of on-demand infrastructure and a plurality of dedicated infrastructure, comprising:

intercepting a workload placement request for a workload of the workloads, wherein the request specifies at least one selected from a group consisting of a type of the workload, resources required to perform the workload, and a prioritization parameter for performance of the workload, wherein the request is issued by a client;

identifying performance metrics by matching the type of the workload to performance profiles associated with the workloads, wherein the performance metrics are used to estimate how efficient the workload will be performed using a combination of the plurality of on-demand infrastructure and the plurality of dedicated infrastructure;

making, based on the request, a determination that the workload has a special purpose hardware requirement;

in response to the determination:

identifying, based on the performance metrics and the special purpose hardware requirement, a plurality of potential placement locations (PLs) in the available infrastructure for the workload that each meet the special purpose hardware requirement,

wherein an available infrastructure repository specifies at least types, quantities, and characteristics of different portions of the available infrastructure for placing the workloads;

placing, based on information obtained from a performance metrics repository, the workload at a first PL of the plurality of the potential PLs,

wherein the information comprises at least a first result specifying a first performance of a test workload using the dedicated infrastructure and a second result specifying a second performance of the test workload using the on-demand infrastructure;

identifying, after placing the workload and while the workload is being performed, a performance metric change in the available infrastructure, wherein the workload is impacted by the performance metric change;

identifying, based on the performance metric change and the special purpose hardware requirement, a second PL of the plurality of potential PLs is now available to perform the workload in a more efficient manner than the first PL, wherein the second PL is different from the first PL or the second PL is not different from the first PL;

making a second determination that the second PL is different from the first PL; and

migrating, based on the second determination, the workload to the second PL.

12. The method of claim 11 , wherein the available infrastructure repository specifies special purpose hardware profiles for the available infrastructure.

13. The method of claim 12 , wherein the special purpose hardware profiles specify special purpose hardware devices by the respective available infrastructure.

14. The method of claim 13 , wherein the special purpose hardware devices are adapted to perform a portion of the workloads in a more efficient manner than general purpose computational devices.

15. The method of claim 14 , wherein the special purpose hardware profiles further specify interconnectivity between the special purpose hardware devices and the general purpose computation devices.

16. A non-transitory computer readable medium comprising computer readable program code, which when executed by a computer processor enables the computer processor to perform a method for placing workloads for performance across available infrastructure comprising a plurality of on-demand infrastructure and a plurality of dedicated infrastructure, the method comprising:

intercepting a workload placement request for a workload of the workloads, wherein the request specifies at least one selected from a group consisting of a type of the workload, resources required to perform the workload, and a prioritization parameter for performance of the workload, wherein the request is issued by a client;

identifying performance metrics by matching the type of the workload to performance profiles associated with the workloads, wherein the performance metrics are used to estimate how efficient the workload will be performed using a combination of the plurality of on-demand infrastructure and the plurality of dedicated infrastructure;

making, based on the request, a determination that the workload has a special purpose hardware requirement;

in response to the determination:

identifying, based on the performance metrics and the special purpose hardware requirement, a plurality of potential placement locations (PLs) in the available infrastructure for the workload that each meet the special purpose hardware requirement,

wherein an available infrastructure repository specifies at least types, quantities, and characteristics of different portions of the available infrastructure for placing the workloads;

placing, based on information obtained from a performance metrics repository, the workload at a first PL of the plurality of the potential PLs,

wherein the information comprises at least a first result specifying a first performance of a test workload using the dedicated infrastructure and a second result specifying a second performance of the test workload using the on-demand infrastructure;

identifying, after placing the workload and while the workload is being performed, a performance metric change in the available infrastructure, wherein the workload is impacted by the performance metric change;

identifying, based on the performance metric change and the special purpose hardware requirement, a second PL of the plurality of potential PLs is now available to perform the workload in a more efficient manner than the first PL, wherein the second PL is different from the first PL or the second PL is not different from the first PL;

making a second determination that the second PL is different from the first PL; and

migrating, based on the second determination, the workload to the second PL.

17. The non-transitory computer readable medium of claim 16 , wherein the available infrastructure repository specifies special purpose hardware profiles for the available infrastructure.

18. The non-transitory computer readable medium of claim 17 , wherein the special purpose hardware profiles specify special purpose hardware devices by the respective available infrastructure.

19. The non-transitory computer readable medium of claim 18 , wherein the special purpose hardware devices are adapted to perform a portion of the workloads in a more efficient manner than general purpose computational devices.

20. The non-transitory computer readable medium of claim 19 , wherein the special purpose hardware profiles further specify interconnectivity between the special purpose hardware devices and the general purpose computation devices.

Assignments (8)
RELEASE OF SECURITY INTEREST IN PATENTS PREVIOUSLY RECORDED AT REEL/FRAME (058014/0560) Recorded Jun 10, 2022
From: THE BANK OF NEW YORK MELLON TRUST COMPANY, N.A., AS NOTES COLLATERAL AGENT
To: DELL PRODUCTS L.P.; EMC IP HOLDING COMPANY LLC
Reel/Frame 062022/0473 →
RELEASE OF SECURITY INTEREST IN PATENTS PREVIOUSLY RECORDED AT REEL/FRAME (057931/0392) Recorded Jun 10, 2022
From: THE BANK OF NEW YORK MELLON TRUST COMPANY, N.A., AS NOTES COLLATERAL AGENT
To: DELL PRODUCTS L.P.; EMC IP HOLDING COMPANY LLC
Reel/Frame 062022/0382 →
RELEASE OF SECURITY INTEREST IN PATENTS PREVIOUSLY RECORDED AT REEL/FRAME (057758/0286) Recorded Jun 10, 2022
From: THE BANK OF NEW YORK MELLON TRUST COMPANY, N.A., AS NOTES COLLATERAL AGENT
To: DELL PRODUCTS L.P.; EMC IP HOLDING COMPANY LLC
Reel/Frame 061654/0064 →
SECURITY INTEREST Recorded Oct 6, 2021
From: DELL PRODUCTS L.P.; EMC IP HOLDING COMPANY LLC
To: THE BANK OF NEW YORK MELLON TRUST COMPANY, N.A., AS NOTES COLLATERAL AGENT
Reel/Frame 058014/0560 →
SECURITY INTEREST Recorded Oct 6, 2021
From: DELL PRODUCTS L.P.; EMC IP HOLDING COMPANY LLC
To: THE BANK OF NEW YORK MELLON TRUST COMPANY, N.A., AS NOTES COLLATERAL AGENT
Reel/Frame 057758/0286 →
SECURITY INTEREST Recorded Oct 6, 2021
From: DELL PRODUCTS L.P.; EMC IP HOLDING COMPANY LLC
To: THE BANK OF NEW YORK MELLON TRUST COMPANY, N.A., AS NOTES COLLATERAL AGENT
Reel/Frame 057931/0392 →
SECURITY AGREEMENT Recorded Oct 1, 2021
From: DELL PRODUCTS, L.P.; EMC IP HOLDING COMPANY LLC
To: CREDIT SUISSE AG, CAYMAN ISLANDS BRANCH
Reel/Frame 057682/0830 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 30, 2021
From: PATEL, DHARMESH M.; KELLY, JOHN
To: DELL PRODUCTS L.P.
Reel/Frame 056719/0009 →
Continuity (1)
Related Publication 20220413987A1 · Dec 29, 2022
Cited By (3)
US 12,360,818 US 12,513,085 US 12,625,542