IP Library Granted Patent US 9,625,974
Granted Patent B2
US 9,625,974 · App. 14/139,739 · Granted Apr 18, 2017

Global throttling of computing nodes in a modular, rack-configured information handling system

Inventors: Edmond Bailey (Cedar Park, TX); John R. Stuewe (Round Rock, TX); Paul W. Vancil (Austin, TX)
Assignee: Dell Products, L.P.
G06F1/3234G06F1/206G06F1/28G06F1/3206Y02B60/1275
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,625,974
App. No.
14/139,739
Filed
Dec 23, 2013
Granted
Apr 18, 2017
Kind
B2
Art Unit
2116
USPC
713/320
Abstract

A computer-implemented method enables global throttling of processing nodes in a rack-configured information handling system (RIHS). A rack-level management controller receives power-usage data and operating parameters associated with processing nodes within separately-controlled blocks of the RIHS. A power subsystem of the RIHS regulates an amount of power supplied to the processing nodes of the RIHS based on the power-usage data and operating parameters for the processing nodes and a total amount of available power for distribution within the RIHS. In response to detecting a condition that reduces the total amount of available power for distribution within the IHS, the management controller autonomously initiates global throttling of the processing nodes within the IHS to reduce power consumption by at least one of the processing nodes. The global throttling is completed via a signal transfer over a select Ethernet cable wire to connected block controllers that control the processing nodes.

Claims (93)

1. A computer implemented method that implements rack-level power control of processing nodes in a rack-configured information handling system, the method comprising:

receiving, at a rack-level management controller, power-usage data, operating parameters, and settings information associated with one or more processing nodes within one or more separately-controlled blocks of the information handling system (IHS);

triggering a power subsystem of the IHS to regulate an amount of power supplied to one or more of the processing nodes of the information handling system based on the received information for the one or more processing nodes and a total amount of available power for distribution within the IHS; and

in response to detecting a condition that reduces the total amount of available power for distribution within the IHS, the rack-level management controller autonomously initiating global throttling of power allocation within the IHS to reduce power consumption by at least one of the processing nodes via a separate block controller, wherein the global throttling is triggered by asserting a global throttle wire that is a subset of available wires within an Ethernet cable interconnecting the rack-level management controller and one or more block-level controllers;

wherein the communication between the management controller and each of the one or more block controllers occurs over an Ethernet cable, which has a subset of individual signal wires assigned for general system and network communication between an infrastructure manager and the one or more block controllers, based in part on triggering commands received from the management controller;

wherein at least one signal wire in the Ethernet cable is assigned as a global throttle wire for a specific connected one of the one or more block controllers to provide communication of a GTPR signal from the infrastructure controller to the specific block controller; and

wherein at least one other signal wire in the Ethernet cable is assigned as a global reset wire for a specific connected one of the one or more block controllers to allow for expedient communication of a reset signal from the management controller via the infrastructure controller to the specific block controller.

2. The method of claim 1 , further comprising:

initializing the management controller during start up configuration of the IHS;

establishing communication between the management controller, the power subsystem, and one or more block controllers that each control block-level operations of processing nodes within a corresponding block;

retrieving power profile data for each block within the IHS, the power profile data comprising the power-usage data and settings information of the individual processing nodes within the particular block;

generating a power allocation for each block based on the received power profile data; and

triggering the power subsystem to supply power to each block and by extension to each of the nodes based on the power allocation for that block.

3. The method of claim 1 , wherein the condition is one of a power supply unit (PSU) failure and an AC input power failure, and the method further comprises:

determining which condition has occurred;

in response to determining that the PSU failure has occurred, transmitting a signal to at least one of the block controllers to reduce power to at least one of the nodes, wherein an overall power is reduced by a first amount correlated to a loss of a PSU; and

in response to determining that the AC input power failure has occurred, transmitting a signal to at least one of the block controllers to reduce power to at least one of the nodes, wherein an overall power is reduced by a second amount correlated to a loss of an AC input.

4. The method of claim 3 , further comprising:

determining via at least one block controller, which processing nodes of the corresponding block are to be throttled in order to reduce power consumption by the corresponding block; and

the at least one of the block controller subsequently throttling operations of the processing nodes that are to be throttled within the corresponding blocks.

5. The method of claim 1 , further comprising:

establishing a maximum power capacity for the information handing system;

monitoring a total power usage and demand across the IHS; and

in response to determining that a current power demand across the IHS is greater than the maximum power capacity, transmitting a signal to at least one of the block controllers to reduce power to at least one of the nodes.

6. The method of claim 1 , wherein initiating global throttling of power allocation within the IHS to reduce power consumption by at least one of the processing nodes via an associated block controller comprises generating a signal on a global throttle wire allocated within each Ethernet cable directly connecting each block controller within the IHS with the management controller, wherein the block controllers within the IHS are pre-programmed to respond to an assertion of a signal on the global throttle wire by the management controller by immediately throttling operations of one or more processing nodes within a respective block being controlled by the block controller.

7. The method of claim 1 , further comprising:

in response to detecting that the overall thermal readings of the IHS are above a system thermal threshold, identifying at least one block drawing large amounts of power and contributing to higher than normal thermal threshold readings; and

transmitting a signal to at least each block controller corresponding to the identified at least one block to reduce power consumption by the at least one node.

8. The method of claim 1 , further comprising:

determining whether the condition remains present after reducing power to at least one of the nodes; and

in response to the condition remaining present, triggering at least one of the block controllers to shut down at least one of the nodes.

9. The method of claim 1 , further comprising:

determining whether at least one of an infrastructure manager or the block controllers are to be reset;

in response to determining that at least one of the infrastructure manager or the block controllers are to be reset, generating a reset signal on a reset wire allocated within each Ethernet cable directly connecting the management controller with the infrastructure manager and the block controllers, wherein the reset signal triggers at least one of the infrastructure manager or the block controllers to reset.

10. A rack-level power control system comprising:

a rack-level management controller having a processor and a memory coupled to the processor via a system interconnect;

a power subsystem communicatively coupled to the rack-level management controller;

a cooling subsystem communicatively coupled to the rack-level management controller;

one or more blocks communicatively coupled to the rack-level management controller, the blocks having at least one block controller communicatively coupled to the rack-level management controller and each of the blocks having one or more processing nodes; and

an Ethernet cable connected between the rack-level management controller and at least one of the block controllers, wherein: at least one of the wires in the Ethernet cable allocated as a global throttle wire to provide communication of a global throttle power reduction signal from the rack-level management controller to at least one of the block controllers and at least one of the nodes allowing an immediate reduction in power usage by the processing nodes upon receipt of the global throttle power reduction signal; a subset of individual signal wires within the Ethernet cable is assigned for general system and network communication between an infrastructure manager and the one or more block controllers, based in part on triggering commands received from the management controller; and at least one other signal wire in the Ethernet cable is assigned as a global reset wire for a specific connected one of the one or more block controllers to allow for expedient communication of a reset signal from the management controller via the infrastructure controller to the specific block controller.

11. The rack-level power control system of claim 10 , further comprising:

an infrastructure manager communicatively connected via the Ethernet cable between the rack-level management controller and at least one of the block controllers, the infrastructure manager comprising a switch communicatively coupled to an infrastructure controller.

12. The rack-level power control system of claim 11 , wherein the infrastructure controller selectively routes the global throttle power reduction signal via the Ethernet cable to at least one selected block controller.

13. The rack-level power control system of claim 11 , wherein the Ethernet cable further comprises:

a rack-level Ethernet cable connected between the management controller and the infrastructure manager, the rack-level Ethernet cable having a first global throttle to provide communication of the global throttle power reduction signal from the rack-level management controller to the infrastructure manager; and

at least one block level Ethernet cable connected between the infrastructure manager and at least one of the block controllers, the block level Ethernet cable having a second global throttle wire to provide communication of the global throttle power reduction signal from the infrastructure manager to at least one of the block controllers.

14. The rack-level power control system of claim 10 , wherein the power subsystem further comprises:

at least one power supply unit communicatively coupled to the management controller, the management controller receiving power supply unit data and settings from the at least one power supply unit; and

an AC switch connected to the at least one power supply unit to supply power to the at least one power supply unit, the AC switch communicatively coupled to the management controller, the management controller receiving AC power data and settings from the AC switch.

15. The rack-level power control system of claim 14 , further comprising:

at least one backup battery connected to at least one of the power supply units, wherein the management controller has firmware executing thereon that configures the rack-level management controller to:

in response to determining that an AC input power failure has occurred, transmitting a signal to at least one of the block controllers to reduce power to at least one of the nodes in order to extend operating life of the backup battery.

16. The rack-level power control system of claim 10 , wherein the block controller further comprises:

a field programmable gate array that contains pre-determined processing node global throttle data designating at least one of the processing nodes to reduce power in response to receiving the global throttle power reduction signal.

17. The rack-level power control system of claim 10 , wherein the cooling subsystem further comprises:

at least one temperature sensor that is communicatively coupled to the rack-level management controller, wherein the management controller has firmware executing thereon that configures the rack-level management controller to, in response to receiving a signal from a temperature sensor indicating that the overall thermal readings of the IHS are above a system thermal threshold:

identify at least one block drawing large amounts of power and contributing to higher than normal thermal threshold readings; and

transmit a signal to at least each block controller corresponding to the identified at least one block to reduce power consumption by the at least one node.

18. The rack-level power control system of claim 10 , wherein the management controller has firmware executing thereon that configures the rack-level management controller to:

in response to reducing power to at least one of the nodes, determine whether a condition that reduces the total amount of available power for distribution within the IHS remains; and

in response to the condition remaining, trigger at least one of the block controllers to shut down at least one of the nodes.

19. The rack-level power control system of claim 10 , wherein the management controller has firmware executing thereon that configures the rack-level management controller to: determine whether at least one of an infrastructure manager or the block controllers are to be reset;

in response to determining that at least one of the infrastructure manager or the block controllers are to be reset, generate a reset signal on a reset wire allocated within each Ethernet cable directly connecting the management controller with the infrastructure manager and the block controllers, wherein the reset signal triggers at least one of the of the infrastructure manager or the block controllers to reset.

20. An information handling system (IHS) comprising:

a rack having a plurality of block chasses;

one or more blocks located within respective ones of the plurality of block chassis, the blocks having at least one block controller and each of the blocks having one or more processing nodes;

a rack-level management controller having a processor a memory coupled to the processor via a system interconnect, the rack-level management controller communicatively coupled to the blocks, the block controllers and the processing nodes;

a power subsystem communicatively coupled to the rack-level management controller;

a cooling subsystem communicatively coupled to the rack-level management controller; and

an Ethernet cable connected between the rack-level management controller and at least one of the block controllers, wherein: at least one of the wires in the Ethernet cable allocated as a global throttle wire to provide communication of a global throttle power reduction signal from the rack-level management controller to at least one of the block controllers and at least one of the nodes allowing an immediate reduction in power usage by the processing nodes upon receipt of the global throttle power reduction signal; a subset of individual signal wires within the Ethernet cable is assigned for general system and network communication between an infrastructure manager and the one or more block controllers, based in part on triggering commands received from the management controller; and at least one other signal wire in the Ethernet cable is assigned as a global reset wire for a specific connected one of the one or more block controllers to allow for expedient communication of a reset signal from the management controller via the infrastructure controller to the specific block controller.

21. The information handling system of claim 20 , further comprising:

an infrastructure manager communicatively connected via the Ethernet cable between the rack-level management controller and at least one of the block controllers, the infrastructure manager comprising a switch communicatively coupled to an infrastructure controller.

22. The information handling system of claim 21 , wherein the infrastructure controller selectively routes the global throttle power reduction signal via the Ethernet cable to at least one selected block controller.

23. The information handling system of claim 21 , wherein the Ethernet cable further comprises:

a rack-level Ethernet cable connected between the management controller and the infrastructure manager, the rack-level Ethernet cable having a first global throttle to provide communication of the global throttle power reduction signal from the rack-level management controller to the infrastructure manager; and

at least one block level Ethernet cable connected between the infrastructure manager and at least one of the block controllers, the block level Ethernet cable having a second global throttle wire to provide communication of the global throttle power reduction signal from the infrastructure manager to at least one of the block controllers.

24. The information handling system of claim 20 , wherein the power subsystem further comprises:

at least one power supply unit communicatively coupled to the management controller, the management controller receiving power supply unit data and settings from the at least one power supply unit; and

an AC switch connected to the at least one power supply unit to supply power to the at least one power supply unit, the AC switch communicatively coupled to the management controller, the management controller receiving AC power data and settings from the AC switch.

25. The information handling system of claim 24 , further comprising:

at least one backup battery connected to at least one of the power supply units, wherein the management controller has firmware executing thereon that configures the rack-level management controller to:

in response to determining that an AC input power failure has occurred, transmitting a signal to at least one of the block controllers to reduce power to at least one of the nodes in order to extend operating life of the backup battery.

26. The information handling system of claim 20 , wherein the block controller further comprises:

a field programmable gate array that contains pre-determined processing node global throttle data designating at least one of the processing nodes to reduce power in response to receiving the global throttle power reduction signal.

27. The information handling system of claim 20 , wherein the cooling subsystem further comprises:

at least one temperature sensor that is communicatively coupled to the rack-level management controller, wherein the management controller has firmware executing thereon that configures the rack-level management controller to:

in response to receiving a signal from temperature sensor that the overall thermal readings of the IHS are above a system thermal threshold, identify at least one block drawing large amounts of power and contributing to higher than normal thermal threshold readings; and

transmit a signal to at least each block controller corresponding to the identified at least one block to reduce power consumption by the at least one node.

28. The information handling system of claim 20 , wherein the management controller has firmware executing thereon that configures the rack-level management controller to:

in response to reducing power to at least one of the nodes, determine whether a condition that reduces the total amount of available power for distribution within the IHS remains; and

in response to the condition remaining, trigger at least one of the block controllers to shut down at least one of the nodes.

29. The information handling system of claim 20 , wherein the management controller has firmware executing thereon that configures the rack-level management controller to: determine whether at least one of an infrastructure manager or the block controllers are to be reset;

in response to determining that at least one of the infrastructure manager or the block controllers are to be reset, generate a reset signal on a reset wire allocated within each Ethernet cable directly connecting the management controller with the infrastructure manager and the block controllers, wherein the reset signal triggers at least one of the of the infrastructure manager or the block controllers to reset.

Assignments (15)
RELEASE OF SECURITY INTEREST IN PATENTS PREVIOUSLY RECORDED AT REEL/FRAME (053546/0001) Recorded Jun 23, 2022
From: THE BANK OF NEW YORK MELLON TRUST COMPANY, N.A., AS NOTES COLLATERAL AGENT
To: DELL MARKETING L.P. (ON BEHALF OF ITSELF AND AS SUCCESSOR-IN-INTEREST TO CREDANT TECHNOLOGIES, INC.); DELL INTERNATIONAL L.L.C.; DELL PRODUCTS L.P.; DELL USA L.P.; EMC CORPORATION; DELL MARKETING CORPORATION (SUCCESSOR-IN-INTEREST TO FORCE10 NETWORKS, INC. AND WYSE TECHNOLOGY L.L.C.); EMC IP HOLDING COMPANY LLC
Reel/Frame 071642/0001 →
RELEASE OF SECURITY INTEREST IN PATENTS PREVIOUSLY RECORDED AT REEL/FRAME (045455/0001) Recorded May 20, 2022
From: THE BANK OF NEW YORK MELLON TRUST COMPANY, N.A., AS NOTES COLLATERAL AGENT
To: DELL MARKETING CORPORATION (SUCCESSOR-IN-INTEREST TO ASAP SOFTWARE EXPRESS, INC.); DELL MARKETING L.P. (ON BEHALF OF ITSELF AND AS SUCCESSOR-IN-INTEREST TO CREDANT TECHNOLOGIES, INC.); DELL USA L.P.; DELL INTERNATIONAL L.L.C.; DELL PRODUCTS L.P.; DELL MARKETING CORPORATION (SUCCESSOR-IN-INTEREST TO FORCE10 NETWORKS, INC. AND WYSE TECHNOLOGY L.L.C.); EMC CORPORATION (ON BEHALF OF ITSELF AND AS SUCCESSOR-IN-INTEREST TO MAGINATICS LLC); EMC IP HOLDING COMPANY LLC (ON BEHALF OF ITSELF AND AS SUCCESSOR-IN-INTEREST TO MOZY, INC.); SCALEIO LLC
Reel/Frame 061753/0001 →
RELEASE OF SECURITY INTEREST IN PATENTS PREVIOUSLY RECORDED AT REEL/FRAME (040136/0001) Recorded Apr 26, 2022
From: THE BANK OF NEW YORK MELLON TRUST COMPANY, N.A., AS NOTES COLLATERAL AGENT
To: DELL MARKETING CORPORATION (SUCCESSOR-IN-INTEREST TO ASAP SOFTWARE EXPRESS, INC.); DELL MARKETING L.P. (ON BEHALF OF ITSELF AND AS SUCCESSOR-IN-INTEREST TO CREDANT TECHNOLOGIES, INC.); DELL USA L.P.; DELL INTERNATIONAL L.L.C.; DELL PRODUCTS L.P.; DELL MARKETING CORPORATION (SUCCESSOR-IN-INTEREST TO FORCE10 NETWORKS, INC. AND WYSE TECHNOLOGY L.L.C.); EMC CORPORATION (ON BEHALF OF ITSELF AND AS SUCCESSOR-IN-INTEREST TO MAGINATICS LLC); EMC IP HOLDING COMPANY LLC (ON BEHALF OF ITSELF AND AS SUCCESSOR-IN-INTEREST TO MOZY, INC.); SCALEIO LLC
Reel/Frame 061324/0001 →
RELEASE OF SECURITY INTEREST Recorded Nov 3, 2021
From: CREDIT SUISSE AG, CAYMAN ISLANDS BRANCH
To: ASAP SOFTWARE EXPRESS, INC.; AVENTAIL LLC; CREDANT TECHNOLOGIES, INC.; DELL USA L.P.; DELL INTERNATIONAL, L.L.C.; DELL MARKETING L.P.; DELL PRODUCTS L.P.; DELL SOFTWARE INC.; DELL SYSTEMS CORPORATION; EMC CORPORATION; EMC IP HOLDING COMPANY LLC; FORCE10 NETWORKS, INC.; MAGINATICS LLC; MOZY, INC.; SCALEIO LLC; WYSE TECHNOLOGY L.L.C.
Reel/Frame 058216/0001 →
SECURITY AGREEMENT Recorded Apr 22, 2020
From: CREDANT TECHNOLOGIES INC.; DELL INTERNATIONAL L.L.C.; DELL MARKETING L.P.; DELL PRODUCTS L.P.; DELL USA L.P.; EMC CORPORATION; FORCE10 NETWORKS, INC.; WYSE TECHNOLOGY L.L.C.; EMC IP HOLDING COMPANY LLC
To: THE BANK OF NEW YORK MELLON TRUST COMPANY, N.A.
Reel/Frame 053546/0001 →
SECURITY AGREEMENT Recorded Mar 21, 2019
From: CREDANT TECHNOLOGIES, INC.; DELL INTERNATIONAL L.L.C.; DELL MARKETING L.P.; DELL PRODUCTS L.P.; DELL USA L.P.; EMC CORPORATION; FORCE10 NETWORKS, INC.; WYSE TECHNOLOGY L.L.C.; EMC IP HOLDING COMPANY LLC
To: THE BANK OF NEW YORK MELLON TRUST COMPANY, N.A.
Reel/Frame 049452/0223 →
SECURITY AGREEMENT Recorded Sep 21, 2016
From: ASAP SOFTWARE EXPRESS, INC.; AVENTAIL LLC; CREDANT TECHNOLOGIES, INC.; DELL USA L.P.; DELL INTERNATIONAL L.L.C.; DELL MARKETING L.P.; DELL PRODUCTS L.P.; DELL SOFTWARE INC.; DELL SYSTEMS CORPORATION; EMC CORPORATION; EMC IP HOLDING COMPANY LLC; FORCE10 NETWORKS, INC.; MAGINATICS LLC; MOZY, INC.; SCALEIO LLC; SPANNING CLOUD APPS LLC; WYSE TECHNOLOGY L.L.C.
To: CREDIT SUISSE AG, CAYMAN ISLANDS BRANCH, AS COLLATERAL AGENT
Reel/Frame 040134/0001 →
SECURITY AGREEMENT Recorded Sep 21, 2016
From: ASAP SOFTWARE EXPRESS, INC.; AVENTAIL LLC; CREDANT TECHNOLOGIES, INC.; DELL USA L.P.; DELL INTERNATIONAL L.L.C.; DELL MARKETING L.P.; DELL PRODUCTS L.P.; DELL SOFTWARE INC.; DELL SYSTEMS CORPORATION; EMC CORPORATION; EMC IP HOLDING COMPANY LLC; FORCE10 NETWORKS, INC.; MAGINATICS LLC; MOZY, INC.; SCALEIO LLC; SPANNING CLOUD APPS LLC; WYSE TECHNOLOGY L.L.C.
To: THE BANK OF NEW YORK MELLON TRUST COMPANY, N.A., AS NOTES COLLATERAL AGENT
Reel/Frame 040136/0001 →
RELEASE OF REEL 032810 FRAME 0206 (NOTE) Recorded Sep 14, 2016
From: BANK OF NEW YORK MELLON TRUST COMPANY, N.A., AS COLLATERAL AGENT
To: DELL SOFTWARE INC.; DELL PRODUCTS L.P.; CREDANT TECHNOLOGIES, INC.; COMPELLENT TECHNOLOGIES, INC.; FORCE10 NETWORKS, INC.; SECUREWORKS, INC.
Reel/Frame 040027/0204 →
RELEASE OF SECURITY INTEREST OF REEL 032809 FRAME 0930 (TL) Recorded Sep 14, 2016
From: BANK OF AMERICA, N.A., AS COLLATERAL AGENT
To: DELL SOFTWARE INC.; DELL PRODUCTS L.P.; CREDANT TECHNOLOGIES, INC.; COMPELLENT TECHNOLOGIES, INC.; FORCE10 NETWORKS, INC.; SECUREWORKS, INC.
Reel/Frame 040045/0255 →
RELEASE OF REEL 032809 FRAME 0887 (ABL) Recorded Sep 13, 2016
From: BANK OF AMERICA, N.A., AS ADMINISTRATIVE AGENT
To: DELL SOFTWARE INC.; DELL PRODUCTS L.P.; CREDANT TECHNOLOGIES, INC.; COMPELLENT TECHNOLOGIES, INC.; FORCE10 NETWORKS, INC.; SECUREWORKS, INC.
Reel/Frame 040017/0314 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 7, 2016
From: DELL INC.
To: DELL PRODUCTS L.P.
Reel/Frame 038222/0748 →
SUPPLEMENT TO PATENT SECURITY AGREEMENT (ABL) Recorded May 1, 2014
From: COMPELLENT TECHNOLOGIES, INC.; DELL PRODUCTS L.P.; DELL SOFTWARE INC.; FORCE10 NETWORKS, INC.; SECUREWORKS, INC.
To: BANK OF AMERICA, N.A., AS ADMINISTRATIVE AGENT
Reel/Frame 032809/0887 →
SUPPLEMENT TO PATENT SECURITY AGREEMENT (NOTES) Recorded May 1, 2014
From: COMPELLENT TECHNOLOGIES, INC.; DELL PRODUCTS L.P.; DELL SOFTWARE INC.; FORCE10 NETWORKS, INC.; SECUREWORKS, INC.
To: THE BANK OF NEW YORK MELLON TRUST COMPANY N.A., AS NOTES COLLATERAL AGENT
Reel/Frame 032810/0206 →
SUPPLEMENT TO PATENT SECURITY AGREEMENT (TERM LOAN) Recorded May 1, 2014
From: COMPELLENT TECHNOLOGIES, INC.; DELL PRODUCTS L.P.; DELL SOFTWARE INC.; FORCE10 NETWORKS, INC.; SECUREWORKS, INC.
To: BANK OF AMERICA, N.A., AS COLLATERAL AGENT
Reel/Frame 032809/0930 →
Continuity (1)
Related Publication 20150177813A1 · Jun 25, 2015