Software entity power consumption estimation and monitoring
Telemetry information in the form of platform telemetry, virtualization layer telemetry, and application telemetry can be used to estimate power consumption of a software entity, such as a virtual machine, container, application, or network slice. A controller can take various actions based on software entity power consumption information. If a power limit of an integrated circuit component is exceeded, the controller can reduce the power consumption of a software entity or move the software entity to another integrated circuit component to reduce the power consumption of the integrated circuit component. The controller can determine a total software entity power consumption for software entities associated with a user entity and take actions to keep the total software entity power consumption within a power budget.
1 . A method comprising:
receiving, at a first computing device, telemetry information associated with a computing platform of a second computing device on which a software entity is executing, wherein the computing platform comprises an integrated circuit component comprising a plurality of physical processor units and non-processor unit circuitry, the software entity executing on a virtual processor unit to which one or more of the plurality of physical processor units are allocated, and the telemetry information comprises information indicating an integrated circuit component power consumption;
determining, at the first computing device, a software entity power consumption for the software entity based on the telemetry information, wherein determining the software entity power consumption comprises:
determining a per-processor unit power consumption based on the integrated circuit component power consumption and a number of physical processor units in the plurality of physical processor units; and
determining the software entity power consumption by scaling the per-processor unit power consumption by a sum of:
a processor unit power consumption scaling factor or a product of a plurality of processor unit power consumption scaling factors indicating a portion of integrated circuit component power consumed by the plurality of physical processor units; and
a non-processor unit circuitry power consumption scaling factor or a product of a plurality of non-processor unit circuitry power consumption scaling factors indicating a portion of integrated circuit component power consumed by the non-processor unit circuitry; and
causing, by the first computing device, an action to be taken at the second computing device to reduce power consumption of the software entity.
2 . The method of claim 1 ,
wherein the telemetry information further comprises one or more of: physical processor unit active information, information indicating an operating frequency for individual of the plurality of physical processor units, information indicating a reference operating frequency of the integrated circuit component, and utilization of the virtual processor unit by the software entity, and
wherein the product of the plurality of processor unit power consumption scaling factors comprises a product of one or more of: a physical processor unit active scaling factor indicating a portion of time that a physical processor unit on which the software entity is executing is in an active state that is based on the physical processor unit active information, a physical processor unit operating frequency scaling based on the reference operating frequency of the integrated circuit component and the operating frequency of individual of the plurality of physical processor units, a virtual processor unit-to-physical processor unit scaling factor indicating a number of the plurality of physical processor units allocated to the virtual processor unit, and a virtual processor unit utilization scaling factor indicating a utilization of a virtual processor unit on which the software entity is executing that is based on the utilization of the virtual processor unit by the software entity.
3 . The method of claim 1 ,
wherein the non-processor unit circuitry comprises a memory controller and an interconnect controller,
wherein the telemetry information further comprises one or more of: information indicating one or more operating frequencies of the non-processor unit circuitry, information indicating a reference operating frequency of the integrated circuit component, information indicating an operating frequency of the memory controller, information indicating a utilization of a memory external to the integrated circuit component by the software entity, information indicating an operating frequency of the interconnect controller, information indicating utilization of the interconnect controller by the software entity, and utilization of the virtual processor unit by the software entity, and
wherein the product of the plurality of non-processor unit circuitry power consumption scaling factors comprises a product of one or more of: a non-processor unit circuitry operating frequency scaling factor based on the reference operating frequency of the integrated circuit component and the one or more operating frequencies of the non-processor unit circuitry, a memory controller operating frequency scaling factor based on the reference operating frequency of the integrated circuit component and the operating frequency of the memory controller, a memory utilization scaling factor based on the utilization of the memory external to the integrated circuit component by the software entity, an interconnect controller operating frequency scaling factor based on the operating frequency of the interconnect controller, an interconnect controller utilization scaling factor based on the utilization of the interconnect controller by the software entity.
4 . The method of claim 1 , wherein the telemetry information further comprises physical processor unit active information and information indicating a utilization of the virtual processor unit by the software entity,
wherein the software entity power consumption is determined according to:
P swe =P ppu ( SF pu SF pu_active SF vpu_ppu SF util_vpu +SF npu )
wherein P swe is the software entity power consumption,
wherein P ppu is a per-processor unit power consumption based on the integrated circuit component power consumption and a number of physical processor units in the plurality of physical processor units,
wherein SF pu is a processor unit power consumption scaling factor indicating a portion of integrated circuit component power consumed by the plurality of physical processor units,
wherein SF pu_active is a physical processor unit active scaling factor indicating a portion of time that a physical processor unit on which the software entity is executing is in an active state and SF pu_active is based on the physical processor unit active information,
wherein SF vpu_ppu is a virtual processor unit-to-physical processor unit scaling factor indicating a number of the plurality of physical processor units allocated to the virtual processor unit,
wherein SF util_vpu is a virtual processor unit utilization scaling factor indicating a utilization of the virtual processor unit by the software entity and SF util_vpu is based on the utilization of the virtual processor unit by the software entity, and
wherein SF npu is a non-processor unit circuitry power consumption scaling factor indicating a portion of integrated circuit component power consumed by the non-processor unit circuitry.
5 . The method of claim 1 ,
wherein the telemetry information further comprises physical processor unit active information, information indicating a reference operating frequency of the integrated circuit component, information indicating an operating frequency of individual of the plurality of physical processor units allocated to the virtual processor unit, and information indicating a utilization of the virtual processor unit by the software entity,
wherein the software entity power consumption is determined according to:
P swe =P ppu ( SF pu SF pu_active SF vpu_ppu SF util_vpu SF pu_freq +SF npu )
wherein P swe is the software entity power consumption,
wherein P ppu is a per-processor unit power consumption based on the integrated circuit component power consumption and a number of physical processor units in the plurality of physical processor units,
wherein SF pu is a processor unit power consumption scaling factor indicating a portion of integrated circuit component power consumed by the plurality of physical processor units,
wherein SF pu_active is a processor unit active scaling factor indicating a portion of time that a physical processor unit on which the software entity is executing is in an active state or an idle that is a shallower idle than a threshold idle state, and SF pu_active is based on the physical processor unit active information,
wherein SF vpu_ppu is a virtual processor unit-to-physical processor unit scaling factor indicating a number of the plurality of physical processor units allocated to the virtual processor unit,
wherein SF util_vpu is a virtual processor unit utilization scaling factor indicating a utilization of a virtual processor unit on which the software entity is executing and SF util_vpu is based on the utilization of the virtual processor unit by the software entity,
wherein SF pu_freq is a processor unit operating frequency scaling based on the reference operating frequency of the integrated circuit component and the operating frequency of the individual of the plurality of physical processor units allocated to the virtual processor unit, and
wherein SF npu is a non-processor unit circuitry power consumption scaling factor indicating a portion of integrated circuit component power consumed by non-processor unit circuitry.
6 . The method of claim 1 , wherein the telemetry information further comprises physical processor unit active information, information indicating a reference operating frequency of the integrated circuit component, information indicating one or more operating frequencies of the non-processor unit circuitry, and information indicating a utilization of the virtual processor unit by the software entity,
wherein the software entity power consumption is determined according to:
P swe =P ppu ( SF pu SF pu_active SF vpu_ppu SF util_vpu +SF npu SF npu_freq )
wherein P swe is the software entity power consumption,
wherein P ppu is a per-processor unit power consumption based on the integrated circuit component power consumption and a number of physical processor units in the plurality of physical processor units,
wherein SF pu is a processor unit power consumption scaling factor indicating a portion of integrated circuit component power consumed by the plurality of physical processor units,
wherein SF pu_active is a physical processor unit active scaling factor indicating a portion of time that a physical processor unit on which the software entity is executing is in an active state and SF pu_active is based on the physical processor unit active information,
wherein SF vpu_ppu is a virtual processor unit-to-physical processor unit scaling factor indicating a number of the plurality of physical processor units allocated to the virtual processor unit,
wherein SF util_vpu is a virtual processor unit utilization scaling factor indicating a utilization of a virtual processor unit on which the software entity is executing and SF util_ypu is based on the information indicating utilization of the virtual processor unit by the software entity,
wherein SF npu is a non-processor unit circuitry power consumption scaling factor indicating a portion of integrated circuit component power consumed by non-processor unit circuitry, and
wherein SF npu_freq is a non-processor unit circuitry operating frequency scaling factor based on the information indicating a reference operating frequency of the integrated circuit component and the information indicating the one or more operating frequencies of the non-processor unit circuitry.
7 . The method of claim 1 ,
wherein the non-processor unit circuitry comprises a memory controller and an interconnect controller,
wherein the telemetry information further comprises physical processor unit active information, information indicating one or more operating frequencies of the non-processor unit circuitry, information indicating an operating frequency for individual of the plurality of physical processor units, information indicating a reference operating frequency of the integrated circuit component, information indicating an operating frequency of the memory controller, information indicating a utilization of a memory external to the integrated circuit component by the software entity, information indicating utilization of the interconnect controller by the software entity, information indicating an operating frequency of the interconnect controller, and utilization of the virtual processor unit by the software entity,
wherein the software entity power consumption is determined according to:
P swe =P ppu ( SF pu SF pu_active SF pu_freq SF vpu_ppu SF util_vpu +SF npu SF npu_freq SF mem_freq SF mem_util SF IC_freq SF IC_util )
wherein P swe is the software entity power consumption,
wherein P ppu is a per-processor unit power consumption based on the integrated circuit component power consumption and a number of physical processor units in the plurality of physical processor units,
wherein SF pu is a processor unit power consumption scaling factor indicating a portion of integrated circuit component power consumed by the plurality of physical processor units,
wherein SF pu_active is a physical processor unit active scaling factor indicating a portion of time that a physical processor unit on which the software entity is executing is in an active state and SF pu_active is based on the physical processor unit active information,
wherein SF vpu_ppu is a virtual processor unit-to-physical processor unit scaling factor indicating a number of the plurality of physical processor units allocated to the virtual processor unit,
wherein SF util_vpu is a virtual processor unit utilization scaling factor indicating a utilization of a virtual processor unit on which the software entity is executing and SF util_vpu is based on the utilization of the virtual processor unit by the software entity,
wherein SF pu_freq is a physical processor unit operating frequency scaling based on the reference operating frequency of the integrated circuit component and the operating frequency of the individual of the plurality of physical processor units,
wherein SF npu is a non-processor unit circuitry power consumption scaling factor indicating a portion of integrated circuit component power consumed by non-processor unit circuitry,
wherein SF npu_freq is a non-processor unit circuitry operating frequency scaling factor based on the reference operating frequency of the integrated circuit component and the one or more operating frequencies of the non-processor unit circuitry,
wherein SF mem_freq is a memory controller operating frequency scaling factor based on the reference operating frequency of the integrated circuit component and the operating frequency of the memory controller,
wherein SF mem_util is a memory utilization scaling factor based on the utilization of the memory external to the integrated circuit component by the software entity,
wherein SF IC_freq is an interconnect controller operating frequency scaling factor based on the operating frequency of the interconnect controller, and
wherein SF IC_util is an interconnect controller utilization scaling factor based on the utilization of the interconnect controller by the software entity.
8 . The method of claim 1 , the method further comprising:
determining that the integrated circuit component power consumption has exceeded a power limit of the integrated circuit component based on the integrated circuit component power consumption; and
selecting the software entity from among a plurality of software entities executing on the integrated circuit component for reduced power consumption based on the software entity power consumption, wherein causing an action to be taken at the second computing device to reduce power consumption of the software entity comprises causing an operating frequency of at least one of the plurality of physical processor units allocated to the virtual processor unit to be reduced.
9 . The method of claim 1 , wherein the software entity is a first software entity and the software entity power consumption of the first software entity is a first software entity power consumption, the first software entity and one or more second software entities are associated with a user entity, individual of the one or more second software entities having an associated second software entity power consumption, the method further comprising:
summing the first software entity power consumption and the second software entity power consumptions to generate a total software entity power consumption; and
determining that the total software entity power consumption exceeds a power budget, wherein causing an action to be taken at the second computing device to reduce power consumption of the first software entity is taken in response to determining that the total software entity power consumption exceeds the power budget.
10 . The method of claim 9 , wherein the action comprises terminating execution of the first software entity.
11 . The method of claim 1 , wherein the software entity is a virtual network function and the causing the action to be taken at the second computing device is performed by a network function virtualization orchestrator operating on the first computing device.
12 . The method of claim 1 , wherein the software entity is a network slice.
13 . One or more non-transitory computer-readable storage media having instructions stored thereon that, when executed by a first computing system cause one or more first physical processor units of a first computing device to:
receive telemetry information associated with a computing platform of a second computing device on which a software entity is executing, wherein the computing platform comprises an integrated circuit component comprising a plurality of second physical processor units and non-processor unit circuitry, the software entity executing on a virtual processor unit to which one or more of the plurality of second physical processor units are allocated, and the telemetry information comprises information indicating an integrated circuit component power consumption;
determine, at the first computing device a software entity power consumption for the software entity based on the telemetry information, wherein to determine the software entity power consumption comprises:
to determine a per-processor unit power consumption based on the integrated circuit component power consumption and a number of second physical processor units in the plurality of second physical processor units; and
to determine the software entity power consumption by scaling the per-processor unit power consumption by a sum of:
a processor unit power consumption scaling factor or a product of a plurality of processor unit power consumption scaling factors indicating a portion of integrated circuit component power consumed by the plurality of second physical processor units; and
a non-processor unit circuitry power consumption scaling factor or a product of a plurality of non-processor unit circuitry power consumption scaling factors indicating a portion of integrated circuit component power consumed by the non-processor unit circuitry; and
cause an action to be taken at the second computing device to reduce power consumption of the software entity.
14 . The one or more non-transitory computer-readable storage media of claim 13 ,
wherein the telemetry information further comprises one or more of: physical processor unit active information, information indicating an operating frequency for individual of the one or more second physical processor units, information indicating a reference operating frequency of the integrated circuit component, and utilization of the virtual processor unit by the software entity, and
wherein the product of the plurality of processor unit power consumption scaling factors comprises a product of one or more of: a physical processor unit active scaling factor indicating a portion of time that a physical processor unit on which the software entity is executing is in an active state that is based on the physical processor unit active information, a physical processor unit operating frequency scaling based on the reference operating frequency of the integrated circuit component and the operating frequency of the individual of the one or more second physical processor units, a virtual processor unit-to-physical processor unit scaling factor indicating a number of the one or more second physical processor units allocated to the virtual processor unit, and a virtual processor unit utilization scaling factor indicating a utilization of a virtual processor unit on which the software entity is executing that is based on the utilization of the virtual processor unit by the software entity.
15 . The one or more non-transitory computer-readable storage media of claim 13 ,
wherein the non-processor unit circuitry comprises a memory controller and an interconnect controller,
wherein the telemetry information further comprises one or more of: information indicating one or more operating frequencies of the non-processor unit circuitry, information indicating a reference operating frequency of the integrated circuit component, information indicating an operating frequency of the memory controller, information indicating a utilization of a memory external to the integrated circuit component by the software entity, information indicating an operating frequency of the interconnect controller, information indicating utilization of the interconnect controller by the software entity, and utilization of the virtual processor unit by the software entity, and
wherein the product of the plurality of non-processor unit circuitry power consumption scaling factors comprises a product of one or more of: a non-processor unit circuitry operating frequency scaling factor based on the reference operating frequency of the integrated circuit component and the one or more operating frequencies of the non-processor unit circuitry, a memory controller operating frequency scaling factor based on the reference operating frequency of the integrated circuit component and the operating frequency of the memory controller, a memory utilization scaling factor based on the utilization of the memory external to the integrated circuit component by the software entity, an interconnect controller operating frequency scaling factor based on the operating frequency of the interconnect controller, an interconnect controller utilization scaling factor based on the utilization of the interconnect controller by the software entity.
16 . The one or more non-transitory computer-readable storage media of claim 13 ,
wherein the telemetry information further comprises second physical processor unit active information and information indicating a utilization of the virtual processor unit by the software entity,
wherein the software entity power consumption is determined according to:
P swe =P ppu ( SF pu SF pu_active SF vpu_ppu SF util_vpu +SF npu )
wherein P swe is the software entity power consumption,
wherein P ppu is a per-processor unit power consumption based on the integrated circuit component power consumption and a number of second physical processor units in the plurality of second physical processor units,
wherein SF pu is a processor unit power consumption scaling factor indicating a portion of integrated circuit component power consumed by the plurality of second physical processor units,
wherein SF pu_active is a second physical processor unit active scaling factor indicating a portion of time that a second physical processor unit on which the software entity is executing is in an active state and SF pu_active is based on the second physical processor unit active information,
wherein SF vpu_ppu is a virtual processor unit-to-second physical processor unit scaling factor indicating a number of the plurality of second physical processor units allocated to the virtual processor unit,
wherein SF util_vpu is a virtual processor unit utilization scaling factor indicating a utilization of the virtual processor unit by the software entity and SF util_vpu is based on the utilization of the virtual processor unit by the software entity, and
wherein SF npu is a non-processor unit circuitry power consumption scaling factor indicating a portion of integrated circuit component power consumed by the non-processor unit circuitry.
17 . The one or more non-transitory computer-readable storage media of claim 13 ,
wherein the telemetry information further comprises second physical processor unit active information, information indicating a reference operating frequency of the integrated circuit component, information indicating one or more operating frequencies of the non-processor unit circuitry, and information indicating a utilization of the virtual processor unit by the software entity,
wherein the software entity power consumption is determined according to:
P swe =P ppu ( SF pu SF pu_active SF vpu_ppu SF util_vpu +SF npu SF npu_freq )
wherein P swe is the software entity power consumption,
wherein P ppu is a per-processor unit power consumption based on the integrated circuit component power consumption and a number of second physical processor units in the plurality of second physical processor units,
wherein SF pu is a processor unit power consumption scaling factor indicating a portion of integrated circuit component power consumed by the plurality of second physical processor units,
wherein SF pu_active is a second physical processor unit active scaling factor indicating a portion of time that a second physical processor unit on which the software entity is executing is in an active state and SF pu_active is based on the second physical processor unit active information,
wherein SF vpu_ppu is a virtual processor unit-to-second physical processor unit scaling factor indicating a number of the plurality of second physical processor units allocated to the virtual processor unit,
wherein SF util_vpu is a virtual processor unit utilization scaling factor indicating a utilization of a virtual processor unit on which the software entity is executing and SF util_vpu is based on the information indicating the utilization of the virtual processor unit by the software entity,
wherein SF npu is a non-processor unit circuitry power consumption scaling factor indicating a portion of integrated circuit component power consumed by non-processor unit circuitry, and
wherein SF npu_freq is a non-processor unit circuitry operating frequency scaling factor based on the information indicating a reference operating frequency of the integrated circuit component and the information indicating the one or more operating frequencies of the non-processor unit circuitry.
18 . The one or more non-transitory computer-readable storage media of claim 13 , wherein the telemetry information comprises information indicating an integrated circuit component power consumption, the instructions stored on the one or more non-transitory computer-readable storage media further cause the one or more first physical processor units to:
determine that the integrated circuit component power consumption exceeds a power limit of the integrated circuit component based on the integrated circuit component power consumption;
select the software entity from among a plurality of software entities executing on the integrated circuit component for reduced power consumption based on the software entity power consumption, wherein to cause an action to be taken at the second computing device to reduce power consumption of the software entity comprises to cause an operating frequency of at least one of the plurality of second physical processor units allocated to the virtual processor unit to be reduced.
19 . The one or more non-transitory computer-readable storage media of claim 13 , wherein the software entity is a first software entity and the software entity power consumption of the first software entity is a first software entity power consumption, the first software entity and one or more second software entities are associated with a user entity, individual of the one or more second software entities having an associated second software entity power consumption, the instructions stored on the one or more non-transitory computer-readable storage media further cause the one or more first physical processor units to:
sum the first software entity power consumption and the second software entity power consumptions to generate a total software entity power consumption; and
determine that the total software entity power consumption exceeds a power budget, wherein to cause an action to be taken at the second computing device to reduce power consumption of the first software entity is performed in response to determining that the total software entity power consumption exceeds the power budget.
20 . A computing system comprising:
one or more first physical processor units, wherein the computing system is a first computing system; and
one or more computer-readable storage media storing instructions thereon that, when executed, cause the one or more first physical processor units to:
receive telemetry information associated with a computing platform of a second computing system on which a software entity is executing, wherein the computing platform comprises an integrated circuit component comprising a plurality of second physical processor units and non-processor unit circuitry, the software entity executing on a virtual processor unit to which one or more of the plurality of second physical processor units are allocated, and the telemetry information comprises information indicating an integrated circuit component power consumption;
determine a software entity power consumption for the software entity based on the telemetry information, wherein to determine the software entity power consumption comprises:
to determine a per-processor unit power consumption based on the integrated circuit component power consumption and a number of second physical processor units in the plurality of second physical processor units; and
to determine the software entity power consumption by scaling the per-processor unit power consumption by a sum of:
a processor unit power consumption scaling factor or a product of a plurality of processor unit power consumption scaling factors indicating a portion of integrated circuit component power consumed by the plurality of second physical processor units; and
a non-processor unit circuitry power consumption scaling factor or a product of a plurality of non-processor unit circuitry power consumption scaling factors indicating a portion of integrated circuit component power consumed by the non-processor unit circuitry; and
cause an action to be taken at the second computing system to reduce power consumption of the software entity.
21 . The computing system of claim 20 ,
wherein the telemetry information further comprises one or more of: physical processor unit active information, information indicating an operating frequency for individual of the plurality of second physical processor units, information indicating a reference operating frequency of the integrated circuit component, and utilization of the virtual processor unit by the software entity, and
wherein the product of the plurality of processor unit power consumption scaling factors comprises a product of one or more of: a physical processor unit active scaling factor indicating a portion of time that a second physical processor unit on which the software entity is executing is in an active state that is based on the physical processor unit active information, a physical processor unit operating frequency scaling based on the reference operating frequency of the integrated circuit component and the operating frequency of the individual of the plurality of second physical processor units, a virtual processor unit-to-physical processor unit scaling factor indicating a number of the plurality of second physical processor units allocated to the virtual processor unit, and a virtual processor unit utilization scaling factor indicating a utilization of a virtual processor unit on which the software entity is executing that is based on the utilization of the virtual processor unit by the software entity.
22 . The computing system of claim 20 ,
wherein the non-processor unit circuitry comprises a memory controller and an interconnect controller,
wherein the telemetry information further comprises one or more of: information indicating one or more operating frequencies of the non-processor unit circuitry, information indicating a reference operating frequency of the integrated circuit component, information indicating an operating frequency of the memory controller, information indicating a utilization of a memory external to the integrated circuit component by the software entity, information indicating an operating frequency of the interconnect controller, information indicating utilization of the interconnect controller by the software entity, and utilization of the virtual processor unit by the software entity, and
wherein the product of the plurality of non-processor unit circuitry power consumption scaling factors comprises a product of one or more of: a non-processor unit circuitry operating frequency scaling factor based on the reference operating frequency of the integrated circuit component and the one or more operating frequencies of the non-processor unit circuitry, a memory controller operating frequency scaling factor based on the reference operating frequency of the integrated circuit component and the operating frequency of the memory controller, a memory utilization scaling factor based on the utilization of the memory external to the integrated circuit component by the software entity, an interconnect controller operating frequency scaling factor based on the operating frequency of the interconnect controller, an interconnect controller utilization scaling factor based on the utilization of the interconnect controller by the software entity.
23 . The computing system of claim 20 , wherein the software entity is a first software entity and the software entity power consumption of the first software entity is a first software entity power consumption, the first software entity and one or more second software entities are associated with a user entity, individual of the one or more second software entities having an associated second software entity power consumption, the instructions stored on the one or more computer-readable storage media further cause the one or more first physical processor units to:
sum the first software entity power consumption and the second software entity power consumptions to generate a total software entity power consumption; and
determine that the total software entity power consumption exceeds a power budget, wherein to cause an action to be taken at the second computing system to reduce power consumption of the first software entity is performed in response to determining that the total software entity power consumption exceeds the power budget.