Granular GPU DVFS with execution unit partial powerdown
Described herein, in one embodiment, are techniques to facilitate the partial powerdown of sub-components of an execution unit or other graphics processing resource based on the workload to be executed. In another embodiment, granular dynamic voltage and frequency scaling is enabled in which the voltage and frequency of groups of processing resources within a graphics processor can be separately scaled.
1 . A graphics processor comprising:
a processing resource including a plurality of components, the plurality of components including fixed function resource components and execution resource components, each execution resource component including a vector engine, a matrix engine, and multiple voltage subdomains; and
circuitry coupled with the plurality of components, the circuitry configured to:
receive a workload for execution;
determine, to execute the workload, a first frequency and a first voltage for the matrix engine of execution resource components of the plurality of components;
determine, to execute the workload, a second frequency and a second voltage for the vector engine of the execution resource components of the plurality of components, wherein the first frequency is less than the second frequency and the first voltage is less than the second voltage; and
configure a first voltage subdomain of an execution resource component with the first frequency and the first voltage and a second voltage subdomain of the execution resource component with the second frequency and the second voltage, the first voltage subdomain including the matrix engine and the second voltage subdomain including the vector engine.
2 . The graphics processor of claim 1 , the circuitry configured to reduce a voltage associated with the first voltage subdomain during execution of the workload.
3 . The graphics processor of claim 2 , the circuitry to reduce the voltage and frequency of the first voltage subdomain to zero in response to a determination that the workload does not include instructions associated with the matrix engine.
4 . The graphics processor of claim 2 , the circuitry to adjust a frequency of the second voltage subdomain during execution of the workload independently of the frequency of the first voltage subdomain.
5 . The graphics processor of claim 4 , the circuitry to increase the voltage of the second voltage subdomain during execution of the workload independently of the voltage of the first voltage subdomain.
6 . The graphics processor of claim 5 , wherein the first voltage subdomain is configured to a low power state to facilitate a resumable standby state.
7 . The graphics processor of claim 5 , wherein the processing resource additionally includes a ray tracing core associated with a third voltage subdomain.
8 . The graphics processor of claim 5 , wherein the processing resource additionally includes a video codec associated with a fourth voltage subdomain.
9 . The graphics processor of claim 1 , the circuitry to determine components of the processing resource to be used to execute the workload based on a command buffer associated with the workload and configure a voltage and frequency of the components based on operations to be performed by the workload.
10 . The graphics processor of claim 1 , the circuitry to determine components of the processing resource to be used to execute the workload based on a context type associated with the workload and configure a voltage and frequency of the components based on operations to be performed by the workload.
11 . A method comprising:
receiving a workload for execution at a processing resource of a graphics processor, the processing resource including a plurality of components, the plurality of components including fixed function resource components and execution resource components, each execution resource component including a vector engine, a matrix engine, and multiple voltage subdomains;
determining a first frequency and a first voltage for a matrix engine of execution resource components to execute the workload;
determining a second frequency and a second voltage for a vector engine of the execution resource components to execute the workload, wherein the first frequency is less than the second frequency and the first voltage is less than the second voltage;
configuring a first voltage subdomain of an execution resource component with the first frequency and the first voltage, the first voltage subdomain including the matrix engine; and
configuring a second voltage subdomain of the execution resource component with the second frequency and the second voltage, the second voltage subdomain including the vector engine.
12 . The method of claim 11 , comprising reducing a voltage associated with the first voltage subdomain during execution of the workload.
13 . The method of claim 12 , comprising reducing the voltage and frequency of the first voltage subdomain to zero in response to determining that the workload does not include instructions associated with the matrix engine.
14 . The method of claim 12 , comprising adjusting a frequency of the second voltage subdomain during execution of the workload independently of the frequency of the first voltage subdomain.
15 . The method of claim 14 , comprising increasing the voltage of the second voltage subdomain during execution of the workload independently of the voltage of the first voltage subdomain and configuring the first voltage subdomain to a low power state to facilitate a resumable standby state.
16 . A graphics processing system comprising:
a memory device;
a processing resource coupled with the memory device, the processing resource including a plurality of components, the plurality of components including fixed function resource components and execution resource components, each execution resource component including a vector engine, a matrix engine, and multiple voltage subdomains; and
circuitry coupled with the plurality of components, the circuitry configured to:
receive a workload for execution;
determine, to execute the workload, a first frequency and a first voltage for the matrix engine of execution resource components of the plurality of components;
determine, to execute the workload, a second frequency and a second voltage for the vector engine of the execution resource components of the plurality of components, wherein the first frequency is less than the second frequency and the first voltage is less than the second voltage; and
configure a first voltage subdomain of an execution resource component with the first frequency and the first voltage and a second voltage subdomain of the execution resource component with the second frequency and the second voltage, the first voltage subdomain including the matrix engine and the second voltage subdomain including the vector engine.
17 . The graphics processing system of claim 16 , the circuitry configured to reduce a voltage associated with the first voltage subdomain during execution of the workload.
18 . The graphics processing system of claim 17 , the circuitry to reduce the voltage and frequency of the first voltage subdomain to zero in response to a determination that the workload does not include instructions associated with the matrix engine.
19 . The graphics processing system of claim 16 , the circuitry to determine components of the processing resource to be used to execute the workload based on a command buffer associated with the workload and configure a voltage and frequency of the components based on operations to be performed by the workload.
20 . The graphics processing system of claim 16 , the circuitry to determine components of the processing resource to be used to execute the workload based on a context type associated with the workload and configure a voltage and frequency of the components based on operations to be performed by the workload.