Scheduling tasks using work fullness counter
A method of activating scheduling instructions within a parallel processing unit includes checking if an ALU targeted by a decoded instruction is full by checking a value of an ALU work fullness counter stored in the instruction controller and associated with the targeted ALU. If the targeted ALU is not full, the decoded instruction is sent to the targeted ALU for execution and the ALU work fullness counter associated with the targeted ALU is updated. If, however, the targeted ALU is full, a scheduler is triggered to de-activate the scheduled task by changing the scheduled task from the active state to a non-active state. When an ALU changes from being full to not being full, the scheduler is triggered to re-activate an oldest scheduled task waiting for the ALU by removing the oldest scheduled task from the non-active state.
1 . A method of scheduling instructions within a parallel processing unit comprising:
checking if a flag in a decoded instruction in a scheduled task in an active state is set;
in response to determining that the flag in the decoded instruction is not set, checking if an Arithmetic Logic Unit (ALU) pipeline targeted by the decoded instruction is full, and in response to determining that the targeted ALU pipeline is full, triggering a scheduler to de-activate the scheduled task; and
in response to determining that the flag in the decoded instruction is set, omitting the checking if the ALU pipeline targeted by the decoded instruction is full and sending the decoded instruction to the targeted ALU pipeline for execution.
2 . The method according to claim 1 , wherein in response to detecting that an ALU pipeline has changed from being full to not being full, triggering the scheduler to re-activate an oldest scheduled task, and further wherein the task that is re-activated is the oldest scheduled task waiting for the ALU pipeline.
3 . The method according to claim 1 , further comprising:
detecting that an ALU pipeline has changed from being full to not being full; and
in response to said determination, sending the decoded instruction to the targeted ALU pipeline for execution and updating an ALU work fullness counter associated with the targeted ALU pipeline.
4 . The method according to claim 1 ,
wherein the sending the decoded instruction to the targeted ALU pipeline for execution is without updating an ALU work fullness counter associated with the targeted ALU pipeline.
5 . The method according to claim 1 , wherein checking if an ALU pipeline targeted by a decoded instruction from a scheduled task in an active state is full is by checking a value of an ALU work fullness counter associated with the targeted ALU pipeline, and comprises:
checking if an ALU pipeline targeted by a decoded instruction from a scheduled task in an active state is full by checking a value of both an ALU work fullness counter and a de-activated scheduled tasks counter associated with the targeted ALU pipeline;
and wherein the method further comprises:
in response to determining that the targeted ALU pipeline is full, updating the de-activated scheduled tasks counter associated with the targeted ALU pipeline; and
after triggering the scheduler to re-activate an oldest scheduled task waiting for the ALU pipeline by removing the oldest scheduled task from the waiting state, updating the de-activated scheduled tasks counter associated with the ALU pipeline.
6 . The method according to claim 1 , further comprising:
in response to detecting that an instruction has been removed from a queue in a particular ALU pipeline, updating the value of an ALU work fullness counter associated with the particular ALU pipeline.
7 . An apparatus comprising:
hardware logic arranged to check if an Arithmetic Logic Unit (ALU) pipeline targeted by a decoded instruction in a scheduled task in an active state is full;
hardware logic arranged, in response to determining that the targeted ALU pipeline is full, to trigger a scheduler to de-activate a scheduled task; and
hardware logic arranged to check if a flag in the decoded instruction is set prior to checking if the ALU pipeline targeted by the decoded instruction is full; and in response to determining that the flag in the decoded instruction is set, to omit the checking if the ALU pipeline targeted by the decoded instruction is full and to send the decoded instruction to the targeted ALU pipeline for execution.
8 . The apparatus according to claim 7 , wherein in response to detecting that an ALU pipeline has changed from being full to not being full, triggering the scheduler to re-activate an oldest scheduled task, and further wherein the task that is re-activated is the oldest scheduled task waiting for the ALU pipeline.
9 . The apparatus according to claim 7 , further comprising:
hardware logic arranged to detect that an ALU pipeline has changed from being full to not being full; and
hardware logic arranged, in response to said determination, to send the decoded instruction to the targeted ALU pipeline for execution and update the ALU work fullness counter associated with the targeted ALU pipeline.
10 . The apparatus according to claim 7 ,
wherein the sending the decoded instruction to the targeted ALU pipeline for execution is without updating an ALU work fullness counter associated with the targeted ALU pipeline.
11 . The apparatus according to claim 7 , further comprising:
one or more de-activated scheduled tasks counters; and
hardware logic arranged to check if an ALU pipeline targeted by a decoded instruction from a scheduled task in an active state is full by checking if an ALU pipeline targeted by a decoded instruction from a scheduled task in an active state is full by checking a value of both an ALU work fullness counter and a de-activated scheduled tasks counter associated with the targeted ALU pipeline; and
hardware logic arranged in response to determining that the targeted ALU pipeline is full, to update the de-activated scheduled tasks counter associated with the targeted ALU pipeline; and after triggering the scheduler to re-activate an oldest scheduled task waiting for the ALU pipeline by removing the oldest scheduled task from the waiting state, to update the de-activated scheduled tasks counter associated with the ALU pipeline.
12 . The apparatus according to claim 7 , further comprising:
hardware logic arranged, in response to detecting that an instruction has been removed from a queue in a particular ALU pipeline, to update the value of an ALU work fullness counter associated with the particular ALU pipeline.
13 . A non-transitory computer readable storage medium having stored thereon a computer readable dataset description of an integrated circuit that, when processed in an integrated circuit manufacturing system, causes the integrated circuit manufacturing system to manufacture an apparatus comprising:
hardware logic arranged to check if an Arithmetic Logic Unit (ALU) pipeline targeted by a decoded instruction in a scheduled task in an active state is full;
hardware logic arranged, in response to determining that the targeted ALU pipeline is full, to trigger a scheduler to de-activate a scheduled task; and
hardware logic arranged to check if a flag in the decoded instruction is set prior to checking if the ALU pipeline targeted by the decoded instruction is full; and in response to determining that the flag in the decoded instruction is set, to omit the checking if the ALU pipeline targeted by the decoded instruction is full and to send the decoded instruction to the targeted ALU pipeline for execution.
14 . The non-transitory computer readable storage medium according to claim 13 , wherein in response to detecting that an ALU pipeline has changed from being full to not being full, triggering the scheduler to re-activate an oldest scheduled task, and further wherein the task that is re-activated is the oldest scheduled task waiting for the ALU pipeline.
15 . The non-transitory computer readable storage medium according to claim 13 , further comprising:
hardware logic arranged to detect that an ALU pipeline has changed from being full to not being full; and
hardware logic arranged, in response to said determination, to send the decoded instruction to the targeted ALU pipeline for execution and update the ALU work fullness counter associated with the targeted ALU pipeline.