Inline data inspection for workload simplification
A method, computer readable medium, and system are disclosed for inline data inspection. The method includes the steps of receiving, by a load/store unit, a load instruction and obtaining, by an inspection circuit that is coupled to the load/store unit, data specified by the load instruction. Additional steps include determining that the data equals zero and transmitting the data and a predicate signal to the load/store unit, wherein the predicate signal indicates that the data equals zero. Alternative additional steps include computing a predicate value based on a comparison between the data and a threshold value and transmitting the data and the predicate value to the load/store unit, wherein the predicate value is asserted when the data is less than the threshold value and is negated when the data is not less than the threshold value.
1. A parallel processing unit, comprising:
a load/store unit configured to execute a load instruction; and
an inspection circuit that is coupled to the load/store unit and configured to:
obtain data specified by the load instruction;
compute a predicate value based on a comparison between the data and a threshold value; and
transmit the data and the predicate value to the load/store unit, wherein the predicate value is asserted when the data is less than the threshold value and is negated when the data is not less than the threshold value.
2. The parallel processing unit of claim 1 , wherein the threshold value is specified by the load instruction.
3. The parallel processing unit of claim 1 , wherein the threshold value is programmable and stored in a register.
4. The parallel processing unit of claim 1 , wherein the data is encoded in a floating point format and the inspection circuit is configured to compare one or more exponents of the data to determine whether the data is less than the threshold value.
5. The parallel processing unit of claim 1 , wherein the inspection circuit is further configured to compute statistics associated with a distribution of the data relative to the threshold value and store the statistics.
6. The parallel processing unit of claim 1 , wherein the threshold value is computed, by the inspection circuit, during execution of a program that includes the load instruction.
7. The parallel processing unit of claim 6 , wherein the threshold value is computed, by the inspection circuit, to cause a predetermined portion of the data to be less than the threshold value.
8. The parallel processing unit of claim 6 , wherein the threshold value is computed, by the inspection circuit, to cause a predetermined portion of the data to be centered around the threshold value.
9. A computer-implemented method, comprising:
receiving, by a load/store unit, a load instruction;
obtaining, by an inspection circuit that is coupled to the load/store unit, data specified by the load instruction;
computing a predicate value based on a comparison between the data and a threshold value; and
transmitting the data and the predicate value to the load/store unit, wherein the predicate value is asserted when the data is less than the threshold value and is negated when the data is not less than the threshold value.
10. The computer-implemented method of claim 9 , wherein the threshold value is computed during execution of a program that includes the load instruction.
11. The computer-implemented method of claim 9 , wherein a branch instruction follows the load instruction in a sequence of instructions for execution by a parallel processing unit and the predicate value controls execution of the branch instruction.
12. A non-transitory machine-readable medium having stored thereon a set of instructions, which when executed by one or more processors, cause the one or more processors to at least:
receive, by a load/store unit, a load instruction;
obtain, by an inspection circuit that is coupled to the load/store unit, data specified by the load instruction;
compute a predicate value based on a comparison between the data and a threshold value; and
transmit the data and the predicate value to the load/store unit, wherein the predicate value is asserted when the data is less than the threshold value and is negated when the data is not less than the threshold value.
13. The non-transitory machine-readable medium of claim 12 , wherein the threshold value is computed during execution of a program that includes the load instruction.
14. The non-transitory machine-readable medium of claim 12 , wherein a branch instruction follows the load instruction in a sequence of instructions for execution by a parallel processing unit and the predicate value controls execution of the branch instruction.