Information processing device and information processing method
There is provided an information processing device to reduce a processing load associated with inner product operations while also guaranteeing the quantization granularity of weight coefficients, the information processing device including: a multiply-accumulate operation circuit configured to execute a multiply-accumulate operation on the basis of multiple input values and multiple weight coefficients that are quantized by an exponential representation and that correspond to each of the input values. Exponents of the quantized weight coefficients are expressed by fractions taking a predetermined divisor as a denominator, and the multiply-accumulate operation circuit performs the multiply-accumulate operation using different addition multipliers on the basis of a remainder determined from the divisor.
1. An information processing device comprising:
a multiply-accumulate operation circuit configured to execute a multiply-accumulate operation on a basis of multiple input values and multiple weight coefficients that are quantized by an exponential representation and that correspond to each of the input values, wherein
exponents of the quantized weight coefficients are expressed by fractions taking a predetermined divisor as a denominator, and
the multiply-accumulate operation circuit performs the multiply-accumulate operation using different addition multipliers on a basis of a remainder determined from the divisor.
2. The information processing device according to claim 1 , wherein
the multiply-accumulate operation circuit is provided with multiple different accumulators configured to hold a computational result for each remainder determined from the divisor.
3. The information processing device according to claim 2 , wherein
the remainder is computed by a modulo operation taking a numerator related to the exponents of the quantized weight coefficients as a dividend, and
the multiply-accumulate operation circuit additionally is provided with a selector configured to connect the accumulator corresponding to the remainder to the circuit.
4. The information processing device according to claim 3 , wherein
the multiply-accumulate operation circuit additionally is provided with a shift operation unit that performs a shift operation related to the input values on a basis of a value obtained by integerizing a quotient from dividing the numerator by the divisor.
5. The information processing device according to claim 1 , wherein
the input values are quantized by an exponential representation,
the quantized input values are expressed by fractions taking a predetermined divisor as a denominator, and
the remainder is remainder from treating a value obtained by summing a numerator related to the exponents of the quantized weight coefficients and a numerator related to the exponents of the quantized input values as a dividend.
6. The information processing device according to claim 5 , wherein
the multiply-accumulate operation circuit is provided with multiple adder-subtractors for each accumulator corresponding to the remainder.
7. The information processing device according to claim 6 , wherein
the multiply-accumulate operation circuit additionally is provided with a selector configured to input, on a basis of the remainder, a signal instructing the adder-subtractor corresponding to the remainder to execute computation.
8. The information processing device according to claim 5 , wherein
the divisor includes a first divisor determined with respect to the input values and a second divisor determined with respect to the weight coefficients, and
the first divisor and the second divisor have mutually different values.
9. The information processing device according to claim 1 , wherein
the multiply-accumulate operation circuit additionally is provided with multiple memory circuits configured to hold each of the addition multipliers corresponding to the remainder.
10. The information processing apparatus according to claim 9 , wherein
the multiply-accumulate operation circuit additionally is provided with a selector configured to connect the memory circuit corresponding to the remainder, on a basis of the remainder.
11. The information processing device according to claim 1 , wherein
the divisor is a natural number.
12. The information processing device according to claim 1 , wherein
the divisor is expressed by exponentiation.
13. An information processing method, executed by a processor, comprising:
executing a multiply-accumulate operation on a basis of multiple input values and multiple weight coefficients that are quantized by an exponential representation and that correspond to each of the input values, wherein
exponents of the quantized weight coefficients are expressed by fractions taking a predetermined divisor as a denominator, and
the executing of the multiply-accumulate operation performs the multiply-accumulate operation using different addition multipliers on a basis of a remainder determined from the divisor.