Granted Patent B2

US 12,333,671 · App. 17/801,999 · Granted Jun 17, 2025

Inventors: Xin Yu (Beijing, CN); Daofu Liu (Beijing, CN); Shiyi Zhou (Beijing, CN)

Assignee: Cambricon Technologies Corporation Limited

G06T3/40G06F17/153G06N3/0464G06N3/0495G06T7/70G06T9/002G06T2207/20084G06V10/454G06V10/70H03M7/24H04N19/124H04N19/94

Abstract

Claims (57)

1. A data quantization processing method comprising:

determining data to be quantized corresponding to each channel of an input image according to a quantity of channels of the input image in a deep convolution layer;

according to the data to be quantized corresponding to each channel, determining a statistical result of the data to be quantized corresponding to each channel;

for each channel, according to the statistical result of the data to be quantized corresponding to the channel, determining a quantization parameter corresponding to each channel; and

quantizing the data to be quantized corresponding to each channel by using the quantization parameter corresponding to each channel to obtain quantized data corresponding to each channel of the input image,

wherein the number of channels of the input image in the deep convolution layer is the same as the number of channels of an output image;

wherein the quantization parameter includes a point position parameter for each channel; and the method further comprises:

for each channel, determining the point position parameter corresponding to the channel according to the statistical result of the data to be quantized corresponding to the channel and a data bit width corresponding to the channel; and

for each channel, adjusting the data bit width corresponding to the channel according to a quantization error of the data bit width corresponding to the channel, so as to determine the quantization parameter corresponding to the channel by using an adjusted data bit width, wherein the quantization error is determined based on the quantized data corresponding to the channel and the data to be quantized corresponding to the channel.

2. The method of claim 1 , wherein the quantization parameter further includes a scaling factor for each channel; and wherein

for each channel, according to the statistical result of the data to be quantized corresponding to the channel, the determining of the quantization parameter corresponding to the channel includes:

for each channel, determining the scaling factor corresponding to the channel according to the statistical result of the data to be quantized corresponding to the channel, the point position parameter corresponding to the channel, and the data bit width corresponding to the channel.

3. The method of claim 1 , wherein the quantization parameter includes an offset for each channel; and the method further comprises:

for each channel, according to the statistical result of the data to be quantized corresponding to the channel, determining the quantization parameter corresponding to the channel includes:

for each channel, according to the statistical result of the data to be quantized corresponding to the channel, determining the offset corresponding to the channel.

4. The method of claim 1 , wherein according to the data to be quantized corresponding to each channel, the determining of the statistical result of the data to be quantized corresponding to each channel includes:

for each channel, determining an absolute maximum value of the data to be quantized corresponding to the channel; and

determining the absolute maximum value of the data to be quantized corresponding to the channel as the statistical result of the data to be quantized corresponding to the channel.

5. The method of claim 4 , wherein for each channel, the determining of the absolute maximum value of the data to be quantized corresponding to the channel includes:

for each channel, determining a maximum value and a minimum value of the data to be quantized corresponding to the channel; and

determining the absolute maximum value of the data to be quantized corresponding to the channel according to the maximum value and the minimum value of the data to be quantized corresponding to the channel.

6. The method of claim 1 , wherein for each channel, the data bit width corresponding to the channel is a preset value.

7. The method of claim 1 , wherein the adjusting of the data bit width corresponding to the channel according to the quantization error of the data bit width corresponding to the channel includes:

comparing the quantization error with a threshold, and adjusting the data bit width corresponding to the channel according to a comparison result.

8. The method of claim 7 , wherein the threshold includes a first threshold and a second threshold; and

wherein the comparing of the quantization error with the threshold and the adjusting of the data bit width corresponding to the channel according to the comparison result include:

increasing the data bit width corresponding to the channel when the quantization error is greater than or equal to the first threshold;

decreasing the data bit width corresponding to the channel when the quantization error is less than or equal to the second threshold; and

keeping the data bit width corresponding to the channel unchanged when the quantization error is between the first threshold and the second threshold.

9. An electronic device, comprising:

a processor; and

a memory configured to store a processor-executable instruction,

wherein the processor is configured to call the instruction stored in the memory to perform the method of claim 1 .

10. A non-transitory computer-readable storage medium, on which a computer program instruction is stored, wherein the method of claim 1 is implemented when the computer program instruction is executed by a processor.

11. The non-transitory computer-readable storage medium of claim 10 , wherein the quantization parameter further includes a scaling factor for each channel, and wherein

for each channel, according to the statistical result of the data to be quantized corresponding to the channel, the determining of the quantization parameter corresponding to the channel includes:

for each channel, determining the scaling factor corresponding to the channel according to the statistical result of the data to be quantized corresponding to the channel, the point position parameter corresponding to the channel, and the data bit width corresponding to the channel.

12. The non-transitory computer-readable storage medium of claim 10 , wherein the quantization parameter includes an offset for each channel, and wherein

for each channel, according to the statistical result of the data to be quantized corresponding to the channel, the determining of the quantization parameter corresponding to the channel includes:

for each channel, according to the statistical result of the data to be quantized corresponding to the channel, determining the offset corresponding to the channel.

13. The non-transitory computer-readable storage medium of claim 12 , wherein the determining of the statistical result of the data to be quantized corresponding to each channel according to the data to be quantized includes:

for each channel, determining an absolute maximum value of the data to be quantized corresponding to the channel; and

determining the absolute maximum value of the data to be quantized corresponding to the channel as the statistical result of the data to be quantized corresponding to the channel.

14. The non-transitory computer-readable storage medium of claim 13 , wherein for each channel, the determining of the absolute maximum value of the data to be quantized corresponding to the channel includes:

for each channel, determining a maximum value and a minimum value of the data to be quantized corresponding to the channel; and

determining the absolute maximum value of the data to be quantized corresponding to the channel according to the maximum value and the minimum value of the data to be quantized corresponding to the channel.

15. A data quantization processing apparatus comprising:

a first determining circuit configured to, according to a quantity of channels of an input image in a deep convolution layer, determine data to be quantized corresponding to each channel of the input image;

a second determining circuit configured to, according to the data to be quantized corresponding to each channel, determine a statistical result of the data to be quantized corresponding to each channel;

a third determining circuit configured to, for each channel, according to the statistical result of the data to be quantized corresponding to the channel, determine a quantization parameter corresponding to the channel; and

a quantization circuit configured to quantize the data to be quantized corresponding to each channel by using the quantization parameter corresponding to each channel to obtain quantized data corresponding to each channel of the input image,

wherein the number of channels of the input image in the deep convolution layer is the same as the number of channels of an output image;

wherein the quantization parameter includes a point position parameter for each channel; and the third determining circuit is further configured to:

for each channel, determine the point position parameter corresponding to the channel according to the statistical result of the data to be quantized corresponding to the channel and a data bit width corresponding to the channel; and

for each channel, adjust the data bit width corresponding to the channel according to a quantization error of the data bit width corresponding to the channel, so as to determine the quantization parameter corresponding to the channel by using an adjusted data bit width, wherein the quantization error is determined based on the quantized data corresponding to the channel and the data to be quantized corresponding to the channel.

16. An artificial intelligence chip, comprising the data quantization processing apparatus of claim 15 .

17. An electronic device, comprising the artificial intelligence chip of claim 16 .

Assignments (1)

Priority Claims (1)

Continuity (1)

References Cited (400)