Image processing method, apparatus and device, and readable storage medium
An image processing method, apparatus and device, and a readable storage medium are disclosed, including: obtaining a target image; inputting the target image into a quantized target deep neural network model for classification/detection to obtain an output result; and processing the target image according to a policy corresponding to the output result. A process of performing quantization to obtain the target deep neural network model includes: obtaining a pre-trained floating point type deep neural network model; extracting weight features of a deep neural network model; determining a quantization policy using the weight features; and quantizing the deep neural network model according to the quantization policy to obtain the target deep neural network model.
1. An image processing method, comprising:
obtaining a target image;
inputting the target image into a quantized target deep neural network model for at least one of classification or detection to obtain an output result; and
processing the target image according to a policy corresponding to the output result; and
performing quantization to obtain the target deep neural network model by:
obtaining a pre-trained floating point type deep neural network model;
extracting weight features of a deep neural network model;
determining a quantization policy using the weight features; and
quantizing the deep neural network model according to the quantization policy to obtain the target deep neural network model.
2. The image processing method according to claim 1 , wherein under a circumstance that the weight features are weight parameter features, extracting the weight features of the deep neural network model comprises:
calculating a per-layer quantization error and a per-channel quantization error corresponding to the deep neural network model separately; and
determining the per-layer quantization error and the per-channel quantization error as the weight parameter features.
3. The image processing method according to claim 2 , wherein determining the quantization policy using the weight features comprises:
calculating a difference value between the per-layer quantization error and the per-channel quantization error;
determining whether the difference value is within an error range;
in response to the difference value being within the error range, determining that the quantization policy is the per-layer quantization; and
in response to the difference value being not within the error range, determining that the quantization policy is the per-channel quantization, or performing quantization according to a certain quantization unit.
4. The image processing method according to claim 3 , wherein before determining that the quantization policy is the per-channel quantization, or performing quantization according to the certain quantization unit, the method further comprises:
extracting weight channel features of the deep neural network model; and
taking similar weight channels in the deep neural network model as the certain quantization unit by using the weight channel features, wherein the certain quantization unit comprises at least one weight channel.
5. The image processing method according to claim 1 , wherein under a circumstance that the weight features are weight channel features, extracting the weight features of the deep neural network model comprises:
clustering various weight channels in the deep neural network model to obtain clustering results; and
determining the clustering results as the weight channel features.
6. The image processing method according to claim 5 , wherein clustering the various weight channels in the deep neural network model to obtain the clustering results comprises:
obtaining weight value ranges of the various weight channels in the deep neural network model, and a statistical distribution chart of weight parameter values of the various weight channels; and
clustering the various weight channels based on the weight value ranges and the statistical distribution chart of the weight parameter values, to obtain the clustering results.
7. The image processing method according to claim 5 , wherein the determining a quantization policy using the weight features comprises:
in response to the number of clusters of the clustering results being 1, determining that the quantization policy is the per-layer quantization;
in response to the number of clusters being equal to a number of the weight channels, determining that the quantization policy is the per-channel quantization; and
in response to the number of clusters being greater than 1 and less than the number of the weight channels, taking all the weight channels corresponding to each cluster as an entirety for quantization.
8. An image processing device, comprising:
a memory storing a computer program; and
a processor configured to execute the computer program wherein the processor, upon execution of the computer program, is configured to:
obtain a target image;
input the target image into a quantized target deep neural network model for at least one of classification or detection to obtain an output result;
process the target image according to a policy corresponding to the output result; and
perform quantization to obtain the target deep neural network model by:
obtaining a pre-trained floating point type deep neural network model;
extracting weight features of a deep neural network model;
determining a quantization policy using the weight features; and
quantizing the deep neural network model according to the quantization policy to obtain the target deep neural network model.
9. The image processing device according to claim 8 , wherein the processor, upon execution of the computer program, is further configured to:
calculate a per-layer quantization error and a per-channel quantization error corresponding to the deep neural network model separately; and
determine the per-layer quantization error and the per-channel quantization error as the weight parameter features.
10. The image processing device according to claim 9 , wherein the processor, upon execution of the computer program, is further configured to:
calculate a difference value between the per-layer quantization error and the per-channel quantization error;
determine whether the difference value is within an error range;
in response to the difference value being within the error range, determine that the quantization policy is the per-layer quantization; and
in response to the difference value being not within the error range, determine that the quantization policy is the per-channel quantization, or perform quantization according to a certain quantization unit.
11. The image processing device according to claim 10 , wherein the processor, upon execution of the computer program, is further configured to:
extract weight channel features of the deep neural network model; and
take similar weight channels in the deep neural network model as the certain quantization unit by using the weight channel features, wherein the certain quantization unit comprises at least one weight channel.
12. The image processing device according to claim 8 , wherein the processor, upon execution of the computer program, is further configured to:
cluster various weight channels in the deep neural network model to obtain clustering results; and
determine the clustering results as the weight channel features.
13. The image processing device according to claim 12 , wherein the processor, upon execution of the computer program, is further configured to:
obtain weight value ranges of the various weight channels in the deep neural network model, and a statistical distribution chart of weight parameter values of the various weight channels; and
cluster the various weight channels based on the weight value ranges and the statistical distribution chart of the weight parameter values, to obtain the clustering results.
14. The image processing device according to claim 12 , wherein the processor, upon execution of the computer program, is further configured to:
in response to the number of clusters of the clustering results being 1, determine that the quantization policy is the per-layer quantization;
in response to the number of clusters being equal to a number of the weight channels, determine that the quantization policy is the per-channel quantization; and
in response to the number of clusters being greater than 1 and less than the number of the weight channels, take all the weight channels corresponding to each cluster as an entirety for quantization.
15. A non-transitory computer-readable storage medium storing a computer program; and the computer program, when executed by a processor, is configured to cause the processor to:
obtain a target image;
input the target image into a quantized target deep neural network model for at least one of classification or detection to obtain an output result;
process the target image according to a policy corresponding to the output result; and
perform quantization to obtain the target deep neural network model by:
obtaining a pre-trained floating point type deep neural network model;
extracting weight features of a deep neural network model;
determining a quantization policy using the weight features; and
quantizing the deep neural network model according to the quantization policy to obtain the target deep neural network model.
16. The non-transitory computer-readable storage medium according to claim 15 , wherein the computer program, upon execution by the processor, is further configured to cause the processor to:
calculate a per-layer quantization error and a per-channel quantization error corresponding to the deep neural network model separately; and
determine the per-layer quantization error and the per-channel quantization error as the weight parameter features.
17. The non-transitory computer-readable storage medium according to claim 16 , wherein the computer program, upon execution by the processor, is further configured to cause the processor to:
calculate a difference value between the per-layer quantization error and the per-channel quantization error;
determine whether the difference value is within an error range;
in response to the difference value being within the error range, determine that the quantization policy is the per-layer quantization; and
in response to the difference value being not within the error range, determine that the quantization policy is the per-channel quantization, or perform quantization according to a certain quantization unit.
18. The non-transitory computer-readable storage medium according to claim 17 , wherein the computer program, upon execution by the processor, is further configured to cause the processor to:
extract weight channel features of the deep neural network model; and
take similar weight channels in the deep neural network model as the certain quantization unit by using the weight channel features, wherein the certain quantization unit comprises at least one weight channel.
19. The non-transitory computer-readable storage medium according to claim 15 , wherein the computer program, upon execution by the processor, is further configured to cause the processor to:
cluster various weight channels in the deep neural network model to obtain clustering results; and
determine the clustering results as the weight channel features.
20. The non-transitory computer-readable storage medium according to claim 19 , wherein the computer program, upon execution by the processor, is further configured to cause the processor to:
obtain weight value ranges of the various weight channels in the deep neural network model, and a statistical distribution chart of weight parameter values of the various weight channels; and
cluster the various weight channels based on the weight value ranges and the statistical distribution chart of the weight parameter values, to obtain the clustering results.