METHOD AND APPARATUS FOR QUANTIZING NEURAL NETWORK PARAMETER
A method and a device for quantizing parameters of a neural network are disclosed. According to one aspect of the present invention, a computer-implemented method for quantizing parameters of a neural network including batch normalization parameters, the method comprising obtaining parameters in a second layer connected to a first layer; removing at least one parameter among the parameters based on either any one of output values of the first layer or batch normalization parameters applied to the parameters; and quantizing the parameters in the second layer based on parameters that have survived the removing, is provided.
1 - 9 . (canceled)
10 . A computer-implemented method for quantizing parameters of a neural network including batch normalization parameters, the method comprising:
obtaining parameters in a second layer connected to a first layer;
removing at least one parameter among the parameters based on either any one of output values of the first layer or batch normalization parameters applied to the parameters; and
quantizing the parameters in the second layer based on parameters that have survived the removing.
11 . The method according to claim 10 , wherein the removing of the at least one parameter comprises:
identifying a channel that outputs all output values as zero among output channels of the first layer; and
removing at least one parameter applied to an output value output through the identified channel among the parameters.
12 . The method according to claim 10 , wherein the removing of the at least one parameter comprises:
identifying a channel in which the number of nonzero output values is less than a preset number among the output channels of the first layer; and
removing at least one parameter applied to output values output through the identified channel among the parameters.
13 . The method according to claim 10 , wherein the removing of the at least one parameter comprises:
identifying a channel in which the number of output values less than a preset value is less than a preset number among the output channels of the first layer; and
removing at least one parameter applied to output values output through the identified channel among the parameters.
14 . The method according to claim 10 , wherein the removing of the at least one parameter comprises setting the value of the at least one parameter to zero.
15 . The method according to claim 10 , wherein the removing of the at least one parameter comprises:
identifying a batch normalization parameter that satisfies preset conditions among the batch normalization parameters; and
removing at least one parameter applied to the identified batch normalization parameter among the parameters.
16 . The method according to claim 15 , wherein the identifying of a batch normalization parameter comprises identifying a batch normalization parameter having a value greater than a preset value among the batch normalization parameters.
17 . A computing device comprising:
a memory in which instructions are stored; and
at least one processor,
wherein the at least one processor is configured to, by executing the instructions:
obtain parameters in a second layer connected to a first layer;
remove at least one parameter among the parameters based on any one of output values of the first layer or batch normalization parameters applied to the parameters; and
quantize the parameters in the second layer based on parameters that have survived the removing.
18 . A computer-readable recording medium recording a computer program for executing the method of claim 10 .