Methods and devices for quantization and de-quantization design in video coding
A method for video decoding is provided. The method may be applied in a decoder and includes: receiving a video bitstream comprising a quantization parameter and a quantized level; deriving a scale value by scaling the quantization parameter by a scale factor; determining a plurality of parameters associated with a coding unit (CU); obtaining a plurality of bit-shifts by bit-shifting the plurality of parameters; and obtaining a plurality of coefficients associated with the CU based on the quantized level, the scale value, and the plurality of bit-shifts.
1. A method for video decoding, comprising:
deriving, from a bitstream and for a first coding block, a quantization parameter and a quantized level;
deriving a scale value by looking up a scale level table based on the quantization parameter; and
in response to determining that the first coding block is coded in a transform skip mode, obtaining a residual sample for a sample in the first coding block based on the quantized level, the scale value and a plurality of bit-shifts by applying a first de-quantization operation;
wherein the first de-quantization operation is also applied to obtain a reconstructed sample for an escape sample in a second coding block coded in a palette mode; and
wherein parameters of the first de-quantization operation are determined without a block size of the first coding block or the second coding block.
2. The method of claim 1 , further comprising:
in response to determining that a third coding block is coded in a regular transform mode, obtaining a residual sample for a sample in the third coding block by applying a second de-quantization operation different from the first de-quantization operation;
wherein parameters of the second de-quantization operation are determined with the block size of the first coding block.
3. The method of claim 1 , wherein the scale level table is levelScale[k]={40, 45, 51, 57, 64, 72} with k is an integer between 0 and 5 inclusive.
4. The method of claim 1 , further comprising:
receiving, in the bitstream, an escape flag to indicate if an escape sample is present in the second coding block.
5. The method of claim 1 , wherein the plurality of bit-shifts comprise a left shift of QP/6 bits and a right shift of 6 bits, wherein QP is the quantization parameter.
6. The method of claim 1 , wherein the first de-quantization operation is applied using following equation:
pResi
′
=
pLevel
×
decScale
[
QP
%6
]
×
2
(
QP
/
6
)
2
6
wherein pLevel is the quantized level, pResi′ is the residual sample, decScale[ ] is the scale value, QP is the quantization parameter, % denotes a modulo operation, QP %6 represents an operation of QP modulo 6.
7. A computing device, comprising:
one or more processors;
a non-transitory storage coupled to the one or more processors; and
a plurality of programs stored in the non-transitory storage that, when executed by the one or more processors, cause the one or more processors to perform acts comprising:
deriving, from a bitstream and for a first coding block, a quantization parameter and a quantized level;
deriving a scale value by looking up a scale level table based on the quantization parameter; and
in response to determining that the first coding block is coded in a transform skip mode, obtaining a residual sample for a sample in the first coding block based on the quantized level, the scale value and a plurality of bit-shifts by applying a first de-quantization operation;
wherein the first de-quantization operation is also applied to obtain a reconstructed sample for an escape sample in a second coding block coded in a palette mode; and
wherein parameters of the first de-quantization operation are determined without a block size of the first coding block or the second coding block.
8. The computing device of claim 7 , wherein the plurality of programs, when executed by the one or more processors, cause the one or more processors to further perform acts comprising:
in response to determining that a third coding block is coded in a regular transform mode, obtaining a residual sample for a sample in the third coding block by applying a second de-quantization operation different from the first de-quantization operation;
wherein parameters of the second de-quantization operation are determined with the block size of the first coding block.
9. The computing device of claim 7 , wherein the scale level table is levelScale[k]={40, 45, 51, 57, 64, 72} with k is an integer between 0 and 5 inclusive.
10. The computing device of claim 7 , wherein the plurality of programs, when executed by the one or more processors, cause the one or more processors to further perform acts comprising:
receiving, in the bitstream, an escape flag to indicate if an escape sample is present in the second coding block.
11. The computing device of claim 7 , wherein the plurality of bit-shifts comprise a left shift of QP/6 bits and a right shift of 6 bits, wherein QP is the quantization parameter.
12. The computing device of claim 7 , wherein the first de-quantization operation is applied using following equation:
pResi
′
=
pLevel
×
decScale
[
QP
%6
]
×
2
(
QP
/
6
)
2
6
wherein pLevel is the quantized level, pResi′ is the residual sample, decScale[ ] is the scale value, QP is the quantization parameter, % denotes a modulo operation, QP %6 represents an operation of QP modulo 6.
13. A non-transitory computer readable storage medium storing a bitstream for execution by a computing device having one or more processors, wherein the bitstream, when executed by the one or more processors, causes the one or more processors to perform acts comprising:
deriving, from a bitstream and for a first coding block, a quantization parameter and a quantized level;
deriving a scale value by looking up a scale level table based on the quantization parameter; and
in response to determining that the first coding block is coded in a transform skip mode, obtaining a residual sample for a sample in the first coding block based on the quantized level, the scale value and a plurality of bit-shifts by applying a first de-quantization operation;
wherein the first de-quantization operation is also applied to obtain a reconstructed sample for an escape sample in a second coding block coded in a palette mode; and
wherein parameters of the first de-quantization operation are determined without a block size of the first coding block or the second coding block.
14. The non-transitory computer readable storage medium of claim 13 , wherein the bitstream, when executed by the one or more processors, causes the one or more processors to further perform acts comprising:
in response to determining that a third coding block is coded in a regular transform mode, obtaining a residual sample for a sample in the third coding block by applying a second de-quantization operation different from the first de-quantization operation;
wherein parameters of the second de-quantization operation are determined with the block size of the first coding block.
15. The non-transitory computer readable storage medium of claim 13 , wherein the scale level table is levelScale[k]={40, 45, 51, 57, 64, 72} with k is an integer between 0 and 5 inclusive.
16. The non-transitory computer readable storage medium of claim 13 , wherein the bitstream, when executed by the one or more processors, causes the one or more processors to further perform acts comprising:
receiving, in the bitstream, an escape flag to indicate if an escape sample is present in the second coding block.
17. The non-transitory computer readable storage medium of claim 13 , wherein the plurality of bit-shifts comprise a left shift of QP/6 bits and a right shift of 6 bits, wherein QP is the quantization parameter.
18. The non-transitory computer readable storage medium of claim 13 , wherein the first de-quantization operation is applied using following equation:
pResi
′
=
pLevel
×
decScale
[
QP
%6
]
×
2
(
QP
/
6
)
2
6
wherein pLevel is the quantized level, pResi′ is the residual sample, decScale[ ] is the scale value, QP is the quantization parameter, % denotes a modulo operation, QP %6 represents an operation of QP modulo 6.