Method and apparatus for quantization level clipping
A method and apparatus for clipping a transform coefficient are disclosed. Embodiments according to the present invention avoid overflow of the quantized transform coefficient by clipping the quantization level adaptively after quantization. In one embodiment, the method comprises generating the quantization level for the transform coefficient of a transform unit by quantizing the transform coefficient according to a quantization matrix and quantization parameter. The clipping condition is determined and the quantization level is clipped according to the clipping condition to generate a clipping-processed quantization level. The clipping condition includes a null clipping condition. The quantization level is clipped to fixed-range represented in n bits for the null clipping condition, where n correspond to 8, 16, or 32. The quantization level may also be clipped within a range from −m to m−1 for the null clipping condition, where m may correspond to 128, 32768, or 2147483648.
1. A method implemented in a video encoder for clipping a quantization level, the method comprising:
generating the quantization level for a transform coefficient of a transform unit by quantizing the transform coefficient according to a quantization matrix and quantization parameter;
determining a clipping condition in the video encoder based on one or a combination of the quantization matrix, the quantization parameter, de-quantization step, video source bit-depth, transform size of the transform unit, wherein the clipping condition includes a null clipping condition; and
clipping the quantization level according to the clipping condition to generate a clipping-processed quantization level,
wherein said clipping the quantization level corresponds to fixed-range clipping and the quantization level is clipped within a range from −m to m−1 for the null clipping condition and m corresponds to 128, 32768, or 2147483648.
2. The method of claim 1 , wherein the quantization level is clipped to a first range for a first clipping condition and the quantization level is clipped to a second range for a second clipping condition.
3. The method of claim 2 , wherein the first range corresponds to a fixed range related to quantization-level bit-depth.
4. The method of claim 2 , wherein the second range is related to dynamic range of the quantization level.
5. The method of claim 1 , wherein the clipping condition is determined by comparing a first weighted value with a threshold, wherein the first weighted value corresponds to a first linear function of the quantization matrix, the quantization parameter, the video source bit-depth, the transform size of the transform unit, or any combination thereof.
6. The method of claim 5 , wherein the threshold corresponds to a fixed value or a second weighted value, wherein the second weighted value corresponds to a second linear function of the quantization matrix, the quantization parameter, the video source bit-depth, the transform size of the transform unit, or any combination thereof.
7. The method of claim 1 , wherein said clipping the quantization level corresponds to fixed-range clipping and the clipped quantization level is represented in n bits for the null clipping condition.
8. The method of claim 7 , wherein n corresponds to 8, 16, or 32.
9. A video encoding apparatus for clipping a quantization level, the apparatus comprising at least one circuit configured to:
generate the quantization level for a transform coefficient of a transform unit by quantizing the transform coefficient according to a quantization matrix and quantization parameter;
determine a clipping condition in the video encoding apparatus based on one or a combination of the quantization matrix, the quantization parameter, de-quantization step, video source bit-depth, transform size of the transform unit, wherein the clipping condition includes a null clipping condition; and
clip the quantization level according to the clipping condition to generate a clipping-processed quantization level,
wherein said clipping the quantization level corresponds to fixed-range clipping and the quantization level is clipped within a range from −m to m−1 for the null clipping condition and m corresponds to 128, 32768, or 2147483648.
10. The apparatus of claim 9 , wherein the quantization level is clipped to a first range for a first clipping condition and the quantization level is clipped to a second range for a second clipping condition.
11. The apparatus of claim 10 , wherein the first range corresponds to a fixed range related to quantization-level bit-depth.
12. The apparatus of claim 10 , wherein the second range is related to dynamic range of the quantization level.
13. The apparatus of claim 9 , wherein the clipping condition is determined by comparing a first weighted value with a threshold, wherein the first weighted value corresponds to a first linear function of the quantization matrix, the quantization parameter, the video source bit-depth, the transform size of the transform unit, or any combination thereof.
14. The apparatus of claim 13 , wherein the threshold corresponds to a fixed value or a second weighted value, wherein the second weighted value corresponds to a second linear function of the quantization matrix, the quantization parameter, the video source bit-depth, the transform size of the transform unit, or any combination thereof.
15. The apparatus of claim 9 , wherein said clipping the quantization level corresponds to fixed-range clipping and the clipped quantization level is represented in n bits for the null clipping condition.
16. The apparatus of claim 15 , wherein n corresponds to 8, 16, or 32.