Method and apparatus for quantization level clipping
A method and apparatus for clipping a transform coefficient are disclosed. In one implementation, a method is implemented in a video encoder for clipping a quantization level. The method operates by generating the quantization level for a transform coefficient of a transform unit by quantizing the transform coefficient according to a quantization matrix and quantization parameter, determining a clipping condition in the video encoder based on video source bit-depth, and clipping the quantization level according to the clipping condition to generate a clipping-processed quantization level.
1. A method implemented in a video encoder for clipping a quantization level, the method comprising:
generating the quantization level for a transform coefficient of a transform unit by quantizing the transform coefficient according to a quantization matrix and quantization parameter;
determining a clipping condition in the video encoder based on video source bit-depth; and
clipping the quantization level according to the clipping condition to generate a clipping-processed quantization level,
wherein the quantization level is clipped to a first range from −m to m−1 for a first clipping condition and the quantization level is clipped to a second range for a second clipping condition, wherein m corresponds to 128, 32768, or 2147483648.
2. The method of claim 1 , wherein the clipped quantization level is represented in n bits for the first clipping condition.
3. The method of claim 2 , wherein n corresponds to 8, 16, or 32.
4. The method of claim 1 , wherein the clipping condition is determined as the first clipping condition when the video source bit-depth is 10 bits or higher.
5. The method of claim 1 , wherein the second range is related to dynamic range of the quantization level.
6. The method of claim 1 , wherein the clipping condition is determined by comparing a first weighted value with a threshold, wherein the first weighted value corresponds to a first linear function of the video source bit-depth.
7. The method of claim 6 , wherein the threshold corresponds to a fixed value or a second weighted value, wherein the second weighted value corresponds to a second linear function of the video source bit-depth.
8. A video encoding apparatus for clipping a quantization level, the apparatus comprising at least one circuit configured to:
generate the quantization level for a transform coefficient of a transform unit by quantizing the transform coefficient according to a quantization matrix and quantization parameter;
determine a clipping condition in the video encoding apparatus based on video source bit-depth; and
clip the quantization level according to the clipping condition to generate a clipping-processed quantization level,
wherein the quantization level is clipped to a first range from −m to m−1 for a first clipping condition and the quantization level is clipped to a second range for a second clipping condition, wherein m corresponds to 128, 32768, or 2147483648.
9. The apparatus of claim 8 , wherein the clipping condition is determined as the first clipping condition when the video source bit-depth is 10 bits or higher.
10. The apparatus of claim 8 , wherein the second range is related to dynamic range of the quantization level.
11. The apparatus of claim 7 , wherein the clipping condition is determined by comparing a first weighted value with a threshold, wherein the first weighted value corresponds to a first linear function of the video source bit-depth.
12. The apparatus of claim 11 , wherein the threshold corresponds to a fixed value or a second weighted value, wherein the second weighted value corresponds to a second linear function of the video source bit-depth.