Transform bypass coded residual blocks in digital video
Devices, systems and methods for transform design for large blocks in video coding are described. An exemplary method for video processing includes determining that a size of a residual block of a video is larger than a maximum block size allowed for a transform skip mode, in which, during a decoding operation, residual coefficients are decoded without performing an inverse transform operation; splitting, based on the size of a residual block, the residual block into multiple regions, wherein each region represents a portion of the residual block of a difference between a portion of a current video block and a prediction block corresponding to the portion of the current video block; and determining a reconstructed current video block from the residual block based on selectively performing the inverse transform operation according to an indicator that indicates the transform skip mode.
1. A method of processing video data, comprising:
determining, for a conversion between a current video block of a video and a bitstream of the video, that a transform skip mode is applied to a residual block of the current video block, wherein a sample of the residual block represents a prediction residual between a sample of the current video block and a prediction sample corresponding to the sample of the current video block, and in the transform skip mode, a transform operation or an inverse transform operation is skipped for the prediction residual; and
performing the conversion based on the determining,
wherein the residual block is coded in the bitstream as a plurality of regions, each region represents a portion of the residual block, and wherein the residual block has a size K*L, K and L are integers, and a size Ki*Li of an i-th region of the plurality of regions is based on the size of the residual block;
wherein a context model index of a fourth syntax element is calculated based on a value of the fourth syntax element of a left neighboring sample and a value of the fourth syntax element of an above neighboring sample, wherein the fourth syntax element included in the bitstream indicates whether a transform coefficient level of a sample of the residual block is non-zero.
2. The method of claim 1 , wherein residual information of a sample of a first region from the plurality of regions is allowed to be used in a context derivation for a sample of a second region from the plurality of regions.
3. The method of claim 1 , wherein the transform skip mode is applied to the residual block in case that a size of the residual block being smaller than or equal to an allowed maximum block size used for the transform skip mode which is indicated by a first syntax element included in the bitstream.
4. The method of claim 3 , wherein the allowed maximum block size is in a range of 4 to 32, inclusive.
5. The method of claim 1 , wherein a second syntax element indicating last significant scanning position is not included in the bitstream for a coefficients coding in the transform skip mode.
6. The method of claim 1 , wherein a third syntax element indicating transform coefficient levels of last one region of the plurality of regions is not included in the bitstream.
7. The method of claim 6 , wherein a context model index of the third syntax element is calculated based on a sum of the third syntax element of the left neighboring sample and the third syntax element of the above neighboring sample.
8. The method of claim 1 , wherein a context model of a fifth syntax element for the residual block which uses the transform skip mode is different from a context model of the fifth syntax element for a block which does not use the transform skip mode, wherein the fifth syntax element included in the bitstream indicates a sign of a transform coefficient level of a sample of the residual block.
9. The method of claim 1 , wherein the conversion includes encoding the current video block into the bitstream.
10. The method of claim 1 , wherein the conversion includes decoding the current video block from the bitstream.
11. An apparatus for processing video data comprising a processor and a non-transitory memory with instructions thereon, wherein the instructions upon execution by the processor, cause the processor to:
determine, for a conversion between a current video block of a video and a bitstream of the video, that a transform skip mode is applied to a residual block of the current video block, wherein a sample of the residual block represents a prediction residual between a sample of the current video block and a prediction sample corresponding to the sample of the current video block, and in the transform skip mode, a transform operation or an inverse transform operation is skipped for the prediction residual; and
perform the conversion based on the determining,
wherein the residual block is coded in the bitstream as a plurality of regions, each region represents a portion of the residual block, and wherein the residual block has a size K*L, K and L are integers, and a size Ki*Li of an i-th region of the plurality of regions is based on the size of the residual block;
wherein a context model index of a fourth syntax element is calculated based on a value of the fourth syntax element of a left neighboring sample and a value of the fourth syntax element of an above neighboring sample, wherein the fourth syntax element included in the bitstream indicates whether a transform coefficient level of a sample of the residual block is non-zero.
12. The apparatus of claim 11 , wherein residual information of a sample of a first region from the plurality of regions is allowed to be used in a context derivation for a sample of a second region from the plurality of regions.
13. The apparatus of claim 11 , wherein the transform skip mode is applied to the residual block in case that a size of the residual block being smaller than or equal to an allowed maximum block size used for the transform skip mode which is indicated by a first syntax element included in the bitstream, and wherein the allowed maximum block size is in a range of 4 to 32, inclusive.
14. The apparatus of claim 11 , wherein a third syntax element indicating transform coefficient levels of last one region of the plurality of regions is not included in the bitstream, and wherein a context model index of the third syntax element is calculated based on a sum of the third syntax element of the left neighboring sample and the third syntax element of the above neighboring sample.
15. The apparatus of claim 11 , wherein a context model of a fifth syntax element for the residual block which uses the transform skip mode is different from a context model of the fifth syntax element for a block which does not use the transform skip mode, wherein the fifth syntax element included in the bitstream indicates a sign of a transform coefficient level of a sample of the residual block.
16. A non-transitory computer-readable storage medium storing instructions that cause a processor to:
determine, for a conversion between a current video block of a video and a bitstream of the video, that a transform skip mode is applied to a residual block of the current video block, wherein a sample of the residual block represents a prediction residual between a sample of the current video block and a prediction sample corresponding to the sample of the current video block, and in the transform skip mode, a transform operation or an inverse transform operation is skipped for the prediction residual; and
perform the conversion based on the determining,
wherein the residual block is coded in the bitstream as a plurality of regions, each region represents a portion of the residual block, and wherein the residual block has a size K*L, K and L are integers, and a size Ki*Li of an i-th region of the plurality of regions is based on the size of the residual block;
wherein a context model index of a fourth syntax element is calculated based on a value of the fourth syntax element of a left neighboring sample and a value of the fourth syntax element of an above neighboring sample, wherein the fourth syntax element included in the bitstream indicates whether a transform coefficient level of a sample of the residual block is non-zero.
17. The non-transitory computer-readable storage medium of claim 16 , wherein residual information of a sample of a first region from the plurality of regions is allowed to be used in a context derivation for a sample of a second region from the plurality of regions.
18. A non-transitory computer-readable recording medium storing a bitstream of a video which is generated by a method performed by a video processing apparatus, wherein the method comprises:
determining that a transform skip mode is applied to a residual block of a current video block of the video, wherein a sample of the residual block represents a prediction residual between a sample of the current video block and a prediction sample corresponding to the sample of the current video block, and in the transform skip mode, a transform operation or an inverse transform operation is skipped for the prediction residual; and
generating the bitstream of the video based on the determining,
wherein the residual block is coded in the bitstream as a plurality of regions, each region represents a portion of the residual block, and wherein the residual block has a size K*L, K and L are integers, and a size Ki*Li of an i-th region of the plurality of regions is based on the size of the residual block;
wherein a context model index of a fourth syntax element is calculated based on a value of the fourth syntax element of a left neighboring sample and a value of the fourth syntax element of an above neighboring sample, wherein the fourth syntax element included in the bitstream indicates whether a transform coefficient level of a sample of the residual block is non-zero.
19. The non-transitory computer-readable recording medium of claim 18 , wherein residual information of a sample of a first region from the plurality of regions is allowed to be used in a context derivation for a sample of a second region from the plurality of regions.
20. The non-transitory computer-readable storage medium of claim 16 , wherein the transform skip mode is applied to the residual block in case that a size of the residual block being smaller than or equal to an allowed maximum block size used for the transform skip mode which is indicated by a first syntax element included in the bitstream, and wherein the allowed maximum block size is in a range of 4 to 32, inclusive.