Granted Patent B2

US 12,375,643 · App. 17/895,511 · Granted Jul 29, 2025

Inventors: Zhipin Deng (Beijing, CN); Kai Zhang (San Diego, CA); Li Zhang (San Diego, CA); Hongbin Liu (Beijing, CN); Jizheng Xu (San Diego, CA)

Assignees: BEIJING BYTEDANCE NETWORK TECHNOLOGY CO., LTD.; BYTEDANCE INC.

H04N19/105H04N19/132H04N19/159H04N19/176H04N19/70

Abstract

Claims (66)

1. A method of processing video data, comprising:

determining, for a first conversion between a first video block of a video and a bitstream of the video, that a first intra mode is applied on the first video block of the video;

deriving reference samples of the first video block;

performing a boundary downsampling operation on the reference samples of the first video block based on a size of the first video block, followed by a matrix vector multiplication operation, and selectively followed by an upsampling operation to generate prediction samples for the first video block; and

performing the first conversion based on the prediction samples for the first video block,

wherein elements of matrices or offset values applied in the matrix vector multiplication operation have a fixed precision,

wherein the fixed precision is an 8-bit precision, and

wherein the prediction samples are determined according to the following formulas in the upsampling operation:

predSamples[ x Hor+ dX][y Hor]=((upHor− dX )*predSamples[ x Hor][ y Hor]+ dX *predSamples[ x Hor+upHor][ y Hor])/upHor, and

predSamples[ x Ver][ y Ver+ dY ]=((upVer− dY )*predSamples[ x Ver][ y Ver]+ dY *predSamples[ x Ver][ y Ver+upVer])/upVer,

wherein offsetHor and offsetVer are integers, upHor is a function of a current video block width and a pre-defined value based on a current video block size, upVer is a function of a current video block height and the pre-defined value based on the current video block size, dX is 1 . . . upHor−1, dY is 1 . . . upVer−1, and xHor are positions based on the upHor and yHor are positions based on the upVer.

2. The method of claim 1 , wherein precision of the first video block and the reference samples are 10-bit depth.

3. The method of claim 1 , wherein at least two blocks with different sizes share a matrix with a same size in the first intra mode.

4. The method of claim 1 , wherein the reference samples are derived without invoking a reference sample filtering operation.

5. The method of claim 4 , wherein the reference sample filtering operation is applied in a normal intra mode which is different from the first intra mode.

6. The method of claim 1 , wherein whether the first intra mode being applied is specified by a first syntax element presented in a sequence level and a second syntax element presented in a coding unit level.

7. The method of claim 6 , wherein at least one bin of the second syntax element is context-based coded.

8. The method of claim 7 , wherein in response to a width-height ratio of the first video block being greater than 2, a context with an index of 3 is used for a first bin of the second syntax element.

9. The method of claim 7 , wherein in response to a width-height ratio of the first video block being smaller than or equal to 2, a single context selected from contexts with indices of 0, 1 or 2 is used for a first bin of the second syntax element.

10. The method of claim 1 , wherein the boundary downsampling operation includes deriving, according to a rule, boundary samples by applying a left bit shift operation or a right bit shift operation on a sum of at least one reference sample, and wherein the rule determines whether to apply the left bit shift operation or the right bit shift operation.

11. The method of claim 10 , wherein the rule defines that the right bit shift operation is applied in response to a number of shifted bits being greater than zero.

12. The method of claim 11 , wherein the boundary samples redBdryS[x] are calculated using one of following equations:

redBdry S[x ]=(Σ i=0 bDwn-1 ref S[x*bDwn+i ]+(1<<(Log 2( bDwn )−1)))>>Log 2( bDwn ), if bDwn >1, or

redBdry S[x ]=ref S[x ] if bDwn =1,

wherein bDwn is equal to a function of the size of the first video block and a boundary size,

wherein refS [x] indicates a number of reference samples x,

wherein >> indicates the right bit shift operation, and

wherein << indicates the left bit shift operation.

13. The method of claim 1 , wherein the first conversion includes encoding the first video block into the bitstream.

14. The method of claim 1 , wherein the first conversion includes decoding the first video block from the bitstream.

15. An apparatus for processing video data comprising a processor and a non-transitory memory with instructions thereon, wherein the instructions upon execution by the processor, cause the processor to:

determine, for a first conversion between a first video block of a video and a bitstream of the video, that a first intra mode is applied on the first video block of the video;

derive reference samples of the first video block;

perform a boundary downsampling operation on the reference samples of the first video block based on a size of the first video block, followed by a matrix vector multiplication operation, and selectively followed by an upsampling operation to generate prediction samples for the first video block; and

perform the first conversion based on the prediction samples for the first video block,

wherein elements of matrices or offset values applied in the matrix vector multiplication operation have a fixed precision,

wherein the fixed precision is an 8-bit precision, and

wherein the prediction samples are determined according to the following formulas in the upsampling operation:

predSamples[ x Hor+ dX][y Hor](((upHor− dX )*predSamples[ x Hor][ y Hor]+ dX *predSamples[ x Hor+upHor][ y Hor]+offsetHor)/upHor, and

predSamples[ x Ver][ y Ver+ dY ]=((upVer− dY )*predSamples[ x Ver][ y Ver]+ dY *predSamples[ x Ver][ y Ver+upVer]+offsetVer)/upVer,

wherein offsetHor and offsetVer are integers, upHor is a function of a current video block width and a pre-defined value based on a current video block size, upVer is a function of a current video block height and the pre-defined value based on the current video block size, dX is 1 . . . upHor−1, dY is 1 . . . upVer−1, and xHor are positions based on the upHor and yHor are positions based on the upVer.

16. The apparatus of claim 15 , wherein at least two blocks with different sizes share a matrix with a same size in the first intra mode.

17. The apparatus of claim 15 , wherein the reference samples are derived without invoking a reference sample filtering operation.

18. The apparatus of claim 17 , wherein the reference sample filtering operation is applied in a normal intra mode which is different from the first intra mode.

19. A non-transitory computer-readable storage medium storing instructions that cause a processor to:

determine, for a first conversion between a first video block of a video and a bitstream of the video, that a first intra mode is applied on the first video block of the video;

derive reference samples of the first video block;

perform a boundary downsampling operation on the reference samples of the first video block based on a size of the first video block, followed by a matrix vector multiplication operation, and selectively followed by an upsampling operation to generate prediction samples for the first video block; and

perform the first conversion based on the prediction samples for the first video block,

wherein elements of matrices or offset values applied in the matrix vector multiplication operation have a fixed precision,

wherein the fixed precision is an 8-bit precision, and

wherein the prediction samples are determined according to the following formulas in the upsampling operation:

predSamples[ x Hor+ dX][y Hor](((upHor− dX )*predSamples[ x Hor][ y Hor]+ dX *predSamples[ x Hor+upHor][ y Hor]+offsetHor)/upHor, and

predSamples[ x Ver][ y Ver+ dY ]=((upVer− dY )*predSamples[ x Ver][ y Ver]+ dY *predSamples[ x Ver][ y Ver+upVer]+offsetVer)/upVer,

wherein offsetHor and offsetVer are integers, upHor is a function of a current video block width and a pre-defined value based on a current video block size, upVer is a function of a current video block height and the pre-defined value based on the current video block size, dX is 1 . . . upHor−1, dY is 1 . . . upVer−1, and xHor are positions based on the upHor and yHor are positions based on the upVer.

20. A non-transitory computer-readable recording medium storing a bitstream of a video which is generated by a method performed by a video processing apparatus, wherein the method comprises:

determining that a first intra mode is applied on a first video block of the video;

deriving reference samples of the first video block;

performing a boundary downsampling operation on the reference samples of the first video block based on a size of the first video block, followed by a matrix vector multiplication operation, and selectively followed by an upsampling operation to generate prediction samples for the first video block; and

generating the bitstream based on the prediction samples for the first video block;

wherein elements of matrices or offset values applied in the matrix vector multiplication operation have a fixed precision,

wherein the fixed precision is an 8-bit precision, and

wherein the prediction samples are determined according to the following formulas in the upsampling operation:

predSamples[ x Hor+ dX][y Hor](((upHor− dX )*predSamples[ x Hor][ y Hor]+ dX *predSamples[ x Hor+upHor][ y Hor]+offsetHor)/upHor, and

predSamples[ x Ver][ y Ver+ dY ]=((upVer− dY )*predSamples[ x Ver][ y Ver]+ dY *predSamples[ x Ver][ y Ver+upVer]+offsetVer)/upVer,

wherein offsetHor and offsetVer are integers, upHor is a function of a current video block width and a pre-defined value based on a current video block size, upVer is a function of a current video block height and the pre-defined value based on the current video block size, dX is 1 . . . upHor−1, dY is 1 . . . upVer−1, and xHor are positions based on the upHor and yHor are positions based on the upVer.

Assignments (2)

Priority Claims (1)

Continuity (3)

References Cited (400)