IP Library › Granted Patent US 11,991,397
Granted Patent B2
US 11,991,397 · App. 18/071,335 · Granted May 21, 2024

Palette mode with local dual tree modetype definition

Inventors: Zhipin Deng (Beijing, CN); Ye-kui Wang (San Diego, CA); Li Zhang (San Diego, CA); Kai Zhang (San Diego, CA)
Assignees: BEIJING BYTEDANCE NETWORK TECHNOLOGY CO., LTD.; BYTEDANCE INC.
H04N19/70H04N19/176H04N19/186H04N19/1883
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,991,397
App. No.
18/071,335
Granted
May 21, 2024
Kind
B2
Abstract

Methods, systems and apparatus for video processing are described. One example video processing method includes performing a conversion between a video comprising a video block and a bitstream of the video according to a rule, wherein the video block is a coding tree node that includes one or more coding units, and wherein the rule specifies that a coded information of the video block is indicative of whether a coding mode is enabled for the one or more coding units of the video block.

Claims (58)

1. A method of processing video data, comprising:

performing a conversion between a video comprising a video block and a bitstream of the video according to a rule,

wherein the video block is a coding tree node that includes one or more coding blocks,

wherein the rule specifies that one or more of the following coding modes are allowed to be used by one or more luma blocks of the one or more coding blocks: an intra prediction coding mode, an intra block copy (IBC) mode and a palette coding mode, and the intra prediction coding mode is applied to one or more chroma blocks of the one or more coding blocks, when a local dual tree is applied to the one or more coding blocks inside the coding tree node, and that an inter prediction coding mode is not allowed for the one or more coding blocks in the coding tree node to which the local dual tree is applied,

wherein the rule specifies that a presence of a first syntax element is at least based on that a value of a variable named mode type is MODE_TYPE_INTRA or MODE_TYPE_ALL, and in a case that the value of the variable named mode type is MODE_TYPE_INTER, the first syntax element is not present, and wherein the first syntax element indicates whether the palette coding mode is enabled for a coding block of the one or more coding blocks, and

wherein the rule further specifies that a third syntax element in a general constraint information syntax structure controls a value of a fourth syntax element in a sequence parameter set, wherein the fourth syntax element indicates whether subpicture information is present in a coded layer video sequence and whether more than one subpictures are included in each picture of the coded layer video sequence.

2. The method of claim 1 , wherein the rule specifies that more than one coding modes of the intra prediction coding mode, the IBC mode and the palette coding mode are allowed to be applied to multiple luma blocks, wherein the more than one coding modes comprise any two or more of the intra prediction coding mode, the IBC mode and the palette coding mode.

3. The method of claim 1 , wherein MODE_TYPE_INTER specifies that only the inter prediction coding mode is allowed to be used for the coding block;

wherein MODE_TYPE_INTRA specifies that only the intra prediction coding mode, the IBC mode and the palette coding mode are allowed to be used for the coding block; and

wherein MODE_TYPE_ALL specifies that the inter prediction coding mode, the intra prediction coding mode, the IBC mode and the palette coding mode are allowed to be used for the coding block.

4. The method of claim 1 , wherein the variable named mode type is based on a variable named modeTypeCondition and a second syntax element non_inter_flag indicating whether only the inter prediction coding mode is allowed.

5. The method of claim 1 , wherein MODE_TYPE_INTER, MODE_TYPE_INTRA and MODE_TYPE_ALL are also used in a partition process, and wherein the partition process includes at least one of a quad split process, a binary split process or a ternary split process.

6. The method of claim 1 , wherein the rule specifies that a fifth syntax element in a general constraint information syntax structure controls a value of a sixth syntax element in a sequence parameter set, wherein the sixth syntax element indicates whether a maximum transform size in luma samples is equal to 64.

7. The method of claim 1 , wherein the performing the conversion comprising encoding the video into the bitstream.

8. The method of claim 1 , wherein the performing the conversion comprises decoding the video from the bitstream.

9. An apparatus for processing video data comprising a processor and a non-transitory memory with instructions thereon, wherein the instructions upon execution by the processor, cause the processor to:

perform a conversion between a video comprising a video block and a bitstream of the video according to a rule,

wherein the video block is a coding tree node that includes one or more coding blocks,

wherein the rule specifies that one or more of the following coding modes are allowed to be used by one or more luma blocks of the one or more coding blocks: an intra prediction coding mode, an intra block copy (IBC) mode and a palette coding mode, and the intra prediction coding mode is applied to one or more chroma blocks of the one or more coding blocks, when a local dual tree is applied to the one or more coding blocks inside the coding tree node, and that an inter prediction coding mode is not allowed for the one or more coding blocks in the coding tree node to which the local dual tree is applied,

wherein the rule specifies that a presence of a first syntax element is at least based on that a value of a variable named mode type is MODE_TYPE_INTRA or MODE_TYPE_ALL, and in a case that the value of the variable named mode type is MODE_TYPE_INTER, the first syntax element is not present, and wherein the first syntax element indicates whether the palette coding mode is enabled for a coding block of the one or more coding blocks, and

wherein the rule further specifies that a third syntax element in a general constraint information syntax structure controls a value of a fourth syntax element in a sequence parameter set, wherein the fourth syntax element indicates whether subpicture information is present in a coded layer video sequence and whether more than one subpictures are included in each picture of the coded layer video sequence.

10. The apparatus of claim 9 , wherein the rule specifies that more than one coding modes of the intra prediction coding mode, the IBC mode and the palette coding mode are allowed to be applied to multiple luma blocks, wherein the more than one coding modes comprise any two or more of the intra prediction coding mode, the IBC mode and the palette coding mode.

11. The apparatus of claim 9 , wherein MODE_TYPE_INTER specifies that only the inter prediction coding mode is allowed to be used for the coding block,

wherein MODE_TYPE_INTRA specifies that only the intra prediction coding mode, the IBC mode and the palette coding mode are allowed to be used for the coding block,

wherein MODE_TYPE_ALL specifies that the inter prediction coding mode, the intra prediction coding mode, the IBC mode and the palette coding mode are allowed to be used for the coding block,

and

wherein MODE_TYPE_INTER, MODE_TYPE_INTRA and MODE_TYPE_ALL are also used in a partition process, and wherein the partition process includes at least one of a quad split process, a binary split process or a ternary split process.

12. A non-transitory computer-readable storage medium storing instructions that cause a processor to:

perform a conversion between a video comprising a video block and a bitstream of the video according to a rule,

wherein the video block is a coding tree node that includes one or more coding blocks,

wherein the rule specifies that one or more of the following coding modes are allowed to be used by one or more luma blocks of the one or more coding blocks: an intra prediction coding mode, an intra block copy (IBC) mode and a palette coding mode, and the intra prediction coding mode is applied to one or more chroma blocks of the one or more coding blocks, when a local dual tree is applied to the one or more coding blocks inside the coding tree node, and that an inter prediction coding mode is not allowed for the one or more coding blocks in the coding tree node to which the local dual tree is applied,

wherein the rule specifies that a presence of a first syntax element is at least based on that a value of a variable named mode type is MODE_TYPE_INTRA or MODE_TYPE_ALL, and in a case that the value of the variable named mode type is MODE_TYPE_INTER, the first syntax element is not present, and wherein the first syntax element indicates whether the palette coding mode is enabled for a coding block of the one or more coding blocks, and

wherein the rule further specifies that a third syntax element in a general constraint information syntax structure controls a value of a fourth syntax element in a sequence parameter set, wherein the fourth syntax element indicates whether subpicture information is present in a coded layer video sequence and whether more than one subpictures are included in each picture of the coded layer video sequence.

13. The non-transitory computer-readable storage medium of claim 12 , wherein the rule specifies that more than one coding modes of the intra prediction coding mode, the IBC mode and the palette coding mode are allowed to be applied to multiple luma blocks, wherein the more than one coding modes comprise any two or more of the intra prediction coding mode, the IBC mode and the palette coding mode,

wherein MODE_TYPE_INTER specifies that only the inter prediction coding mode is allowed to be used for the coding block,

wherein MODE_TYPE_INTRA specifies that only the intra prediction coding mode, the IBC mode and the palette coding mode are allowed to be used for the coding block,

wherein MODE_TYPE_ALL specifies that the inter prediction coding mode, the intra prediction coding mode, the IBC mode and the palette coding mode are allowed to be used for the coding block,

and

wherein MODE_TYPE_INTER, MODE_TYPE_INTRA and MODE_TYPE_ALL are also used in a partition process, and wherein the partition process includes at least one of a quad split process, a binary split process or a ternary split process.

14. A non-transitory computer-readable recording medium storing a bitstream of a video which is generated by a method performed by a video processing apparatus, wherein the method comprises:

generating the bitstream of the video comprising a video block according to a rule,

wherein the video block is a coding tree node that includes one or more coding blocks,

wherein the rule specifies that one or more of the following coding modes are allowed to be used by one or more luma blocks of the one or more coding blocks: an intra prediction coding mode, an intra block copy (IBC) mode and a palette coding mode, and the intra prediction coding mode is applied to one or more chroma blocks of the one or more coding blocks, when a local dual tree is applied to the one or more coding blocks inside the coding tree node, and that an inter prediction coding mode is not allowed for the one or more coding blocks in the coding tree node to which the local dual tree is applied,

wherein the rule specifies that a presence of a first syntax element is at least based on that a value of a variable named mode type is MODE_TYPE_INTRA or MODE_TYPE_ALL, and in a case that the value of the variable named mode type is MODE_TYPE_INTER, the first syntax element is not present, and wherein the first syntax element indicates whether the palette coding mode is enabled for a coding block of the one or more coding blocks, and

wherein the rule further specifies that a third syntax element in a general constraint information syntax structure controls a value of a fourth syntax element in a sequence parameter set, wherein the fourth syntax element indicates whether subpicture information is present in a coded layer video sequence and whether more than one subpictures are included in each picture of the coded layer video sequence.

15. The non-transitory computer-readable recording medium of claim 14 , wherein the rule specifies that more than one coding modes of the intra prediction coding mode, the IBC mode and the palette coding mode are allowed to be applied to multiple luma blocks, wherein the more than one coding modes comprise any two or more of the intra prediction coding mode, the IBC mode and the palette coding mode,

wherein MODE_TYPE_INTER specifies that only the inter prediction coding mode is allowed to be used for the coding block,

wherein MODE_TYPE_INTRA specifies that only the intra prediction coding mode, the IBC mode and the palette coding mode are allowed to be used for the coding block,

wherein MODE_TYPE_ALL specifies that the inter prediction coding mode, the intra prediction coding mode, the IBC mode and the palette coding mode are allowed to be used for the coding block,

wherein the variable named mode type is based on a variable named modeTypeCondition and a second syntax element non_inter_flag indicating whether only the inter prediction coding mode is allowed, and

wherein MODE_TYPE_INTER, MODE_TYPE_INTRA and MODE_TYPE_ALL are also used in a partition process, and wherein the partition process includes at least one of a quad split process, a binary split process or a ternary split process.

16. The non-transitory computer-readable recording medium of claim 14 ,

wherein the rule specifies that a fifth syntax element in the general constraint information syntax structure controls a value of a sixth syntax element in a sequence parameter set, wherein the sixth syntax element indicates whether a maximum transform size in luma samples is equal to 64.

17. The non-transitory computer-readable storage medium of claim 12 ,

wherein the rule specifies that a fifth syntax element in the general constraint information syntax structure controls a value of a sixth syntax element in a sequence parameter set, wherein the sixth syntax element indicates whether a maximum transform size in luma samples is equal to 64.

18. The apparatus of claim 9 , wherein the rule specifies that a fifth syntax element in a general constraint information syntax structure controls a value of a sixth syntax element in a sequence parameter set, and wherein the sixth syntax element indicates whether a maximum transform size in luma samples is equal to 64.

19. The apparatus of claim 9 , wherein the variable named mode type is based on a variable named modeTypeCondition and a second syntax element non_inter_flag indicating whether only the inter prediction coding mode is allowed.

20. The non-transitory computer-readable storage medium of claim 12 , wherein the variable named mode type is based on a variable named modeTypeCondition and a second syntax element non_inter_flag indicating whether only the inter prediction coding mode is allowed.

Assignments (3)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 19, 2022
From: BEIJING ZITIAO NETWORK TECHNOLOGY CO., LTD.
To: BEIJING BYTEDANCE NETWORK TECHNOLOGY CO., LTD.
Reel/Frame 062144/0940 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 3, 2022
From: WANG, YE-KUI; ZHANG, LI; ZHANG, KAI
To: BYTEDANCE INC.
Reel/Frame 061964/0150 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 3, 2022
From: DENG, ZHIPIN
To: BEIJING ZITIAO NETWORK TECHNOLOGY CO., LTD.
Reel/Frame 062054/0396 →
Continuity (2)
Continuation PCTCN2021096707 · May 28, 2021
Related Publication 20230111806A1 · Apr 13, 2023
Cited By (1)
US 12,395,682