Neighbor based partitioning constraints
Systems, methods, apparatus for video processing are described. A video processing method includes determining, for a conversion between a current block of a video and a bitstream of the video, whether or which a partitioning scheme is enabled for coding of the current block according to a rule, and performing the conversion based on the determining. The rule is based on one or more neighboring blocks of the current block.
1 . A method for processing video data, comprising:
determining whether a partitioning scheme is enabled for a current block based on a rule associated with one or more neighboring samples or blocks of the current block; and
performing a conversion between a video comprising the current block and a bitstream based on the determining;
wherein a neighboring block of the one or more neighboring blocks is set to be unavailable if one or more conditions are not satisfied,
wherein the one or more conditions comprises at least one of: the current block being coded before the neighboring block, the current block being in a different coding tree unit (CTU) row from the neighboring block, the current block being in a different virtual pipeline data unit (VPDU) from the neighboring block, the current block being in a different subpicture from the neighboring block, the current block being in a different slice from the neighboring block, the current block being in a different tile from the neighboring block, the current block being in a different brick from the neighboring block;
wherein the rule specifies that in a case that the neighboring block is unavailable, information from the neighboring block is disallowed to be used to determine whether the partitioning scheme is enabled.
2 . The method of claim 1 , wherein the rule specifies that whether the partitioning scheme is enabled for the current block is based on information of the one or more neighboring samples or blocks of the current block.
3 . The method of claim 1 , wherein the one or more neighboring blocks of the current block comprise at least one of: a neighboring block or sub-block covering a neighboring sample located on a top side of a top-left sample of the current block, a neighboring block or sub-block covering a neighboring sample located on a top side of a top-right sample of the current block, a neighboring block or sub-block covering a neighboring sample located on a left side of the top-left sample of the current block, or a neighboring block or sub-block covering a neighboring sample located on a left side of a bottom-left sample of the current block.
4 . The method of claim 1 , wherein the one or more neighboring samples or blocks are adjacent or non-adjacent to the current block;
wherein the one or more neighboring samples or blocks are in a current picture including the current block or a picture different from the current picture including the current block.
5 . The method of claim 1 , wherein the rule indicates that when a constraint is applied the partitioning scheme is disabled for the current block, and wherein the constraint is applied in a case that a relationship between at least two neighboring samples or blocks of the one or more neighboring samples or blocks satisfies at least one condition.
6 . The method of claim 5 , wherein whether the constraint is applied or not is based on at least one of a width of the current block, a height of the current block, or a top-left coordinate position of the current block.
7 . The method of claim 5 , wherein whether the constraint is applied or not is based on whether at least two neighboring blocks of the one or more neighboring blocks are in a same coding unit;
wherein the at least two neighboring blocks comprises a neighboring block or sub-block covering a neighboring sample located on a top side of a top-left sample of the current block and a neighboring block or sub-block covering a neighboring sample located on a top side of a top-right sample of the current block, or
wherein the at least two neighboring blocks comprises a neighboring block or sub-block covering a neighboring sample located on a left side of a top-left sample of the current block and a neighboring block or sub-block covering a neighboring sample located on a left side of a bottom-left sample of the current block.
8 . The method of claim 5 , wherein whether the constraint is applied or not is based on whether a first two neighboring blocks of the one or more neighboring blocks are in a first common coding unit and whether a second two neighboring blocks of the one or more neighboring blocks are in a second common coding unit;
wherein the first common coding unit and the second common coding unit are different coding units; and
wherein the first two neighboring blocks comprises a neighboring block or sub-block covering a neighboring sample located on a top side of a top-left sample of the current block and a neighboring block or sub-block covering a neighboring sample located on a top side of a top-right sample of the current block, and the second two neighboring blocks comprises a neighboring block or sub-block covering a neighboring sample located on a left side of the top-left sample of the current block and a neighboring block or sub-block covering a neighboring sample located on a left side of a bottom-left sample of the current block.
9 . The method of claim 5 , wherein whether the constraint is applied or not is based on a number N of coding units covering a range of neighboring samples of the current block, wherein N is an integer.
10 . The method of claim 5 , wherein the partitioning scheme comprises at least one of: a binary tree (BT), a triple tree (TT), an unsymmetric binary tree (UBT), an unsymmetrical quad-tree (UQT), an extended ternary-tree (ETT), a vertical BT, a horizontal BT, a vertical TT, a horizontal TT, a vertical UBT, a horizontal UBT, a vertical ETT, or a horizontal ETT.
11 . The method of claim 5 , wherein whether a syntax element for indicating the partitioning scheme for the current block is present in the bitstream is dependent on the constraint.
12 . The method of claim 5 , wherein whether the constraint is applied or not is dependent on sequence-level information or picture-level information or slice-level information or coding tree unit-level information of the current block and/or information of a neighboring block of the current block.
13 . The method of claim 1 , wherein the rule is based on a color component of the current block.
14 . The method of claim 1 , wherein the conversion comprises decoding the video from the bitstream.
15 . The method of claim 1 , wherein the conversion comprises encoding the video into the bitstream.
16 . An apparatus for processing video data comprising a processor and a non-transitory memory with instructions thereon, wherein the instructions upon execution by the processor, cause the processor to:
determine whether a partitioning scheme is enabled for a current block based on a rule associated with one or more neighboring samples or blocks of the current block; and
perform a conversion between a video comprising the current block and a bitstream based on the determination;
wherein a neighboring block of the one or more neighboring blocks is set to be unavailable if one or more conditions are not satisfied, wherein the one or more conditions comprises at least one of: the current block being coded before the neighboring block, the current block being in a different coding tree unit (CTU) row from the neighboring block, the current block being in a different virtual pipeline data unit (VPDU) from the neighboring block, the current block being in a different subpicture from the neighboring block, the current block being in a different slice from the neighboring block, the current block being in a different tile from the neighboring block, the current block being in a different brick from the neighboring block;
wherein the rule specifies that in a case that the neighboring block is unavailable, information from the neighboring block is disallowed to be used to determine whether the partitioning scheme is enabled.
17 . The apparatus of claim 16 , wherein the rule specifies that whether the partitioning scheme is enabled for the current block is based on information of the one or more neighboring samples or blocks of the current block;
wherein the one or more neighboring blocks of the current block comprise at least one of: a neighboring block or sub-block covering a neighboring sample located on a top side of a top-left sample of the current block, a neighboring block or sub-block covering a neighboring sample located on a top side of a top-right sample of the current block, a neighboring block or sub-block covering a neighboring sample located on a left side of the top-left sample of the current block, or a neighboring block or sub-block covering a neighboring sample located on a left side of a bottom-left sample of the current block;
wherein the one or more neighboring samples or blocks are adjacent or non-adjacent to the current block;
wherein the one or more neighboring samples or blocks are in a current picture including the current block or a picture different from the current picture including the current block;
wherein the rule indicates that when a constraint is applied the partitioning scheme is disabled for the current block, and wherein the constraint is applied in a case that a relationship between at least two neighboring samples or blocks of the one or more neighboring samples or blocks satisfies at least one condition;
wherein whether the constraint is applied or not is based on at least one of a width of the current block, a height of the current block, or a top-left coordinate position of the current block;
wherein whether the constraint is applied or not is based on whether at least two neighboring blocks of the one or more neighboring blocks are in a same coding unit, wherein the at least two neighboring blocks comprises a neighboring block or sub-block covering a neighboring sample located on a top side of a top-left sample of the current block and a neighboring block or sub-block covering a neighboring sample located on a top side of a top-right sample of the current block, or wherein the at least two neighboring blocks comprises a neighboring block or sub-block covering a neighboring sample located on a left side of a top-left sample of the current block and a neighboring block or sub-block covering a neighboring sample located on a left side of a bottom-left sample of the current block;
wherein whether the constraint is applied or not is based on whether a first two neighboring blocks of the one or more neighboring blocks are in a first common coding unit and whether a second two neighboring blocks of the one or more neighboring blocks are in a second common coding unit; wherein the first common coding unit and the second common coding unit are different coding units; and wherein the first two neighboring blocks comprises a neighboring block or sub-block covering a neighboring sample located on a top side of a top-left sample of the current block and a neighboring block or sub-block covering a neighboring sample located on a top side of a top-right sample of the current block, and the second two neighboring blocks comprises a neighboring block or sub-block covering a neighboring sample located on a left side of the top-left sample of the current block and a neighboring block or sub-block covering a neighboring sample located on a left side of a bottom-left sample of the current block;
wherein whether the constraint is applied or not is based on a number N of coding units covering a range of neighboring samples of the current block, wherein N is an integer;
wherein the partitioning scheme comprises at least one of: a binary tree (BT), a triple tree (TT), an unsymmetric binary tree (UBT), an unsymmetrical quad-tree (UQT), an extended ternary-tree (ETT), a vertical BT, a horizontal BT, a vertical TT, a horizontal TT, a vertical UBT, a horizontal UBT, a vertical ETT, or a horizontal ETT;
wherein whether a syntax element for indicating the partitioning scheme for the current block is present in the bitstream is dependent on the constraint;
wherein whether the constraint is applied or not is dependent on sequence-level information or picture-level information or slice-level information or coding tree unit-level information of the current block and/or information of a neighboring block of the current block; and
wherein the rule is based on a color component of the current block.
18 . A method for storing a bitstream of a video, comprising:
determining whether a partitioning scheme is enabled for a current block based on a rule associated with one or more neighboring samples or blocks of the current block; and
generating the bitstream based on the determining;
storing the bitstream in a non-transitory computer-readable recording medium;
wherein a neighboring block of the one or more neighboring blocks is set to be unavailable if one or more conditions are not satisfied, wherein the one or more conditions comprises at least one of: the current block being coded before the neighboring block, the current block being in a different coding tree unit (CTU) row from the neighboring block, the current block being in a different virtual pipeline data unit (VPDU) from the neighboring block, the current block being in a different subpicture from the neighboring block, the current block being in a different slice from the neighboring block, the current block being in a different tile from the neighboring block, the current block being in a different brick from the neighboring block;
wherein the rule specifies that in a case that the neighboring block is unavailable, information from the neighboring block is disallowed to be used to determine whether the partitioning scheme is enabled.
19 . The method of claim 18 , wherein the rule specifies that whether the partitioning scheme is enabled for the current block is based on information of the one or more neighboring samples or blocks of the current block;
wherein the one or more neighboring blocks of the current block comprise at least one of: a neighboring block or sub-block covering a neighboring sample located on a top side of a top-left sample of the current block, a neighboring block or sub-block covering a neighboring sample located on a top side of a top-right sample of the current block, a neighboring block or sub-block covering a neighboring sample located on a left side of the top-left sample of the current block, or a neighboring block or sub-block covering a neighboring sample located on a left side of a bottom-left sample of the current block;
wherein the one or more neighboring samples or blocks are adjacent or non-adjacent to the current block;
wherein the one or more neighboring samples or blocks are in a current picture including the current block or a picture different from the current picture including the current block;
wherein the rule indicates that when a constraint is applied the partitioning scheme is disabled for the current block, and wherein the constraint is applied in a case that a relationship between at least two neighboring samples or blocks of the one or more neighboring samples or blocks satisfies at least one condition;
wherein whether the constraint is applied or not is based on at least one of a width of the current block, a height of the current block, or a top-left coordinate position of the current block;
wherein whether the constraint is applied or not is based on whether at least two neighboring blocks of the one or more neighboring blocks are in a same coding unit, wherein the at least two neighboring blocks comprises a neighboring block or sub-block covering a neighboring sample located on a top side of a top-left sample of the current block and a neighboring block or sub-block covering a neighboring sample located on a top side of a top-right sample of the current block, or wherein the at least two neighboring blocks comprises a neighboring block or sub-block covering a neighboring sample located on a left side of a top-left sample of the current block and a neighboring block or sub-block covering a neighboring sample located on a left side of a bottom-left sample of the current block;
wherein whether the constraint is applied or not is based on whether a first two neighboring blocks of the one or more neighboring blocks are in a first common coding unit and whether a second two neighboring blocks of the one or more neighboring blocks are in a second common coding unit; wherein the first common coding unit and the second common coding unit are different coding units; and wherein the first two neighboring blocks comprises a neighboring block or sub-block covering a neighboring sample located on a top side of a top-left sample of the current block and a neighboring block or sub-block covering a neighboring sample located on a top side of a top-right sample of the current block, and the second two neighboring blocks comprises a neighboring block or sub-block covering a neighboring sample located on a left side of the top-left sample of the current block and a neighboring block or sub-block covering a neighboring sample located on a left side of a bottom-left sample of the current block;
wherein whether the constraint is applied or not is based on a number N of coding units covering a range of neighboring samples of the current block, wherein N is an integer;
wherein the partitioning scheme comprises at least one of: a binary tree (BT), a triple tree (TT), an unsymmetric binary tree (UBT), an unsymmetrical quad-tree (UQT), an extended ternary-tree (ETT), a vertical BT, a horizontal BT, a vertical TT, a horizontal TT, a vertical UBT, a horizontal UBT, a vertical ETT, or a horizontal ETT;
wherein whether a syntax element for indicating the partitioning scheme for the current block is present in the bitstream is dependent on the constraint;
wherein whether the constraint is applied or not is dependent on sequence-level information or picture-level information or slice-level information or coding tree unit-level information of the current block and/or information of a neighboring block of the current block; and
wherein the rule is based on a color component of the current block.