High level syntax for inter prediction with geometric partitioning
A method of video processing is described. The method includes determining, for a conversion between a current video block of a video and a bitstream representation of the video, an applicability of a geometric partitioning mode based on a rule; and performing the conversion based on the determining, and wherein the rule depends on a block width, a block height, and/or an aspect ratio of the current video block.
1. A method of processing video data, comprising:
determining whether to enable a geometric partitioning mode for a current video block at least based on a first syntax element indicative of an application of a combined inter-picture merge and intra-picture prediction mode and a second syntax element indicative of an application of a regular merge mode; and
performing a conversion between the current video block of a video and a bitstream of the video,
wherein a geometric partitioning mode index for the current video block is coded in the bitstream and a binarization of the geometric partitioning mode index is performed according to a rule,
wherein the geometric partitioning mode index specifies a geometric splitting shape of the geometric partitioning mode applied to the current video block,
wherein the rule specifies that the geometric partitioning mode index is coded with a fixed-length binarization.
2. The method of claim 1 , wherein a splitting angle variable and a splitting distance variable are derived according to a value of the geometric partitioning mode index, which are used in a weighted sample prediction process in the geometric partitioning mode of the current video block.
3. The method of claim 2 , wherein in the geometric partitioning mode, a first motion information and a second motion information are determined, the weighted sample prediction process is performed to generate a final prediction for the current video block based on a weighted sum of prediction samples derived from the first motion information and the second motion information, and values of weights are derived based on the splitting angle variable and the splitting distance variable.
4. The method of claim 2 , wherein the geometric partitioning mode applied to the current video block is selected from a set of geometric partitioning modes,
wherein the geometric partitioning modes are computed using a set of splitting angles and a set of splitting distances for the set of splitting angles, and
wherein a number of splitting distances for a vertical splitting angle or a horizontal splitting angle in the set of splitting angles is equal to 2.
5. The method of claim 1 , wherein when a geometric partitioning mode index for a video block is not present in the bitstream, it is inferred to be equal to 0.
6. The method of claim 1 , wherein the geometric partitioning mode is disabled if the first syntax element indicates that the combined inter-picture merge and intra-picture prediction mode is applied or if the second syntax element indicates that the regular merge mode is applied.
7. The method of claim 3 , wherein the first motion information and the second motion information are determined as following:
constructing a merge candidate list that has L0 motion vectors and L1 motion vectors; and
determining the first motion information and the second motion information based on the merge candidate list, a parity of a first merge index and a parity of a second merge index,
wherein the first motion information and the second motion information are uni-prediction motion information.
8. The method of claim 1 , wherein the conversion includes encoding the video into the bitstream.
9. The method of claim 1 , wherein the conversion includes decoding the video from the bitstream.
10. An apparatus for processing video data comprising a processor and a non-transitory memory with instructions thereon, wherein the instructions upon execution by the processor, cause the processor to:
determine whether to enable a geometric partitioning mode for a current video block at least based on a first syntax element indicative of an application of a combined inter-picture merge and intra-picture prediction mode and a second syntax element indicative of an application of a regular merge mode; and
perform a conversion between the current video block of a video and a bitstream of the video,
wherein a geometric partitioning mode index for the current video block is coded in the bitstream and a binarization of the geometric partitioning mode index is performed according to a rule,
wherein the geometric partitioning mode index specifies a geometric splitting shape of the geometric partitioning mode applied to the current video block,
wherein the rule specifies that the geometric partitioning mode index is coded with a fixed-length binarization.
11. The apparatus of claim 10 , wherein a splitting angle variable and a splitting distance variable are derived according to a value of the geometric partitioning mode index, which are used in a weighted sample prediction process in the geometric partitioning mode of the current video block;
wherein in the geometric partitioning mode, a first motion information and a second motion information are determined, the weighted sample prediction process is performed to generate a final prediction for the current video block based on a weighted sum of prediction samples derived from the first motion information and the second motion information, and values of weights are derived based on the splitting angle variable and the splitting distance variable;
wherein the first motion information and the second motion information are determined as following:
constructing a merge candidate list that has L0 motion vectors and L1 motion vectors; and
determining the first motion information and the second motion information based on the merge candidate list, a parity of a first merge index and a parity of a second merge index,
wherein the first motion information and the second motion information are uni-prediction motion information;
wherein the geometric partitioning mode applied to the current video block is selected from a set of geometric partitioning modes,
wherein the geometric partitioning modes are computed using a set of splitting angles and a set of splitting distances for the set of splitting angles, and
wherein a number of splitting distances for a vertical splitting angle or a horizontal splitting angle in the set of splitting angles is equal to 2.
12. The apparatus of claim 10 , wherein when a geometric partitioning mode index for a video block is not present in the bitstream, it is inferred to be equal to 0.
13. The apparatus of claim 10 ,
wherein the geometric partitioning mode is disabled if the first syntax element indicates that the combined inter-picture merge and intra-picture prediction mode is applied or if the second syntax element indicates that the regular merge mode is applied.
14. A non-transitory computer-readable storage medium storing instructions that cause a processor to:
determine whether to enable a geometric partitioning mode for a current video block at least based on a first syntax element indicative of application of a combined inter-picture merge and intra-picture prediction mode and a second syntax element indicative of application of a regular merge mode; and
perform a conversion between the current video block of a video and a bitstream of the video,
wherein a geometric partitioning mode index for the current video block is coded in the bitstream and a binarization of the geometric partitioning mode index is performed according to a rule,
wherein the geometric partitioning mode index specifies a geometric splitting shape of the geometric partitioning mode applied to the current video block,
wherein the rule specifies that the geometric partitioning mode index is coded with a fixed-length binarization.
15. The non-transitory computer-readable storage medium of claim 14 , wherein a splitting angle variable and a splitting distance variable are derived according to a value of the geometric partitioning mode index, which are used in a weighted sample prediction process in the geometric partitioning mode of the current video block;
wherein in the geometric partitioning mode, a first motion information and a second motion information are determined, the weighted sample prediction process is performed to generate a final prediction for the current video block based on a weighted sum of prediction samples derived from the first motion information and the second motion information, and values of weights are derived based on the splitting angle variable and the splitting distance variable;
wherein the first motion information and the second motion information are determined as following:
constructing a merge candidate list that has L0 motion vectors and L1 motion vectors; and
determining the first motion information and the second motion information based on the merge candidate list, a parity of a first merge index and a parity of a second merge index,
wherein the first motion information and the second motion information are uni-prediction motion information;
wherein the geometric partitioning mode applied to the current video block is selected from a set of geometric partitioning modes,
wherein the geometric partitioning modes are computed using a set of splitting angles and a set of splitting distances for the set of splitting angles, and
wherein a number of splitting distances for a vertical splitting angle or a horizontal splitting angle in the set of splitting angles is equal to 2.
16. The non-transitory computer-readable storage medium of claim 14 , wherein when a geometric partitioning mode index for a video block is not present in the bitstream, it is inferred to be equal to 0;
and
wherein the geometric partitioning mode is disabled if the first syntax element indicates that the combined inter-picture merge and intra-picture prediction mode is applied or if the second syntax element indicates that the regular merge mode is applied.
17. A non-transitory computer-readable recording medium storing a bitstream of a video which is generated by a method performed by a video processing apparatus, wherein the method comprises:
determining whether to enable a geometric partitioning mode for a current video block at least based on a first syntax element indicative of application of a combined inter-picture merge and intra-picture prediction mode and a second syntax element indicative of application of a regular merge mode; and
generating the bitstream for the current video block of the video,
wherein a geometric partitioning mode index for the current video block is coded in the bitstream and a binarization of the geometric partitioning mode index is performed according to a rule,
wherein the geometric partitioning mode index specifies a geometric splitting shape of the geometric partitioning mode applied to the current video block,
wherein the rule specifies that the geometric partitioning mode index is coded with a fixed-length binarization.
18. The non-transitory computer-readable recording medium of claim 17 , wherein a splitting angle variable and a splitting distance variable are derived according to a value of the geometric partitioning mode index, which are used in a weighted sample prediction process in the geometric partitioning mode of the current video block;
wherein in the geometric partitioning mode, a first motion information and a second motion information are determined, the weighted sample prediction process is performed to generate a final prediction for the current video block based on a weighted sum of prediction samples derived from the first motion information and the second motion information, and values of weights are derived based on the splitting angle variable and the splitting distance variable;
wherein the first motion information and the second motion information are determined as following:
constructing a merge candidate list that has L0 motion vectors and L1 motion vectors; and
determining the first motion information and the second motion information based on the merge candidate list, a parity of a first merge index and a parity of a second merge index,
wherein the first motion information and the second motion information are uni-prediction motion information;
wherein the geometric partitioning mode applied to the current video block is selected from a set of geometric partitioning modes,
wherein the geometric partitioning modes are computed using a set of splitting angles and a set of splitting distances for the set of splitting angles, and
wherein a number of splitting distances for a vertical splitting angle or a horizontal splitting angle in the set of splitting angles is equal to 2.
19. The non-transitory computer-readable recording medium of claim 17 , wherein when a geometric partitioning mode index for a video block is not present in the bitstream, it is inferred to be equal to 0;
and
wherein the geometric partitioning mode is disabled if the first syntax element indicates that the combined inter-picture merge and intra-picture prediction mode is applied or if the second syntax element indicates that the regular merge mode is applied.