Granted Patent B2

US 12,395,671 · App. 18/486,641 · Granted Aug 19, 2025

Inventors: Kai Zhang (San Diego, CA); Li Zhang (San Diego, CA); Hongbin Liu (Beijing, CN); Yue Wang (Beijing, CN)

Assignees: BEIJING BYTEDANCE NETWORK TECHNOLOGY CO., LTD.; BYTEDANCE INC.

H04N19/52H04N19/159H04N19/176H04N19/184H04N19/51H04N19/593

Abstract

Claims (59)

1. A method of processing video data, comprising:

determining that an intra block copy (IBC) mode is applied to a first video block of a video, wherein in the IBC mode, reference samples from a video region including the first video block are used; and

performing, based on the determining, a first conversion between the first video block and a bitstream of the video,

wherein the first video block is a block with a dual coding tree in which a luma component and chroma components are coded with separate separated coding structure trees,

wherein the method further comprises:

constructing, during a second conversion between a second video block of the video and the bitstream of the video, a motion candidate list for the second video block based on an affine motion candidate,

wherein the second conversion is performed based on the motion candidate list, and

wherein the affine motion candidate is derived based on a spatial neighboring block of the second video block, and wherein, in response to the spatial neighboring block being the first video block, the spatial neighboring block is excluded from deriving the affine motion candidate.

2. The method of claim 1 , further comprising making a decision regarding a disabling of a specific coding mode for the first video block.

3. The method of claim 2 , wherein a flag for the specific coding mode is not included in the bitstream in response to the IBC mode being used in the first video block, and wherein when the flag is not included in the bitstream, the flag is inferred to be zero.

4. The method of claim 2 , wherein the specific coding mode comprises a bi-prediction with CU-level weights mode, wherein in the bi-prediction with CU-level weights mode, different weighting values relate with different reference pictures in a prediction derivation process.

5. The method of claim 4 , wherein a weighting index of the bi-prediction with CU-level weights mode is not included in the bitstream in response to the IBC mode being used in the first video block, and

wherein when the weighting index is not included in the bitstream, the weighting index is inferred to be 0.

6. The method of claim 2 , wherein the specific coding mode comprises a merge with motion vector difference (MMVD) mode, wherein in the MMVD mode, a motion vector of a video block is derived based on a merge motion candidate list and is further refined by at least one motion vector offset, or

wherein the specific coding mode comprises an affine mode and a combined inter-intra prediction mode, wherein the affine mode uses at least one control point motion vector, and wherein in the combined inter-intra prediction mode, a final prediction is generated at least based on a weighted sum of an intermediate intra prediction signal and an intermediate inter prediction signal, or

wherein the specific coding mode comprises a sub-block based temporal motion vector prediction mode, and wherein in the sub-block based temporal motion vector prediction mode, motion information is derived based on a collocated region that is determined by at least one temporal motion offset.

7. The method of claim 1 , wherein before the performing, the method further comprises:

deriving a block vector for the first video block; and

using at least one block vector difference included in the bitstream to refine the block vector.

8. The method of claim 1 , wherein a width of the first video block is greater than or equal to 2 and a height is greater than or equal to 2.

9. The method of claim 1 , wherein the motion candidate list is a subblock merge candidate list.

10. The method of claim 9 , wherein the spatial neighboring block is treated as unavailable based on determining that the spatial neighboring block uses the IBC mode, and wherein the subblock merge candidate list is constructed further based on a subblock-based temporal motion vector prediction candidate.

11. The method of claim 10 , wherein constructing the subblock merge candidate list comprises adding of the subblock-based temporal motion vector prediction candidate is disabled in case that a temporal motion vector prediction tool is disabled or a subblock-based temporal motion vector prediction tool is disabled.

12. The method of claim 10 , wherein the subblock-based temporal motion vector prediction candidate is derived by:

initializing a temporal motion information to a default motion information;

setting, in response to a specific neighboring block which is adjacent to a lower left corner of the second video block being available and a reference picture of the specific neighboring block being a collocated picture of the second video block, the temporal motion information to specific motion information related to the specific neighboring block; and

deriving the subblock-based temporal motion vector prediction candidate based on the temporal motion information,

wherein the specific neighboring block covers a luma location (xCb−1, yCb+cbHeight−1), wherein (xCb,yCb) is a luma location of a top-left sample of the second video block relative to a top-left luma sample of a current picture and cbHeight is a height of the second video block.

13. The method of claim 1 , wherein the motion candidate list is a motion vector prediction candidate list, and wherein performing the second conversion based on the motion candidate list comprises deriving a motion information for the second video block based on the affine motion candidate and at least one motion vector difference which is used to refine the motion information, and

wherein the spatial neighboring block is treated as unavailable based on determining that the spatial neighboring block uses the IBC mode.

14. The method of claim 1 , wherein the second conversion comprises generating the bitstream from the second video block, and the method further comprises:

storing the bitstream in a non-transitory computer-readable recording medium.

15. The method of claim 1 , wherein the first conversion comprises decoding the first video block from the bitstream.

16. The method of claim 1 , wherein the first conversion comprises encoding the first video block into the bitstream.

17. An apparatus for processing video data comprising a processor and a non-transitory memory with instructions thereon, wherein the instructions upon execution by the processor, cause the processor to:

determine that an intra block copy (IBC) mode is applied to a first video block of a video, wherein in the IBC mode, reference samples from a video region including the first video block are used; and

perform, based on the determination, a first conversion between the first video block and a bitstream of the video,

wherein the first video block is a block with a dual coding tree in which a luma component and chroma components are coded with separate separated coding structure trees,

wherein the instructions upon execution by the processor, further cause the processor to:

construct, during a second conversion between a second video block of the video and the bitstream of the video, a motion candidate list for the second video block based on an affine motion candidate,

wherein the second conversion is performed based on the motion candidate list, and

wherein the affine motion candidate is derived based on a spatial neighboring block of the second video block, and wherein in response to the spatial neighboring block being the first video block, the spatial neighboring block is excluded from deriving the affine motion candidate.

18. A non-transitory computer-readable storage medium storing instructions that cause a processor to:

determine that an intra block copy (IBC) mode is applied to a first video block of a video, wherein in the IBC mode, reference samples from a video region including the first video block are used; and

perform, based on the determination, a first conversion between the first video block and a bitstream of the video,

wherein the first video block is a block with a dual coding tree in which a luma component and chroma components are coded with separate separated coding structure trees,

wherein the instructions further cause the processor to:

construct, during a second conversion between a second video block of the video and the bitstream of the video, a motion candidate list for the second video block based on an affine motion candidate,

wherein the second conversion is performed based on the motion candidate list, and

wherein the affine motion candidate is derived based on a spatial neighboring block of the second video block, and wherein in response to the spatial neighboring block being the first video block, the spatial neighboring block is excluded from deriving the affine motion candidate.

19. A method for storing a bitstream of a video, comprising:

determining that an intra block copy (IBC) mode is applied to a first video block of the video, wherein in the IBC mode, reference samples from a video region including the first video block are used; and

generating the bitstream from the first video block based on the determining,

storing the bitstream in a non-transitory computer-readable recording medium;

wherein the first video block is a block with a dual coding tree in which a luma component and chroma components are coded with separate coding structure trees,

wherein the method further comprises:

constructing a motion candidate list for a second video block based on an affine motion candidate,

generating the bitstream from the second video block based on the motion candidate list, and

wherein the affine motion candidate is derived based on a spatial neighboring block of the second video block, and wherein in response to the spatial neighboring block being the first video block, the spatial neighboring block is excluded from deriving the affine motion candidate.

Assignments (2)

Priority Claims (1)

Continuity (4)

References Cited (113)