Granted Patent B2

US 11,095,917 · App. 17/167,303 · Granted Aug 17, 2021

Inventors: Kai Zhang (San Diego, CA); Li Zhang (San Diego, CA); Hongbin Liu (Beijing, CN); Yue Wang (Beijing, CN)

Assignees: BEIJING BYTEDANCE NETWORK TECHNOLOGY CO., LTD.; BYTEDANCE INC.

H04N19/52H04N19/159H04N19/176H04N19/184H04N19/51H04N19/593

Abstract

Claims (54)

1. A method for coding video data, comprising:

constructing, during a conversion between a current video block of a video and a bitstream of the video, a motion candidate list for the current video block based on an affine motion candidate;

performing the conversion based on the motion candidate list;

wherein the affine motion candidate is derived based on a spatial neighboring block of the current video block, and wherein in response to the spatial neighboring block using an intra block copy (IBC) mode in which reference samples from a video region including the spatial neighboring block are used, the spatial neighboring block is excluded from deriving the affine motion candidate,

wherein the motion candidate list is a subblock merge candidate list,

wherein the subblock merge candidate list is constructed further based on a subblock-based temporal motion vector prediction candidate,

wherein the subblock-based temporal motion vector prediction candidate is derived by:

initializing a temporal motion information to a default motion information;

setting, in response to a specific neighboring block which is adjacent to the current video block being available and a reference picture of the specific neighboring block being a collocated picture of the current video block, the temporal motion information to specific motion information related to the specific neighboring block; and

deriving the subblock-based temporal motion vector prediction candidate based on the temporal motion information.

2. The method of claim 1 , wherein the spatial neighboring block is treated as unavailable based on determining that the spatial neighboring block uses the IBC mode.

3. The method of claim 1 , wherein constructing the subblock merge candidate list comprises:

adding of the subblock-based temporal motion vector prediction candidate is disabled in case that a temporal motion vector prediction tool is disabled or a subblock-based temporal motion vector prediction tool is disabled.

4. The method of claim 1 , wherein the specific neighboring block is adjacent to a lower left corner of the current video block.

5. The method of claim 4 , wherein the specific neighboring block covers a luma location (xCb−1, yCb+cbHeight−1), wherein (xCb,yCb) is a luma location of the top-left sample of the current block relative to the top-left luma sample of the current picture and cbHeight is a height of the current block.

6. The method of claim 1 , wherein the motion candidate list is a motion vector prediction candidate list, and wherein performing the conversion based on the motion candidate list comprises deriving a motion information for the current video block based on the affine motion candidate and at least one motion vector difference which is used to refine the motion information.

7. The method of claim 6 , wherein the spatial neighboring block is treated as unavailable based on determining that the spatial neighboring block uses the IBC mode.

8. The method of claim 1 , wherein the conversion comprises decoding the current video block from the bitstream.

9. The method of claim 1 , wherein the conversion comprises encoding the current video block into the bitstream.

10. The method of claim 1 , wherein the conversion comprises generating the bitstream from the current video block; and the method further comprises:

storing the bitstream in a non-transitory computer-readable recording medium.

11. An apparatus for processing video data comprising a processor and a non-transitory memory with instructions thereon, wherein the instructions upon execution by the processor, cause the processor to:

construct, during a conversion between a current video block of a video and a bitstream of the video, a motion candidate list for the current video block based on an affine motion candidate;

perform the conversion based on the motion candidate list;

wherein the affine motion candidate is derived based on a spatial neighboring block of the current video block, and wherein in response to the spatial neighboring block using an intra block copy (IBC) mode in which reference samples from a video region including the spatial neighboring block are used, the spatial neighboring block is excluded from deriving the affine motion candidate,

wherein the motion candidate list is a subblock merge candidate list,

wherein the subblock merge candidate list is constructed further based on a subblock-based temporal motion vector prediction candidate,

wherein the subblock-based temporal motion vector prediction candidate is derived by:

initializing a temporal motion information to a default motion information;

setting, in response to a specific neighboring block which is adjacent to the current video block being available and a reference picture of the specific neighboring block being a collocated picture of the current video block, the temporal motion information to specific motion information related to the specific neighboring block; and

deriving the subblock-based temporal motion vector prediction candidate based on the temporal motion information.

12. The apparatus of claim 11 , wherein constructing the subblock merge candidate list comprises:

adding of the subblock-based temporal motion vector prediction candidate is disabled in case that a temporal motion vector prediction tool is disabled or a subblock-based temporal motion vector prediction tool is disabled.

13. The apparatus of claim 11 , wherein the motion candidate list is a motion vector prediction candidate list, and wherein performing the conversion based on the motion candidate list comprises deriving a motion information for the current video block based on the affine motion candidate and at least one motion vector difference which is used to refine the motion information.

14. A non-transitory computer-readable recording medium storing a bitstream of a video which is generated by a method performed by a video processing apparatus, wherein the method comprises:

constructing, during a conversion between a current video block of a video and a bitstream of the video, a motion candidate list for the current video block based on an affine motion candidate;

generating the bitstream from the current video block based on the motion candidate list;

wherein the affine motion candidate is derived based on a spatial neighboring block of the current video block, and wherein in response to the spatial neighboring block using an intra block copy (IBC) mode in which reference samples from a video region including the spatial neighboring block are used, the spatial neighboring block is excluded from deriving the affine motion candidate,

wherein the motion candidate list is a subblock merge candidate list,

wherein the subblock merge candidate list is constructed further based on a subblock-based temporal motion vector prediction candidate,

wherein the subblock-based temporal motion vector prediction candidate is derived by:

initializing a temporal motion information to a default motion information;

setting, in response to a specific neighboring block which is adjacent to the current video block being available and a reference picture of the specific neighboring block being a collocated picture of the current video block, the temporal motion information to specific motion information related to the specific neighboring block; and

deriving the subblock-based temporal motion vector prediction candidate based on the temporal motion information.

15. A non-transitory computer-readable storage medium storing instructions that cause a processor to:

construct, during a conversion between a current video block of a video and a bitstream of the video, a motion candidate list for the current video block based on an affine motion candidate;

perform the conversion based on the motion candidate list;

wherein the affine motion candidate is derived based on a spatial neighboring block of the current video block, and wherein in response to the spatial neighboring block using an intra block copy (IBC) mode in which reference samples from a video region including the spatial neighboring block are used, the spatial neighboring block is excluded from deriving the affine motion candidate,

wherein the motion candidate list is a subblock merge candidate list,

wherein the subblock merge candidate list is constructed further based on a subblock-based temporal motion vector prediction candidate,

wherein the subblock-based temporal motion vector prediction candidate is derived by:

initializing a temporal motion information to a default motion information;

setting, in response to a specific neighboring block which is adjacent to the current video block being available and a reference picture of the specific neighboring block being a collocated picture of the current video block, the temporal motion information to specific motion information related to the specific neighboring block; and

deriving the subblock-based temporal motion vector prediction candidate based on the temporal motion information.

Assignments (2)

Priority Claims (1)

Continuity (2)

Cited By (13)

US 12,192,459 US 12,301,799 US 12,335,531 US 12,348,761 US 12,388,989 US 12,395,671 US 12,413,714 US 12,457,327 US 12,513,291 US 12,621,450 US 12,641,248 US 12,666,047 US 12,701,217