IP Library › Granted Patent US 11,722,660
Granted Patent B2
US 11,722,660 · App. 17/719,708 · Granted Aug 8, 2023

Interplay between reference picture resampling and video coding tools

Inventors: Kai Zhang (San Diego, CA); Li Zhang (San Diego, CA); Hongbin Liu (Beijing, CN)
Assignees: BEIJING BYTEDANCE NETWORK TECHNOLOGY CO., LTD; BYTEDANCE INC.
H04N19/105H04N19/132H04N19/137H04N19/176H04N19/46
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,722,660
App. No.
17/719,708
Granted
Aug 8, 2023
Kind
B2
Abstract

An example method of video processing includes determining, for a conversion between a current block of a current picture of a video and a bitstream of the video, whether to disable a coding tool for the current block; and performing the conversion based on the determining, wherein the coding tool is disabled when a dimension of a reference picture of one or more reference pictures of the current block is different from a dimension of the current picture, or a dimension of a scaling window in a reference picture of one or more reference pictures of the current block is different from a dimension of a scaling window in the current picture.

Claims (45)

1. A method of video processing, comprising:

determining, for a conversion between a current block of a current picture of a video and a bitstream of the video, whether to disable a refinement coding tool for refining a motion vector or a prediction sample for the current block by an offset value; and

performing the conversion based on the determining,

wherein the refinement coding tool is disabled when a dimension of a reference picture of one or more reference pictures of the current block is different from a dimension of the current picture, or a dimension of a scaling window in a reference picture of one or more reference pictures of the current block is different from a dimension of a scaling window in the current picture.

2. The method of claim 1 , wherein the refinement coding tool comprises a first refinement coding tool, and

wherein the first refinement coding tool refines a signaled motion vector based on at least one motion vector with an offset to the signaled motion vector.

3. The method of claim 1 , wherein the refinement coding tool comprises a second refinement coding tool, and

wherein the second refinement coding tool obtains a motion vector refinement based on at least one gradient value corresponding to a sample in a reference block of the current block.

4. The method of claim 1 , wherein an affine mode is applied to the current block and initial prediction samples of a sub-block of the current block are generated,

wherein the refinement coding tool comprises a third refinement coding tool,

wherein the third refinement coding tool is applied to generate final prediction samples for the sub-block by deriving a prediction refinement based on motion vector differences dMvH and/or dMvV, and

wherein dMvH and dMvV indicate motion vector differences along a horizontal direction and a vertical direction.

5. The method of claim 4 , wherein the third refinement coding tool is disabled for a first reference picture list of the current block when a dimension of a reference picture in the first reference picture list is different from a dimension of the current picture, or a dimension of a scaling window in a reference picture in the first reference picture list is different from a dimension of a scaling window in the current picture, and

wherein the third refinement coding tool is disabled for a second reference picture list of the current block when a dimension of a reference picture in the second reference picture list is different from a dimension of the current picture, or a dimension of a scaling window in a reference picture in the second reference picture list is different from a dimension of a scaling window in the current picture.

6. The method of claim 1 , wherein whether the refinement coding tool is disabled is determined based on values of one or more flags associated with the one or more reference pictures respectively.

7. The method of claim 6 , wherein when a dimension of a reference picture in a first reference picture list of the current block is different from a dimension of the current picture, or a dimension of a scaling window in a reference picture in a first reference picture list of the current block is different from a dimension of a scaling window in the current picture, a value of a first flag is set to be unequal to 0, and

when a dimension of a reference picture in a second reference picture list of the current block is different from a dimension of the current picture, or a dimension of a scaling window in a reference picture in a second reference picture list of the current block is different from a dimension of a scaling window in the current picture, a value of a second flag is set to be unequal to 0.

8. The method of claim 6 , wherein the one or more flags are derived during a reference picture list construction process.

9. The method of claim 1 , wherein a dimension of a scaling window is determined based on at least one of a left offset associated with the scaling window, a right offset associated with the scaling window, a bottom offset associated with the scaling window, or a top offset associated with the scaling window.

10. The method of claim 1 , wherein an adaptive motion vector resolution is enabled for the current block when a dimension of a reference picture of one or more reference pictures of the current block is different from a dimension of the current picture, or a dimension of a scaling window in a reference picture of one or more reference pictures of the current block is different from a dimension of a scaling window in the current picture.

11. The method of claim 1 , wherein the conversion includes encoding the current picture into the bitstream.

12. The method of claim 1 , wherein the conversion includes decoding the current picture from the bitstream.

13. An apparatus for processing video data comprising a processor and a non-transitory memory with instructions thereon, wherein the instructions upon execution by the processor, cause the processor to:

determine, for a conversion between a current block of a current picture of a video and a bitstream of the video, whether to disable a refinement coding tool for refining a motion vector or a prediction sample for the current block by an offset value; and

perform the conversion based on the determining,

wherein the refinement coding tool is disabled when a dimension of a reference picture of one or more reference pictures of the current block is different from a dimension of the current picture, or a dimension of a scaling window in a reference picture of one or more reference pictures of the current block is different from a dimension of a scaling window in the current picture.

14. The apparatus of claim 13 , wherein the refinement coding tool comprises a first refinement coding tool, and

wherein the first refinement coding tool refines a signaled motion vector based on at least one motion vector with an offset to the signaled motion vector.

15. The apparatus of claim 13 , wherein the refinement coding tool comprises a second refinement coding tool, and

wherein the second refinement coding tool obtains a motion vector refinement based on at least one gradient value corresponding to a sample in a reference block of the current block.

16. The apparatus of claim 13 , wherein an affine mode is applied to the current block and initial prediction samples of a sub-block of the current block are generated,

wherein the refinement coding tool comprises a third refinement coding tool,

wherein the third refinement coding tool is applied to generate final prediction samples for the sub-block by deriving a prediction refinement based on motion vector differences dMvH and/or dMvV, and

wherein dMvH and dMvV indicate motion vector differences along a horizontal direction and a vertical direction.

17. The apparatus of claim 16 , wherein the third refinement coding tool is disabled for a first reference picture list of the current block when a dimension of a reference picture in the first reference picture list is different from a dimension of the current picture, or a dimension of a scaling window in a reference picture in the first reference picture list is different from a dimension of a scaling window in the current picture, and

wherein the third refinement coding tool is disabled for a second reference picture list of the current block when a dimension of a reference picture in the second reference picture list is different from a dimension of the current picture, or a dimension of a scaling window in a reference picture in the second reference picture list is different from a dimension of a scaling window in the current picture.

18. The apparatus of claim 13 , wherein whether the refinement coding tool is disabled is determined based on values of one or more flags associated with the one or more reference pictures respectively.

19. A non-transitory computer-readable storage medium storing instructions that cause a processor to:

determine, for a conversion between a current block of a current picture of a video and a bitstream of the video, whether to disable a refinement coding tool for refining a motion vector or a prediction sample for the current block by an offset value; and

perform the conversion based on the determining,

wherein the refinement coding tool is disabled when a dimension of a reference picture of one or more reference pictures of the current block is different from a dimension of the current picture, or a dimension of a scaling window in a reference picture of one or more reference pictures of the current block is different from a dimension of a scaling window in the current picture.

20. A non-transitory computer-readable recording medium storing a bitstream of a video which is generated by a method performed by a video processing apparatus, wherein the method comprises:

determining, for a current block of a current picture of a video, whether to disable a refinement coding tool for refining a motion vector or a prediction sample for the current block by an offset value; and

generating the bitstream based on the determining,

wherein the refinement coding tool is disabled when a dimension of a reference picture of one or more reference pictures of the current block is different from a dimension of the current picture, or a dimension of a scaling window in a reference picture of one or more reference pictures of the current block is different from a dimension of a scaling window in the current picture.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 13, 2022
From: ZHANG, KAI; ZHANG, LI
To: BYTEDANCE INC.
Reel/Frame 059586/0757 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 13, 2022
From: LIU, HONGBIN
To: BEIJING BYTEDANCE NETWORK TECHNOLOGY CO., LTD.
Reel/Frame 059586/0975 →
Continuity (3)
Continuation PCTCN2020120554 · Oct 13, 2020
Provisional Application 62914544 · Oct 13, 2019
Related Publication 20220264086A1 · Aug 18, 2022
Cited By (6)
US 12,192,473 US 12,395,661 US 12,407,812 US 12,483,691 US 12,615,394 US 12,726,651