IP Library › Granted Patent US 11,363,290
Granted Patent B2
US 11,363,290 · App. 16/998,653 · Granted Jun 14, 2022

Block size restrictions for DMVR

Inventors: Hongbin Liu (Beijing, CN); Li Zhang (San Diego, CA); Kai Zhang (San Diego, CA); Yue Wang (Beijing, CN)
Assignees: BEIJING BYTEDANCE NETWORK TECHNOLOGY CO., LTD.; BYTEDANCE INC.
H04N19/513H04N19/176H04N19/44H04N19/56
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,363,290
App. No.
16/998,653
Granted
Jun 14, 2022
Kind
B2
Abstract

Methods of enabling and disabling a decoder-side motion vector refinement (DMVR) video decoder and/or encoder are described. One example method includes determining a width (W) and a height (H) of a video block, making a determination, based on a condition of the video block, between enabling and disabling a decoder side motion vector refinement step for a conversion between the video block and a coded representation of the video block, in a case that the determination is enabling, performing the conversion by enabling the decoder side motion vector refinement step; and in a case that the determination is disabling, performing the conversion by disabling the decoder side motion vector refinement step, wherein the decoder side motion vector refinement step includes refining value of a motion vector signaled in the coded representation and using the refined value during the conversion.

Claims (48)

1. A method of video processing, comprising:

performing a conversion between a video block and a bitstream of the video block based on at least one of a width and a height of the video block;

refraining from applying, in response to a ratio of the width to the height (W/H) being smaller than a first threshold value, a decoder side motion vector refinement step during the conversion; and

refraining from applying, in response to the ratio of the width to the height (W/H) being greater than a second threshold value, the decoder side motion vector refinement step during the conversion,

wherein W and H are the width and the height of the video block, respectively, and

wherein the decoder side motion vector refinement step includes refining a value of a motion vector signaled in the bitstream and using the refined value during the conversion,

wherein the decoder side motion vector refinement step is determined to be disabled when W<=T1 or H<=T2, wherein T1 is a third threshold and equal to 4 and T2 is a fourth threshold and equal to 4.

2. The method of claim 1 , wherein the conversion includes decoding the bitstream into pixel values of the video block.

3. The method of claim 1 , wherein the conversion includes encoding pixel values of the video block into the bitstream.

4. The method of claim 1 , wherein the decoder side motion vector refinement step is determined to be disabled when W<=T1 and H<=T2.

5. The method of claim 1 , wherein the decoder side motion vector refinement step is determined to be disabled when W*H<=T0, wherein T0 is a fifth threshold and T0 is an integer value greater than or equal to 1.

6. The method of claim 1 , wherein the decoder side motion vector refinement step is determined to be disabled when W=4 and H=4.

7. The method of claim 1 , wherein the decoder side motion vector refinement step is determined to be disabled when W=4 or H=4.

8. The method of claim 1 , wherein the first threshold value and the second threshold value have fixed values.

9. The method of claim 1 , wherein the second threshold value is equal to 8.

10. The method of claim 1 , wherein in response to an affine mode being applied to the current block, the decoder side motion vector refinement step is refrained from the current block.

11. An apparatus for coding video data comprising a processor and a non-transitory memory with instructions thereon, wherein the instructions upon execution by the processor, cause the processor to:

perform a conversion between a video block and a bitstream of the video block based on at least one of a width and a height of the video block;

refrain from applying, in response to a ratio of the width to the height (W/H) being smaller than a first threshold value, a decoder side motion vector refinement step during the conversion; and

refrain from applying, in response to the ratio of the width to the height (W/H) being greater than a second threshold value, the decoder side motion vector refinement step during the conversion,

wherein W and H are the width and the height of the video block, respectively, and

wherein the decoder side motion vector refinement step includes refining a value of a motion vector signaled in the bitstream and using the refined value during the conversion,

wherein the decoder side motion vector refinement step is determined to be disabled when W<=T1 or H<=T2, wherein T1 is a third threshold and equal to 4 and T2 is a fourth threshold and equal to 4.

12. The apparatus of claim 11 , wherein the conversion includes decoding the bitstream into pixel values of the video block.

13. The apparatus of claim 11 , wherein the conversion includes encoding pixel values of the video block into the bitstream.

14. The apparatus of claim 11 , wherein the decoder side motion vector refinement step is determined to be disabled when W<=T1 and H<=T2.

15. The apparatus of claim 11 , wherein the decoder side motion vector refinement step is determined to be disabled when W*H<=T0, wherein T0 is a fifth threshold and T0 is an integer value greater than or equal to 1.

16. The apparatus of claim 11 , wherein the decoder side motion vector refinement step is determined to be disabled when W=4 and H=4.

17. The apparatus of claim 11 , wherein the decoder side motion vector refinement step is determined to be disabled when W=4 or H=4.

18. A non-transitory computer-readable storage medium storing instructions that cause a processor to:

perform a conversion between a video block and a bitstream of the video block based on at least one of a width and a height of the video block;

refrain from applying, in response to a ratio of the width to the height (W/H) being smaller than a first threshold value, a decoder side motion vector refinement step during the conversion; and

refrain from applying, in response to the ratio of the width to the height (W/H) being greater than a second threshold value, the decoder side motion vector refinement step during the conversion,

wherein W and H are the width and the height of the video block, respectively, and

wherein the decoder side motion vector refinement step includes refining a value of a motion vector signaled in the bitstream and using the refined value during the conversion,

wherein the decoder side motion vector refinement step is determined to be disabled when W<=T1 or H<=T2, wherein T1 is a third threshold and equal to 4 and T2 is a fourth threshold and equal to 4.

19. The non-transitory computer-readable storage medium of claim 18 , wherein the decoder side motion vector refinement step is determined to be disabled in at least one of the following conditions:

when W<=T1 and H<=T2;

when W*H<=T0, wherein T0 is a fifth threshold and T0 is an integer value greater than or equal to 1;

when W=4 and H=4; or

when W=4 or H=4.

20. A non-transitory computer-readable storage medium storing a bitstream of a video which is generated by a method performed by a video processing apparatus, wherein the method comprises:

generating the bitstream based on at least one of a width and a height of the video block;

refrain from applying, in response to a ratio of the width to the height (W/H) being smaller than a first threshold value, a decoder side motion vector refinement step during the conversion; and

refrain from applying, in response to the ratio of the width to the height (W/H) being greater than a second threshold value, the decoder side motion vector refinement step during the conversion,

wherein W and H are the width and the height of the video block, respectively, and

wherein the decoder side motion vector refinement step includes refining a value of a motion vector signaled in the bitstream and using the refined value during the conversion,

wherein the decoder side motion vector refinement step is determined to be disabled when W<=T1 or H<=T2, wherein T1 is a third threshold and equal to 4 and T2 is a fourth threshold and equal to 4.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 20, 2020
From: ZHANG, LI; ZHANG, KAI
To: BYTEDANCE INC.
Reel/Frame 053556/0464 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 20, 2020
From: LIU, HONGBIN; WANG, YUE
To: BEIJING BYTEDANCE NETWORK TECHNOLOGY CO., LTD.
Reel/Frame 053556/0488 →
Continuity (3)
Continuation PCTIB2019055616 · Jul 2, 2019
Provisional Application 62693412 · Jul 2, 2018
Related Publication 20200382807A1 · Dec 3, 2020