IP Library Granted Patent US 11,575,887
Granted Patent B2
US 11,575,887 · App. 17/519,310 · Granted Feb 7, 2023

Selective use of coding tools in video processing

Inventors: Kai Zhang (San Diego, CA); Li Zhang (San Diego, CA); Hongbin Liu (Beijing, CN); Yue Wang (Beijing, CN)
Assignees: BEIJING BYTEDANCE NETWORK TECHNOLOGY CO., LTD.; BYTEDANCE INC.
H04N19/105H04N19/176H04N19/51
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,575,887
App. No.
17/519,310
Granted
Feb 7, 2023
Kind
B2
Abstract

A video processing method is provided to include determining, for a conversion between a current video block of a current picture of a video and a coded representation of the video, that use of a coding tool is disabled for the current video block due to use of a reference picture having a dimension different from a dimension of the current picture for coding of the current video block into the coded representation; and performing the conversion based on the determining.

Claims (41)

1. A method for processing video data, comprising:

determining, for a conversion between a first video block of a first current picture of a video and a bitstream of the video, that at least one of one or more first coding tools is disabled for the first video block due to a first reference picture resampling being enabled, wherein whether the first reference picture resampling is enabled is based on at least one of a width or a height of the first current picture, wherein, when the first reference picture resampling for the first current picture is enabled, a first reference picture of the current picture has a resolution different from a resolution of the first current picture, and wherein the one or more first coding tools comprise a decoder side motion vector refinement (DMVR) tool; and

performing the conversion based on the determining.

2. The method of claim 1 , wherein the one or more first coding tools comprise a bi-directional optical flow (BDOF) tool.

3. The method of claim 1 , further comprising:

determining, for a further conversion between a second video block of a second current picture of the video and a bitstream of the video, that at least one of one or more second coding tools is disabled for the second video block due to a second reference picture resampling being enabled, wherein whether the second reference picture resampling is enabled is based on at least one of a width or a height of the first current picture, wherein, when the second reference picture resampling for the second current picture is enabled, a second reference picture of the second current picture has a resolution different from a resolution of the second current picture, wherein the one or more second coding tools comprise a prediction refinement with optical flow (PROF) tool.

4. The method of claim 3 , wherein the one or more second coding tools further comprise a sub-block based temporal motion vector prediction tool, wherein in the sub-block based temporal motion vector prediction tool, a block is divided into at least one subblock, and motion information of the at least one subblock is derived based on a video region in a collocated picture, and wherein a position of the video region is derived based on an available specific neighboring block.

5. The method of claim 1 , wherein the one or more first coding tools further comprise a temporal motion vector prediction tool.

6. The method of claim 1 , wherein the performing the conversion based on the determining comprises:

calculating predictors of the first video block; and

applying an interpolation processing to the predictors once without a resampling processing.

7. The method of claim 1 , wherein the one or more first coding tools further comprise an affine prediction, a triangular prediction mode, a symmetric motion vector difference (SMVD), a merge mode with motion vector differences (MMVD), an inter-intra prediction, a local illumination compensation (LIC), a history-based motion vector prediction (HMVP), a multiple Transform Set (MTS), a sub-block transform (SBT), a low frequency non-square transform (LFNST), or a filtering tool.

8. The method of claim 1 , wherein information related to the coding tool is not included in a case that the use of the coding tool is disabled.

9. The method of claim 1 , wherein the performing of the conversion includes decoding the first video block from the bitstream.

10. The method of claim 1 , wherein the performing of the conversion includes encoding the first video block into the bitstream.

11. An apparatus for processing video data comprising a processor and a non-transitory memory with instructions thereon, wherein the instructions upon execution by the processor, cause the processor to:

determine, for a conversion between a first video block of a first current picture of a video and a bitstream of the video, that at least one of one or more first coding tools is disabled for the first video block due to a first reference picture resampling being enabled, wherein whether the first reference picture resampling is enabled is based on at least one of a width or a height of the first current picture, wherein, when the first reference picture resampling for the first current picture is enabled, a first reference picture of the current picture has a resolution different from a resolution of the first current picture, wherein the one or more first coding tools comprise a decoder side motion vector refinement (DMVR) tool; and

perform the conversion based on the determining.

12. The apparatus of claim 11 , wherein the one or more first coding tools comprise:

a bi-directional optical flow (BDOF) tool; and

a temporal motion vector prediction tool.

13. The apparatus of claim 11 , wherein performing the conversion based on the determining comprises:

calculating predictors of the first video block; and

applying an interpolation processing to the predictors without a resampling processing.

14. The apparatus of claim 11 , wherein the performing of the conversion includes decoding the first video block from the bitstream.

15. The apparatus of claim 11 , wherein the performing of the conversion includes encoding the current first video block into the bitstream.

16. A non-transitory computer-readable storage medium storing instructions that cause a processor to:

determine, for a conversion between a first video block of a first current picture of a video and a bitstream of the video, that at least one of one or more first coding tools is disabled for the first video block due to a first reference picture resampling being enabled, wherein whether the first reference picture resampling is enabled is based on at least one of a width or a height of the first current picture, wherein, when the first reference picture resampling for the first current picture is enabled, a first reference picture of the current picture has a resolution different from a resolution of the first current picture, wherein the one or more first coding tools comprise a decoder side motion vector refinement (DMVR) tool; and

perform the conversion based on the determining.

17. The non-transitory computer-readable storage medium of claim 16 , wherein the one or more first coding tools comprise:

a bi-directional optical flow (BDOF) tool; and

a temporal motion vector prediction tool.

18. A non-transitory computer-readable recording medium storing a bitstream which is generated by a method performed by a video processing apparatus, wherein the method comprises:

determining, for a first video block of a first current picture of the video, that at least one of one or more first coding tools is disabled for the first video block due to a first reference picture resampling being enabled, wherein whether the first reference picture resampling is enabled is based on at least one of a width or a height of the first current picture, wherein, when the first reference picture resampling for the first current picture is enabled, a first reference picture of the current picture has a resolution different from a resolution of the first current picture, wherein the one or more first coding tools comprise a decoder side motion vector refinement (DMVR) tool; and

generating the bitstream based on the determining.

19. The non-transitory computer-readable storage medium of claim 16 , wherein performing the conversion based on the determining comprises:

calculating predictors of the first video block; and

applying an interpolation processing to the predictors without a resampling processing.

20. The non-transitory computer-readable storage medium of claim 18 , wherein the one or more first coding tools comprise:

a bi-directional optical flow (BDOF) tool; and

a temporal motion vector prediction tool.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Nov 4, 2021
From: ZHANG, KAI; ZHANG, LI
To: BYTEDANCE INC.
Reel/Frame 058025/0292 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Nov 4, 2021
From: LIU, HONGBIN; WANG, YUE
To: BEIJING BYTEDANCE NETWORK TECHNOLOGY CO., LTD.
Reel/Frame 058025/0302 →
Priority Claims (2)
WO PCT/CN2019/086487 · May 11, 2019 · international
WO PCT/CN2019/110905 · Oct 12, 2019 · international
Continuity (2)
Continuation PCTCN2020089556 · May 11, 2020
Related Publication 20220060692A1 · Feb 24, 2022
Cited By (4)
US 12,206,902 US 12,348,706 US 12,382,085 US 12,621,481