Granted Patent B2

US 12,432,345 · App. 17/524,477 · Granted Sep 30, 2025

Inventors: Li Zhang (San Diego, CA); Weijia Zhu (San Diego, CA); Kai Zhang (San Diego, CA); Hongbin Liu (Beijing, CN); Jizheng Xu (San Diego, CA)

Assignee: BEIJING BYTEDANCE NETWORK TECHNOLOGY CO., LTD.

H04N19/117H04N19/132H04N19/159H04N19/176H04N19/1883H04N19/635H04N19/82

Abstract

Claims (61)

1. A method for visual media processing, comprising:

selectively applying, for a conversion between a current video block and a bitstream of a visual media data and based on a first determining, wherein the conversion includes encoding the current video block into the bitstream or decoding the current video block from the bitstream, a deblocking filter (DB) process by:

identifying a first range of the visual media data,

calculating a boundary strength of the first range,

deciding whether to turn on or off a first deblocking filter based on the boundary strength of the first range, and

wherein the boundary strength is independent of a motion vector difference between motion vectors associated with a pair of adjacent blocks of the visual media data, wherein the first determining includes determining whether the pair of adjacent blocks of visual media data are both intra block copy (IBC) coded, wherein the first range includes a boundary at a vertical edge and/or a horizontal edge of the pair of adjacent blocks of the visual media data; and

applying, based on a second determining, the DB process by:

identifying a second range of the visual media data,

calculating a boundary strength of the second range,

deciding whether to turn on or off a second deblocking filter based on the boundary strength of the second range, and

performing the conversion based on a first deblocking filter strength of the first deblocking filter when the first deblocking filter is turned on and based on a second deblocking filter strength of the second deblocking filter when the second deblocking filter is turned on,

wherein the second determining includes determining one or more sub-regions within the current video block of the visual media data, and wherein the second range includes boundaries of the one or more sub-regions within the current video block at vertical and/or horizontal edges; and

wherein, upon determining that the pair of adjacent blocks are both IBC coded, the boundary strength is selected as M in case the pair of adjacent blocks are both intra block copy (IBC) coded regardless of the motion vector difference and regardless of whether a non-zero coefficient is associated with the pair of adjacent blocks, and wherein M is selected from a group consisting of 0, 1, and 2.

2. The method of claim 1 , wherein the deblocking filter (DB) process is skipped at boundaries of the pair of adjacent blocks which are both IBC-coded blocks.

3. The method of claim 1 , wherein the deblocking filter (DB) process is skipped for samples of an IBC-coded block.

4. The method of claim 1 , wherein the current video block makes use of a decoder-side motion refinement coding tool.

5. The method of claim 4 , wherein the decoder-side motion refinement coding tool includes a decoder-side motion vector refinement (DMVR) technique, a prediction refinement with optical flow (PROF) technique, or a Bi-directional optical flow (BDOF) technique.

6. The method of claim 4 , wherein the one or more sub-regions within the current video block are defined based on sub-blocks on which the decoder-side motion refinement coding tool is applied, wherein the sub-blocks are included within the current video block.

7. The method of claim 1 , wherein the one or more sub-regions are sub-blocks of the current video block and have size M×N, wherein M=16 or 64 and N=16 or 64.

8. The method of claim 1 , wherein the DB process is selectively applied on a subset of the boundaries of the one or more sub-regions within the current video block.

9. The method of claim 1 , wherein the DB process is selectively applied on the boundaries of the one or more sub-regions within the current video block based upon a location of the one or more sub-regions relative to the current video block.

10. The method of claim 9 , further comprising:

optionally, turning one or more of the first deblocking filter and the second deblocking filter on for samples located at one or more bottom boundaries of a sub-region, wherein the one or more bottom boundaries of the sub-region is same as a bottom boundary of a coding tree unit (CTU) associated with the current video block,

optionally, turning one or more of the first deblocking filter and the second deblocking filter off for samples located at the one or more bottom boundaries of the sub-region, wherein the one or more bottom boundaries of the sub-region is same as the bottom boundary of the CTU associated with the current video block,

optionally, turning one or more of the first deblocking filter and the second deblocking filter on for samples located at one or more right boundaries of a sub-region, wherein the one or more bottom boundaries of the sub-region is same as the bottom boundary of the CTU associated with the current video block,

optionally, turning one or more of the first deblocking filter and the second deblocking filter off for samples located at the one or more right boundaries of the sub-region, wherein the one or more bottom boundaries of the sub-region is same as the bottom boundary of the CTU associated with the current video block,

optionally, turning one or more of the first deblocking filter and the second deblocking filter on for samples located at the one or more right boundaries of the sub-region, wherein the one or more bottom boundaries of the sub-region is different from the bottom boundary of the CTU associated with the current video block,

optionally, turning one or more of the first deblocking filter and the second deblocking filter off for samples located at the one or more right boundaries of the sub-region, wherein the one or more bottom boundaries of the sub-region is different from the bottom boundary of the CTU associated with the current video block.

11. The method of claim 1 , wherein the DB process further includes:

selectively using refined motion information or unrefined motion information for the one or more sub-regions within the current video block based upon a location of the one or more sub-regions relative to the current video block.

12. The method of claim 11 , wherein using the refined motion information on samples located at one or more right boundaries of a sub-region, wherein one or more bottom boundaries of the sub-region is different from a bottom boundary of a coding tree unit (CTU) associated with the current video block.

13. The method of claim 11 , wherein using the unrefined motion information on samples located at one or more right boundaries of a sub-region, wherein one or more bottom boundaries of the sub-region is different from a bottom boundary of a coding tree unit (CTU) associated with the current video block.

14. An apparatus for processing video data comprising a processor and a non-transitory memory with instructions thereon, wherein the instructions upon execution by the processor, cause the processor to:

apply, for a conversion between a current video block and a bitstream of a visual media data and based on a first determining, wherein the conversion includes encoding the current video block into the bitstream or decoding the current video block from the bitstream, a deblocking filter (DB) process by:

identifying a first range of visual media data,

calculating a boundary strength of the first range,

deciding whether to turn on or off a first deblocking filter based on the boundary strength of the first range, and

wherein the boundary strength is independent of a motion vector difference between motion vectors associated with a pair of adjacent blocks of the visual media data, wherein the first determining includes determining whether the pair of adjacent blocks of the visual media data are both intra block copy (IBC) coded, wherein the first range includes a boundary at a vertical edge and/or a horizontal edge of the pair of adjacent blocks of the visual media data; and

apply, based on a second determining, the DB process by:

identifying a second range of the visual media data,

calculating a boundary strength of the second range,

deciding whether to turn on or off a second deblocking filter based on the boundary strength of the second range, and

performing the conversion based on a first deblocking filter strength of the first deblocking filter when the first deblocking filter is turned on and based on a second deblocking filter strength of the second deblocking filter when the second deblocking filter is turned on,

wherein the second determining includes determining one or more sub-regions within the current video block of the visual media data, and wherein the second range includes boundaries of the one or more sub-regions within the current video block at vertical and/or horizontal edges; and

wherein, upon determining that the pair of adjacent blocks are both IBC coded, the boundary strength is selected as M in case the pair of adjacent blocks are both intra block copy (IBC) coded regardless of the motion vector difference and regardless of whether a non-zero coefficient is associated with the pair of adjacent blocks, and wherein M is selected from a group consisting of 0, 1, and 2.

15. The apparatus of claim 14 , wherein the current video block makes use of a decoder-side motion refinement coding tool.

16. A non-transitory computer-readable recording medium storing a bitstream of a video which is generated by a method performed by a video processing apparatus, wherein the method comprises:

applying, for a current video block and based on a first determining, a deblocking filter (DB) process by:

identifying a first range of visual media data,

calculating a boundary strength of the first range,

deciding whether to turn on or off a first deblocking filter based on the boundary strength of the first range, and

wherein the boundary strength is independent of a motion vector difference between motion vectors associated with a pair of adjacent blocks of the visual media data;

applying, based on a second determining, the DB process by:

identifying a second range of the visual media data,

calculating the boundary strength of the second range,

deciding whether to turn on or off a second deblocking filter based on the boundary strength of the second range, and

performing the conversion based on a first deblocking filter strength of the first deblocking filter when the first deblocking filter is turned on and based on a second deblocking filter strength of the second deblocking filter when the second deblocking filter is turned on,

wherein the second determining includes determining one or more sub-regions within the current video block of the visual media data, and wherein the second range includes boundaries of the one or more sub-regions within the current video block at vertical and/or horizontal edges; and

generating the bitstream based on applying the DB process, wherein the generating includes encoding the current video block into the bitstream,

wherein the first determining includes determining whether a pair of adjacent blocks of the visual media data are both intra block copy (IBC) coded, wherein the first range includes a boundary at a vertical edge and/or a horizontal edge of the pair of adjacent blocks of the visual media data; and

wherein, upon determining that the pair of adjacent blocks are both IBC coded, the boundary strength is selected as M in case the pair of adjacent blocks are both intra block copy (IBC) coded regardless of the motion vector difference and regardless of whether a non-zero coefficient is associated with the pair of adjacent blocks, and wherein M is selected from a group consisting of 0, 1, and 2.

Assignments (2)

Priority Claims (2)

Continuity (2)

References Cited (77)