Granted Patent B2

US 12,348,713 · App. 18/503,773 · Granted Jul 1, 2025

Inventors: Li Zhang (San Diego, CA); Kai Zhang (San Diego, CA); Hongbin Liu (Beijing, CN); Yue Wang (Beijing, CN)

Assignees: BEIJING BYTEDANCE NETWORK TECHNOLOGY CO., LTD.; BYTEDANCE INC.

H04N19/117H04N19/132H04N19/14H04N19/176H04N19/82H04N19/96

Abstract

Claims (56)

1. A method of processing video data, comprising:

determining, for a conversion between a picture of a video comprising one or more coding tree blocks and a bitstream of the video, that an adaptive loop filtering process is applied to a current coding tree block of the one or more coding tree blocks;

determining a classification of an M×N region of the current coding tree block based on gradients derived from a P×Q region including the M×N region according to a rule, wherein the rule disallows use of a sample in the P×Q region across one or more boundaries of multiple kinds of video regions, and wherein the picture is divided into multiple kinds of video regions and the one or more boundaries at least comprise a 360-degree virtual boundary or a picture boundary, where M, N, P, and Q are positive integers, P is greater than M, and Q is greater than N; and

performing the conversion by applying the adaptive loop filtering process according to the determined classification, wherein the adaptive loop filtering process comprises:

deriving a filtering coefficient set for the M×N region based on the determined classification;

determining a clipping value set for the M×N region; and

performing a filtering operation based on the filtering coefficient set and the clipping value set,

wherein the one or more boundaries conditionally further comprise at least one of: a slice boundary, a tile boundary, or a sub-picture boundary.

2. The method of claim 1 , wherein a one-side padding process is applied to generate one or more virtual samples for the sample across the one or more boundaries, wherein the one or more virtual samples are copied from available samples inside a video region in which the M×N region is located.

3. The method of claim 2 , further comprising determining whether a virtual boundary is enabled for the current coding tree block based on a relationship between a bottom boundary of the current coding tree block and a bottom boundary of the picture.

4. The method of claim 3 , wherein the virtual boundary is enabled if the bottom boundary of the current coding tree block is not the bottom boundary of the picture.

5. The method of claim 3 , wherein the virtual boundary is used to determine the classification, and wherein samples outside the virtual boundary are not used to determine the classification.

6. The method of claim 1 , wherein the M×N region is a 4×4 region and the P×Q region is a 10×10 region.

7. The method of claim 1 , wherein 1:2 subsampling is used when determining the classification.

8. The method of claim 1 , wherein the conversion includes encoding the video into the bitstream.

9. The method of claim 1 , wherein the conversion includes decoding the bitstream into the video.

10. An apparatus for processing video data comprising a processor and a non-transitory memory with instructions thereon, wherein the instructions upon execution by the processor, cause the processor to:

determine, for a conversion between a picture of a video comprising one or more coding tree blocks and a bitstream of the video, that an adaptive loop filtering process is applied to a current coding tree block of the one or more coding tree blocks;

determine a classification of an M×N region of the current coding tree block based on gradients derived from a P×Q region including the M×N region according to a rule, wherein the rule disallows use of a sample in the P×Q region across one or more boundaries of multiple kinds of video regions, and wherein the picture is divided into multiple kinds of video regions and the one or more boundaries at least comprise a 360-degree virtual boundary or a picture boundary, where M, N, P, and Q are positive integers, P is greater than M, and Q is greater than N; and

perform the conversion by applying the adaptive loop filtering process according to the determined classification, wherein the adaptive loop filtering process comprises:

deriving a filtering coefficient set for the M×N region based on the determined classification;

determining a clipping value set for the M×N region; and

performing a filtering operation based on the filtering coefficient set and the clipping value set,

wherein the one or more boundaries conditionally further comprise at least one of: a slice boundary, a tile boundary, or a sub-picture boundary.

11. The apparatus of claim 10 , wherein a one-side padding process is applied to generate one or more virtual samples for the sample across the one or more boundaries, wherein the one or more virtual samples are copied from available samples inside a video region in which the M×N region is located.

12. The apparatus of claim 10 , wherein the processor is further caused to determine whether a virtual boundary is enabled for the current coding tree block based on a relationship between a bottom boundary of the current coding tree block and a bottom boundary of the picture;

wherein the virtual boundary is enabled if the bottom boundary of the current coding tree block is not the bottom boundary of the picture; and

wherein the virtual boundary is used to determine the classification, and wherein samples outside the virtual boundary are not used to determine the classification.

13. The apparatus of claim 10 , wherein the M×N region is a 4×4 region and the P×Q region is a 10×10 region.

14. A non-transitory computer-readable storage medium storing instructions that cause a processor to:

determine, for a conversion between a picture of a video comprising one or more coding tree blocks and a bitstream of the video, that an adaptive loop filtering process is applied to a current coding tree block of the one or more coding tree blocks;

determine a classification of an M×N region of the current coding tree block based on gradients derived from a P×Q region including the M×N region according to a rule, wherein the rule disallows use of a sample in the P×Q region across one or more boundaries of multiple kinds of video regions, and wherein the picture is divided into multiple kinds of video regions and the one or more boundaries at least comprise a 360-degree virtual boundary or a picture boundary, where M, N, P, and Q are positive integers, P is greater than M, and Q is greater than N; and

perform the conversion by applying the adaptive loop filtering process according to the determined classification, wherein the adaptive loop filtering process comprises:

deriving a filtering coefficient set for the M×N region based on the determined classification;

determining a clipping value set for the M×N region; and

performing a filtering operation based on the filtering coefficient set and the clipping value set,

wherein the one or more boundaries conditionally further comprise at least one of: a slice boundary, a tile boundary, or a sub-picture boundary.

15. The non-transitory computer-readable storage medium of claim 14 , wherein a one-side padding process is applied to generate one or more virtual samples for the sample across the one or more boundaries, wherein the one or more virtual samples are copied from available samples inside a video region in which the M×N region is located.

16. The non-transitory computer-readable storage medium of claim 14 , wherein the processor is further caused to determine whether a virtual boundary is enabled for the current coding tree block based on a relationship between a bottom boundary of the current coding tree block and a bottom boundary of the picture;

wherein the virtual boundary is enabled if the bottom boundary of the current coding tree block is not the bottom boundary of the picture; and

wherein the virtual boundary is used to determine the classification, and wherein samples outside the virtual boundary are not used to determine the classification.

17. The non-transitory computer-readable storage medium of claim 14 , wherein the M×N region is a 4×4 region and the P×Q region is a 10×10 region.

18. A method for storing a bitstream of a video, comprising:

determining, for a picture of a video comprising one or more coding tree blocks, that an adaptive loop filtering process is applied to a current coding tree block of the one or more coding tree blocks;

determining a classification of an M×N region of the current coding tree block based on gradients derived from a P×Q region including the M×N region according to a rule, wherein the rule disallows use of a sample in the P×Q region across one or more boundaries of multiple kinds of video regions, and wherein the picture is divided into multiple kinds of video regions and the one or more boundaries at least comprise a 360-degree virtual boundary or a picture boundary, where M, N, P, and Q are positive integers, P is greater than M, and Q is greater than N;

generating the bitstream by applying the adaptive loop filtering process according to the determined classification; and

storing the bitstream in a non-transitory computer-readable recording medium,

wherein the adaptive loop filtering process comprises:

deriving a filtering coefficient set for the M×N region based on the determined classification;

determining a clipping value set for the M×N region; and

performing a filtering operation based on the filtering coefficient set and the clipping value set,

wherein the one or more boundaries conditionally further comprise at least one of: a slice boundary, a tile boundary, or a sub-picture boundary.

19. The method of claim 18 , wherein a one-side padding process is applied to generate one or more virtual samples for the sample across the one or more boundaries, wherein the one or more virtual samples are copied from available samples inside a video region in which the M×N region is located.

20. The method of claim 18 , wherein the method further comprises determining whether a virtual boundary is enabled for the current coding tree block based on a relationship between a bottom boundary of the current coding tree block and a bottom boundary of the picture;

wherein the virtual boundary is enabled if the bottom boundary of the current coding tree block is not the bottom boundary of the picture; and

wherein the virtual boundary is used to determine the classification, and wherein samples outside the virtual boundary are not used to determine the classification.

Assignments (2)

Priority Claims (1)

Continuity (4)

References Cited (223)