IP Library Granted Patent US 11,956,432
Granted Patent B2
US 11,956,432 · App. 17/723,175 · Granted Apr 9, 2024

Interplay between subpictures and in-loop filtering

Inventors: Kai Zhang (San Diego, CA); Zhipin Deng (Beijing, CN); Hongbin Liu (Beijing, CN); Li Zhang (San Diego, CA); Jizheng Xu (San Diego, CA)
Assignees: BEIJING BYTEDANCE NETWORK TECHNOLOGY CO., LTD; BYTEDANCE INC.
H04N19/119H04N19/117H04N19/132H04N19/176H04N19/186H04N19/46H04N19/70H04N19/82
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,956,432
App. No.
17/723,175
Granted
Apr 9, 2024
Kind
B2
Abstract

An example method of video processing includes determining, for a conversion between a block of a first sub-picture of a video and a bitstream representation of the video, whether to apply a deblocking process across an edge between the block and a neighboring block of a second sub-picture based on whether a loop filtering process is allowed across subpicture boundaries. The method also includes performing the conversion based on the determining.

Claims (48)

1. A method of video processing, comprising:

determining, for a conversion between a chroma block of a current processing unit of a current subpicture of a current picture of a video and a bitstream of the video, that a cross component adaptive loop filtering operation is applied to the chroma block, wherein the current picture comprises one or more subpictures; and

performing the conversion based on the determining,

wherein in the cross component adaptive loop filtering operation, a chroma sample of the chroma block is filtered based on information of luma samples,

wherein one or more luma samples located outside the current processing unit are excluded from the filtering of the chroma sample,

wherein the bitstream conforms to a format rule which specifies that different subpictures have different subpicture ID values, wherein when a value of one or more syntax elements is equal to 0 indicating that subpicture ID mapping is not explicitly signalled in a sequence parameter set or in a picture parameter set, a default value is assigned to the subpicture ID value of the subpicture.

2. The method of claim 1 , wherein the current processing unit is defined by an adaptive loop filtering virtual boundary.

3. The method of claim 1 , wherein one or more luma samples located outside an adaptive loop filtering virtual boundary are excluded from the filtering of the chroma sample.

4. The method of claim 3 , wherein one or more luma samples inside the adaptive loop filtering virtual boundary is used to replace the one or more luma samples located outside an adaptive loop filtering virtual boundary and is included in the filtering of the chroma sample.

5. The method of claim 1 , wherein the current picture further comprises a video block, and

wherein when an edge of the video block coincide with a boundary of a subpicture in the current picture and an in-loop filtering operation across the boundary of the subpicture is disabled, a deblocking filter process is not applied to the edge.

6. The method of claim 5 , wherein a syntax element indicating whether the in-loop filtering operation process across the boundary of the subpicture is disabled is included in the bitstream.

7. The method of claim 1 , wherein a syntax element indicating a maximum block size used for a transform skip coding tool is conditionally included in a sequence parameter set in the bitstream based on a value of a transform skip enabled flag included in the sequence parameter set in the bitstream.

8. The method of claim 1 , wherein the current picture further comprises a video block,

wherein a history-based motion vector prediction table is maintained to be used for motion vector prediction,

wherein when the video block is coded in a first mode, the history-based motion vector prediction table is refrained from being updated based on the video block, and

wherein in the first mode, a partition scheme dividing the video block into two partitions is allowed, and at least one of the two partitions is non-square and non-rectangular.

9. The method of claim 1 , wherein the conversion includes encoding the current picture into the bitstream.

10. The method of claim 1 , wherein the conversion includes decoding the current picture from the bitstream.

11. An apparatus for processing video data comprising a processor and a non-transitory memory with instructions thereon, wherein the instructions upon execution by the processor, cause the processor to:

determine, for a conversion between a chroma block of a current processing unit of a current subpicture of a current picture of a video and a bitstream of the video, that a cross component adaptive loop filtering operation is applied to the chroma block, wherein the current picture comprises one or more subpictures; and

perform the conversion based on the determining,

wherein in the cross component adaptive loop filtering operation, a chroma sample of the chroma block is filtered based on information of luma samples,

wherein one or more luma samples located outside the current processing unit are excluded from the filtering of the chroma sample,

wherein the bitstream conforms to a format rule which specifies that different subpictures have different subpicture ID values, wherein when a value of one or more syntax elements is equal to 0 indicating that subpicture ID mapping is not explicitly signalled in a sequence parameter set or in a picture parameter set, a default value is assigned to the subpicture ID value of the subpicture.

12. The apparatus of claim 11 , wherein the current processing unit is defined by an adaptive loop filtering virtual boundary.

13. The apparatus of claim 11 , wherein one or more luma samples located outside an adaptive loop filtering virtual boundary are excluded from the filtering of the chroma sample.

14. The apparatus of claim 13 , wherein one or more luma samples inside the adaptive loop filtering virtual boundary is used to replace the one or more luma samples located outside an adaptive loop filtering virtual boundary and is included in the filtering of the chroma sample.

15. The apparatus of claim 11 , wherein the current picture further comprises a video block, and

wherein when an edge of the video block coincide with a boundary of a subpicture in the current picture and an in-loop filtering operation across the boundary of the subpicture is disabled, a deblocking filter process is not applied to the edge.

16. The apparatus of claim 15 , wherein a syntax element indicating whether the in-loop filtering operation process across the boundary of the subpicture is disabled is included in the bitstream.

17. The apparatus of claim 11 , wherein a syntax element indicating a maximum block size used for a transform skip coding tool is conditionally included in a sequence parameter set in the bitstream based on a value of a transform skip enabled flag included in the sequence parameter set in the bitstream.

18. The apparatus of claim 11 , wherein the current picture further comprises a video block,

wherein a history-based motion vector prediction table is maintained to be used for motion vector prediction,

wherein when the video block is coded in a first mode, the history-based motion vector prediction table is refrained from being updated based on the video block, and

wherein in the first mode, a partition scheme dividing the video block into two partitions is allowed, and at least one of the two partitions is non-square and non-rectangular.

19. A non-transitory computer-readable storage medium storing instructions that cause a processor to:

determine, for a conversion between a chroma block of a current processing unit of a current subpicture of a current picture of a video and a bitstream of the video, that a cross component adaptive loop filtering operation is applied to the chroma block, wherein the current picture comprises one or more subpictures; and

perform the conversion based on the determining,

wherein in the cross component adaptive loop filtering operation, a chroma sample of the chroma block is filtered based on information of luma samples,

wherein one or more luma samples located outside the current processing unit are excluded from the filtering of the chroma sample,

wherein the bitstream conforms to a format rule which specifies that different subpictures have different subpicture ID values, wherein when a value of one or more syntax elements is equal to 0 indicating that subpicture ID mapping is not explicitly signalled in a sequence parameter set or in a picture parameter set, a default value is assigned to the subpicture ID value of the subpicture.

20. A non-transitory computer-readable recording medium storing a bitstream of a video which is generated by a method performed by a video processing apparatus, wherein the method comprises:

determining, for a chroma block of a current processing unit of a current subpicture of a current picture of a video, that a cross component adaptive loop filtering operation is applied to the chroma block, wherein the current picture comprises one or more subpictures; and

generating the bitstream based on the determining,

wherein in the cross component adaptive loop filtering operation, a chroma sample of the chroma block is filtered based on information of luma samples,

wherein one or more luma samples located outside the current processing unit are excluded from the filtering of the chroma sample,

wherein the bitstream conforms to a format rule which specifies that different subpictures have different subpicture ID values, wherein when a value of one or more syntax elements is equal to 0 indicating that subpicture ID mapping is not explicitly signalled in a sequence parameter set or in a picture parameter set, a default value is assigned to the subpicture ID value of the subpicture.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 19, 2022
From: ZHANG, KAI; ZHANG, LI; XU, JIZHENG
To: BYTEDANCE INC.
Reel/Frame 059637/0214 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 19, 2022
From: DENG, ZHIPIN; LIU, HONGBIN
To: BEIJING BYTEDANCE NETWORK TECHNOLOGY CO., LTD.
Reel/Frame 059637/0281 →
Priority Claims (1)
WO PCT/CN2019/111807 · Oct 18, 2019 · international
Continuity (2)
Continuation PCTCN2020121768 · Oct 19, 2020
Related Publication 20220256146A1 · Aug 11, 2022
Cited By (5)
US 12,348,761 US 12,388,989 US 12,413,714 US 12,513,291 US 12,621,450