IP Library Granted Patent US 11,496,772
Granted Patent B2
US 11,496,772 · App. 17/667,380 · Granted Nov 8, 2022

Subpicture size definition in video processing

Inventors: Kai Zhang (San Diego, CA); Zhipin Deng (Beijing, CN); Hongbin Liu (Beijing, CN); Li Zhang (San Diego, CA); Jizheng Xu (San Diego, CA)
Assignees: BEIJING BYTEDANCE NETWORK TECHNOLOGY CO., LTD.; BYTEDANCE INC.
H04N19/70H04N19/157H04N19/176H04N19/1883
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,496,772
App. No.
17/667,380
Granted
Nov 8, 2022
Kind
B2
Abstract

A method of video processing includes performing a conversion between a video comprising a video picture that includes multiple sub-pictures and multiple video blocks, and a coded representation of the video according to a rule. The rule specifies that a boundary between any two sub-pictures is also a boundary between two video blocks.

Claims (37)

1. A method of processing video data, comprising:

determining, for a conversion between a video unit of a video and a bitstream of the video, a sub-picture coding mode is enabled for the video unit, wherein the video unit comprises one or more video pictures,

partitioning, a video picture in the video unit into multiple coding tree blocks and the video picture into one or more sub-pictures according to a rule,

performing the conversion between the video unit and the bitstream based on the partitioning,

wherein the rule specifies that a boundary between any two sub-pictures is also a boundary between two coding tree blocks, and that a coding tree block is not allowed to cover more than one sub-pictures.

2. The method of claim 1 , wherein a first syntax element and a second syntax element are included in the bitstream,

wherein the first syntax element specifies a width of a sub-picture in units of a width of a coding tree block, and the second syntax element specifies a height of a sub-picture in units of a height of a coding tree block.

3. The method of claim 1 , wherein any position in the video picture is constrained to be covered by only one subpicture.

4. The method of claim 1 , wherein the two sub-pictures of the video picture have no overlapping area.

5. The method of claim 1 , wherein a sub-picture is constrained to have a rectangular shape.

6. The method of claim 5 , wherein the sub-picture comprises rectangular slices.

7. The method of claim 1 , wherein a third syntax element indicating the sub-picture coding mode is enabled is included in a sequence parameter set in the bitstream.

8. The method of claim 1 , wherein a sub-picture is applicable to only selected one or more layers of the video.

9. The method of claim 8 , wherein sub-pictures are defined for a certain layer and are mapped to other layers.

10. The method of claim 1 , wherein the conversion comprises encoding the video into the bitstream.

11. The method of claim 1 , wherein the conversion comprises decoding the video from the bitstream.

12. An apparatus for processing video data comprising a processor and a non-transitory memory with instructions thereon, wherein the instructions upon execution by the processor, cause the processor to:

determine, for a conversion between a video unit of a video and a bitstream of the video, a sub-picture coding mode is enabled for the video unit, wherein the video unit comprises one or more video pictures,

partition, a video picture in the video unit into multiple coding tree blocks and the video picture into one or more sub-pictures according to a rule,

perform the conversion between the video unit and the bitstream based on the partitioning,

wherein the rule specifies that a boundary between any two sub-pictures is also a boundary between two coding tree blocks, and that a coding tree block is not allowed to cover more than one sub-pictures.

13. The apparatus of claim 12 , wherein a first syntax element and a second syntax element are included in the bitstream,

wherein the first syntax element specifies a width of a sub-picture in units of a width of a coding tree block, and the second syntax element specifies a height of a sub-picture in units of a height of a coding tree block.

14. The apparatus of claim 12 , wherein any position in the video picture is constrained to be covered by only one subpicture.

15. The apparatus of claim 12 , wherein the two sub-pictures of the video picture have no overlapping area.

16. The apparatus of claim 12 , wherein a sub-picture is constrained to have a rectangular shape.

17. The apparatus of claim 16 , wherein the sub-picture comprises rectangular slices.

18. The apparatus of claim 12 , wherein a third syntax element indicating the sub-picture coding mode is enabled is included in a sequence parameter set in the bitstream.

19. A non-transitory computer-readable storage medium storing instructions that cause a processor to:

determine, for a conversion between a video unit of a video and a bitstream of the video, a sub-picture coding mode is enabled for the video unit, wherein the video unit comprises one or more video pictures,

partition, a video picture in the video unit into multiple coding tree blocks and the video picture into one or more sub-pictures according to a rule,

perform the conversion between the video unit and the bitstream based on the partitioning,

wherein the rule specifies that a boundary between any two sub-pictures is also a boundary between two coding tree blocks, and that a coding tree block is not allowed to cover more than one sub-pictures.

20. A non-transitory computer-readable recording medium storing a bitstream of a video which is generated by a method performed by a video processing apparatus, wherein the method comprises:

determining, for a video unit of a video, a sub-picture coding mode is enabled for the video unit, wherein the video unit comprises one or more video pictures,

partitioning, a video picture in the video unit into multiple coding tree blocks and the video picture into one or more sub-pictures according to a rule,

generating the bitstream based on the partitioning, wherein the rule specifies that a boundary between any two sub-pictures is also a boundary between two coding tree blocks, and that a coding tree block is not allowed to cover more than one sub-pictures.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Feb 9, 2022
From: DENG, ZHIPIN; LIU, HONGBIN
To: BEIJING BYTEDANCE NETWORK TECHNOLOGY CO., LTD.
Reel/Frame 058933/0733 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Feb 9, 2022
From: ZHANG, KAI; ZHANG, LI; XU, JIZHENG
To: BYTEDANCE INC.
Reel/Frame 058933/0739 →
Priority Claims (1)
WO PCT/CN2019/100114 · Aug 10, 2019 · international
Continuity (2)
Continuation PCTCN2020108159 · Aug 10, 2020
Related Publication 20220174322A1 · Jun 2, 2022