IP Library › Granted Patent US 11,363,307
Granted Patent B2
US 11,363,307 · App. 16/984,818 · Granted Jun 14, 2022

Video coding with subpictures

Inventors: Lulin Chen (San Jose, CA); Chih-Wei Hsu (Hsinchu, TW); Yu-Wen Huang (Hsinchu, TW)
Assignee: HFI Innovation Inc.
H04N19/96H04N19/119H04N19/184H04N19/70
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,363,307
App. No.
16/984,818
Granted
Jun 14, 2022
Kind
B2
Abstract

A method of decoding a video sequence coded with subpictures can include receiving a first syntax element corresponding to a coding tree unit (CTU) size in a bitstream at a decoder, receiving a second syntax element corresponding to whether a picture being partitioned into subpictures, in response to the second syntax element indicating the picture is partitioned into the subpictures, receiving third syntax elements indicating a position and a size of each of the subpictures in the picture based on a unit of the CTU size, and reconstructing one or more of the subpictures based on the position and the size of each of the respective subpictures in the picture.

Claims (47)

1. A method, comprising:

receiving a first syntax element indicating a coding tree unit (CTU) size in a bitstream at a decoder;

receiving a second syntax element corresponding to whether a picture is partitioned into subpictures, the second syntax element corresponding to whether the picture is partitioned into the subpictures being signaled in a sequence parameter set (SPS) in the bitstream, each subpicture containing one or more slices partitioned from the picture;

in response to the second syntax element corresponding to the picture being partitioned into the subpictures, receiving third syntax elements indicating a position and a size of each of the subpictures in the picture based on a unit of the CTU size, the third syntax elements indicating the position and the size of each of the subpictures being signaled in the SPS in the bitstream; and

reconstructing one or more of the subpictures based on the position and the size of each of the respective subpictures in the picture.

2. The method of claim 1 , wherein the first or second syntax element is included in the SPS or a picture parameter set (PPS).

3. The method of claim 1 , wherein the third syntax elements include subpicture indices associated with respective grid elements of a grid partitioning the picture, the grid elements associated with a same index of the subpicture indices collectively forming one of the subpictures, a size of the grid elements being specified with a unit of the CTU size or a unit of 8 samples.

4. The method of claim 1 , further comprising:

receiving a fourth syntax element in a slice header of one of the one or more slices in the picture, the fourth syntax element indicating a subpicture identifier (ID) of one of the subpictures that contains the one of the one or more slices in the picture, the subpicture ID indicating that the one of the one or more slices in the picture belongs to the one of the subpictures.

5. The method of claim 1 , further comprising:

receiving a flag indicating whether the picture includes a single tile in a PPS or the SPS; and

in response to the picture including the single tile, determining the picture includes a single slice.

6. The method of claim 1 , further comprising:

for each slice in the picture, receiving a subpicture ID associated with each slice in a PPS or the SPS.

7. The method of claim 1 , wherein the receiving the third syntax elements includes:

receiving syntax elements indicating a layout of the one or more slices in the picture;

receiving a subpicture ID for each of the one or more slices in the picture; and

determining the position, the size, or a subpicture ID of each of the subpictures in the picture based on the received syntax elements indicating the layout of the one or more slices in the picture and the received subpicture ID for each of the one or more slices in the picture.

8. The method of claim 7 , wherein the syntax elements indicating the layout of the one or more slices in the picture, or the subpicture ID for each of the one or more slices in the picture are received in the SPS or a PPS.

9. An apparatus, comprising circuitry configured to:

receive a first syntax element indicating a coding tree unit (CTU) size in a bitstream at a decoder;

receive a second syntax element corresponding to whether a picture is partitioned into subpictures, the second syntax element corresponding to whether the picture is partitioned into the subpictures being signaled in a sequence parameter set (SPS) in the bitstream, each subpicture containing one or more slices partitioned from the picture;

in response to the second syntax element corresponding to the picture being partitioned into the subpictures, receive third syntax elements indicating a position and a size of each of the subpictures in the picture based on a unit of the CTU size, the third syntax elements indicating the position and the size of each of the subpictures being signaled in the SPS in the bitstream; and

reconstruct one or more of the subpictures based on the position and the size of each of the respective subpictures in the picture.

10. The apparatus of claim 9 , wherein the first or second syntax element is included in the SPS or a picture parameter set (PPS).

11. The apparatus of claim 9 , wherein the third syntax elements include subpicture indices associated with respective grid elements of a grid partitioning the picture, the grid elements associated with a same index of the subpicture indices collectively forming one of the subpictures, a size of the grid elements being specified with a unit of the CTU size or a unit of 8 samples.

12. The apparatus of claim 9 , wherein the circuitry is further configured to:

receive a fourth syntax element in a slice header of one of the one or more slices in the picture, the fourth syntax element indicating a subpicture identifier (ID) of one of the subpictures that contains the one of the one or more slices in the picture, the subpicture ID indicating that the one of the one or more slices in the picture belongs to the one of the subpictures.

13. The apparatus of claim 9 , wherein the circuitry is further configured to:

receive a flag indicating whether the picture includes a single tile in a PPS or the SPS; and

in response to the picture including the single tile, determine the picture includes a single slice.

14. The apparatus of claim 9 , wherein the circuitry is further configured to:

for each slice in the picture, receive a subpicture ID associated with each slice in a PPS or the SPS.

15. The apparatus of claim 9 , wherein the circuitry is further configured to:

receive syntax elements indicating a layout of the one or more slices in the picture;

receive a subpicture ID for each of the one or more slices in the picture; and

determine the position, the size, or a subpicture ID of each of the subpictures in the picture based on the received syntax elements indicating the layout of the one or more slices in the picture and the received subpicture ID for each of the one or more slices in the picture.

16. The apparatus of claim 15 , wherein the syntax elements indicating the layout of the one or more slices in the picture, or the subpicture ID for each of the one or more slices in the picture are signaled in the SPS or a PPS.

17. A non-transitory computer-readable medium storing instructions that, when executed by a processor, cause the processor to perform a method, the method comprising:

receiving a first syntax element indicating a coding tree unit (CTU) size in a bitstream at a decoder;

receiving a second syntax element corresponding to whether a picture is partitioned into subpictures, the second syntax element corresponding to whether the picture is partitioned into the subpictures being signaled in a sequence parameter set (SPS) in the bitstream, each subpicture containing one or more slices partitioned from the picture;

in response to the second syntax element corresponding to the picture being partitioned into the subpictures, receiving third syntax elements indicating a position and a size of each of the subpictures in the picture based on a unit of the CTU size, the third syntax elements indicating the position and the size of each of the subpictures being signaled in the SPS in the bitstream; and

reconstructing one or more of the subpictures based on the position and the size of each of the respective subpictures in the picture.

18. The non-transitory computer-readable medium of claim 17 , wherein the first or second syntax element is included in the SPS or a picture parameter set (PPS).

19. The non-transitory computer-readable medium of claim 17 , wherein the third syntax elements include subpicture indices associated with respective grid elements of a grid partitioning the picture, the grid elements associated with a same index of the subpicture indices collectively forming one of the subpictures, a size of the grid elements being specified with a unit of the CTU size or a unit of 8 samples.

20. The non-transitory computer-readable medium of claim 17 , wherein the method further comprises:

receiving a fourth syntax element in a slice header of one of the one or more slices in the picture, the fourth syntax indicating a subpicture identifier (ID) of one of the subpictures that contains the one of the one or more slices in the picture, the subpicture ID indicating that the one of the one or more slices in the picture belongs to the one of the subpictures.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 16, 2022
From: MEDIATEK SINGAPORE PTE LTD.
To: HFI INNOVATION INC.
Reel/Frame 059281/0513 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 3, 2020
From: CHEN, LULIN; HSU, CHIH-WEI; HUANG, YU-WEN
To: MEDIATEK SINGAPORE PTE. LTD.
Reel/Frame 053685/0170 →
Continuity (3)
Provisional Application 62889068 · Aug 20, 2019
Provisional Application 62884206 · Aug 8, 2019
Related Publication 20210044838A1 · Feb 11, 2021
Cited By (1)
US 12,439,032