IP Library › Granted Patent US 11,356,685
Granted Patent B2
US 11,356,685 · App. 17/027,262 · Granted Jun 7, 2022

Signaling number of sub-pictures in high-level syntax for video coding

Inventors: Yao-Jen Chang (San Diego, CA); Muhammed Zeyd Coban (Carlsbad, CA); Vadim Seregin (San Diego, CA); Marta Karczewicz (San Diego, CA)
Assignee: Qualcomm Incorproated
H04N19/44H04N19/132H04N19/176H04N19/186H04N19/423H04N19/70
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,356,685
App. No.
17/027,262
Granted
Jun 7, 2022
Kind
B2
Abstract

A video decoder can be configured to decode a first syntax element indicating a size of a coding tree unit (CTU); after decoding the first syntax element indicating the size of the CTU, decode a second syntax element indicating a width of elements of a subpicture identifier grid; after decoding the first syntax element indicating the size of the CTU, decode a third syntax element indicating a height of the elements of the subpicture identifier grid; and determine a location of a subpicture within a picture based on the first syntax element, the second syntax element, and the third syntax element.

Claims (75)

1. A method of decoding video data, the method comprising:

decoding a first syntax element indicating a size of a coding tree unit (CTU);

after decoding the first syntax element indicating the size of the CTU, decoding a second syntax element indicating a width of elements of a subpicture identifier grid;

after decoding the first syntax element indicating the size of the CTU, decoding a third syntax element indicating a height of the elements of the subpicture identifier grid;

after decoding the first syntax element indicating the size of the CTU, decoding a fourth syntax element indicating a grid index for a subpicture;

determining a maximum value between the size of the CTU and a predetermined value;

in response to the predetermined value being the maximum value, determining a number of columns in the subpicture identifier grid based on the predetermined value;

in response to the predetermined value being the maximum value, determining a number of rows in the subpicture identifier grid based on the predetermined value;

determining a location of the subpicture within a picture based on the grid index, the determined number of columns, and the determined number of rows; and

decoding the subpicture based on the determined location.

2. The method of claim 1 , wherein determining the location of the subpicture within the picture based on the grid index, the determined number of columns, and the determined number of row further comprises:

identifying an element of the elements of the subpicture identifier grid based on a value of the fourth syntax element, the determined number of columns in the subpicture identifier grid, and the determined number of rows in the subpicture identifier grid; and

determining the location of the subpicture within the picture based on the identified element.

3. The method of claim 2 , wherein determining the location of the subpicture within the picture based on the identified element comprises determining a top-left luma sample of the subpicture based on the identified element.

4. The method of claim 1 , further comprising:

allocating an amount of memory to store the value of the fourth syntax element based on the size of the CTU.

5. The method of claim 1 , further comprising:

receiving the first syntax element, the second syntax element, and the third syntax element in a sequence parameter set of the video data.

6. The method of claim 4 , wherein the first syntax element is included in the sequence parameter set of the video data before the second syntax element and the third syntax element.

7. A device for decoding video data, the device comprising:

a memory; and

one or more processors implemented in circuitry, coupled to the memory, and configured to:

decode a first syntax element indicating a size of a coding tree unit (CTU);

after decoding the first syntax element indicating the size of the CTU, decode a second syntax element indicating a width of elements of a subpicture identifier grid;

after decoding the first syntax element indicating the size of the CTU, decode a third syntax element indicating a height of the elements of the subpicture identifier grid;

after decoding the first syntax element indicating the size of the CTU, decode a fourth syntax element indicating a grid index for a subpicture;

determine a maximum value between the size of the CTU and a predetermined value;

in response to the predetermined value being the maximum value, determine a number of columns in the subpicture identifier grid based on the predetermined value;

in response to the predetermined value being the maximum value, determine a number of rows in the subpicture identifier grid based on the predetermined value;

determine a location of the subpicture within a picture based on the grid index, the determined number of columns, and the determined number of rows; and

decode the subpicture based on the determined location.

8. The device of claim 7 , wherein to determine the location of the subpicture within the picture based on the grid index, the determined number of columns, and the determined number of row, the one or more processors are further configured to:

identify an element of the elements of the subpicture identifier grid based on a value of the fourth syntax element, the determined number of columns in the subpicture identifier grid, and the determined number of rows in the subpicture identifier grid; and

determine the location of the subpicture within the picture based on the identified element.

9. The device of claim 8 , wherein to determine the location of the subpicture within the picture based on the identified element, the one or more processors are further configured to determine a top-left luma sample of the subpicture based on the identified element.

10. The device of claim 7 , wherein the one or more processors are further configured to:

allocate an amount of memory to store the value of the fourth syntax element based on the size of the CTU.

11. The device of claim 7 , wherein the one or more processors are further configured to:

receive the first syntax element, the second syntax element, and the third syntax element in a sequence parameter set of the video data.

12. The device of claim 10 , wherein the first syntax element is included in the sequence parameter set of the video data before the second syntax element and the third syntax element.

13. The device of claim 10 , further comprising:

a display configured to display the decoded subpicture.

14. A non-transitory computer-readable storage medium having stored thereon instructions that, when executed, configure a processor to:

decode a first syntax element indicating a size of a coding tree unit (CTU);

after decoding the first syntax element indicating the size of the CTU, decode a second syntax element indicating a width of elements of a subpicture identifier grid;

after decoding the first syntax element indicating the size of the CTU, decode a third syntax element indicating a height of the elements of the subpicture identifier grid;

after decoding the first syntax element indicating the size of the CTU, decode a fourth syntax element indicating a grid index for a subpicture;

determine a maximum value between the size of the CTU and a predetermined value;

in response to the predetermined value being the maximum value, determine a number of columns in the subpicture identifier grid based on the predetermined value;

in response to the predetermined value being the maximum value, determine a number of rows in the subpicture identifier grid based on the predetermined value;

determine a location of the subpicture within a picture based on the grid index, the determined number of columns, and the determined number of rows; and

decode the subpicture based on the determined location.

15. The non-transitory computer-readable storage medium of claim 14 , wherein the instructions configure the processor to:

identify an element of the elements of the subpicture identifier grid based on a value of the fourth syntax element, the determined number of columns in the subpicture identifier grid, and the determined number of rows in the subpicture identifier grid; and

determine the location of the subpicture within the picture based on the identified element.

16. The non-transitory computer-readable storage medium of claim 15 , wherein the instructions configure the processor to determine a top-left luma sample of the subpicture based on the identified element.

17. The non-transitory computer-readable storage medium of claim 14 , wherein the instructions configure the processor to allocate an amount of memory to store the value of the fourth syntax element based on the size of the CTU.

18. The non-transitory computer-readable storage medium of claim 14 , wherein the instructions configure the processor to:

receive the first syntax element, the second syntax element, and the third syntax element in a sequence parameter set of the video data.

19. The non-transitory computer-readable storage medium of claim 17 , wherein the first syntax element is included in the sequence parameter set of the video data before the second syntax element and the third syntax element.

20. A device for decoding video data, the device comprising:

means for decoding a first syntax element indicating a size of a coding tree unit (CTU);

means for decoding a second syntax element indicating a width of elements of a subpicture identifier grid after decoding the first syntax element indicating the size of the CTU;

means for decoding a third syntax element indicating a height of the elements of the subpicture identifier grid after decoding the first syntax element indicating the size of the CTU;

means for decoding a fourth syntax element indicating a grid index for a subpicture after decoding the first syntax element indicating the size of the CTU;

means for determining a maximum value between the size of the CTU and a predetermined value;

means for determining a number of columns in the subpicture identifier grid based on the predetermined value in response to the predetermined value being the maximum value;

means for determining a number of rows in the subpicture identifier grid based on the predetermined value in response to the predetermined value being the maximum value;

means for determining a location of the subpicture within a picture based on the grid index, the determined number of columns, and the determined number of rows; and

means for decoding the subpicture based on the determined location.

21. The device of claim 20 , wherein the means for determining the location of the subpicture within the picture based on the grid index, the determined number of columns, and the determined number of rows further comprises:

means for identifying an element of the elements of the subpicture identifier grid based on a value of the fourth syntax element, the determined number of columns in the subpicture identifier grid, and the determined number of rows in the subpicture identifier grid; and

means for determining the location of the subpicture within the picture based on the identified element.

22. The device of claim 20 , further comprising:

means for allocating an amount of memory to store the value of the fourth syntax element based on the size of the CTU.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 24, 2021
From: CHANG, YAO-JEN; COBAN, MUHAMMED ZEYD; SEREGIN, VADIM; KARCZEWICZ, MARTA
To: QUALCOMM INCORPORATED
Reel/Frame 055702/0837 →
Continuity (2)
Provisional Application 62904516 · Sep 23, 2019
Related Publication 20210092421A1 · Mar 25, 2021
Cited By (1)
US 12,309,406