IP Library Granted Patent US 12,316,865
Granted Patent B2
US 12,316,865 · App. 17/370,887 · Granted May 27, 2025

Sub-picture identifier signaling in video coding

Inventors: Ye-Kui Wang (San Diego, CA); Fnu Hendry (San Diego, CA)
Assignee: Huawei Technologies Co., Ltd.
H04N19/436H04N19/119H04N19/132H04N19/137H04N19/174H04N19/184H04N19/188H04N19/1883H04N19/44H04N19/593H04N19/176H04N19/31H04N19/70
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,316,865
App. No.
17/370,887
Granted
May 27, 2025
Kind
B2
Abstract

A video coding mechanism is disclosed. The mechanism includes receiving a bitstream comprising a sequence parameter set (SPS), one or more sub-pictures partitioned from a picture, and one or more slice headers associated with one or more slices. The SPS is parsed to obtain sub-picture identifiers (IDs) for the one or more sub-pictures. The slice headers are parsed to obtain a current sub-picture ID associated with a current sub-picture. The current sub-picture ID indicating the slices are included in the current sub-picture of the one or more sub-pictures. The current sub-picture is decoded based on the current sub-picture ID to create a video sequence. The video sequence is forwarded for display.

Claims (42)

1. A method implemented in a decoder, the method comprising:

receiving a bitstream comprising a sequence parameter set (SPS), one or more sub-pictures partitioned from a picture, and one or more slice headers associated with one or more slices, wherein the SPS comprises a complete set of all sub-picture identifiers (IDs) for the one or more sub-pictures, wherein each sub-picture is a rectangular region capable of including more than one slice within the picture, and wherein the SPS further comprises one or more sub-picture sizes and one or more sub-picture positions for the one or more sub-pictures partitioned from the picture;

parsing the SPS to obtain sub-picture IDs for the one or more sub-pictures;

determining positions for the one or more sub-pictures based on the SPS;

parsing the slice headers to obtain a current sub-picture ID associated with a current sub-picture, the current sub-picture ID indicating the slices are included in the current sub-picture from the one or more sub-pictures;

obtaining a loop filter across sub-picture boundaries enabled flag (loop_filter_across_subpic_enabled_flag), wherein the loop_filter_across_subpic_enabled_flag specifies that in-loop filtering operations across sub-picture boundaries are enabled when equal to one, and wherein the loop_filter_across_subpic_enabled_flag specifies that in-loop filtering operations are not performed across sub-picture boundaries when equal to zero; and

decoding the current sub-picture based on the current sub-picture ID, the loop_filter_across_subpic_enabled_flag, and the positions for the one or more sub-pictures to create a video sequence.

2. The method of claim 1 , wherein decoding the current sub-picture includes:

matching the slices to the current sub-picture based on the current sub-picture ID; and

positioning the slices based on a sub-picture size and a position for the current sub-picture.

3. The method of claim 1 , wherein a sub-picture position includes an offset distance between a top-left sample of the current sub-picture and a top-left sample of the picture.

4. The method of claim 1 , wherein a sub-picture size includes a sub-picture height in luma samples and a sub-picture width in luma samples.

5. The method of claim 1 , wherein the SPS further comprises an indication that one or more of the sub-pictures are motion constrained sub-pictures.

6. The method of claim 1 , wherein the bitstream further comprises a supplemental enhancement information (SEI) message, and wherein the SEI message comprises information describing a bit rate of a set of sub-picture sequences.

7. A method implemented in a decoder, the method comprising:

receiving a bitstream comprising a sequence parameter set (SPS), a sub-picture partitioned from a picture, and a slice header associated with a slice, wherein the SPS comprises a complete set of all sub-picture identifiers (IDs) for one or more sub-pictures, wherein each sub-picture is a rectangular region capable of including more than one slice within the picture, and wherein the SPS further comprises one or more sub-picture sizes and one or more sub-picture positions for the one or more sub-pictures partitioned from the picture;

obtaining a sub-picture ID for the sub-picture from the slice header;

determining a position for the sub-picture based on the SPS;

determining that the sub-picture contains the slice based on the sub-picture ID;

obtaining a loop filter across sub-picture boundaries enabled flag (loop_filter_across_subpic_enabled_flag), wherein the loop_filter_across_subpic_enabled_flag specifies that in-loop filtering operations across sub-picture boundaries are enabled when equal to one, and wherein the loop_filter_across_subpic_enabled_flag specifies that in-loop filtering operations are not performed across sub-picture boundaries when equal to zero; and

decoding the picture based on the sub-picture ID, the loop_filter_across_subpic_enabled_flag, and the position for the sub-picture.

8. The method of claim 7 , wherein the SPS further comprises the sub-picture ID for the sub-picture.

9. The method of claim 7 , wherein decoding the picture includes:

matching the slice to the sub-picture based on the sub-picture ID; and

positioning the slice based on a sub-picture size and the position for the sub-picture.

10. The method of claim 7 , wherein the position for the sub-picture includes an offset distance between a top-left sample of the sub-picture and a top-left sample of the picture.

11. The method of claim 7 , wherein a sub-picture size includes a sub-picture height in luma samples and a sub-picture width in luma samples.

12. The method of claim 7 , wherein the bitstream further comprises a supplemental enhancement information (SEI) message, and wherein the SEI message comprises information describing a bit rate of a set of sub-picture sequences.

13. A decoder comprising:

a receiver configured to receive a bitstream comprising a sequence parameter set (SPS), a sub-picture partitioned from a picture, and a slice header associated with a slice, wherein the SPS comprises a complete set of all sub-picture identifiers (IDs) for the one or more sub-pictures, wherein each sub-picture is a rectangular region capable of including more than one slice within the picture, and wherein the SPS further comprises one or more sub-picture sizes and one or more sub-picture positions for the one or more sub-pictures partitioned from the picture; and

a processor coupled to the receiver and configured to:

obtain a sub-picture ID for the sub-picture from the slice header;

determine a position for the sub-picture based on the SPS;

determine the sub-picture contains the slice based on the sub-picture ID;

obtain a loop filter across sub-picture boundaries enabled flag (loop_filter_across_subpic_enabled_flag), wherein the loop_filter_across_subpic_enabled_flag specifies that in-loop filtering operations across sub-picture boundaries are enabled when equal to one, and wherein the loop_filter_across_subpic_enabled_flag specifies that in-loop filtering operations are not performed across sub-picture boundaries when equal to zero; and

decode the picture based on the sub-picture ID, the loop_filter_across_subpic_enabled_flag, and the position for the sub-picture.

14. The decoder of claim 13 , wherein the SPS further comprises the sub-picture ID for the sub-picture.

15. The decoder of claim 13 , wherein decoding the picture includes:

matching the slice to the sub-picture based on the sub-picture ID; and

positioning the slice based on a sub-picture size and the position for the sub-picture.

16. The decoder of claim 13 , wherein the position for the sub-picture includes an offset distance between a top-left sample of the sub-picture and a top-left sample of the picture.

17. The decoder of claim 13 , wherein the bitstream further comprises a supplemental enhancement information (SEI) message, and wherein the SEI message comprises information describing a bit rate of a set of sub-picture sequences.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 19, 2024
From: FUTUREWEI TECHNOLOGIES, INC.
To: HUAWEI TECHNOLOGIES CO., LTD.
Reel/Frame 068033/0884 →
Continuity (3)
Continuation PCTUS2020012970 · Jan 9, 2020
Provisional Application 62790207 · Jan 9, 2019
Related Publication 20210337227A1 · Oct 28, 2021
References Cited (76)
US 6393196B1 · Yamane · 2002 [cited by examiner]
US 20030112867A1 · Hannuksela et al. · 2003 [cited by applicant]
US 20030112868A1 · Yan et al. · 2003 [cited by applicant]
US 20060127040A1 · Takakuwa · 2006 [cited by examiner]
US 20070183676A1 · Hannuksela · 2007 [cited by examiner]
US 20100080304A1 · Reddy · 2010 [cited by examiner]
US 20100135384A1 · Berkvens et al. · 2010 [cited by applicant]
US 20120039386A1 · Srinivasamurthy et al. · 2012 [cited by applicant]
US 20120179833A1 · Kenrick · 2012 [cited by examiner]
US 20130089149A1 · Hayashi · 2013 [cited by examiner]
US 20130089265A1 · Yie · 2013 [cited by examiner]
US 20130156101A1 · Lu · 2013 [cited by examiner]
US 20130176389A1 · Chen et al. · 2013 [cited by applicant]
US 20130202051A1 · Zhou · 2013 [cited by applicant]
US 20130216146A1 · Yu et al. · 2013 [cited by applicant]
US 20130266075A1 · Wang et al. · 2013 [cited by applicant]
US 20130266076A1 · Wang · 2013 [cited by examiner]
US 20130287093A1 · Hannuksela et al. · 2013 [cited by applicant]
US 20140003493A1 · Chen et al. · 2014 [cited by applicant]
US 20140003504A1 · Ugur et al. · 2014 [cited by applicant]
US 20140092963A1 · Wang · 2014 [cited by examiner]
US 20140161174A1 · Mohsenian · 2014 [cited by examiner]
US 20140301464A1 · Wu et al. · 2014 [cited by applicant]
US 20140362919A1 · Zhou et al. · 2014 [cited by applicant]
US 20150016504A1 · Auyeung et al. · 2015 [cited by applicant]
US 20150016547A1 · Tabatabai · 2015 [cited by examiner]
US 20150195577A1 · Hannuksela · 2015 [cited by applicant]
US 20150222928A1 · Tian et al. · 2015 [cited by applicant]
US 20150304667A1 · Suehring et al. · 2015 [cited by applicant]
US 20150365702A1 · Deshpande · 2015 [cited by applicant]
US 20160027246A1 · Newton et al. · 2016 [cited by applicant]
US 20160057444A1 · Gisquet · 2016 [cited by examiner]
US 20160255373A1 · Deshpande · 2016 [cited by applicant]
US 20160330255A1 · Denoual et al. · 2016 [cited by applicant]
US 20180084260A1 · Chien · 2018 [cited by examiner]
US 20180097966A1 · Cmielowski · 2018 [cited by examiner]
US 20180352226A1 · An et al. · 2018 [cited by applicant]
US 20180376126A1 · Hannuksela · 2018 [cited by applicant]
US 20190007680A1 · Chen · 2019 [cited by examiner]
US 20190014337A1 · Skupin · 2019 [cited by examiner]
US 20200092578A1 · Huang · 2020 [cited by examiner]
US 20200177922A1 · Chujoh · 2020 [cited by examiner]
US 20200186838A1 · Zhao · 2020 [cited by examiner]
US 20200296417A1 · Ko · 2020 [cited by examiner]
US 20210112246A1 · Aono · 2021 [cited by examiner]
US 20210136363A1 · Jang · 2021 [cited by examiner]
US 20210274217A1 · Lim · 2021 [cited by examiner]
US 20210281858A1 · Hannuksela · 2021 [cited by examiner]
CN 1593065A · 2005 [cited by applicant]
JP 2013232887A · 2013 [cited by applicant]
JP 2017508334A · 2017 [cited by applicant]
JP 2022535312A · 2022 [cited by applicant]
WO 2014168650A1 · 2014 [cited by applicant]
WO 2020239743A1 · 2020 [cited by applicant]
JVET-M0536, “AHG12: On picture-level tile and sequence-level tile for VVC,” Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, 13th Meeting: Marrakesh, MO, Jan. 9-18, 2019, 8 pages. [cited by applicant]
JVET-M0261, “AHG12: On grouping of tiles,” Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, 13th Meeting: Marrakech, MA, Jan. 9-18, 2019, 11 pages. [cited by applicant]
CTVC-AC1005-v2, “HEVC Additional Supplemental Enhancement Information (Draft 4),” Joint Collaborative Team on Video Coding (JCT-VC) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, 29th Meeting: Macao, CN, Oct. 19-25,… [cited by applicant]
“Line Transmission of Non-Telephone Signals, Video Codec for Audiovisual Services at p x 64 kbits,” ITU-T, H.261, Mar. 1993, 29 pages. [cited by applicant]
“Transmission of Non-Telephone Signals, Information Technology—Generic Coding of Moving Pictures and Associated Audio Information: Video,” H.262, Jul. 1995, 211 pages. [cited by applicant]
“Series H: Audiovisual and Multimedia Systems, Infrastructure of audiovisual services—Coding of moving video, Video coding for low bit rate communication,” ITU-T, H.263, Jan. 2005, 226 pages. [cited by applicant]
“Series H: Audiovisual and Multimedia Systems, Infrastructure of audiovisual services—Coding of moving video, Advanced video coding for generic audiovisual services,” ITU-T, H.264, Jun. 2019, 836 pages. [cited by applicant]
“Series H: Audiovisual and Multimedia Systesm, Infrastructure of audiovisual services—Coding of moving video, High efficiency video coding,” H.265, Apr. 2013, 317 pages. [cited by applicant]
Bross, B., et al., “Versatile Video Coding (Draft 3),” JVET-L1001-v3, Oct. 3-12, 2018, 181 pages. [cited by applicant]
Wank, Y.K.., “RTP Payload Format for High Efficiency Video Coding (HEVC),” RFC 7798, Mar. 2016, 86 pages. [cited by applicant]
Zhou, M., “AHG4: Enable parallel decoding with tiles,” Joint Collaborative Team on Video Coding (JCT-VC) of ITU-T SG16 WP3 and ISO/IEC JTC1/SC29/WG11,9th Meeting: Geneva, Switzerland, Apr. 27-May 7, 2012, JCTVC-I0118, 9… [cited by applicant]
Coban, M., et al., “Support of independent sub-pictures,” Joint Collaborative Team on Video Coding (JCT-VC) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11,9th Meeting: Geneva, CH, Apr. 27-May 7, 2012, JCTVC-I0356, 5 … [cited by applicant]
Chen, L., et al., “AHG17/AHG12: On associating slices with a subpicture,” Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11,16th Meeting: Geneva, CH, Oct. 1-11, 2019, JVET-P0144-v1, 7 pag… [cited by applicant]
Document: JVET-N1001-v7, Bross, B., et al., “Versatile Video Coding (Draft 5)” Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, 14th Meeting: Geneva, CH, Mar. 19-27, 2019, 28 pages. [cited by applicant]
Document: JVET-Q0281, Choi, B., et al., “AHG12: Independently coded regions output window SEI message,” Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, 17th Meeting: Brussels, BE, Jan.… [cited by applicant]
Document: JVET-00182r1, He, Y., et al., “AHG12: On picture and sub-picture signaling,” Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, 15th Meeting: Gothenburg, SE, Jul. 3-12, 2019, 14… [cited by applicant]
Document: JVET-M0530, Coban, M., et al., “AHG12: On signalling of tiles”, Joint Video Experts Team (JVET) of ITU- T SG 16 WP 3 and ISO/IEC JTC1/SC29/WG11 13th Meeting: Marrakech, MA, Jan. 9-18, 2019, 4 pages. [cited by applicant]
Document: JVET-J0101-v2, Bross, B., et al., “Versatile Video Coding (Draft 1),” Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC1/SC29/WG11 10th Meeting: San Diego, US, Apr. 10-20, 2018, 42 pages. [cited by applicant]
Document: JVET-N0107, Wang, Y.K., et al., “AHG12: Sub-picture based coding for VVC”, Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC1/SC29/WG11 14th Meeting: Geneva, CH, Mar. 19-27, 2019, 4 pages. [cited by applicant]
Document: JVET-M0416, Deshpande, S., et al., “On Tile Information Signalling,” Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, 13th Meeting: Marrakech, MA, Jan. 9-18, 2019, 16 pages. [cited by applicant]
Document: JVET-M0261, Hannuksela, M., et al., “AHG12: On grouping of tiles,” Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, 13th Meeting: Marrakech, MA, Jan. 9-18, 2019, 18 pages. [cited by applicant]
Document: JVET-L1001-v9, Bross, B., et al., “Versatile Video Coding (Draft 3),” Joint Video Experts Team (JVET) of ITU-T SG16 WP 3 and ISO/IEC JTC 1/SC 19/WG 11, 12th Meeting: Macao, CN, Oct. 3-12, 2018, 235 pages. [cited by applicant]