IP Library › Granted Patent US 12,375,724
Granted Patent B2
US 12,375,724 · App. 17/702,418 · Granted Jul 29, 2025

Signaling of picture header in video coding

Inventors: Fnu Hendry (San Diego, CA); Ye-Kui Wang (San Diego, CA); Jianle Chen (San Diego, CA)
Assignee: Huawei Technologies Co., Ltd.
H04N19/70H04N19/172H04N19/174H04N19/188H04N19/44H04N19/46
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,375,724
App. No.
17/702,418
Granted
Jul 29, 2025
Kind
B2
Abstract

A method of decoding is provided. The method includes receiving a video bitstream including a picture unit (PU), where the PU includes a picture header (PH) network abstraction layer (NAL) unit preceding a first video coding layer (VCL) NAL unit, and decoding a coded picture from the PU to obtain a decoded picture.

Claims (40)

1. A method of decoding implemented by a video decoder, comprising:

receiving a video bitstream including a picture unit (PU), the PU including a picture header (PH) network abstraction layer (NAL) unit preceding a first video coding layer (VCL) NAL unit, wherein the first VCL NAL unit includes a slice of a coded picture, wherein the PH NAL unit is a non-VCL NAL unit, and wherein a value of a temporal identifier (TemporalId) for non-VCL NAL units is constrained as follows:

when a NAL unit type (nal_unit_type) is equal to dependency parameter set NAL unit type (DPS_NUT), video parameter set NAL unit type (VPS_NUT), or sequence parameter set NAL unit type (SPS_NUT), the temporal identifier for the non-VCL NAL units is equal to 0 and a temporal identifier of the PU containing the NAL unit shall be equal to 0, and

when the nal_unit type is equal to PH NAL unit type (PH_NUT), the temporal identifier for the non-VCL NAL units shall be equal to the temporal identifier of the PU containing the NAL unit; and

decoding the coded picture from the PU to obtain a decoded picture.

2. The method of claim 1 , wherein the PU includes only one picture header (PH), and wherein the coded picture is the only picture in the PU.

3. The method of claim 1 , wherein the PH NAL unit in the PU precedes each VCL NAL unit in the PU inclusive of the first VCL NAL unit of the PU.

4. The method of claim 1 , wherein the first VCL NAL unit includes a slice of the coded picture.

5. The method of claim 2 , wherein the PH NAL unit includes the only one PH.

6. The method of claim 5 , wherein the only one PH in the PH NAL unit includes syntax elements that apply to all slices of the coded picture.

7. The method of claim 1 , wherein the first VCL NAL unit is an initial VCL NAL unit in the PU.

8. The method of claim 1 , further comprising displaying the decoded picture on a display of an electronic device.

9. A method of encoding implemented by a video encoder, the method comprising:

generating a picture unit (PU) including a picture header (PH) network abstraction layer (NAL) unit preceding a first video coding layer (VCL) NAL unit, wherein the first VCL NAL unit includes a slice of a coded picture, wherein the PH NAL unit is a non-VCL NAL unit, and wherein a value of a temporal identifier (TemporalId) for non-VCL NAL units is constrained as follows:

when a NAL unit type (nal_unit_type) is equal to dependency parameter set NAL unit type (DPS_NUT), video parameter set NAL unit type (VPS_NUT), or sequence parameter set NAL unit type (SPS_NUT), the temporal identifier for the non-VCL NAL units is equal to 0 and a temporal identifier of the PU containing the NAL unit shall be equal to 0, and

when the nal_unit type is equal to PH NAL unit type (PH_NUT), the temporal identifier for the non-VCL NAL units shall be equal to the temporal identifier of the PU containing the NAL unit;

encoding the PU into a video bitstream; and

storing the video bitstream for communication toward a video decoder.

10. The method of claim 9 , wherein the PU includes only one picture header (PH) and the coded picture, and wherein the coded picture is the only picture in the PU.

11. The method of claim 9 , wherein the PH NAL unit in the PU precedes each VCL NAL unit in the PU inclusive of the first VCL NAL unit.

12. The method of claim 9 , wherein the first VCL NAL unit includes a slice of the coded picture.

13. A decoding device, comprising:

a receiver configured to receive a video bitstream including a picture unit (PU), the PU including a picture header (PH) network abstraction layer (NAL) unit preceding a first video coding layer (VCL) NAL unit, wherein the first VCL NAL unit includes a slice of a coded picture, wherein the PH NAL unit is a non-VCL NAL unit, and wherein a value of a temporal identifier (TemporalId) for non-VCL NAL units is constrained as follows:

when a NAL unit type (nal_unit_type) is equal to dependency parameter set NAL unit type (DPS_NUT), video parameter set NAL unit type (VPS_NUT), or sequence parameter set NAL unit type (SPS_NUT), the temporal identifier for the non-VCL NAL units is equal to 0 and a temporal identifier of the PU containing the NAL unit shall be equal to 0, and

when the nal_unit type is equal to PH NAL unit type (PH_NUT), the temporal identifier for the non-VCL NAL units shall be equal to the temporal identifier of the PU containing the NAL unit;

a memory coupled to the receiver, the memory storing instructions; and

one or more processors coupled to the memory, the one or more processors configured to execute the instructions to cause the decoding device to decode the coded picture from the PU to obtain a decoded picture.

14. The decoding device of claim 13 , wherein the PU includes only one picture header (PH), and wherein the coded picture is the only picture in the PU.

15. The decoding device of claim 13 , wherein the PH NAL unit in the PU precedes each VCL NAL unit in the PU inclusive of the first VCL NAL unit.

16. The decoding device of claim 13 , wherein the first VCL NAL unit includes a slice of the coded picture.

17. An encoding device, comprising:

a memory containing instructions;

one or more processors coupled to the memory, the one or more processors configured to implement the instructions to cause the encoding device to:

generate a picture unit (PU) including a picture header (PH) network abstraction layer (NAL) unit preceding a first video coding layer (VCL) NAL unit, wherein the first VCL NAL unit includes a slice of a coded picture, wherein the PH NAL unit is a non-VCL NAL unit, and wherein a value of a temporal identifier (Temporalld) for non-VCL NAL units is constrained as follows:

when a NAL unit type (nal_unit_type) is equal to dependency parameter set NAL unit type (DPS_NUT), video parameter set NAL unit type (VPS_NUT), or sequence parameter set NAL unit type (SPS_NUT), the temporal identifier for the non-VCL NAL units is equal to 0 and a temporal identifier of the PU containing the NAL unit shall be equal to 0, and

when the nal_unit type is equal to PH NAL unit type (PH_NUT), the temporal identifier for the non-VCL NAL units shall be equal to the temporal identifier of the PU containing the NAL unit;

encode the PU into a video bitstream; and

a transmitter coupled to the one or more processors, the transmitter configured to transmit the video bitstream toward a video decoder.

18. The encoding device of claim 17 , wherein the PU includes only one picture header (PH) and the coded picture, and wherein the coded picture is the only picture in the PU.

19. The encoding device of claim 17 , wherein the PH NAL unit in the PU precedes each VCL NAL unit in the PU inclusive of the first VCL NAL unit, and wherein the first VCL NAL unit includes a slice of the coded picture.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Oct 26, 2023
From: FUTUREWEI TECHNOLOGIES, INC.
To: HUAWEI TECHNOLOGIES CO., LTD.
Reel/Frame 065362/0693 →
Continuity (3)
Continuation PCTUS2020045038 · Aug 5, 2020
Provisional Application 62905150 · Sep 24, 2019
Related Publication 20220224945A1 · Jul 14, 2022
References Cited (103)
US 6965646B1 · Firestone · 2005 [cited by applicant]
US 10674171B2 · Samuelsson et al. · 2020 [cited by applicant]
US 12010309B2 · Poirier et al. · 2024 [cited by applicant]
US 20030068089A1 · Sano et al. · 2003 [cited by applicant]
US 20060050793A1 · Wang et al. · 2006 [cited by applicant]
US 20060083300A1 · Han et al. · 2006 [cited by applicant]
US 20060171471A1 · Zhou · 2006 [cited by examiner]
US 20070171986A1 · Hannuksela · 2007 [cited by applicant]
US 20130064284A1 · Samuelsson et al. · 2013 [cited by applicant]
US 20130077681A1 · Chen et al. · 2013 [cited by applicant]
US 20130101037A1 · Chono et al. · 2013 [cited by applicant]
US 20130107953A1 · Chen et al. · 2013 [cited by applicant]
US 20130114735A1 · Wang · 2013 [cited by applicant]
US 20130182755A1 · Chen et al. · 2013 [cited by applicant]
US 20130195201A1 · Boyce et al. · 2013 [cited by applicant]
US 20130322531A1 · Chen et al. · 2013 [cited by applicant]
US 20130343465A1 · Chen · 2013 [cited by examiner]
US 20140003520A1 · Rodriguez et al. · 2014 [cited by applicant]
US 20140092955A1 · Wang · 2014 [cited by applicant]
US 20140092963A1 · Wang · 2014 [cited by applicant]
US 20140098894A1 · Wang · 2014 [cited by applicant]
US 20140153636A1 · Esenlik et al. · 2014 [cited by applicant]
US 20140192897A1 · Wang et al. · 2014 [cited by applicant]
US 20140314148A1 · Lainema et al. · 2014 [cited by applicant]
US 20150063453A1 · Kang et al. · 2015 [cited by applicant]
US 20150110192A1 · Wang et al. · 2015 [cited by applicant]
US 20150146976A1 · Ma et al. · 2015 [cited by applicant]
US 20150195577A1 · Hannuksela · 2015 [cited by applicant]
US 20150326883A1 · Rosewarne · 2015 [cited by applicant]
US 20150382018A1 · Hendry et al. · 2015 [cited by applicant]
US 20150382023A1 · Ramasubramonian et al. · 2015 [cited by applicant]
US 20160212439A1 · Hannuksela · 2016 [cited by applicant]
US 20160381393A1 · Tsukuba et al. · 2016 [cited by applicant]
US 20170105004A1 · Chen et al. · 2017 [cited by applicant]
US 20170237999A1 · Hendry et al. · 2017 [cited by applicant]
US 20170324981A1 · Deshpande · 2017 [cited by applicant]
US 20180248653A1 · Ishigaya et al. · 2018 [cited by applicant]
US 20200404334A1 · Coban et al. · 2020 [cited by applicant]
US 20210092426A1 · Choi et al. · 2021 [cited by applicant]
US 20210144384A1 · Berg et al. · 2021 [cited by applicant]
US 20220060752A1 · Pettersson et al. · 2022 [cited by applicant]
US 20220067052A1 · Chauhan et al. · 2022 [cited by applicant]
US 20220321922A1 · Kim et al. · 2022 [cited by applicant]
CN 1764276A · 2006 [cited by applicant]
EP 3399752A1 · 2018 [cited by applicant]
EP 3005705B1 · 2019 [cited by applicant]
JP 2003169333A · 2003 [cited by applicant]
JP 2013048307A · 2013 [cited by applicant]
JP 6224162B2 · 2017 [cited by applicant]
JP 6272343B2 · 2018 [cited by applicant]
RU 2584491C2 · 2016 [cited by applicant]
RU 2618942C2 · 2017 [cited by applicant]
RU 2619194C2 · 2017 [cited by applicant]
RU 2625534C2 · 2017 [cited by applicant]
RU 2630176C2 · 2017 [cited by applicant]
RU 2633100C2 · 2017 [cited by applicant]
RU 2635892C2 · 2017 [cited by applicant]
RU 2639958C2 · 2017 [cited by applicant]
RU 2646325C2 · 2018 [cited by applicant]
RU 2653299C2 · 2018 [cited by applicant]
RU 2667048C2 · 2018 [cited by applicant]
WO 2013012372A1 · 2013 [cited by applicant]
WO 2014165653A2 · 2014 [cited by applicant]
WO 2015137432A1 · 2015 [cited by applicant]
WO 2015140401A1 · 2015 [cited by applicant]
WO 2018159987A1 · 2018 [cited by applicant]
WO 2021055699A1 · 2021 [cited by applicant]
WO 2021100724A1 · 2021 [cited by applicant]
WO 2021133519A1 · 2021 [cited by applicant]
Document: JVET-O0146-v1, Wang, Y., “AHG17: On unspecified NAL unit types,” Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IECJTC 1/SC 29/WG11, 15th Meeting: Gothenburg, SE, Jul. 3-12, 2019, 5 pages, XP03020… [cited by applicant]
Document: JVET-O2001-vE, Bross, B., et al., “Versatile Video Coding (Draft 6),” Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and 1S0/IEC JTC 1/SC 29/WG 11, 15th Meeting: Gothenburg, SE, Jul. 3-12, 2019, 455 pages… [cited by applicant]
Sjoberg, R., et al., “Overview of HEVC High-Level Syntax and Reference Picture Management,” IEEE Transactions on Circuits and Systems for Video Technology, vol. 22, No. 12, Dec. 2012, 13 pages, XP011487159. [cited by applicant]
Document: JVET-L0415-v1, Sjoberg, R., et al., “Tile groups for VVC,” Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC29/WG 11, 12th Meeting: Macao, CN, Oct. 3-12, 2018, 4 pages, XP030193912. [cited by applicant]
Document: JVET-S0269 SpecText based on JVET-S2001-v5, [online], Bross, B., et al., “Versatile Video Coding (Draft 10),” Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, 19th Meeting: by… [cited by applicant]
Document: JVET-M0377-v2, Sjoberg, R., et al., “AHG17: Picture header NAL unit type,” Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IECJTC 1/SC 29/WG11, 14th Meeting: Marrakesh, MA, Jan. 9-18, 2019, 8 pages… [cited by applicant]
Document: JVET-P1006-v2, Wan, W., et al., “AHG17: Text for picture header,” Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IECJTC 1/SC 29/WG11, 16th Meeting: Geneva, CH, Oct. 1-11, 2019, 4 pages, XP03021840… [cited by applicant]
Document: JVET-M0260, Hannuksela, M., “AHG 17: Carriage of tile group header parameters in higher level structures,” Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG11, 13th Meeting: Marrak… [cited by applicant]
Document: JVET-P0120-v1, Hendry, et al., “AHG17: On Access Unit Delimiter and Picture Header,” Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IECJTC 1/SC 29/WG11, 16th Meeting: Geneva, CH, Oct. 1-11, 2019, … [cited by applicant]
Document: JVET-M0415, Deshpande, S., “Comments on High-Level Syntax of VVC,” Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG11, 13th Meeting: Marrakech, MA, Jan. 9-18, 2019, 7 pages, XP030… [cited by applicant]
Document: JVET-M0430, Skupin, R., et al., “AHG12: On Tiles and Tile Groups for VVC,” Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG11, 13th Meeting: Marrakech, MA, Jan. 9-18, 2019, 3 page… [cited by applicant]
Document: JVET-P2001-vE, Bross, B., et al., “Versatile Video Coding (Draft 7),” Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, 16th Meeting: Geneva, CH, Oct. 1-11, 2019, 491 pages, XP… [cited by applicant]
Document: JVET-Q2001-vE, Bross, B., et al., “Versatile Video Coding (Draft 8),” Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/ SC 29/WG11, 17th Meeting: Brussels, BE, Jan. 7-17, 2020, 512 pages, … [cited by applicant]
Document: JVET-O2001-vE, Bross, B., et al., “Versatile Video Coding (Draft 6),” Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/ SC 29/WG11, 15th Meeting: Gothenburg, SE, Jul. 3-12, 2019, 455 pages… [cited by applicant]
Wenger Stephan et al., “RTP payload format for H.264/SVC scalable video coding,” Journal of Zhejiang University Science A, May 2006, 12 pages. [cited by applicant]
“Line Transmission of Non-Telephone Signals Video Codec for Audiovisual Services at px64 kbits,” ITU-T Recommendation H.261, Mar. 1993, 29 pages. [cited by applicant]
“Transmission of Non-Telephone Signals; Information Technology—Generic Coding of Moving Pictures and Associated Audio Information: Video,” ITU-T Recommendation H.262, Jul. 1995, 211 pages. [cited by applicant]
“Series H: Audiovisual and Multimedia Systems; Infrastructure of audiovisual services—Coding of moving video; Video coding for low bit rate communication,” ITU-T Recommendation H.263, Jan. 2005, 226 pages. [cited by applicant]
“Series H: Audiovisual and Multimedia Systems; Infrastructure of audiovisual services—Coding of moving video; Advanced video coding for generic audiovisual services,” Recommendation ITU-T H.264, Jun. 2019, 836 pages. [cited by applicant]
“Series H: Audiovisual and Multimedia Systems; Infrastructure of audiovisual services—Coding of moving video; High efficiency video coding” Recommendation ITU-T H.265, Apr. 2013, 317 pages. [cited by applicant]
Bross, B., et al., “Versatile Video Coding (Draft 6),” Document: JVET-O2001-vE, Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11 15th Meeting: Gothenburg, SE, Jul. 3-12, 2019, 455 pages. [cited by applicant]
Wenger, S., et al., “RTP Payload format for H.264/SVC scalable video coding,” Journal of Zhejiang University, Science A ISSN 100-3095 (Print); ISSN 1862-1775 (Online), Feb. 25, 2006, 3 pages. [cited by applicant]
Hannuksela, M., et al., “Isolated Regions in Video Coding,” IEEE Transactions on Multimedia, vol. 6, No. 2, Apr. 2004, 9 pages. [cited by applicant]
Chan, Y., “Introduction to H.264: (1) NAL Unit,” H.264, ISO, ITU-T, MPEG-4, Standard/Specification, Nov. 12, 2014, 8 pages. [cited by applicant]
Series HL Audiovisual and Multimedia Systems Infrastructure of audiovisual services—Coding of moving video;High efficiency video coding; Recommendation ITU-T H.265, Feb. 2018, 21 pages total. pp. 11 and 66-70. [cited by applicant]
Supervised by Sakae Okubo, Impress standardization textbook series H.265/HEVC textbook, the first edition, Impress Japan co., Ltd., Oct. 21, 2013, pp. 93-95, 192-197, ISBN: 978-4-8443-3468-2. [cited by applicant]
Edited by Tokumichi Murakami (and two others), High efficiency video coding technique HEVC/H.265 and their applications, the first edition, Feb. 25, 2013, pp. 79-82, ISBN: 978-4-274-21329-8. [cited by applicant]
Document: JVET-R0065-v1, Wang, Y.K., et al., “AHG8/AHG9: On IRAP and GDR AUs,” Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WVG 11, 18th Meeting: by teleconference, Apr. 15-24, 2020, 3 pag… [cited by applicant]
Author: Yumi Chan, “Introduction to H.264: (1) NAL Unit,” Nov. 12, 2014, URL:https://yumichan.net/video-processing/video-compression/introduction-to-h264-nal-unit/, 8 pages. [cited by applicant]
Document: JVET-S2001-v5, Bross, B., et al., “Versatile Video Coding (Draft 10),” Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11 19th Meeting: by teleconference, Jun. 22-Jul. 1, 2020, 5… [cited by applicant]
Hannuksela (Nokia) M M: “AHG12/AHG17: On merging of MCTSs for viewport-dependent streaming”, 13. JVET Meeting; Jan. 9-18, 2019; Marrakech; (The Joint Video Exploration Team of ISO/IEC JTC1/SC29/WG11 and ITU-T SG. 16) no… [cited by applicant]
Chen L et al: “AHG17: Signaling random access properties in the NAL unit header”, 13 JVET Meeting; Jan. 9-18, 2019; Marrakech; (The Joint Video Exploration Team of ISO/IEC JTC1/SC29/WG11 and ITU-T SG. 16) no. JVET-M0161… [cited by applicant]
Sjoberg (Ericsson) ret al: “AHG9: Picture header enabled flag”, 17. JVET Meeting; Jan. 7-17, 2020; Brussels; (The Joint Video Exploration Team of ISO/IEC JTC1/SC29/WG11 and ITU-T SG. 16) no. JVET-Q0426; m52021 Dec. 31, … [cited by applicant]
Miska M. Hannuksela et al, “AHG12: On independently coded picture regions,” Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, Document: JVET-O0394, 15th Meeting: Gothenburg, SE, Jul. 3-1… [cited by applicant]