IP Library › Granted Patent US 12,407,870
Granted Patent B2
US 12,407,870 · App. 18/671,389 · Granted Sep 2, 2025

Signaling of picture header in video coding

Inventors: FNU Hendry (San Diego, CA); Ye-Kui Wang (San Diego, CA); Jianle Chen (San Diego, CA)
Assignee: Huawei Technologies Co., Ltd.
H04N19/70H04N19/172H04N19/174H04N19/188H04N19/44H04N19/46
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,407,870
App. No.
18/671,389
Granted
Sep 2, 2025
Kind
B2
Abstract

A method of decoding is provided. The method includes receiving a video bitstream including a picture unit (PU), where the PU includes a picture header (PH) network abstraction layer (NAL) unit preceding a first video coding layer (VCL) NAL unit, and decoding a coded picture from the PU to obtain a decoded picture.

Claims (29)

1. A non-transitory computer readable medium comprising a computer program product for use by a video coding device, the computer program product comprising computer executable instructions stored on the non-transitory computer readable medium such that when executed by a processor cause the video coding device to:

receive a video bitstream including a picture unit (PU), the PU including a picture header (PH) network abstraction layer (NAL) unit preceding a first video coding layer (VCL) NAL unit, wherein the first VCL NAL unit includes a slice of a coded picture, wherein the PH NAL unit is a non-VCL NAL unit, and wherein a value of a temporal identifier (TemporalId) for non-VCL NAL units is constrained as follows:

when a NAL unit type (nal_unit_type) is equal to dependency parameter set NAL unit type (DPS_NUT), video parameter set NAL unit type (VPS_NUT), or sequence parameter set NAL unit type (SPS_NUT), the temporal identifier for the non-VCL NAL units is equal to 0 and a temporal identifier of the PU containing the NAL unit shall be equal to 0, and

when the nal_unit_type is equal to PH NAL unit type (PH_NUT), the temporal identifier for the non-VCL NAL units shall be equal to the temporal identifier of the PU containing the NAL unit; and

decode the coded picture from the PU to obtain a decoded picture.

2. The non-transitory computer readable medium of claim 1 , wherein the PU includes only one picture header (PH), and wherein the coded picture is the only picture in the PU.

3. The non-transitory computer readable medium of claim 1 , wherein the PH NAL unit in the PU precedes each VCL NAL unit in the PU inclusive of the first VCL NAL unit of the PU.

4. The non-transitory computer readable medium of claim 1 , wherein the first VCL NAL unit includes a slice of the coded picture.

5. The non-transitory computer readable medium of claim 2 , wherein the PH NAL unit includes the only one PH.

6. The non-transitory computer readable medium of claim 5 , wherein the only one PH in the PH NAL unit includes syntax elements that apply to all slices of the coded picture.

7. The non-transitory computer readable medium of claim 1 , wherein the first VCL NAL unit is an initial VCL NAL unit in the PU.

8. The non-transitory computer readable medium of claim 1 , further comprising displaying the decoded picture on a display of an electronic device.

9. A non-transitory computer readable medium comprising a computer program product for use by a video coding device, the computer program product comprising computer executable instructions stored on the non-transitory computer readable medium such that when executed by a processor cause the video coding device to:

generate a picture unit (PU) including a picture header (PH) network abstraction layer (NAL) unit preceding a first video coding layer (VCL) NAL unit, wherein the first VCL NAL unit includes a slice of a coded picture, wherein the PH NAL unit is a non-VCL NAL unit, and wherein a value of a temporal identifier (TemporalId) for non-VCL NAL units is constrained as follows:

when a NAL unit type (nal_unit_type) is equal to dependency parameter set NAL unit type (DPS_NUT), video parameter set NAL unit type (VPS_NUT), or sequence parameter set NAL unit type (SPS_NUT), the temporal identifier for the non-VCL NAL units is equal to 0 and a temporal identifier of the PU containing the NAL unit shall be equal to 0, and

when the nal_unit_type is equal to PH NAL unit type (PH_NUT), the temporal identifier for the non-VCL NAL units shall be equal to the temporal identifier of the PU containing the NAL unit;

encoding the PU into a video bitstream; and

store the video bitstream for communication toward a video decoder.

10. The non-transitory computer readable medium of claim 9 , wherein the PU includes only one picture header (PH) and the coded picture, and wherein the coded picture is the only picture in the PU.

11. The non-transitory computer readable medium of claim 9 , wherein the PH NAL unit in the PU precedes each VCL NAL unit in the PU inclusive of the first VCL NAL unit.

12. The non-transitory computer readable medium of claim 9 , wherein the first VCL NAL unit includes a slice of the coded picture.

13. A method for storing a coded video bitstream, the method comprising:

encoding into a video bitstream a picture unit (PU) including a picture header (PH) network abstraction layer (NAL) unit preceding a first video coding layer (VCL) NAL unit, wherein the first VCL NAL unit includes a slice of a coded picture, wherein the PH NAL unit is a non-VCL NAL unit, and wherein a value of a temporal identifier (TemporalId) for non-VCL NAL units is constrained as follows:

when a NAL unit type (nal_unit_type) is equal to dependency parameter set NAL unit type (DPS_NUT), video parameter set NAL unit type (VPS_NUT), or sequence parameter set NAL unit type (SPS_NUT), the temporal identifier for the non-VCL NAL units is equal to 0 and a temporal identifier of the PU containing the NAL unit shall be equal to 0, and

when the nal_unit_type is equal to PH NAL unit type (PH_NUT), the temporal identifier for the non-VCL NAL units shall be equal to the temporal identifier of the PU containing the NAL unit; and

storing the coded video bitstream.

14. The method of claim 13 , wherein the PU includes only one picture header (PH) and the coded picture, and wherein the coded picture is the only picture in the PU.

15. The method of claim 13 , wherein the PH NAL unit in the PU precedes each VCL NAL unit in the PU inclusive of the first VCL NAL unit.

16. The method of claim 13 , wherein the first VCL NAL unit includes a slice of the coded picture.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 24, 2025
From: FUTUREWEI TECHNOLOGIES, INC.
To: HUAWEI TECHNOLOGIES CO., LTD.
Reel/Frame 071711/0661 →
Continuity (4)
Continuation 17702418 · Mar 23, 2022
Continuation PCTUS2020045038 · Aug 5, 2020
Provisional Application 62905150 · Sep 24, 2019
Related Publication 20240357180A1 · Oct 24, 2024
References Cited (114)
US 6965646B1 · Firestone · 2005 [cited by applicant]
US 10674171B2 · Samuelsson et al. · 2020 [cited by applicant]
US 12010309B2 · Poirier · 2024 [cited by examiner]
US 20030068089A1 · Sano et al. · 2003 [cited by applicant]
US 20060050793A1 · Wang et al. · 2006 [cited by applicant]
US 20060083300A1 · Han et al. · 2006 [cited by applicant]
US 20060171471A1 · Zhou · 2006 [cited by applicant]
US 20070171986A1 · Hannuksela · 2007 [cited by applicant]
US 20130064284A1 · Samuelsson et al. · 2013 [cited by applicant]
US 20130077681A1 · Chen et al. · 2013 [cited by applicant]
US 20130101037A1 · Chono · 2013 [cited by examiner]
US 20130107953A1 · Chen et al. · 2013 [cited by applicant]
US 20130114735A1 · Wang · 2013 [cited by applicant]
US 20130114742A1 · Hannuksela et al. · 2013 [cited by applicant]
US 20130182755A1 · Chen et al. · 2013 [cited by applicant]
US 20130195201A1 · Boyce et al. · 2013 [cited by applicant]
US 20130322531A1 · Chen et al. · 2013 [cited by applicant]
US 20130343465A1 · Chen et al. · 2013 [cited by applicant]
US 20140003520A1 · Rodriguez et al. · 2014 [cited by applicant]
US 20140092955A1 · Wang · 2014 [cited by applicant]
US 20140092963A1 · Wang · 2014 [cited by applicant]
US 20140098894A1 · Wang · 2014 [cited by applicant]
US 20140153636A1 · Esenlik et al. · 2014 [cited by applicant]
US 20140192897A1 · Wang et al. · 2014 [cited by applicant]
US 20140314148A1 · Lainema et al. · 2014 [cited by applicant]
US 20150063453A1 · Kang et al. · 2015 [cited by applicant]
US 20150110192A1 · Wang et al. · 2015 [cited by applicant]
US 20150146976A1 · Ma et al. · 2015 [cited by applicant]
US 20150195577A1 · Hannuksela · 2015 [cited by applicant]
US 20150326883A1 · Rosewarne · 2015 [cited by examiner]
US 20150382018A1 · Hendry et al. · 2015 [cited by applicant]
US 20150382023A1 · Ramasubramonian et al. · 2015 [cited by applicant]
US 20160212439A1 · Hannuksela · 2016 [cited by applicant]
US 20160381393A1 · Tsukuba et al. · 2016 [cited by applicant]
US 20170105004A1 · Chen et al. · 2017 [cited by applicant]
US 20170237999A1 · Hendry et al. · 2017 [cited by applicant]
US 20170324981A1 · Deshpande · 2017 [cited by applicant]
US 20180248653A1 · Ishigaya et al. · 2018 [cited by applicant]
US 20200404334A1 · Coban et al. · 2020 [cited by applicant]
US 20210092426A1 · Choi et al. · 2021 [cited by applicant]
US 20210144384A1 · Sjoberg et al. · 2021 [cited by applicant]
US 20220060752A1 · Pettersson et al. · 2022 [cited by applicant]
US 20220321922A1 · Kim et al. · 2022 [cited by applicant]
US 20230128218A1 · Deng et al. · 2023 [cited by applicant]
CN 1764276A · 2006 [cited by applicant]
EP 3399752A1 · 2018 [cited by applicant]
EP 3005705B1 · 2019 [cited by applicant]
JP 2003169333A · 2003 [cited by applicant]
JP 2013048307A · 2013 [cited by applicant]
JP 6224162B2 · 2017 [cited by applicant]
JP 6272343B2 · 2018 [cited by applicant]
RU 2584491C2 · 2016 [cited by applicant]
RU 2618942C2 · 2017 [cited by applicant]
RU 2619194C2 · 2017 [cited by applicant]
RU 2625534C2 · 2017 [cited by applicant]
RU 2630176C2 · 2017 [cited by applicant]
RU 2633100C2 · 2017 [cited by applicant]
RU 2635892C2 · 2017 [cited by applicant]
RU 2639958C2 · 2017 [cited by applicant]
RU 2646325C2 · 2018 [cited by applicant]
RU 2653299C2 · 2018 [cited by applicant]
RU 2667048C2 · 2018 [cited by applicant]
WO 2013012372A1 · 2013 [cited by applicant]
WO 2014165653A2 · 2014 [cited by applicant]
WO 2015137237A1 · 2015 [cited by applicant]
WO 2015137432A1 · 2015 [cited by applicant]
WO 2015140401A1 · 2015 [cited by applicant]
WO 2018159987A1 · 2018 [cited by applicant]
WO 2021055699A1 · 2021 [cited by applicant]
WO 2021100724A1 · 2021 [cited by applicant]
WO 2021133519A1 · 2021 [cited by applicant]
Document: JVET-R0065-v1, Wang, Y.K., et al., “AHG8/AHG9: On IRAP and GDR AUs,” Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, 18th Meeting: by teleconference, Apr. 15-24, 2020, 3 page… [cited by applicant]
Author: Yumi Chan, “Introduction to H.264: (1) NAL Unit,” Nov. 12, 2014, URL:https://yumichan.net/video-processing/video-compression/introduction-to-h264-nal-unit/, 8 pages. [cited by applicant]
Document: JVET-S2001-v5, Bross, B., et al., “Versatile Video Coding (Draft 10),” Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11 19th Meeting: by teleconference, Jun. 22-Jul. 1, 2020, 5… [cited by applicant]
Hannuksela, M., et al., “Isolated Regions in Video Coding,” IEEE Transactions on Multimedia, vol. 6, No. 2, Apr. 2004, 9 pages. [cited by applicant]
Chan, Y., “Introduction to H.264: (1) NAL Unit,” H.264, ISO, ITU-T, MPEG-4, Standard/Specification, Nov. 12, 2014, 8 pages. [cited by applicant]
Series HL Audiovisual and Multimedia Systems Infrastructure of audiovisual services—Coding of moving video; High efficiency video coding; Recommendation ITU-T H.265, Feb. 2018, 21 pages total. pp. 11 and 66-70. [cited by applicant]
Supervised by Sakae Okubo, Impress standardization textbook series H.265/HEVC textbook, the first edition, Impress Japan co., Ltd., Oct. 21, 2013, pp. 93-95, 192-197, ISBN: 978-4-8443-3468-2. [cited by applicant]
Edited by Tokumichi Murakami (and two others), High efficiency video coding technique HEVC/H.265 and their applications, the first edition, Feb. 25, 2013, pp. 79-82, ISBN: 978-4-274-21329-8. [cited by applicant]
Document: JVET-O0146-v1, Wang, Y., “AHG17: On unspecified NAL unit types,” Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IECJTC 1/SC 29/WG11, 15th Meeting: Gothenburg, SE, Jul. 3-12, 2019, 5 pages, XP03020… [cited by applicant]
Document: JVET-O2001-vE, Bross, B., et al., “Versatile Video Coding (Draft 6),” Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and 1S0/IEC JTC 1/SC 29/WG 11, 15th Meeting: Gothenburg, SE, Jul. 3-12, 2019, 455 pages… [cited by applicant]
Sjoberg, R., et al., “Overview of HEVC High-Level Syntax and Reference Picture Management,” IEEE Transactions on Circuits and Systems for Video Technology, vol. 22, No. 12, Dec. 2012, 13 pages, XP011487159. [cited by applicant]
Document: JVET-L0415-v1, Sjoberg, R., et al., “Tile groups for VVC,” Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC29/WG 11, 12th Meeting: Macao, CN, Oct. 3-12, 2018, 4 pages, XP030193912. [cited by applicant]
Document: JVET-S0269 SpecText based on JVET-S2001-v5, [online], Bross, B., et al., “Versatile Video Coding (Draft 10),” Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, 19th Meeting: by… [cited by applicant]
Document: JVET-M0377-v2, Sjoberg, R., et al., “AHG17: Picture header NAL unit type,” Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IECJTC 1/SC 29/WG11, 14th Meeting: Marrakesh, MA, Jan. 9-18, 2019, 8 pages… [cited by applicant]
Document: JVET-P1006-v2, Wan, W., et al., “AHG17: Text for picture header,” Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IECJTC 1/SC 29/WG11, 16th Meeting: Geneva, CH, Oct. 1-11, 2019, 4 pages, XP03021840… [cited by applicant]
Document: JVET-M0260, Hannuksela, M., “AHG 17: Carriage of tile group header parameters in higher level structures,” Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG11, 13th Meeting: Marrak… [cited by applicant]
Document: JVET-P0120-v1, Hendry, et al., “AHG17: On Access Unit Delimiter and Picture Header,” Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IECJTC 1/SC 29/WG11, 16th Meeting: Geneva, CH, Oct. 1-11, 2019, … [cited by applicant]
Document: JVET-M0415, Deshpande, S., “Comments on High-Level Syntax of VVC,” Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG11, 13th Meeting: Marrakech, MA, Jan. 9-18, 2019, 7 pages, XP030… [cited by applicant]
Document: JVET-M0430, Skupin, R., et al., “AHG12: On Tiles and Tile Groups for VVC,” Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG11, 13th Meeting: Marrakech, MA, Jan. 9-18, 2019, 3 page… [cited by applicant]
Document: JVET-P2001-vE, Bross, B., et al., “Versatile Video Coding (Draft 7),” Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, 16th Meeting: Geneva, CH, Oct. 1-11, 2019, 491 pages, XP… [cited by applicant]
Document: JVET-Q2001-vE, Bross, B., et al., “Versatile Video Coding (Draft 8),” Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/ SC 29/WG11, 17th Meeting: Brussels, BE, Jan. 7-17, 2020, 512 pages, … [cited by applicant]
Document: JVET-O2001-vE, Bross, B., et al., “Versatile Video Coding (Draft 6),” Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/ SC 29/WG11, 15th Meeting: Gothenburg, SE, Jul. 3-12, 2019, 455 pages… [cited by applicant]
Wenger Stephan et al., “RTP payload format for H.264/SVC scalable video coding,” Journal of Zhejiang University Science A, May 2006, 12 pages. [cited by applicant]
“Line Transmission of Non-Telephone Signals Video Codec for Audiovisual Services at p x 64 kbits,” ITU-T Recommendation H.261, Mar. 1993, 29 pages. [cited by applicant]
“Transmission of Non-Telephone Signals; Information Technology—Generic Coding of Moving Pictures and Associated Audio Information: Video,” ITU-T Recommendation H.262, Jul. 1995, 211 pages. [cited by applicant]
“Series H: Audiovisual and Multimedia Systems; Infrastructure of audiovisual services—Coding of moving video; Video coding for low bit rate communication,” ITU-T Recommendation H.263, Jan. 2005, 226 pages. [cited by applicant]
“Series H: Audiovisual and Multimedia Systems; Infrastructure of audiovisual services—Coding of moving video; Advanced video coding for generic audiovisual services,” Recommendation ITU-T H.264, Jun. 2019, 836 pages. [cited by applicant]
“Series H: Audiovisual and Multimedia Systems; Infrastructure of audiovisual services—Coding of moving video; High efficiency video coding” Recommendation ITU-T H.265, Apr. 2013, 317 pages. [cited by applicant]
Bross, B., et al., “Versatile Video Coding (Draft 6),” Document: JVET-O2001-vE, Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11 15th Meeting: Gothenburg, SE, Jul. 3-12, 2019, 455 pages. [cited by applicant]
Wenger, S., et al., “RTP Payload format for H.264/SVC scalable video coding,” Journal of Zhejiang University, Science A ISSN 100-3095 (Print); ISSN 1862-1775 (Online), Feb. 25, 2006, 3 pages. [cited by applicant]
Rickard Sjöberg et al:“AHG17: Picture header NAL unit type.” JVET of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, 14th Meeting: Marrakesh, MA, Jan. 9-18, 2019. JVET-M0377-v2, total 11 pages. [cited by applicant]
Benjamin Bross et al:“Versatile Video Coding (Draft 6).” JVET of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, 15th Meeting: Gothenburg, SE, Jul. 3-12, 2019. JVET-O2001-vE, total 461 pages. [cited by applicant]
ITU-T H.265. Series H: Audiovisual and Multimedia Systems Infrastructure of audiovisual services Coding of moving video. High efficiency video coding, Feb. 2018, total 692 pages. [cited by applicant]
Hannuksela (Nokia) M M: “AHG12/AHG17: On merging of MCTSs for viewport-dependent streaming”, JVET Meeting; Jan. 9, 2019-Jan. 18, 2019; Marrakech, MA, Jan. 9-18, 2019; (The Joint Video Exploration Team of ISO/IEC JTC1/SC… [cited by applicant]
Chen L et al: “AHG17: Signalling random access properties in the NAL unit header”, JVET Meeting; Jan. 9, 2019-Jan. 18, 2019; Marrakech, MA, Jan. 9-18, 2019; (The Joint Video Exploration Team of ISO/IEC JTC1/SC29/WG11 an… [cited by applicant]
Sjoberg (Ericsson) R et al: “AHG9: Picture header enabled flag”, JVET Meeting; Jan. 7, 2020-Jan. 17, 2020; Brussels, BE, Jan. 7-17, 2020; (The Joint Video Exploration Team of ISO/IEC JTC1/SC29/WG11 and ITU-T SG.16 ), No… [cited by applicant]
Miska M.Hannuksela et al,“Isolated Regions in Video Coding”, IEEE Transactions on Multimedia,vol. 6,No. 2,Apr. 2004(Apr. 2004),total 9 pages. [cited by applicant]
Nightingale et al.“Priority-based methods for reducing the impact of packet loss on HEVC encoded video streams.” In: Real-Time image and Video Processing 2013.Jan. 7, 2013(Jan. 7, 2013) Retrieved on Oct. 8, 2020 (Oct. 8… [cited by applicant]
Wenger et al.“RTP payload format for H.264/SVC scalable video coding.” In: Journal of Zhejiang University—Science A.Feb. 25, 2006(Feb. 25, 2006),total 11 pages. [cited by applicant]
Yumi Chan“Introduction to H.264:(1) NAL Unit”,Nov. 12, 2014,URL:https://yumichan.net/video-processing/video-compression/introduction-to-h264-nal-unit/,total 7 pages. [cited by applicant]
Rickard Sjoberg et al,“Overview of HEVC High-Level Syntax and Reference Picture Management” In:IEEE transactions on circuits and systems for video technology.Dec. 2012 (Dec. 2012),total 14 pages. [cited by applicant]
Miska M. Hannuksela et al, “AHG12: On independently coded picture regions,” Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, Document: JVET-00394, 15th Meeting: Gothenburg, SE, Jul. 3-1… [cited by applicant]
Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, JVET-N1001-v10, “Versatile Video Coding (Draft 5)”, Benjamin Bross et al., Mar. 19-27, 2019, total 408 pages. [cited by applicant]