IP Library Granted Patent US 12,356,013
Granted Patent B2
US 12,356,013 · App. 17/984,861 · Granted Jul 8, 2025

System and method for decoding including network abstraction layer unit structure with picture header

Inventors: Byeongdoo Choi (Palo Alto, CA); Stephan Wenger (Hillsborough, CA); Shan Liu (San Jose, CA)
Assignee: TENCENT AMERICA LLC
H04N19/70H04N19/172H04N19/46H04N19/50
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,356,013
App. No.
17/984,861
Granted
Jul 8, 2025
Kind
B2
Abstract

A method is provided that includes obtaining a coded bitstream that includes an access unit (AU); and decoding at least one picture of the coded bitstream based on the AU. The AU includes at least one picture unit (PU) that includes: a picture header network abstraction layer (NAL) unit; and at least one video coding layer (VCL) NAL unit that is after the picture header NAL unit within the AU.

Claims (55)

1. A method performed by at least one processor, the method comprising:

receiving a coded bitstream that includes an access unit (AU), the AU including a picture unit (PU) that includes:

a picture header network abstraction layer (NAL) unit that is a dependent picture header NAL unit, and

at least one video coding layer (VCL) NAL unit that is after the picture header NAL unit within the AU;

obtaining an independent picture header NAL unit of a coded picture of a reference layer, the coded picture of the reference layer being referenced by an enhancement layer picture that includes the at least one VCL NAL unit;

obtaining the dependent picture header NAL unit of the enhancement layer picture; and

performing picture header prediction comprising predicting a value of a syntax element of the dependent picture header NAL unit based on a value of a syntax element of the independent picture header NAL unit,

wherein the independent picture header NAL unit and the dependent picture header NAL unit are each an NAL unit that includes a NAL unit type syntax element that has a value indicating a picture header NAL unit.

2. The method of claim 1 , further comprising:

determining a delta value between the value of the syntax element of the dependent picture header NAL unit and the value of the syntax element of the independent picture header NAL unit.

3. The method of claim 1 , further comprising:

determining that the coded picture of the reference layer includes the independent picture header NAL unit based on a flag of the independent picture header NAL unit; and

determining that the enhancement layer picture includes the dependent picture header NAL unit based on a flag of the dependent picture header NAL unit.

4. The method of claim 1 , further comprising:

determining that the coded picture of the reference layer includes the independent picture header NAL unit based on a unit type of the coded picture of the reference layer; and

determining that the enhancement layer picture includes the dependent picture header NAL unit based on a unit type of the enhancement layer picture.

5. The method of claim 1 , wherein the independent picture header NAL unit directly precedes a VCL NAL unit in a decoding order in the coded picture of the reference layer.

6. The method of claim 1 , wherein the dependent picture header NAL unit directly precedes the at least one VCL NAL unit in a decoding order in the enhancement layer picture.

7. The method of claim 1 , wherein each of the coded picture in the reference layer and the enhancement layer picture includes a plurality of VCL NAL units and a plurality of picture header NAL units directly preceding the plurality of VCL NAL units, the plurality of VCL NAL units in the enhancement layer picture including the at least one VCL NAL unit in the enhancement layer picture.

8. A method of encoding, the method comprising:

encoding a bitstream that includes an access unit (AU), the AU including a picture unit (PU) that includes:

a picture header network abstraction layer (NAL) unit that is a dependent picture header NAL unit, and

at least one video coding layer (VCL) NAL unit that is after the picture header NAL unit within the AU; and

encoding an independent picture header NAL unit of a picture of a reference layer, the picture of the reference layer being referenced by an enhancement layer picture that includes the at least one VCL NAL unit, wherein

a value of a syntax element of the dependent picture header NAL unit of the enhancement layer picture is based on a value of a syntax element of the independent picture header NAL unit, and

the independent picture header NAL unit and the dependent picture header NAL unit are each an NAL unit that includes a NAL unit type syntax element that has a value indicating a picture header NAL unit.

9. The method of claim 8 , further comprising:

encoding, in the bitstream, a delta value between the value of the syntax element of the dependent picture header NAL unit and the value of the syntax element of the independent picture header NAL unit.

10. The method of claim 8 , further comprising:

encoding a flag of the independent picture header NAL unit that indicates the picture of the reference layer includes the independent picture header NAL unit; and

encoding a flag of the dependent picture header NAL unit that indicates the enhancement layer picture includes the dependent picture header NAL unit.

11. The method of claim 8 , further comprising:

encoding a unit type of the picture of the reference layer that indicates the picture of the reference layer includes the independent picture header NAL unit; and

encoding a unit type of the enhancement layer picture that indicates the enhancement layer picture includes the dependent picture header NAL unit.

12. The method of claim 8 , wherein the independent picture header NAL unit directly precedes a VCL NAL unit in an encoding order in the picture of the reference layer.

13. The method of claim 8 , wherein the dependent picture header NAL unit directly precedes the at least one VCL NAL unit in an encoding order in the enhancement layer picture.

14. The method of claim 8 , wherein each of the picture in the reference layer and the enhancement layer picture includes a plurality of VCL NAL units and a plurality of picture header NAL units directly preceding the plurality of VCL NAL units, the plurality of VCL NAL units in the enhancement layer picture including the at least one VCL NAL unit in the enhancement layer picture.

15. A method of processing visual media data, the method comprising:

processing a bitstream of the visual media data according to a format rule, wherein

the bitstream includes an access unit (AU), the AU including a picture unit (PU) that includes:

a picture header network abstraction layer (NAL) unit that is a dependent picture header NAL unit, and

at least one video coding layer (VCL) NAL unit that is after the picture header NAL unit within the AU; and

the format rule specifies that:

an independent picture header NAL unit of a coded picture of a reference layer is obtained, the coded picture of the reference layer being referenced by an enhancement layer picture that includes the at least one VCL NAL unit;

the dependent picture header NAL unit of the enhancement layer picture is obtained; and

picture header prediction is performed in which a value of a syntax element of the dependent picture header NAL unit is predicted based on a value of a syntax element of the independent picture header NAL unit, the independent picture header NAL unit and the dependent picture header NAL unit each being an NAL unit that includes a NAL unit type syntax element that has a value indicating a picture header NAL unit.

16. The method of claim 15 , wherein the format rule specifies that a delta value between the value of the syntax element of the dependent picture header NAL unit and the value of the syntax element of the independent picture header NAL unit is determined.

17. The method of claim 15 , wherein the format rule specifies that:

the coded picture of the reference layer is determined to include the independent picture header NAL unit based on a flag of the independent picture header NAL unit; and

the enhancement layer picture is determined to include the dependent picture header NAL unit based on a flag of the dependent picture header NAL unit.

18. The method of claim 15 , wherein the format rule specifies that:

the coded picture of the reference layer is determined to include the independent picture header NAL unit based on a unit type of the coded picture of the reference layer; and

the enhancement layer picture is determined to include the dependent picture header NAL unit based on a unit type of the enhancement layer picture.

19. The method of claim 15 , wherein the independent picture header NAL unit directly precedes a VCL NAL unit in a decoding order in the coded picture of the reference layer.

20. The method of claim 15 , wherein the dependent picture header NAL unit directly precedes the at least one VCL NAL unit in a decoding order in the enhancement layer picture.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 3, 2025
From: CHOI, BYEONGDOO; WENGER, STEPHAN; LIU, SHAN
To: TENCENT AMERICA LLC
Reel/Frame 070729/0729 →
Continuity (5)
Continuation 17832185 · Jun 3, 2022
Continuation 17071479 · Oct 15, 2020
Provisional Application 62947226 · Dec 12, 2019
Provisional Application 62947236 · Dec 12, 2019
Related Publication 20230075516A1 · Mar 9, 2023
References Cited (28)
US 20080317124A1 · Cho et al. · 2008 [cited by applicant]
US 20120230433A1 · Chen · 2012 [cited by examiner]
US 20130343465A1 · Chen · 2013 [cited by examiner]
US 20140003491A1 · Chen et al. · 2014 [cited by applicant]
US 20140016707A1 · Wang · 2014 [cited by examiner]
US 20140092994A1 · Wang · 2014 [cited by examiner]
US 20150156501A1 · Hannuksela · 2015 [cited by applicant]
US 20150195577A1 · Hannuksela · 2015 [cited by applicant]
US 20170076196A1 · Sainath et al. · 2017 [cited by applicant]
US 20180176578A1 · Rippel et al. · 2018 [cited by applicant]
US 20190370658A1 · Xie et al. · 2019 [cited by applicant]
US 20210185359A1 · Choi · 2021 [cited by examiner]
US 20210195248A1 · Coban · 2021 [cited by examiner]
US 20210314624A1 · Coban · 2021 [cited by examiner]
US 20220086431A1 · Wang · 2022 [cited by examiner]
US 20220086457A1 · Wang · 2022 [cited by examiner]
US 20220109848A1 · Wang · 2022 [cited by examiner]
EP 3562162A1 · 2019 [cited by applicant]
WO WO2020256601A2 · 2020 [cited by examiner]
WO WO2021061284A1 · 2021 [cited by examiner]
WO WO2021061285A1 · 2021 [cited by examiner]
WO WO2021061454A1 · 2021 [cited by examiner]
WO WO2021061490A1 · 2021 [cited by examiner]
WO WO2021112037A1 · 2021 [cited by examiner]
WO WO2021117644A1 · 2021 [cited by examiner]
Benjamin Bross et al., “Versatile Video Coding (Draft 6)”, Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, Jul. 2019, 439 pages, JVET-O2001-vE. [cited by applicant]
Office Action issued Jun. 15, 2024 in Chinese Application No. 202080035810.4. [cited by applicant]
Korean Office Action dated Sep. 25, 2024 in Application No. 10-2021-7033218. [cited by applicant]