IP Library Granted Patent US 12,041,249
Granted Patent B2
US 12,041,249 · App. 17/568,517 · Granted Jul 16, 2024

Mixed NAL unit picture constraints in video coding

Inventors: Ye-Kui Wang (San Diego, CA); FNU Hendry (San Diego, CA)
Assignee: Huawei Technologies Co., Ltd.
H04N19/188H04N19/105H04N19/107H04N19/172H04N19/174H04N19/70H04N19/117
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,041,249
App. No.
17/568,517
Granted
Jul 16, 2024
Kind
B2
Abstract

A video coding mechanism is disclosed. The mechanism includes receiving a bitstream comprising a current picture including a plurality of video coding layer (VCL) network abstraction layer (NAL) units that do not have a same NAL unit type. Active entries of reference picture lists are obtained for slices positioned in a sub-picture A (subpicA) in subsequent pictures following the current picture in decoding order. The active entries do not refer to any reference picture preceding the current picture in decoding order when the subpicA at the current picture is associated with an intra-random access point (IRAP) NAL unit type. The subsequent pictures are decoded based on the reference picture list active entries. The subsequent pictures are forwarded for display as part of a decoded video sequence.

Claims (29)

1. A method implemented by a decoder, the method comprising:

receiving a bitstream comprising a current picture that has more than one video coding layer (VCL) network abstraction layer (NAL) units that do not have a same NAL unit type;

obtaining active entries of reference picture lists for slices positioned in a sub-picture A (subpicA) in subsequent pictures following the current picture in decoding order, wherein the active entries do not include a reference to any reference picture preceding the current picture in decoding order when the subpicA at the current picture is associated with an intra-random access point (IRAP) NAL unit type, wherein all slices of the current picture positioned in subpicA are associated with the same NAL unit type; and

decoding the subsequent pictures based on the reference picture list active entries.

2. The method of claim 1 , wherein the IRAP NAL unit type is a clean random access (CRA) NAL unit type.

3. The method of claim 1 , wherein the IRAP NAL unit type is an instantaneous decoder refresh (IDR) NAL unit type.

4. The method of claim 1 , further comprising determining a first NAL unit type value for the VCL NAL units of the current picture is different than a second NAL unit type value for VCL NAL units of the current picture based on a flag.

5. The method of claim 4 , wherein the bitstream includes a picture parameter set (PPS), and wherein the flag is obtained from the PPS.

6. The method of claim 5 , wherein the flag is a mixed_nalu_types_in_pic_flag, and wherein the mixed_nalu_types_in_pic_flag is equal to one when specifying that each picture referring to the PPS has more than one VCL NAL unit and the VCL NAL units do not have the same value of NAL unit type (nal_unit_type).

7. A method implemented by an encoder, the method comprising:

determining that a current picture includes a plurality of video coding layer (VCL) network abstraction layer (NAL) units that do not have a same NAL unit type;

determining that a sub-picture A (subpicA) at the current picture is associated with an intra-random access point (IRAP) NAL unit type;

generating active entries of reference picture lists for slices positioned in the subpicA in subsequent pictures following the current picture in decoding order, wherein the active entries do not include a reference to any reference picture preceding the current picture in decoding order when the subpicA at the current picture is associated with the IRAP NAL unit type, wherein all slices of the current picture positioned in subpicA are associated with the same NAL unit type; and

encoding the subsequent pictures into a bitstream based on the reference picture lists.

8. The method of claim 7 , wherein the IRAP NAL unit type is a clean random access (CRA) NAL unit type.

9. The method of claim 7 , wherein the IRAP NAL unit type is an instantaneous decoder refresh (IDR) NAL unit type.

10. The method of claim 7 , further comprising encoding into the bitstream, by the encoder, a flag indicating a first NAL unit type value for the VCL NAL units of the current picture is different than a second NAL unit type value for VCL NAL units of the current picture.

11. The method of claim 10 , wherein the flag is encoded into a picture parameter set (PPS) in the bitstream.

12. The method of claim 11 , wherein the flag is a mixed_nalu_types_in_pic_flag, and wherein the mixed_nalu_types_in_pic_flag is set equal to one when specifying that each picture referring to the PPS has more than one VCL NAL unit and the VCL NAL units do not have the same value of NAL unit type (nal_unit_type).

13. A video coding device comprising:

a receiver configured to receive a bitstream comprising a current picture that has more than one video coding layer (VCL) network abstraction layer (NAL) units that do not have a same NAL unit type;

a processor coupled to the receiver and configured to:

obtain active entries of reference picture lists for slices positioned in a sub-picture A (subpicA) in subsequent pictures following the current picture in decoding order, wherein the active entries do not include a reference to any reference picture preceding the current picture in decoding order when the subpicA at the current picture is associated with an intra-random access point (IRAP) NAL unit type, wherein all slices of the current picture positioned in subpicA are associated with the same NAL unit type; and

decode the subsequent pictures based on the reference picture list active entries.

14. The video coding device of claim 13 , wherein the IRAP NAL unit type is a clean random access (CRA) NAL unit type.

15. The video coding device of claim 13 , wherein the IRAP NAL unit type is an instantaneous decoder refresh (IDR) NAL unit type.

16. The video coding device of claim 13 , wherein the processor is further configured to determine a first NAL unit type value for the VCL NAL units of the current picture is different than a second NAL unit type value for VCL NAL units of the current picture based on a flag.

17. The video coding device of claim 16 , wherein the bitstream includes a picture parameter set (PPS), and wherein the flag is obtained from the PPS.

18. The video coding device of claim 17 , wherein the flag is a mixed_nalu_types_in_pic_flag, and wherein the mixed_nalu_types_in_pic_flag is equal to one when specifying that each picture referring to the PPS has more than one VCL NAL unit and the VCL NAL units do not have the same value of NAL unit type (nal_unit_type).

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Nov 9, 2023
From: FUTUREWEI TECHNOLOGIES, INC.
To: HUAWEI TECHNOLOGIES CO., LTD.
Reel/Frame 065532/0126 →
Continuity (3)
Continuation PCTUS2020041035 · Jul 7, 2020
Provisional Application 62871524 · Jul 8, 2019
Related Publication 20220132148A1 · Apr 28, 2022