IP Library Granted Patent US 12,382,079
Granted Patent B2
US 12,382,079 · App. 18/443,861 · Granted Aug 5, 2025

Techniques for random access point indication and picture output in coded video stream

Inventors: Byeongdoo Choi (Palo Alto, CA); Stephan Wenger (Palo Alto, CA); Shan Liu (Palo Alto, CA)
Assignee: TENCENT AMERICA LLC
H04N19/46H04N19/105H04N19/159H04N19/172H04N19/188
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,382,079
App. No.
18/443,861
Granted
Aug 5, 2025
Kind
B2
Abstract

Systems and methods for decoding a coded video stream are provided. A method includes receiving a coded video stream that includes an access unit, including a picture; signaling a first flag that indicates whether the access unit includes either or neither one from among an intra random access point (IRAP) picture and a gradual decoding refresh (GDR) picture; signaling a second flag that indicates whether the picture is the IRAP picture; and decoding the picture, as a current picture, based on the signaling of the first flag and the second flag, wherein a value of the first flag and a value of the second flag are aligned.

Claims (92)

1. A method of video decoding performed by at least one processor, the method comprising:

receiving a coded video stream that includes an access unit, including a picture;

determining whether a first flag, in an access unit delimiter of the coded video stream, indicates that the access unit includes either or neither one from among an intra random access point (IRAP) picture and a gradual decoding refresh (GDR) picture;

determining whether a second flag, in a picture header of the coded video stream, indicates that the picture is the IRAP picture; and

decoding the picture, as a current picture, based on the first flag and the second flag,

wherein a value of the first flag and a value of the second flag are aligned, and

wherein the decoding comprises:

constructing a reference picture list;

generating an unavailable reference picture in the reference picture list; and

checking bitstream conformance, for reference pictures in the reference picture list, that the following constraints apply:

a number of entries that are indicated to be in the reference picture list is not less than a number of active entries that are indicated to be in the reference picture list,

each picture referred to by an active entry in the reference picture list is present in a decoded picture buffer (DPB) and has a temporal identifier value less than or equal to a temporal identifier value of the current picture, and

each picture referred to by an entry in the reference picture list is not the current picture and is indicated by a picture header flag to potentially be a reference picture.

2. The method of claim 1 , further comprising:

determining whether a third flag, in the picture header of the coded video stream, indicates that the picture is the GDR picture,

wherein the value of the first flag and a value of the third flag are aligned, and

wherein the third flag is based on the second flag indicating that the picture is not the IRAP picture.

3. The method of claim 1 , wherein

the first flag has a value that indicates that the picture is either one from among the IRAP picture and the GDR picture,

the second flag has a value that indicates that the picture is the IRAP picture, and

the method further comprises determining whether a third flag, in a slice header of a slice of the picture of the coded video stream, indicates that any pictures prior to the IRAP picture are outputted.

4. The method of claim 3 , further comprising:

determining a network abstraction layer (NAL) unit type of the slice,

wherein the third flag is based on the NAL unit type that is determined, and

wherein the third flag is based on the NAL unit type being determined to be equal to IDR_W_RADL, IDR_N_LP, or CRA_NUT.

5. The method of claim 4 , further comprising:

determining whether a fourth flag, in the picture header of the coded video stream, indicates that the picture is the GDR picture,

wherein the value of the first flag and a value of the fourth flag are aligned, and

wherein the fourth flag is based on the second flag indicating that the picture is not the IRAP picture.

6. The method of claim 1 , wherein checking bitstream conformance, for reference pictures in the reference picture list, comprises checking, in order, that each of the following constraints apply:

the number of entries that are indicated to be in the reference picture list is not less than the number of active entries that are indicated to be in the reference picture list,

each picture referred to by the active entry in the reference picture list is present in the decoded picture buffer (DPB) and has the temporal identifier value less than or equal to the temporal identifier value of the current picture, and

each picture referred to by the entry in the reference picture list is not the current picture and is indicated by the picture header flag to potentially be the reference picture.

7. The method of claim 1 , wherein the checking bitstream conformance is performed based on determining the current picture is an independent decoder refresh (IDR) picture, a clean random access (CRA) picture, or a gradual decoding refresh (GDR) picture.

8. A method of video encoding performed by at least one processor, the method comprising:

receiving a video data including a picture;

encoding the video data such that a coded video stream comprises a first flag, in an access unit delimiter of the coded video stream indicating that the access unit includes either or neither one from among an intra random access point (IRAP) picture and a gradual decoding refresh (GDR) picture, and a second flag, in a picture header of the coded video stream, indicating that the picture is the IRAP picture; and

wherein a value of the first flag and a value of the second flag are aligned, and

wherein the the coded video stream signals to:

construct a reference picture list;

generate an unavailable reference picture in the reference picture list; and

check bitstream conformance, for reference pictures in the reference picture list, that the following constraints apply:

a number of entries that are indicated to be in the reference picture list is not less than a number of active entries that are indicated to be in the reference picture list,

each picture referred to by an active entry in the reference picture list is present in a decoded picture buffer (DPB) and has a temporal identifier value less than or equal to a temporal identifier value of the current picture, and

each picture referred to by an entry in the reference picture list is not the current picture and is indicated by a picture header flag to potentially be a reference picture.

9. The method of claim 8 , wherein the coded video stream further signals to:

determine whether a third flag, in the picture header of the coded video stream, indicates that the picture is the GDR picture,

wherein the value of the first flag and a value of the third flag are aligned, and

wherein the third flag is based on the second flag indicating that the picture is not the IRAP picture.

10. The method of claim 8 , wherein

the first flag has a value that indicates that the picture is either one from among the IRAP picture and the GDR picture,

the second flag has a value that indicates that the picture is the IRAP picture, and

the coded video stream further signals to determine whether a third flag, in a slice header of a slice of the picture of the coded video stream, indicates that any pictures prior to the IRAP picture are outputted.

11. The method of claim 10 , the coded video stream further signals to determine a network abstraction layer (NAL) unit type of the slice,

wherein the third flag is based on the NAL unit type that is determined,

wherein the third flag is based on the NAL unit type being determined to be equal to IDR_W_RADL, IDR_N_LP, or CRA_NUT.

12. The method of claim 11 , the coded video stream further signals to determine whether a fourth flag, in the picture header of the coded video stream, indicates that the picture is the GDR picture,

wherein the value of the first flag and a value of the fourth flag are aligned, and

wherein the fourth flag is based on the second flag indicating that the picture is not the IRAP picture.

13. The method of claim 8 , wherein checking bitstream conformance, for reference pictures in the reference picture list, comprises checking, in order, that each of the following constraints apply:

the number of entries that are indicated to be in the reference picture list is not less than the number of active entries that are indicated to be in the reference picture list,

each picture referred to by the active entry in the reference picture list is present in the decoded picture buffer (DPB) and has the temporal identifier value less than or equal to the temporal identifier value of the current picture, and

each picture referred to by the entry in the reference picture list is not the current picture and is indicated by the picture header flag to potentially be the reference picture.

14. The method of claim 8 , wherein the checking bitstream conformance is based on determining the current picture is an independent decoder refresh (IDR) picture, a clean random access (CRA) picture, or a gradual decoding refresh (GDR) picture.

15. A method of processing video data, the method being performed by at least one processor and comprising:

performing a conversion between a visual media file and a bitstream of a visual media data according to a format rule,

wherein the bitstream comprises a first flag, in an access unit delimiter of the bitstream and indicating that the access unit includes either or neither one from among an intra random access point (IRAP) picture and a gradual decoding refresh (GDR) picture, and a second flag, in a picture header of the bitstream, indicating that the picture is the IRAP picture; and

wherein a value of the first flag and a value of the second flag are aligned, and

wherein the bitstream signals to:

construct a reference picture list;

generate an unavailable reference picture in the reference picture list; and

check bitstream conformance, for reference pictures in the reference picture list, that the following constraints apply:

a number of entries that are indicated to be in the reference picture list is not less than a number of active entries that are indicated to be in the reference picture list,

each picture referred to by an active entry in the reference picture list is present in a decoded picture buffer (DPB) and has a temporal identifier value less than or equal to a temporal identifier value of the current picture, and

each picture referred to by an entry in the reference picture list is not the current picture and is indicated by a picture header flag to potentially be a reference picture.

16. The method of claim 15 , wherein the bitstream further signals to determine whether a third flag, in the picture header of the coded video stream, indicates that the picture is the GDR picture,

wherein the value of the first flag and a value of the third flag are aligned, and

wherein the third flag is based on the second flag indicating that the picture is not the IRAP picture.

17. The method of claim 15 , wherein

the first flag has a value that indicates that the picture is either one from among the IRAP picture and the GDR picture,

the second flag has a value that indicates that the picture is the IRAP picture, and

wherein the bitstream further signals to determine whether a third flag, in a slice header of a slice of the picture of the coded video stream, indicates that any pictures prior to the IRAP picture are outputted.

18. The method of claim 17 , wherein the bitstream further signals to determine a network abstraction layer (NAL) unit type of the slice,

wherein the third flag is based on the NAL unit type that is determined,

wherein the third flag is based on the NAL unit type being determined to be equal to IDR_W_RADL, IDR_N_LP, or CRA_NUT.

19. The method of claim 18 , wherein the bitstream further signals to determine whether a fourth flag, in the picture header of the coded video stream, indicates that the picture is the GDR picture,

wherein the value of the first flag and a value of the fourth flag are aligned, and

wherein the fourth flag is based on the second flag indicating that the picture is not the IRAP picture.

20. The method of claim 15 , wherein checking bitstream conformance, for reference pictures in the reference picture list, comprises checking that each of the following constraints apply:

the number of entries that are indicated to be in the reference picture list is not less than the number of active entries that are indicated to be in the reference picture list,

each picture referred to by the active entry in the reference picture list is present in the decoded picture buffer (DPB) and has the temporal identifier value less than or equal to the temporal identifier value of the current picture, and

each picture referred to by the entry in the reference picture list is not the current picture and is indicated by the picture header flag to potentially be the reference picture.

Continuity (7)
Continuation 17965203 · Oct 13, 2022
Continuation 17320764 · May 14, 2021
Provisional Application 63037903 · Jun 11, 2020
Provisional Application 63036335 · Jun 8, 2020
Provisional Application 63035274 · Jun 5, 2020
Provisional Application 63027826 · May 20, 2020
Related Publication 20240187630A1 · Jun 6, 2024
References Cited (11)
US 20150023422A1 · Zhang · 2015 [cited by examiner]
US 20210168359A1 · Wang et al. · 2021 [cited by applicant]
GB 2535453A · 2016 [cited by examiner]
WO WO2020037278A1 · 2020 [cited by examiner]
WO 2020130910A1 · 2020 [cited by applicant]
WO WO2020254720A1 · 2020 [cited by examiner]
WO WO2021153475A1 · 2021 [cited by examiner]
Gary Sullivan et al., “Meeting Report of the 17th Meeting of the Joint Video Experts Team (JVET)”, Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, JVET-Q_Notes_dE 17th Meeting. Jan. 20… [cited by applicant]
International Search Report dated Aug. 17, 2021 in International Application No. PCT/US21/32924. [cited by applicant]
Written Opinion of the International Searching Authority dated Aug. 17, 2021 in International Application No. PCT/US21/32924. [cited by applicant]
Benjamin Bross et al., “Versatile Video Coding (Draft 9)”, Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11 18th Meeting, Apr. 2020, 525 pages, JVET-R2001-vA. [cited by applicant]