IP Library › Granted Patent US 12,301,849
Granted Patent B2
US 12,301,849 · App. 17/926,657 · Granted May 13, 2025

Video encoder, video decoder, methods for encoding and decoding and video data stream for realizing advanced video coding concepts

Inventors: Yago Sánchez de la Fuente (Berlin, DE); Karsten Sühring (Berlin, DE); Cornelius Hellge (Berlin, DE); Thomas Schierl (Berlin, DE); Robert Skupin (Berlin, DE); Thomas Wiegand (Berlin, DE)
Assignee: Dolby Video Compression, LLC
H04N19/423H04N19/172H04N19/184H04N19/188H04N19/44H04N19/46H04N19/70H04N19/85
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,301,849
App. No.
17/926,657
Granted
May 13, 2025
Kind
B2
Abstract

An apparatus ( 200 ) for receiving an input video data stream according to an embodiment is provided. The input video data stream has a video encoded thereinto. The apparatus ( 200 ) is configured to generate an output video data stream from the input video data stream.

Claims (79)

1. An apparatus for receiving an input video data stream, wherein:

the input video data stream has a video encoded thereinto,

the apparatus is configured to generate an output video data stream from the input video data stream,

the output video data stream comprises a first flag indicating whether a picture of the video preceding a dependent random access picture shall be output or not, and

the output video data stream comprises a second flag indicating whether or not the first flag exists in a picture header of the picture of the video.

2. The apparatus according to claim 1 , wherein:

the apparatus is configured to generate the output video data stream such that the output video data stream comprises supplemental enhancement information comprising the first flag that indicates whether the picture of the video preceding the dependent random access picture shall be output or not.

3. The apparatus according to claim 1 , wherein:

the picture of the video that precedes the dependent random access picture is an independent random access picture, and

the first flag has a predefined value in a picture header of the independent random access picture, such that the predefined value of the first flag indicates that the independent random access picture directly precedes said dependent random access picture within the video data stream, and that said independent random access picture shall not be output.

4. The apparatus according to claim 3 , wherein:

the second flag is in a picture parameter set of the output video data stream, and indicates whether or not the first flag exists in the picture header of the independent random access picture.

5. The apparatus according to claim 1 , wherein the first flag is one of:

a supplemental enhancement information flag within a supplemental enhancement information of the output video data stream, or

a picture parameter set flag within a picture parameter set of the output video data stream, or

a sequence parameter set flag within a sequence parameter set of the output video data stream, or

an external means flag, wherein a value of the external means flag is set by an external unit being external to the apparatus.

6. The apparatus according to claim 1 , wherein:

the apparatus is configured to determine a value of a third flag for the picture of the video that precedes the dependent random access picture depending on the first flag,

the third flag indicates for said picture whether said picture shall be output or not, and

the apparatus is configured to output or to not output said picture depending on the third flag.

7. The apparatus according to claim 1 , wherein:

the picture of the video that precedes the dependent random access picture is an independent random access picture, and

the first flag indicates that the independent random access picture shall not be output.

8. The apparatus according to claim 1 , wherein:

the picture of the video that precedes the dependent random access picture is an independent random access picture, and

the first flag indicates that the independent random access picture shall be output.

9. The apparatus according to claim 1 , wherein:

the apparatus is configured to signal to a video decoder, whether a picture of the video preceding a dependent random access picture shall be output or not.

10. A video encoder, wherein:

the video encoder is configured to encode a video into a video data stream, such that the video data stream comprises:

a first flag that indicates whether a picture of the video preceding a dependent random access picture shall be output or not, and

a second flag that indicates whether or not the first flag exists in a picture header of the picture of the video.

11. The video encoder according to claim 10 , wherein:

the video encoder is configured to generate the video data stream such that the video data stream comprises supplemental enhancement information comprising the first flag that indicates whether the picture of the video preceding the dependent random access picture shall be output or not.

12. The video encoder according to claim 10 , wherein:

the picture of the video that precedes the dependent random access picture is an independent random access picture, and

the first flag has a predefined value in a picture header of the independent random access picture, such that the predefined value of the first flag indicates that the independent random access picture directly precedes said dependent random access picture within the video data stream, and that said independent random access picture shall not be output.

13. The video encoder according to claim 12 , wherein:

the second flag is in a picture parameter set of the output video data stream, and indicates whether or not the first flag exists in the picture header of the independent random access picture.

14. The video encoder according to claim 10 , wherein the first flag is one of:

a supplemental enhancement information flag within a supplemental enhancement information of the output video data stream, or

a picture parameter set flag within a picture parameter set of the output video data stream, or

a sequence parameter set flag within a sequence parameter set of the output video data stream, or

an external means flag, wherein a value of the external means flag is set by an external unit being external to an apparatus.

15. A video decoder for receiving a video data stream having a video stored therein, wherein:

the video decoder is configured to decode the video from the video data stream, and

the video decoder is configured to decode the video depending on:

a first flag that indicates whether a picture of the video preceding a dependent random access picture shall be output or not, and

a second flag that indicates whether or not the first flag exists in a picture header of the picture of the video.

16. The video decoder according to claim 15 , wherein:

the video data stream comprises the first flag that indicates whether the picture of the video preceding the dependent random access picture shall be output or not, and

the video decoder is configured to decode the video depending on the first flag within the video data stream.

17. The video decoder according to claim 16 , wherein:

the video data stream comprises supplemental enhancement information comprising the first flag that indicates whether the picture of the video preceding the dependent random access picture shall be output or not, and

the video decoder is configured to decode the video depending on the supplemental enhancement information.

18. The video decoder according to claim 16 , wherein:

the picture of the video that precedes the dependent random access picture is an independent random access picture, and

the first flag has a predefined value in a picture header of the independent random access picture, such that the predefined value of the first flag indicates that the independent random access picture directly precedes said dependent random access picture within the video data stream, and that said independent random access picture shall not be output.

19. The video decoder according to claim 18 , wherein:

the second flag is in a picture parameter set of the video data stream, and indicates whether or not the first flag exists in the picture header of the independent random access picture.

20. The video decoder according to claim 16 , wherein the first flag is one of:

a supplemental enhancement information flag within a supplemental enhancement information of the output video data stream, or

a picture parameter set flag within a picture parameter set of the output video data stream, or

a sequence parameter set flag within a sequence parameter set of the output video data stream, or

an external means flag, wherein a value of the external means flag is set by an external unit being external to an apparatus.

21. The video decoder according to claim 15 , wherein:

the video decoder is configured to reconstruct the video from the video data stream, and

the video decoder is configured to output or to not output the picture of the video that precedes the dependent random access picture depending on the first flag.

22. The video decoder according to claim 15 , wherein:

the video decoder is configured to determine a value of a third flag for the picture of the video that precedes the dependent random access picture depending on the first flag,

the third flag indicates for said picture whether said picture shall be output or not, and

the apparatus is configured to output or to not output said picture depending on the third flag.

23. The video decoder according to claim 15 , wherein:

the picture of the video that precedes the dependent random access picture is an independent random access picture, and

the first flag indicates that the independent random access picture shall not be output.

24. The video decoder according to claim 15 , wherein:

the picture of the video that precedes the dependent random access picture is an independent random access picture, and

the first flag indicates that the independent random access picture shall be output.

Assignments (4)
CHANGE OF NAME Recorded Jan 30, 2026
From: GE VIDEO COMPRESSION, LLC
To: DOLBY VIDEO COMPRESSION, LLC
Reel/Frame 074536/0748 →
CHANGE OF NAME Recorded Nov 26, 2024
From: GE VIDEO COMPRESSION, LLC
To: DOLBY VIDEO COMPRESSION, LLC
Reel/Frame 069450/0772 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 27, 2023
From: SÁNCHEZ DE LA FUENTE, YAGO; SÜHRING, KARSTEN; HELLGE, CORNELIUS; SCHIERL, THOMAS; SKUPIN, ROBERT; WIEGAND, THOMAS
To: FRAUNHOFER-GESELLSCHAFT ZUR FÖRDERUNG DER ANGEWANDTEN FORSCHUNG E.V.
Reel/Frame 064071/0123 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 27, 2023
From: FRAUNHOFER-GESELLSCHAFT ZUR FÖRDERUNG DER ANGEWANDTEN FORSCHUNG E.V.
To: GE VIDEO COMPRESSION, LLC
Reel/Frame 064073/0488 →
Priority Claims (2)
EP 20176178 · May 22, 2020 · regional
EP 20176206 · May 22, 2020 · regional
Continuity (1)
Related Publication 20240022735A1 · Jan 18, 2024
References Cited (67)
US 8542492B2 · Dunn · 2013 [cited by applicant]
US 8594202B2 · Eleftheriadis · 2013 [cited by applicant]
US 9154785B2 · Wang · 2015 [cited by applicant]
US 9270989B2 · Hannuksela · 2016 [cited by applicant]
US 9521393B2 · Wang et al. · 2016 [cited by applicant]
US 9641862B2 · Hannuksela · 2017 [cited by applicant]
US 9712833B2 · Wang et al. · 2017 [cited by applicant]
US 10003815B2 · Ramasubramonian et al. · 2018 [cited by applicant]
US 10021394B2 · Wang · 2018 [cited by applicant]
US 10284858B2 · Chen et al. · 2019 [cited by applicant]
US 10432951B2 · Wang · 2019 [cited by applicant]
US 11356681B2 · Choi et al. · 2022 [cited by applicant]
US 11936889B2 · Skupin et al. · 2024 [cited by applicant]
US 11956471B2 · Pettersson · 2024 [cited by examiner]
US 20080013620A1 · Hannuksela · 2008 [cited by applicant]
US 20120294366A1 · Eliyahu · 2012 [cited by applicant]
US 20130266075A1 · Wang et al. · 2013 [cited by applicant]
US 20140098894A1 · Wang · 2014 [cited by applicant]
US 20140192149A1 · Wang et al. · 2014 [cited by applicant]
US 20140192893A1 · Sullivan et al. · 2014 [cited by applicant]
US 20150016547A1 · Tabatabai et al. · 2015 [cited by applicant]
US 20150103895A1 · Deshpande · 2015 [cited by applicant]
US 20160234526A1 · Wang · 2016 [cited by applicant]
US 20170085896A1 · Ramasubramonian et al. · 2017 [cited by applicant]
US 20210368183A1 · Deshpande · 2021 [cited by applicant]
US 20210385472A1 · Seregin · 2021 [cited by examiner]
US 20220141494A1 · Deshpande · 2022 [cited by examiner]
US 20220217376A1 · Wang · 2022 [cited by applicant]
JP WO2015053157A1 · 2017 [cited by applicant]
RU 2406254C2 · 2010 [cited by applicant]
WO 2015104451A1 · 2015 [cited by applicant]
WO 2015140401A1 · 2015 [cited by applicant]
WO 2015192990A1 · 2015 [cited by applicant]
WO 2020253816A1 · 2020 [cited by applicant]
WO 2021123159A1 · 2021 [cited by applicant]
Office Action is issued in corresponding Georgian Patent Application 16098/1 dated Jul. 1, 2023, with English translation. [cited by applicant]
Notice of Allowance issued in corresponding Taiwanese Patent Application No. 110118547 dated Jan. 7, 2023, with English translation. [cited by applicant]
ITU-T H.266 (Aug. 2020), Series H Audiovisual and Multimedia Systems, Infrastructure of audiovisual services—Coding of moving video, Versatile Video Coding. [cited by applicant]
ISO/IEC, ITU-T. High efficiency video coding. ITU-T Recommendation H.265 | ISO/IEC 23008 10 (HEVC), edition 1, 2013. [cited by applicant]
ISO/IEC, ITU-T. High efficiency video coding. ITU-T Recommendation H.265 | ISO/IEC 23008 10 (HEVC), edition 2, 2014. [cited by applicant]
Office Action issued in corresponding Australian Patent Application No. 2022271427 dated Jan. 5, 2023. [cited by applicant]
International Telecommunication Union, Telecommunication Standardization Sector of ITU, ‘H series: Audiovisual and Multimedia systems, Infrastructure of Audiovisual Services—Coding of Moving Video’, H.265, Nov. 2019; ap… [cited by applicant]
International Telecommunication Union, Telecommunication Standardization Sector of ITU, ‘Series H; Audiovisual and Multimedia Systems Infrastructure of Audiovisual services—Coding of Moving Video—Advanced Video Coding f… [cited by applicant]
Office Action issued in corresponding Australian Patent Application No. 2022271423 dated Jan. 10, 2023. [cited by applicant]
Office Action issued in corresponding Australian Patent Application 2021277524 dated Dec. 20, 2022. [cited by applicant]
Bross, B. et al., “Versatile Video Coding (Draft 9)”, Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, 18th Meeting: by teleconference, Apr. 15-24, 2020, Document: JVET-R2001-vA. [cited by applicant]
Office Action issued in corresponding Eurasian Patent Application 202293010 dated Dec. 21, 2022, with English translation. [cited by applicant]
Office Action issued in corresponding Eurasian Patent Application 202293010 dated Jul. 7, 2023, with English translation. [cited by applicant]
International Search Report and Written Opinion dated Jul. 23, 2021 for International Patent Application No. PCT/EP2021/063587, 17 pages. [cited by applicant]
Pettersson M et al. “HLS: Dependent RAP indication SEI message” 18. JCT-VC Meeting; Jun. 30, 2014-Sep. 7, 2014; Sapporo; (Joint Collaborative Team on Video Coding of ISo/IEC JTC1/SC29/WG11 And ITU-T SG.16); URL: HTTP://… [cited by applicant]
Sanchez (Faunhofer) Y et al.: “AHG9: On DRAP output”, 131. MPEG Meeting;v Jun. 29, 2020-Jul. 3, 2020; Online; (Motion Picture Expert Group Or iSO/IEC JTC1/SC29/WG11),, No. m54090 ; JVET-S0104 May 22, 2020 (May 22, 2020)… [cited by applicant]
Office Action issued in corresponding Uzbek Patent Application IAP 2023 0017 dated Apr. 25, 2023. [cited by applicant]
Office Action issued in corresponding Uzbek Patent Application IAP 2023 0018 dated Apr. 25, 2023. [cited by applicant]
Office Action issued in corresponding Eurasian Patent Application 202293135 dated Mar. 22, 2023, with English translation. [cited by applicant]
Sanchez Yago et al. AHG9: On OLS extraction and scalable nesting SEI message. Joint Video Experts Team (JVET) of ITU-T SG16 WP3 and ISO/IEC JTC1/SC29/WG11. JVET-Q0394. 17th Meeting: Brussels Jan. 7-17, 2020, section 2-4. [cited by applicant]
Office Action issued in corresponding Eurasian Patent Application 202293134 dated Mar. 22, 2023, with English translation. [cited by applicant]
Wang, Ye-Kui, AHG8/AHG17: Scalable nesting SEI message. Joint Video Experts Team (JVET) of ITU-T SG16 WP3 and ISO/IEC JTC1/SC29/WG11. JVET-P0190-v2. 16th Meeting: Geneva, Oct. 1-11, 2019, pp. 1-4. [cited by applicant]
Skupin, Robert et al., AHG12: On subpicture extraction. Joint Video Experts Team (JVET) of ITU-T SG16 WP3 and ISO/IEC JTC1/SC29/WG11. JVET-Q0397-v3. 17th Meeting: Brussels, Jan. 7-17, 2020, section 2-4. [cited by applicant]
Notice of Allowance issued in corresponding U.S. Appl. No. 17/934,007 dated Jun. 7, 2023. [cited by applicant]
Notice of Acceptance for patent application issued in corresponding Australian Application No. 2021277524 dated Mar. 31, 2023. [cited by applicant]
Office Action issued in corresponding U.S. Appl. No. 17/981,969 dated Mar. 22, 2023. [cited by applicant]
Ye-Kui Wang et al., “SVC temporal layer switching points”, Joint Video Team (JVT) of IS0/IEC MPEG & ITU-T VCEG (IS0/IEC JTC1/SC29/WG11 and ITU-T SG16 Q.6) 24th Meeting: Geneva, CH, Jun. 29-Jul. 5, 2007. [cited by applicant]
Alex Eleftheriadis et al., “Showcase for the Temporal Level Nesting Flag”, Joint Video Team (JVT) of IS0/IEC MPEG & ITU-T VCEG (IS0/IEC JTC1/SC29/WG11 and ITU-T SG16 Q.6) 22nd Meeting: Marrakech, Morocco, Jan. 13-19, 20… [cited by applicant]
Ci He et al., “Showcase of Temporal Level Switching Point SEI Message”, Joint Video Team (JVT) of IS0/IEC MPEG & ITU-T VCEG (IS0/IEC JTC1/SC29/WG11 and ITU-T S.G16 Q.6) 25th Meeting: Shenzhen, CN, Oct. 21-26, 2007. [cited by applicant]
Office Action issued in corresponding U.S. Appl. No. 17/934,007 dated Mar. 30, 2023. [cited by applicant]
Office Action issued in corresponding U.S. Appl. No. 17/982,015 dated Apr. 26, 2023. [cited by applicant]
Martin Pettersson et al., “Dependent random access point pictures in HEVC”, 2015 IEEE International Conference on Image Processing (ICIP), Sep. 27-30, 2015. [cited by applicant]