IP Library › Granted Patent US 12,501,062
Granted Patent B2
US 12,501,062 · App. 17/981,969 · Granted Dec 16, 2025

Video encoder, video decoder, methods for encoding and decoding and video data stream for realizing advanced video coding concepts

Inventors: Yago Sanchez De La Fuente (Berlin, DE); Karsten Sühring (Berlin, DE); Cornelius Hellge (Berlin, DE); Thomas Schierl (Berlin, DE); Robert Skupin (Berlin, DE); Thomas Wiegand (Berlin, DE)
Assignee: Dolby Video Compression, LLC
H04N19/423H04N19/172H04N19/184H04N19/188H04N19/44H04N19/46H04N19/70H04N19/85
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,501,062
App. No.
17/981,969
Granted
Dec 16, 2025
Kind
B2
Abstract

An apparatus ( 200 ) for receiving an input video data stream according to an embodiment is provided. The input video data stream has a video encoded thereinto. The apparatus ( 200 ) is configured to generate an output video data stream from the input video data stream.

Claims (52)

1 . A video decoder for receiving a video data stream having a video stored therein,

wherein the video decoder is configured to decode the video from the video data stream,

wherein the video data stream comprises an indication indicating whether or not a non-scalable nested picture timing supplemental enhancement information message of a network abstraction layer unit of an access unit of the plurality of access units of a coded video sequence of a one or more coded video sequences of the video data stream is defined to apply to all output layer sets of a plurality of output layer sets of said access unit,

wherein, if the indication has a first value, then the non-scalable nested picture timing supplemental enhancement information message of said network abstraction layer unit of said access unit is defined to apply to all output layer sets of the plurality of output layer sets of said access unit,

wherein, if the indication has a value being different from the first value, then the indication does not define whether or not the non-scalable nested picture timing supplemental enhancement information message of said network abstraction layer unit of said access unit applies to all output layer sets of the plurality of output layer sets of said access unit,

wherein the video decoder is configured to decode the video depending on said indication.

2 . The video decoder according to claim 1 ,

wherein, if the indication has the first value, then said network abstraction layer unit does not comprise any other supplemental enhancement information message with different picture timings.

3 . The video decoder according to claim 1 ,

wherein, if the indication has the first value, then all supplemental enhancement information messages have a same payload type.

4 . The video decoder according to claim 1 ,

wherein, if the indication has the first value, then said network abstraction layer unit does not comprise any other supplemental enhancement information message that is different from a picture timing supplemental enhancement information message.

5 . The video decoder according to claim 1 ,

wherein, if the indication has the first value, then said network abstraction layer unit does not comprise any other supplemental enhancement information message.

6 . The video decoder according to claim 1 ,

wherein, if the indication has the first value, then for each network abstraction layer unit, which comprises a non-scalable nested picture timing supplemental enhancement information message, of each access unit of the plurality of access units of a coded video sequence of the one or more coded video sequences, said network abstraction layer does not comprise any other supplemental enhancement information message that is different from a picture timing supplemental enhancement information message, or does not comprise any other supplemental enhancement information message.

7 . The video decoder according to claim 1 ,

wherein, if the indication has the first value, then for each network abstraction layer unit, which comprises a non-scalable nested picture timing supplemental enhancement information message, of each access unit of the plurality of access units of each of the one or more coded video sequences of the video data stream, said network abstraction layer unit does not comprise any other supplemental enhancement information message that is different from a picture timing supplemental enhancement information message, or does not comprise any other supplemental enhancement information message.

8 . A video encoder,

wherein the video encoder is configured to encode a video into a video data stream,

wherein the video encoder is configured to generate the video data stream such that the video data stream comprises an indication indicating whether or not a non-scalable nested picture timing supplemental enhancement information message of a network abstraction layer unit of an access unit of the plurality of access units of a coded video sequence of a one or more coded video sequences of the video data stream is defined to apply to all output layer sets of a plurality of output layer sets of said access unit,

wherein, if the indication has a first value, then the non-scalable nested picture timing supplemental enhancement information message of said network abstraction layer unit of said access unit is defined to apply to all output layer sets of the plurality of output layer sets of said access unit,

wherein, if the indication has a value being different from the first value, then the indication does not define whether or not the non-scalable nested picture timing supplemental enhancement information message of said network abstraction layer unit of said access unit applies to all output layer sets of the plurality of output layer sets of said access unit.

9 . The video encoder according to claim 8 ,

wherein, if the indication has the first value, then said network abstraction layer unit does not comprise any other supplemental enhancement information message with different picture timings.

10 . The video encoder according to claim 8 ,

wherein, if the indication has the first value, then all supplemental enhancement information messages have a same payload type.

11 . The video encoder according to claim 8 ,

wherein, if the indication has the first value, then said network abstraction layer unit does not comprise any other supplemental enhancement information message that is different from a picture timing supplemental enhancement information message.

12 . The video encoder according to claim 8 ,

wherein, if the indication has the first value, then said network abstraction layer unit does not comprise any other supplemental enhancement information message.

13 . The video encoder according to claim 8 ,

wherein, if the indication has the first value, then the video encoder is configured to generate the video data stream such that for each network abstraction layer unit, which comprises a non-scalable nested picture timing supplemental enhancement information message, of each access unit of the plurality of access units of a coded video sequence of the one or more coded video sequences, said network abstraction layer unit does not comprise any other supplemental enhancement information message that is different from a picture timing supplemental enhancement information message, or does not comprise any other supplemental enhancement information message.

14 . The video encoder according to claim 8 ,

wherein, if the indication has the first value, then the video encoder is configured to generate the video data stream such that for each network abstraction layer unit, which comprises a non-scalable nested picture timing supplemental enhancement information message, of each access unit of the plurality of access units of each of the one or more coded video sequences of the video data stream, said network abstraction layer unit does not comprise any other supplemental enhancement information message that is different from a picture timing supplemental enhancement information message, or does not comprise any other supplemental enhancement information message.

15 . A non-transitory computer-readable medium storing a video data stream,

wherein the video data stream has a video encoded thereinto,

wherein the video data stream comprises an indication indicating whether or not a non-scalable nested picture timing supplemental enhancement information message of a network abstraction layer unit of an access unit of the plurality of access units of a coded video sequence of a one or more coded video sequences of the video data stream is defined to apply to all output layer sets of a plurality of output layer sets of said access unit,

wherein, if the indication has a first value, then the non-scalable nested picture timing supplemental enhancement information message of said network abstraction layer unit of said access unit is defined to apply to all output layer sets of the plurality of output layer sets of said access unit,

wherein, if the indication has a value being different from the first value, then the indication does not define whether or not the non-scalable nested picture timing supplemental enhancement information message of said network abstraction layer unit of said access unit applies to all output layer sets of the plurality of output layer sets of said access unit.

16 . The non-transitory computer-readable medium storing the video data stream according to claim 15 ,

wherein, if the indication has the first value, then said network abstraction layer unit does not comprise any other supplemental enhancement information message with different picture timings.

17 . The non-transitory computer-readable medium storing the video data stream according to claim 15 ,

wherein, if the indication has the first value, then all supplemental enhancement information messages have a same payload type.

18 . The non-transitory computer-readable medium storing the video data stream according to claim 15 ,

wherein, if the indication has the first value, then said network abstraction layer unit does not comprise any other supplemental enhancement information message that is different from a picture timing supplemental enhancement information message.

19 . The non-transitory computer-readable medium storing the video data stream according to claim 15 ,

wherein, if the indication has the first value, then said network abstraction layer unit does not comprise any other supplemental enhancement information message.

20 . The non-transitory computer-readable medium storing the video data stream according to claim 15 ,

wherein, if the indication has the first value, then for each network abstraction layer unit, which comprises a non-scalable nested picture timing supplemental enhancement information message, of each access unit of the plurality of access units of a coded video sequence of the one or more coded video sequences, said network abstraction layer unit does not comprise any other supplemental enhancement information message that is different from a picture timing supplemental enhancement information message, or does not comprise any other supplemental enhancement information message.

21 . The non-transitory computer-readable medium storing the video data stream according to claim 15 ,

wherein, if the indication has the first value, then for each network abstraction layer unit, which comprises a non-scalable nested picture timing supplemental enhancement information message, of each access unit of the plurality of access units of each of the one or more coded video sequences of the video data stream, said network abstraction layer unit does not comprise any other supplemental enhancement information message that is different from a picture timing supplemental enhancement information message, or does not comprise any other supplemental enhancement information message.

Assignments (4)
CHANGE OF NAME Recorded Jan 30, 2026
From: GE VIDEO COMPRESSION, LLC
To: DOLBY VIDEO COMPRESSION, LLC
Reel/Frame 074536/0781 →
CHANGE OF NAME Recorded Nov 26, 2024
From: GE VIDEO COMPRESSION, LLC
To: DOLBY VIDEO COMPRESSION, LLC
Reel/Frame 069450/0772 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 27, 2023
From: SÁNCHEZ DE LA FUENTE, YAGO; SÜHRING, KARSTEN; HELLGE, CORNELIUS; SCHIERL, THOMAS; SKUPIN, ROBERT; WIEGAND, THOMAS
To: FRAUNHOFER-GESELLSCHAFT ZUR FÖRDERUNG DER ANGEWANDTEN FORSCHUNG E.V.
Reel/Frame 064071/0146 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 27, 2023
From: FRAUNHOFER-GESELLSCHAFT ZUR FÖRDERUNG DER ANGEWANDTEN FORSCHUNG E.V.
To: GE VIDEO COMPRESSION, LLC
Reel/Frame 064073/0505 →
Priority Claims (2)
EP 20176178 · May 22, 2020 · regional
EP 20176206 · May 22, 2020 · regional
Continuity (2)
Continuation PCTEP2021063587 · May 21, 2021
Related Publication 20230092331A1 · Mar 23, 2023
References Cited (68)
US 8204134B2 · Hannuksela · 2012 [cited by examiner]
US 8542492B2 · Dunn, Jr. · 2013 [cited by examiner]
US 8594202B2 · Eleftheriadis · 2013 [cited by examiner]
US 9154785B2 · Wang · 2015 [cited by examiner]
US 9270989B2 · Hannuksela · 2016 [cited by examiner]
US 9521393B2 · Wang · 2016 [cited by examiner]
US 9641862B2 · Hannuksela · 2017 [cited by applicant]
US 9712833B2 · Wang · 2017 [cited by examiner]
US 9894370B2 · Wang · 2018 [cited by examiner]
US 10003815B2 · Ramasubramonian et al. · 2018 [cited by applicant]
US 10021394B2 · Wang · 2018 [cited by applicant]
US 10284858B2 · Chen et al. · 2019 [cited by applicant]
US 10432951B2 · Wang · 2019 [cited by examiner]
US 11356681B2 · Choi · 2022 [cited by examiner]
US 11936889B2 · Skupin et al. · 2024 [cited by applicant]
US 11956471B2 · Pettersson et al. · 2024 [cited by applicant]
US 20080013620A1 · Hannuksela · 2008 [cited by applicant]
US 20120294366A1 · Eliyahu · 2012 [cited by applicant]
US 20130266075A1 · Wang et al. · 2013 [cited by applicant]
US 20140098894A1 · Wang · 2014 [cited by applicant]
US 20140192149A1 · Wang et al. · 2014 [cited by applicant]
US 20140192893A1 · Sullivan et al. · 2014 [cited by applicant]
US 20140355692A1 · Ramasubramonian et al. · 2014 [cited by applicant]
US 20150016547A1 · Tabatabai et al. · 2015 [cited by applicant]
US 20150103895A1 · Deshpande · 2015 [cited by applicant]
US 20160234526A1 · Wang · 2016 [cited by applicant]
US 20210368183A1 · Deshpande · 2021 [cited by applicant]
US 20210385472A1 · Seregin et al. · 2021 [cited by applicant]
US 20220141494A1 · Deshpande · 2022 [cited by applicant]
US 20220217375A1 · Wang · 2022 [cited by examiner]
US 20220217376A1 · Wang · 2022 [cited by applicant]
US 20220217393A1 · Wang · 2022 [cited by examiner]
ES 2973667T3 · 2024 [cited by applicant]
JP WO2015053157A1 · 2017 [cited by applicant]
RU 2406254C2 · 2010 [cited by applicant]
WO 2015104451A1 · 2015 [cited by applicant]
WO 2015140401A1 · 2015 [cited by applicant]
WO 2015192990A1 · 2015 [cited by applicant]
WO 2020253816A1 · 2020 [cited by applicant]
WO 2021123159A1 · 2021 [cited by applicant]
SVC temporal layer switching points; Wang—2007. (Year: 2007). [cited by examiner]
Showcase of temporal level nesting flag; Eleftheriadis—2007. (Year: 2007). [cited by examiner]
Showcase of temporal level switching point SEI message; Wang—2007. (Year: 2007). [cited by examiner]
International Search Report and Written Opinion dated Jul. 23, 2021 for International Patent Application No. PCT/EP2021/063587, 17 pages. [cited by applicant]
Pettersson M et al. “HLS: Dependent RAP indication SEI message” 18. JCT-VC Meeting; Jun. 30, 2014-Jul. 9, 2014; Sapporo; (Joint Collaborative Team on Video Coding of ISo/IEC JTC1/SC29/WG11 and ITU-T SG.16); URL: http://… [cited by applicant]
Notice of Allowance issued in corresponding Taiwanese Patent Application No. 110118547 dated Jan. 7, 2023, with English translation. [cited by applicant]
Office Action issued in corresponding Australian Patent Application No. 2022271427 dated Jan. 5, 2023. [cited by applicant]
Office Action issued in corresponding Australian Patent Application No. 2022271423 dated Jan. 10, 2023. [cited by applicant]
Office Action issued in corresponding Australian Patent Application 2021277524 dated Dec. 20, 2022. [cited by applicant]
Office Action issued in corresponding Eurasian Patent Application 202293010 dated Dec. 21, 2022, with English translation. [cited by applicant]
Notice of Allowance issued in corresponding U.S. Appl. No. 17/934,007 dated Jun. 7, 2023. [cited by applicant]
Office Action issued in corresponding Uzbek Patent Application IAP 2023 0017 dated Apr. 25, 2023. [cited by applicant]
Office Action issued in corresponding Uzbek Patent Application IAP 2023 0018 dated Apr. 25, 2023. [cited by applicant]
Office Action issued in corresponding Eurasian Patent Application 202293135 dated Mar. 22, 2023, with English translation. [cited by applicant]
Sanchez Yago et al. AHG9: On OLS extraction and scalable nesting SEI message. Joint Video Experts Team (JVET) of ITU-T SG16 WP3 and ISO/IEC JTC1/SC29/WG11. JVET-Q0394. 17th Meeting: Brussels Jan. 7-17, 2020, section 2-4. [cited by applicant]
Office Action issued in corresponding Eurasian Patent Application 202293134 dated Mar. 22, 2023, with English translation. [cited by applicant]
Wang, Ye-Kui, AHG8/AHG17: Scalable nesting SEI message. Joint Video Experts Team (JVET) of ITU-T SG16 WP3 and ISO/IEC JTC1/SC29/WG11. JVET-P0190-v2. 16th Meeting: Geneva, Oct. 1-11, 2019, pp. 1-4. [cited by applicant]
Skupin, Robert et al., AHG12: On subpicture extraction. Joint Video Experts Team (JVET) of ITU-T SG16 WP3 and ISO/IEC JTC1/SC29/WG11. JVET-Q0397-v3. 17th Meeting: Brussels, Jan. 7-17, 2020, section 2-4. [cited by applicant]
Office Action issued in corresponding U.S. Appl. No. 17/934,007 dated Mar. 30, 2023. [cited by applicant]
Office Action issued in corresponding U.S. Appl. No. 17/982,015 dated Apr. 26, 2023. [cited by applicant]
Office Action issued in corresponding Eurasian Patent Application 202293010 dated Jul. 7, 2023, with English translation. [cited by applicant]
Office Action is issued in corresponding Georgian Patent Application 16098/1 dated Jul. 1, 2023, with English translation. [cited by applicant]
Wang, Y-K., et al., “AHG9: General SEI semantics and constraints”, 19, JVET Meeting by teleconference, Jun. 22, 2020-Jul. 1, 2020, Document JVET-S0178-v2 (4 pages). [cited by applicant]
Suehring, K., et al., “AHG17: Parsing of HRD related SEI messages”, 14, JVET Meeting, Geneva, Mar. 19-27, 2019, Document JVET-N0353 (5 pages). [cited by applicant]
Martin Pettersson et al., “Dependent random access point pictures in HEVC”, 2015 IEEE International Conference on Image Processing (ICIP), Sep. 27-30, 2015. [cited by applicant]
Notice of Acceptance for patent application issued in corresponding Australian Application No. 2021277524 dated Mar. 31, 2023. [cited by applicant]
Sullivan, G. J., et al., “Overview of the High Efficiency Video Coding (HEVC) Standard”, IEEE Transactions on Circuits and Systems for Video Technology (2012). [cited by applicant]
International Telecommunication Union, “Series H: Audiovisual and Multimedia Systems Infrastructure of audiovisual services—Coding of moving video”, ITU-T H.265, Telecommunication Standardization Sector of ITU, High eff… [cited by applicant]