IP Library › Granted Patent US 12,706,752
Granted Patent B2
US 12,706,752 · App. 19/097,774 · Granted Aug 11, 2026

Trustworthiness of video data streams

Inventors: Jonathan Pfaff (Berlin, DE); Tobias Hinz (Berlin, DE); Karsten Sühring (Berlin, DE); Heiko Schwarz (Berlin, DE); Detlev Marpe (Berlin, DE); Thomas Wiegand (Berlin, DE)
Assignee: Fraunhofer-Gesellschaft zur Foerderung der angewandten Forschung e.V.
H04L9/3247H04L9/3236
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,706,752
App. No.
19/097,774
Filed
Apr 1, 2025
Granted
Aug 11, 2026
Kind
B2
Art Unit
2493
USPC
713/176
Abstract

A method for checking a video data stream having a video encoded thereinto on trustworthiness comprises: subjecting a predetermined portion of the video data stream, or data derived therefrom, to a hash function to obtain a hash value; deriving a digital signature from the video data stream; and checking whether the hash value fits to the digital signature to determine whether the video data stream is trustworthy.

Claims (51)

1 . Apparatus for checking a video data stream having a video encoded thereinto on trustworthiness, wherein the apparatus comprises:

a processor, configured for

subjecting a predetermined portion of the video data stream, or data derived therefrom, to a hash function to obtain a hash value;

deriving a digital signature from the video data stream; and

checking whether the hash value fits to the digital signature to determine whether the video data stream is trustworthy; and further configured for:

deriving an overview supplemental enhancement information message from the video data stream, the overview supplemental enhancement information message indicating one or more substreams of the video data stream with respect to each of which the checking the video data stream on trustworthiness is possible based on one or more portions in the respective substream; and

performing the checking the video data stream on trustworthiness with respect to a subset of one or more substreams of the one or more substreams by determining respective portions of the video data stream for the one or more substreams by

checking, for a picture unit of the video data stream, whether the video data stream includes a substream selection supplemental enhancement information message for the picture unit, and

assigning video coded layer payload packets of the picture unit to a first substream of the one or more substreams, if the video data stream does not include a substream selection supplemental enhancement information message for the picture unit, and

if the video data stream includes a substream selection supplemental enhancement information message for the picture unit, assigning video coded layer payload packets of the picture unit to a substream of the one or more substreams, which substream is indicated by the substream selection supplemental enhancement information message.

2 . Apparatus according to claim 1 , wherein the digital signature is transmitted in a supplemental enhancement information message of the video data stream.

3 . Apparatus according to claim 1 , configured for, in checking whether the hash value fits to the digital signature to determine whether the video data stream is trustworthy,

decrypting the digital signature to obtain a check value; and

checking whether the hash value matches the check value.

4 . Apparatus according to claim 1 , the apparatus being a decoder configured for

decoding the video from the video data stream, and

decoding the digital signature from the video data stream.

5 . Apparatus according to claim 1 , wherein the digital signature is fitted to by a predetermined value in case of

an equality of the predetermined value with a check value obtained by decrypting the digital signature, or a predetermined portion of the check value associated with the predetermined value, or

an equality with the check value in a further hashed domain, reached by a further hash function applied onto the predetermined value or a concatenation of value including the predetermined value.

6 . Apparatus according to claim 1 , configured for performing the checking by use of an asymmetric decryption scheme using a public key.

7 . Apparatus according to claim 1 , wherein the hash value depends on every bit of the predetermined portion of the video data stream in an entropy coded domain.

8 . Apparatus according to claim 1 , wherein the predetermined portion of the video data stream extends over more than one access unit of the video data stream so that the hash value depends on bits of the more than one access unit.

9 . Apparatus for rendering a video data stream having a video encoded thereinto checkable on trustworthiness, wherein the apparatus comprises:

a processor, configured for

subjecting a predetermined portion of the video data stream, or data derived therefrom, to a hash function to obtain a hash value;

computing a digital signature based on the hash value so as to digitally sign the hash value, and

inserting the digital signature into the video data stream, thereby allowing determining whether the video data stream is trustworthy by checking whether the hash value fits to the digital signature; and further configured for

inserting an overview supplemental enhancement information message into the video data stream, the overview supplemental enhancement information message indicating one or more substreams of the video data stream with respect to each of which the checking the video data stream on trustworthiness is possible based on one or more portions in the respective substream; and

rendering the video data stream checkable on trustworthiness with respect to a subset of one or more substreams of the one or more substreams, so that respective portions of the video data stream for the one or more substreams are to be located in the video data stream by

checking, for a picture unit of the video data stream, whether the video data stream includes a substream selection supplemental enhancement information message for the picture unit, and

assigning video coded layer payload packets of the picture unit to a first substream of the one or more substreams, if the video data stream does not include a substream selection supplemental enhancement information message for the picture unit, and

if the video data stream includes a substream selection supplemental enhancement information message for the picture unit, assigning video coded layer payload packets of the picture unit to a substream of the one or more substreams, which substream is indicated by the substream selection supplemental enhancement information message.

10 . Method for checking a video data stream having a video encoded thereinto on trustworthiness, wherein the method comprises:

subjecting a predetermined portion of the video data stream, or data derived therefrom, to a hash function to obtain a hash value;

deriving a digital signature from the video data stream;

checking whether the hash value fits to the digital signature to determine whether the video data stream is trustworthy;

deriving an overview supplemental enhancement information message from the video data stream, the overview supplemental enhancement information message indicating one or more substreams of the video data stream with respect to each of which the checking the video data stream on trustworthiness is possible based on one or more portions in the respective substream; and

performing the checking the video data stream on trustworthiness with respect to a subset of one or more substreams of the one or more substreams by determining respective portions of the video data stream for the one or more substreams by

checking, for a picture unit of the video data stream, whether the video data stream includes a substream selection supplemental enhancement information message for the picture unit, and

assigning video coded layer payload packets of the picture unit to a first substream of the one or more substreams, if the video data stream does not include a substream selection supplemental enhancement information message for the picture unit, and

if the video data stream includes a substream selection supplemental enhancement information message for the picture unit, assigning video coded layer payload packets of the picture unit to a substream of the one or more substreams, which substream is indicated by the substream selection supplemental enhancement information message.

11 . Non-transitory digital storage medium having stored thereon a video data stream, wherein the video data stream has a video encoded thereinto by a method for rendering a video data stream having a video encoded thereinto checkable on trustworthiness, the method comprising:

subjecting a predetermined portion of the video data stream, or data derived therefrom, to a hash function to obtain a hash value;

computing a digital signature based on the hash value so as to digitally sign the hash value,

inserting the digital signature into the video data stream, thereby allowing determining whether the video data stream is trustworthy by checking whether the hash value fits to the digital signature;

inserting an overview supplemental enhancement information message into the video data stream, the overview supplemental enhancement information message indicating one or more substreams of the video data stream with respect to each of which the checking the video data stream on trustworthiness is possible based on one or more portions in the respective substream; and

rendering the video data stream checkable on trustworthiness with respect to a subset of one or more substreams of the one or more substreams, so that respective portions of the video data stream for the one or more substreams are to be located in the video data stream by

checking, for a picture unit of the video data stream, whether the video data stream includes a substream selection supplemental enhancement information message for the picture unit, and

assigning video coded layer payload packets of the picture unit to a first substream of the one or more substreams, if the video data stream does not include a substream selection supplemental enhancement information message for the picture unit, and

if the video data stream includes a substream selection supplemental enhancement information message for the picture unit, assigning video coded layer payload packets of the picture unit to a substream of the one or more substreams, which substream is indicated by the substream selection supplemental enhancement information message.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 17, 2025
From: PFAFF, JONATHAN; HINZ, TOBIAS; SÜHRING, KARSTEN; SCHWARZ, HEIKO; MARPE, DETLEV; WIEGAND, THOMAS
To: FRAUNHOFER-GESELLSCHAFT ZUR FOERDERUNG DER ANGEWANDTEN FORSCHUNG E.V.
Reel/Frame 071435/0748 →
Priority Claims (1)
EP 24168161 · Apr 2, 2024 · regional
Continuity (1)
Related Publication 20250310121A1 · Oct 2, 2025
References Cited (101)
US 5646997A · Barton · 1997 [cited by applicant]
US 6674770B1 · Jarfjord · 2004 [cited by applicant]
US 6959384B1 · Serret-Avila · 2005 [cited by examiner]
US 7917763B2 · Kulessa · 2011 [cited by examiner]
US 8214632B2 · Choi et al. · 2012 [cited by applicant]
US 8256015B2 · Gentry · 2012 [cited by examiner]
US 8645145B2 · Subbaraman et al. · 2014 [cited by applicant]
US 9154785B2 · Wang · 2015 [cited by applicant]
US 9699467B2 · Kirchhoffer et al. · 2017 [cited by applicant]
US 9832022B1 · Pedersen · 2017 [cited by applicant]
US 10263783B2 · Bohli · 2019 [cited by examiner]
US 11057215B1 · Miller · 2021 [cited by applicant]
US 11321878B2 · Graziosi et al. · 2022 [cited by applicant]
US 11449584B1 · Pamucci · 2022 [cited by examiner]
US 11770260B1 · Pamucci · 2023 [cited by examiner]
US 11871057B2 · Blythe · 2024 [cited by examiner]
US 11902559B2 · Levy · 2024 [cited by examiner]
US 12489925B2 · Pfaff et al. · 2025 [cited by applicant]
US 20060047967A1 · Akhan · 2006 [cited by examiner]
US 20090136145A1 · Morimoto et al. · 2009 [cited by applicant]
US 20110043387A1 · Abali et al. · 2011 [cited by applicant]
US 20110179279A1 · Greevenbosch et al. · 2011 [cited by applicant]
US 20110276804A1 · Anzai et al. · 2011 [cited by applicant]
US 20120183052A1 · Lou · 2012 [cited by examiner]
US 20120287989A1 · Budagavi · 2012 [cited by examiner]
US 20130111212A1 · Baltes et al. · 2013 [cited by applicant]
US 20130128958A1 · Gamei · 2013 [cited by examiner]
US 20130259228A1 · Ren et al. · 2013 [cited by applicant]
US 20140016708A1 · Wang · 2014 [cited by applicant]
US 20140092993A1 · Wang · 2014 [cited by applicant]
US 20140156997A1 · Gopalakrishna Rao et al. · 2014 [cited by applicant]
US 20140282696A1 · Mao et al. · 2014 [cited by applicant]
US 20160080742A1 · Kirchhoffer et al. · 2016 [cited by applicant]
US 20170141925A1 · Camenisch et al. · 2017 [cited by applicant]
US 20170230339A1 · Xie · 2017 [cited by examiner]
US 20170278212A1 · Fry · 2017 [cited by examiner]
US 20180089029A1 · Resch et al. · 2018 [cited by applicant]
US 20180218753A1 · Hodge · 2018 [cited by examiner]
US 20180262763A1 · Seregin · 2018 [cited by examiner]
US 20190028441A1 · Thakkar · 2019 [cited by examiner]
US 20200077117A1 · Karczewicz et al. · 2020 [cited by applicant]
US 20200267404A1 · Levy · 2020 [cited by examiner]
US 20200296423A1 · Chao et al. · 2020 [cited by applicant]
US 20200372184A1 · Meirosu · 2020 [cited by applicant]
US 20200409571A1 · Saad · 2020 [cited by examiner]
US 20210211685A1 · Egilmez · 2021 [cited by examiner]
US 20210337235A1 · Choi et al. · 2021 [cited by applicant]
US 20220038719A1 · Leleannec et al. · 2022 [cited by applicant]
US 20220045863A1 · Bai · 2022 [cited by applicant]
US 20220217411A1 · Wang · 2022 [cited by applicant]
US 20220368534A1 · Lundberg et al. · 2022 [cited by applicant]
US 20220400300A1 · Blythe · 2022 [cited by examiner]
US 20230020655A1 · Xu et al. · 2023 [cited by applicant]
US 20230079866A1 · Choi et al. · 2023 [cited by applicant]
US 20230246834A1 · Xu et al. · 2023 [cited by applicant]
US 20230325473A1 · Buffard et al. · 2023 [cited by applicant]
US 20230345013A1 · Li et al. · 2023 [cited by applicant]
US 20230388504A1 · Reddy et al. · 2023 [cited by applicant]
US 20240048394A1 · Völcker · 2024 [cited by examiner]
US 20240119132A1 · Wieker et al. · 2024 [cited by applicant]
US 20240235847A1 · Jacobson · 2024 [cited by applicant]
US 20240305822A1 · Nguyen et al. · 2024 [cited by applicant]
US 20240422141A1 · Shade et al. · 2024 [cited by applicant]
CN 107871063A · 2018 [cited by applicant]
EA 009450B1 · 2007 [cited by applicant]
EP 3737109A1 · 2020 [cited by applicant]
EP 4239520A1 · 2023 [cited by examiner]
JP 2008047983A · 2008 [cited by applicant]
JP 2018201202A · 2018 [cited by applicant]
JP 2022174726A · 2022 [cited by applicant]
JP 2024020162A · 2024 [cited by applicant]
KR 20240017745A · 2024 [cited by applicant]
RU 2452007C2 · 2012 [cited by applicant]
RU 2015117520A · 2016 [cited by applicant]
RU 2618942C2 · 2017 [cited by applicant]
RU 2619194C2 · 2017 [cited by applicant]
RU 2820747C1 · 2024 [cited by applicant]
WO 2014058600A1 · 2014 [cited by applicant]
WO 2015028098A1 · 2015 [cited by applicant]
WO 2021061393A1 · 2021 [cited by applicant]
WO 2021183645A1 · 2021 [cited by applicant]
WO 2023004159A1 · 2023 [cited by applicant]
“Advanced video coding for generic audiovisual services”, Recommendation ITU-T H.264 (V15) (Aug. 2024), Series H: Audiovisual and multimedia systems, Infrastructure of audiovisual services, Coding of moving video (854 p… [cited by applicant]
“Anonymous_Context-adaptive variable-length coding”, Wikipedia, Jan. 23, 2024 (Jan. 23, 2024), XP093280326; retrieved from the Internet: URL:https://en.wikipedia.org/w/index.php?title=Context-adaptive_variable-length_co… [cited by applicant]
“Digital Signature Standard”, (DSS) FIPS 186-5, Feb. 3, 2023, Information Technology Laboratory, National Institute of Standards and Technology (86 pages). [cited by applicant]
“High efficiency video coding”, Recommendation ITU-T H.265 (V10) (Jul. 2024) Series H: Audiovisual and multimedia systems Infrastructure of audiovisual services, Coding of moving video (728 pages). [cited by applicant]
“Open System Communications and Security”, ITU-T X.509, Series X: , Directory, “Information technology—Open Systems Interconnection—The Directory: Public-key and attribute certificate frameworks”, (Oct. 2019) (236 pages… [cited by applicant]
“Secure Hash Standard”, FIPS PUB 180-4, Aug. 2015, Federal Information Processing Standards Publication, Information Technology Laboratory, National Institute of Standards and Technology (36 pages). [cited by applicant]
“Versatile video coding”, Recommendation ITU-T H.266 (V3) (Sep. 2023) Series H: Audiovisual and multimedia systems—Infrastructure of audiovisual services, Coding of moving video (538 pages). [cited by applicant]
Berners-Lee, et al., “Uniform Resource Identifier (URI): Generic Syntax”, Network Working Group, Jan. 2005 (61 pages). [cited by applicant]
Mokhtarian, et al., “End-to-End Secure Delivery of Sclable Video Streams”, Proceedings of the 18th International Workshop on Network and Operating Systems Support for Digital Audio and Video, Nossdav '09, ACM Press, New… [cited by applicant]
Xu, et al., “AHG9: Digital signature SEI message”, 20. JVET Meeting; Oct. 7, 2020-Oct. 16, 2020; Teleconference; (The Joint Video Exploration Team of ISO/IEC JTC1/SC29/WG11 and ITU-T SG. 16), No. JVET-T0090, Oct. 1, 202… [cited by applicant]
Karwowski, Damian, “Advanced Adaptation Algorithms of Arithmetic Coding in Hybrid Video Compression”, PhD diss., Doctoral Dissertation, Poznań University of Technology 2008. <URL: https://www.multimedia.edu.pl/publicati… [cited by applicant]
Sze, et al., “Entropy Coding in HEVC”, High Efficiency Video Coding (HEVC) (2014): 209-274. http://dx.doi.org/10.1007/978-3-319-06895-4_8, 384 pages. [cited by applicant]
“ITU-T Series H: Audiovisual and Multimedia Systems Infrastructure of audiovisual services-Coding of moving video Advanced video coding for generic audiovisual services”, Recommendation ITU-T H. 264, Aug. 2021, 844 page… [cited by applicant]
Xu, et al., AHG9: Digital signature SEI message, JVET-T0090, 2020, 5 pages. [cited by applicant]
Arai, Kenjiro, “Countermeasures against Caller ID Spoofing in IMS Networks”, IEICE Technical Report, vol. 116, No. 484, Feb. 23, 2017, The Institute of Electronics, Information and Communication Engineers (IEICE), pp. 5… [cited by applicant]
Internet Security Systems, Inc., (., “Microsoft Windows 2000 Technical Reference: Security Guide”, Top Studio Co., Ltd. (Translator), First Editon, Apr. 2, 2001, Nikkei BP Soft Press, pp. 181-191, ISBN: 4-89100-167-4. (… [cited by applicant]
Okubo, Sakae(., “Impress Standard Textbook Series: Revised 3rd Edition H.264/AVC Textbook”, 1st Edition, Jan. 1, 2009, Impress R&D, pp. 86-88, 150-153, 337-342, ISBN: 978-4-8443-2664-9. (Reference indicating well- known… [cited by applicant]
Ono, et al., “Ubiquitous Technology: High Efficiency Video Coding—MPEG-4 and H.264”, 1st Edition, Apr. 20, 2005, Ohmsha, Ltd., pp. 40, 41, 50-55, 129-136, ISBN: 4-274-20060-4. (Reference indicating well-known art). [cited by applicant]
Une, et al., “Recent Theoretical Research Trends in Digital Signatures”, Imes Discussion Paper Series (Institute for Monetary and Economic Studies Discussion Paper Series (1999)), [online], Institute for Monetary and Ec… [cited by applicant]