Granted Patent B2

US 12,489,925 · App. 19/097,518 · Granted Dec 2, 2025

Inventors: Jonathan Pfaff (Berlin, DE); Tobias Hinz (Berlin, DE); Karsten Suehring (Berlin, DE); Heiko Schwarz (Berlin, DE); Detlev Marpe (Berlin, DE); Thomas Wiegand (Berlin, DE)

Assignee: Fraunhofer-Gesellschaft zur Foerderung der angewandten Forschung e.V.

H04N19/70H04L9/0825H04L9/3236H04L9/3247H04N19/13H04N19/18

Abstract

Claims (86)

1 . Apparatus for checking a video data stream having a video encoded thereinto on trustworthiness, wherein the apparatus is configured for

subjecting a predetermined portion of the video data stream, or data derived therefrom, to a hash function to acquire a hash value;

deriving a digital signature from the video data stream; and

checking whether the hash value fits to the digital signature to determine whether the video data stream is trustworthy,

wherein the video data stream has the video encoded thereinto by

encoding the video into the video data stream by block based predictive coding and transform based residual coding by

encoding the prediction residual data of the residual block into the video data stream by use of context adaptive variable length coding by using

a first syntax element indicating a total number of non-zero transform coefficients in a transform block representing the residual block, and a trailing-one number, indicating a number of non-zero transform coefficients comprising an absolute value of one when traversing the coefficients along a scan order,

one or more second syntax elements indicating a sign of the non-zero transform coefficients comprising an absolute value of one when traversing the coefficients along the scan order,

one or more third syntax elements indicating a value of the non-zero transform coefficients except for the number of non-zero transform coefficients comprising an absolute value of one when traversing the coefficients along the scan order,

a fourth syntax element indicating a total number of zero-valued transform coefficient levels in the transform block from a firstly-encountered non-zero transform coefficient in the scan order onwards, and

one or more fifth syntax elements indicting positions of the non-zero transform coefficients along the scan order by indicating a number of consecutive zero-valued transform coefficients in the scan order between in the scan order consecutively encountered non-zero transform coefficients.

2 . Apparatus according to claim 1 , wherein the digital signature is transmitted in an supplemental enhancement information message of the video data stream.

3 . Apparatus according to claim 1 , configured for, in checking whether the hash value fits to the digital signature to determine whether the video data stream is trustworthy,

decrypting the digital signature to acquire a check value; and

checking whether the hash value matches the check value.

4 . Apparatus according to claim 1 , the apparatus being a decoder configured for

decoding the video from the video data stream, and

decoding the digital signature from the video data stream.

5 . Apparatus according to claim 1 , configured for locating the predetermined portion within the video data stream by use of one or more SEI messages interspersed into video data stream and determining the predetermined portion to be a section of the video data stream extending between, or extending from, the one or more SEI messages.

6 . Apparatus according to claim 1 , configured for locating the predetermined portion within the video data stream by use of a first SEI message and a second SEI message interspersed into video data stream and determining the predetermined portion to be located between the first and the second SEI messages, or located between the first SEI message and a point in the data stream which is located downstream the second SEI message.

7 . Apparatus according to claim 1 , configured for

deriving an overview SEI message from the video data stream, the overview SEI message indicating one or more substreams of the video data stream with respect to each of which the checking the video data stream on trustworthiness is possible based on one or more portions in the respective substream; and

performing the checking the video data stream on trustworthiness with respect to a subset of one or more substreams of the one or more substreams by, for a predetermined substream out of the subset,

locating a portion of the predetermined substream of the video data stream by use of one or more first SEI messages interspersed into video data stream and determining the portion of the predetermined substream to be a section of the video data stream formed by concatenating subsections of the video data stream following each of the one or more first SEI messages and extending up to a video coding layer end of an access unit the respective first SEI message is comprised in.

8 . Apparatus according to claim 1 , configured for

deriving an overview SEI message from the video data stream, the overview SEI message indicating one or more substreams of the video data stream with respect to each of which the checking the video data stream on trustworthiness is possible based on one or more portions in the respective substream; and

performing the checking the video data stream on trustworthiness with respect to a subset of one or more substreams of the one or more substreams by determining respective portions of the video data stream for the one or more substreams by

checking, for a picture unit of the video data stream, whether the video data stream comprises a substream selection SEI message for the picture unit, and

assigning video coded layer payload packets of the picture unit to a first substream of the one or more substreams, if the video data stream does not comprise a substream selection SEI message for the picture unit, and

if the video data stream comprises a substream selection SEI message for the picture unit, assigning video coded layer payload packets of the picture unit to a substream of the one or more substreams, which substream is indicated by the substream selection SEI message.

9 . Apparatus according to claim 7 , further configured for determining the respective portions for the substreams of the subset of one or more substreams to end at or before an end of a coded video sequence.

10 . Apparatus according to claim 7 , wherein the one or more substreams have an order defined among them, and wherein the apparatus is configured for determining the predetermined portion to be part of a predetermined substream out of the subset of one or more substreams, and configured for

performing the checking the video data stream on trustworthiness sequentially with respect to respective portions of the video data stream derived for the one or more substreams by

checking

whether the hash value and a further hash value acquired by subjecting a previous portion of the predetermined portion, or further data derived therefrom, to the hash function, fit to the digital signature, or

whether a combined hash value derived by hashing the predetermined portion and a further hash value acquired by subjecting a previous portion of the video data stream, or further data derived therefrom, to the hash function, fits to the digital signature,

wherein the previous portion precedes the predetermined portion in the sequential order defined among the portions.

11 . Apparatus according to claim 1 , configured for

performing the checking the video data stream on trustworthiness sequentially with respect to a plurality of portions of the video data stream, and further by

checking

whether the hash value and a further hash value acquired by subjecting a previous portion of the video data stream, or further data derived therefrom, to the hash function, fit to the digital signature, or

whether a combined hash value derived by hashing the predetermined portion and a further hash value acquired by subjecting a previous portion of the video data stream, or further data derived therefrom, to the hash function, fits to the digital signature.

12 . Apparatus of claim 10 , configured for

subjecting

the hash value and the further hash value to a combination to acquire a combined hash value and checking whether the combined hash value fits to the digital signature, or

the predetermined portion and the further hash value acquired by subjecting a previous portion of the video data stream, or further data derived therefrom, to the hash function, to a combination to acquire a combined hash value and checking whether the combined hash value fits to the digital signature.

13 . Apparatus according to claim 1 , wherein the digital signature is fitted to by a predetermined value in case of

an equality of the predetermined value with a check value acquired by decrypting the digital signature, or a predetermined portion of the check value associated with the predetermined value, or

an equality with the check value in a further hashed domain, reached by a further hash function applied onto the predetermined value or a concatenation of value comprising the predetermined value.

14 . Apparatus according to claim 1 , configured for performing the checking by use of an asymmetric decryption scheme using a public key.

15 . Apparatus according to claim 14 , configured for deriving the asymmetric decryption scheme using a first information derived from the data stream, wherein the first information comprises a decryption scheme indicator or a first pointer to a first location from which the asymmetric decryption scheme may be determined, or an identifier of the entity having encoded the video into the video data stream.

16 . Apparatus according to claim 14 , configured for deriving the public key using a second information derived from the data stream, wherein the second information comprises a second pointer to a second location from which the public key may be retrieved, or an identifier of the entity having encoded the video into the video data stream.

17 . Apparatus according to claim 14 , configured for deriving the public key by deriving a first syntax element and a second syntax element from the video data stream, and wherein the second syntax element is indicative of a pointer to a location, from which the public key is derivable, and wherein the apparatus is configured for,

if the first syntax element comprises a first state, inferring that the location identifies exactly one public key, and deriving the exactly one public key from the location; and

if the first syntax element comprises the second state, inferring that the location is indicative of a list of keys, and deriving a third syntax element from the video data stream, the third syntax element indicating a pointer to an entry in the list of keys, and deriving the public key from the entry in the list of keys indicated by the pointer.

18 . Apparatus according to claim 1 , configured for deriving the hash function using a third information derived from the data stream, wherein the third information comprises a hash function indicator or a third pointer to a third location from which the hash function may be determined, or an identifier of the entity having encoded the video into the video data stream.

19 . Apparatus according to claim 1 , wherein the hash value depends on every bit of the predetermined portion of the video data stream in an entropy coded domain.

20 . Apparatus according to claim 1 , wherein the predetermined portion of the video data stream extends over more than one access unit of the video data stream so that the hash value depends on bits of the more than one access unit.

21 . Apparatus according to claim 1 , configured for checking the video data stream on trustworthiness further by

checking the hash function is correct by checking whether a parametrization of, or an identifier of the hash function fits to the digital signature.

22 . Apparatus for rendering a video data stream having a video encoded thereinto checkable on trustworthiness, wherein the apparatus is configured for

subjecting a predetermined portion of the video data stream, or data derived therefrom, to a hash function to acquire a hash value;

computing a digital signature based on the hash value so as to digitally sign the hash value, and

inserting the digital signature into the video data stream, thereby allowing determining whether the video data stream is trustworthy by checking whether the hash value fits to the digital signature,

wherein the video data stream has the video encoded thereinto by

encoding the video into the video data stream by block based predictive coding and transform based residual coding by

encoding the prediction residual data of the residual block into the video data stream by use of context adaptive variable length coding by using

a first syntax element indicating a total number of non-zero transform coefficients in a transform block representing the residual block, and a trailing-one number, indicating a number of non-zero transform coefficients comprising an absolute value of one when traversing the coefficients along a scan order,

one or more second syntax elements indicating a sign of the non-zero transform coefficients comprising an absolute value of one when traversing the coefficients along the scan order,

one or more third syntax elements indicating a value of the non-zero transform coefficients except for the number of non-zero transform coefficients comprising an absolute value of one when traversing the coefficients along the scan order,

a fourth syntax element indicating a total number of zero-valued transform coefficient levels in the transform block from a firstly-encountered non-zero transform coefficient in the scan order onwards, and

one or more fifth syntax elements indicting positions of the non-zero transform coefficients along the scan order by indicating a number of consecutive zero-valued transform coefficients in the scan order between in the scan order consecutively encountered non-zero transform coefficients.

23 . Method for checking a video data stream having a video encoded thereinto on trustworthiness, wherein the method comprises:

subjecting a predetermined portion of the video data stream, or data derived therefrom, to a hash function to acquire a hash value;

deriving a digital signature from the video data stream; and

checking whether the hash value fits to the digital signature to determine whether the video data stream is trustworthy,

wherein the video data stream has the video encoded thereinto by

encoding the video into the video data stream by block based predictive coding and transform based residual coding by

encoding the prediction residual data of the residual block into the video data stream

by use of context adaptive variable length coding by using

a first syntax element indicating a total number of non-zero transform coefficients in a transform block representing the residual block, and a trailing-one number, indicating a number of non-zero transform coefficients comprising an absolute value of one when traversing the coefficients along a scan order,

one or more second syntax elements indicating a sign of the non-zero transform coefficients comprising an absolute value of one when traversing the coefficients along the scan order,

one or more third syntax elements indicating a value of the non-zero transform coefficients except for the number of non-zero transform coefficients comprising an absolute value of one when traversing the coefficients along the scan order,

a fourth syntax element indicating a total number of zero-valued transform coefficient levels in the transform block from a firstly-encountered non-zero transform coefficient in the scan order onwards, and

one or more fifth syntax elements indicting positions of the non-zero transform coefficients along the scan order by indicating a number of consecutive zero-valued transform coefficients in the scan order between in the scan order consecutively encountered non-zero transform coefficients.

Assignments (1)

Priority Claims (1)

Continuity (1)

References Cited (39)

Cited By (2)

US 12,706,752 US 12,750,242