Coded video transmission concept
A video encoder, decoder, system, and method for coding a video are presented. The video encoder for encoding a video is configured to encode frames of the video using intra coding and differential inter-frame coding into a data stream, measure a quality loss resulting from coding loss, and signal, as side information, information on the quality loss in the data stream. Further is presented a video decoder configured to decode frames of the video using intra decoding and differential inter-frame decoding from a data stream into which the video is encoded at a coding loss, estimate information on a quality loss resulting from the coding loss, and output, at an output interface of the video decoder, meta data revealing the information on the picture loss, and/or modify a reconstructed version of the video.
1 . A video encoder for encoding a video, the video encoder comprising a processor configured to
encode frames of the video using intra coding and differential inter-frame coding into a data stream,
perform the differential inter-frame coding by subtraction in a transform domain between a current frame and a previously coded frame at a mutually undisplaced manner,
measure a quality loss resulting from coding loss, and
signal, as side information, information on the quality loss in the data stream.
2 . The video encoder of claim 1 , configured to
perform the measuring and the signaling at a spatial granularity corresponding to frames or sub-frame portions; and/or
wherein the video encoder is configured to
perform the measuring and the signaling at a temporal granularity corresponding to a frame rate of the video.
3 . The video encoder of claim 1 , configured to
measure the quality loss by determining an average of a per-pixel deviation measure between an undistorted version of the video and a reconstructable version as reconstructable from the data stream.
4 . The video encoder of claim 1 , configured to
perform the encoding of the frames in the transform domain and measure the quality loss by averaging over transform coefficients of the transform domain.
5 . The video encoder of claim 1 , configured to
signal the information on the quality loss
as a binary information having two states, a first one of which corresponds to sufficient quality and a second one of which corresponds to insufficient quality, wherein sufficient quality and insufficient quality are indicative of the quality loss meeting one or more criteria having a threshold, or
by use of an integer number or floating point scale.
6 . The video encoder of claim 1 , configured to
perform the differential inter-frame coding by subtraction between a current frame and a previously coded frame to obtain a difference and coding the difference into the data stream.
7 . The video encoder of claim 1 , configured to
use gradual decoding refresh so as to spatially re-position, from frame to frame, an intra-coded portion of the frames of the video over a frame area with coding portions of the frames, and, external to the intra-coded portion, use differential inter-frame coding.
8 . The video encoder of claim 7 , configured to
encode the frames of the video using a bitrate control according to which a constant bitrate is obeyed at units of sub-frame portions into which the frame area is partitioned.
9 . A video decoder for decoding a video, the video decoder comprising a processor configured to
decode frames of the video using intra decoding and differential inter-frame decoding from a data stream,
perform the differential inter-frame decoding by addition in a transform domain between a current frame and a previously coded frame at a mutually undisplaced manner, and
derive, from side information of the data stream, information on a quality loss resulting from coding loss at which the video is encoded into the data stream.
10 . The video decoder of claim 9 , configured to
derive the information on the quality loss from the data stream at a spatial granularity corresponding to frames or sub-frame portions; and/or
wherein in the video decoder is configured to
derive the information on the quality loss from the data stream at a temporal granularity corresponding to a frame rate of the video.
11 . The video decoder of claim 9 , wherein
information on the quality loss is indicative of an average of a per-pixel deviation measure between an undistorted version of the video and a reconstructable version as reconstructable from the data stream.
12 . The video decoder of claim 9 , configured to
derive the information on the quality loss from the data stream
as a binary information having two states, a first one of which corresponds to sufficient quality and a second one of which corresponds to insufficient quality, wherein sufficient quality and insufficient quality are indicative of the quality loss meeting one or more criteria having a threshold, or
by use of an integer number or floating point scale.
13 . The video decoder of claim 9 , configured to
perform the differential inter-frame decoding by decoding, from the data stream, a difference between a current frame and a previously decoded frame and performing an addition between the difference and the previously decoded frame.
14 . The video decoder of claim 13 , configured to
decode, from the data stream, the difference between the current frame and the immediately preceding frame in the transform domain, perform the addition in the transform domain to obtain a transform of the current frame and subject the transform to a re-transformation.
15 . The video decoder of any of claim 9 , configured to
use gradual decoding refresh so as to spatially re-position, from frame to frame, an intra-decoded portion of the frames of the video over a frame area with decoding portions of the frames, and, external to the intra-decoded portion, use differential inter-frame decoding.
16 . The video decoder of claim 9 , configured to
output, at an output interface of the video decoder, meta data revealing the information on the quality loss, and/or
modify a reconstructed version of the video, obtained by the decoding from the data stream, so as to provide the reconstructed version of the video with an indication of phases during which the quality loss fulfills some criterion.
17 . A video decoder for decoding a video, the video decoder comprising a processor configured to
decode frames of the video using intra decoding and differential inter-frame decoding from a data stream into which the video is encoded at a coding loss,
perform the differential inter-frame decoding by addition in a transform domain between a current frame and a previously coded frame at a mutually undisplaced manner,
estimate information on a quality loss resulting from the coding loss, and
output, at an output interface of the video decoder, meta data revealing the information on the quality loss, and/or modify a reconstructed version of the video, obtained by the decoding from the data stream, so as to provide the reconstructed version of the video with an indication of phases during which the quality loss fulfills some criterion.
18 . The video decoder of claim 17 , configured to
estimate the information on the quality loss resulting from coding loss at which the video is encoded into the data stream based on
an average level or average energy of a non-refreshed frame portion, or
a combination of
an average level or average energy of a non-refreshed frame portion of a frame for which the information on the quality loss is to be estimated and an average level or average energy of a co-located non-refreshed frame portion of a subsequent frame following, or preceding frame preceding the frame for which the information on the quality loss is to be estimated, wherein the co-located non-refreshed frame portion is co-located to a refreshed portion of the frame for which the information on the quality loss is to be estimated.
19 . The video decoder of claim 18 , configured to
output, at the output interface of the video decoder, as the meta data revealing the information on the quality loss, a binary information whether the quality loss meets a predetermined quality minimum level, with setting the binary information to indicate that the quality loss meets the predetermined quality minimum level if the average level or average energy falls below a predetermined threshold, or
modify the reconstructed version of the video, obtained by the decoding from the data stream, so as to provide the reconstructed version of the video with the indication of phases during which the quality loss fulfills some criterion in such a manner that the indication provides a binary information whether the quality loss meets a predetermined quality minimum level, so that the quality loss is indicated to meet the predetermined quality minimum level if the average level or average energy falls below a predetermined threshold.
20 . The video decoder of claim 17 , configured to
perform the differential inter-frame decoding by decoding, from the data stream, a difference between a current frame and a previously decoded frame and performing an addition between the difference and the previously decoded frame.
21 . The video decoder of claim 20 , configured to
decode, from the data stream, the difference between the current frame and the immediately preceding frame in the transform domain, perform the addition in the transform domain to obtain a transform of the current frame and subject the transform to a re-transformation.
22 . The video decoder of claim 17 , configured to
use gradual decoding refresh so as to spatially re-position, from frame to frame, an intra-decoded portion of the frames of the video over a frame area with decoding portions of the frames, and, external to the intra-decoded portion, use differential inter-frame decoding.
23 . A system comprising
a video encoder for encoding a video, the video encoder comprising a processor configured to
encode frames of the video using intra coding and differential inter-frame coding into a data stream,
perform the differential inter-frame coding by subtraction in a transform domain between a current frame and a previously coded frame at a mutually undisplaced manner, and
measure a quality loss resulting from coding loss, and
signal, as side information, information on the quality loss; and
a video decoder for decoding the video, the video decoder comprising a processor configured to
decode frames of the video using intra decoding and differential inter-frame decoding from a data stream,
perform the differential inter-frame decoding by addition in a transform domain between a current frame and a previously coded frame at a mutually undisplaced manner, and
derive, from side information of the data stream, the information on a quality loss resulting from coding loss at which the video is encoded into the data stream.
24 . A system comprising
a video encoder comprising a processor configured to encode frames of the video using intra coding and differential inter-frame coding into a data stream, and
perform the differential inter-frame coding by subtraction in a transform domain between a current frame and a previously coded frame at a mutually undisplaced manner; and
a video decoder for decoding the video, the video decoder comprising a processor configured to
decode frames of the video using intra decoding and differential inter-frame decoding from a data stream into which the video is encoded at a coding loss,
perform the differential inter-frame decoding by addition in the transform domain between a current frame and a previously coded frame at a mutually undisplaced manner,
estimate information on a quality loss resulting from the coding loss, and
output, at an output interface of the video decoder, meta data revealing the information on the quality loss, and/or modify a reconstructed version of the video, obtained by the decoding from the data stream, so as to provide the reconstructed version of the video with an indication of phases during which the quality loss fulfills some criterion.
25 . A system comprising
a video decoder for decoding a video, the video decoder comprising a processor configured to
decode frames of the video using intra decoding and differential inter-frame decoding from a data stream,
perform the differential inter-frame decoding by addition in a transform domain between a current frame and a previously coded frame at a mutually undisplaced manner, and
derive, from side information of the data stream, the information on a quality loss resulting from coding loss at which the video is encoded into the data stream;
or
a video decoder for decoding a video, the video decoder comprising a processor configured to
decode frames of the video using intra decoding and differential inter-frame decoding from a data stream into which the video is encoded at a coding loss,
perform the differential inter-frame decoding by addition in the transform domain between a current frame and a previously coded frame at a mutually undisplaced manner, and
estimate information on a quality loss resulting from the coding loss, and
output, at an output interface of the video decoder, meta data revealing the information on the quality loss, and/or modify a reconstructed version of the video, obtained by the decoding from the data stream, so as to provide the reconstructed version of the video with an indication of phases during which the quality loss fulfills some criterion;
wherein the system further comprises
a display for displaying a reconstructed video derived by the video decoder by decoding.
26 . The system of claim 25 , wherein the display is configured to modify the reconstructed version of the video so as to present the reconstructed version of the video modified with an indication of phases during which the quality loss fulfills some criterion; and/or
wherein the display is configured to modify the reconstructed version of the video so as to present the reconstructed version of the video modified with an indication of phases of picture invariance.
27 . A method for encoding a video, the method being performed by a processor and comprising
encoding frames of the video using intra coding and differential inter-frame coding into a data stream,
performing the differential inter-frame coding by subtraction in a transform domain between a current frame and a previously coded frame at a mutually undisplaced manner,
measuring a quality loss resulting from coding loss, and
signaling, as side information, information on the quality loss in the data stream.
28 . A method for decoding a video, the method being performed by a processor and comprising
decoding frames of the video using intra decoding and differential inter-frame decoding from a data stream,
performing the differential inter-frame decoding by addition in a transform domain between a current frame and a previously coded frame at a mutually undisplaced manner, and
deriving, from side information of the data stream, information on a quality loss resulting from coding loss at which the video is encoded into the data stream.
29 . A method for decoding a video, the method being performed by a processor and comprising
decoding frames of the video using intra decoding and differential inter-frame decoding from a data stream into which the video is encoded at a coding loss, perform the differential inter-frame decoding by addition in a transform domain between a current frame and a previously coded frame at a mutually undisplaced manner,
estimating information on a quality loss resulting from the coding loss, and
outputting, at an output interface of the video decoder, meta data revealing the information on the quality loss, and/or modifying a reconstructed version of the video, obtained by the decoding from the data stream, so as to provide the reconstructed version of the video with an indication of phases during which the quality loss fulfills some criterion.