Low-resolution video coding content extraction
Low complexity method directly decode low-resolution frames from compressed high-resolution videos that were encoded using predictive coding techniques like the H.264 video coding standard. The smaller the decoding resolution, the higher will be the computation and power savings of using the method. Low-frequency coefficients of 2D transformed predictions are added to the low-frequency coefficients of the transformed residual error. Low-frequency coefficients of the reconstructed data are then inverse transformed taking a smaller size transform. Further savings are obtained by reconstructing only those reference pixels that will be needed for accurate decoding of further Intra blocks.
1. A device for extracting low resolution frames from high resolution compressed frames which have been encoded using predictive coding techniques, comprising:
a device for generating frequency coefficients of a prediction needed, wherein the number of frequency coefficients are no more than N/2×N/2 and a fraction of the number in high resolution compressed Intra frames being sampled;
a device for generating corresponding frequency coefficients of a residual error;
a device for reconstructing only those pixels of a particular block that will be used as reference pixels for decoding future blocks;
a device for adding the frequency coefficients of the prediction needed to corresponding frequency coefficients of the residual error;
a device for taking an inverse transform of the sum of said frequency coefficients of prediction and said frequency coefficients of a reconstructed residual error;
a device for normalizing the result of said inverse transform;
a device for deciding if a down-sampled frame generated is to be used as a reference frame, then any reference DC coefficients for a next frame are generated by a weighted average of four reference DC coefficients, so the DC coefficient of the reference block of the next frame are within a region covered by the four reference DC coefficients, wherein, using down-sampled Intra frames as reference frames for Intra frame reconstruction introduces drift errors which are accepted;
a video thumbnail device for generating a low resolution video bitstream for use as a supplementary video file for a corresponding high-resolution video bitstream;
a device for generating supplementary information files to index locations and frame properties of key frames in video bitstreams;
a device for associating and storing supplementary video files and supplementary information files along with their corresponding video bitstreams in a single container file format; and
a device for extracting selected low-resolution frames from a high-resolution stored compressed video file, wherein frames to be decoded are either chosen on-the-fly from the high-resolution coded bitstream.
2. The device of claim 1 , further comprising:
a device for sub-sampling of Inter blocks in a predictive coding video bitstream;
a device for using an integer portion of a motion vector to point to a reference block selected in a reference frame;
a device for disregarding the fractional part of the motion vector;
a device for generating frequency coefficients needed from a selected reference block, wherein, the number of these frequency coefficients are no more than N/2×N/2;
a device for dropping a fractional part in sub-sampling to avoid the otherwise considerable computational load;
a device for generating corresponding frequency coefficients of a residual error;
a device for adding frequency coefficients of a prediction needed to corresponding frequency coefficients of a reconstructed residual error;
a device for taking an inverse transform of only the few frequency coefficients needed; and
a device for normalizing a resulting down-sampled block to form a down-sampled image.
3. The device of claim 1 , further comprising:
a device for deciding if any down-sampled frame generated is to be used as a reference frame later, then a reference DC coefficient for next frame is generated from it using a weighted average of four reference DC coefficients, and the DC coefficients of a reference block of a next frame will be within a region covered by said four reference DC coefficients.
4. The device of claim 1 , further comprising:
a device for decoding selected frames and displaying only selected decoded low-resolution frames for selected video bitstreams when a user opens a video archive.
5. The device of claim 1 , further comprising:
a device for visually communicating to a user simultaneous, motion picture content of a number of video files.
6. A device for extracting low resolution frames from high resolution compressed frames which have been encoded using predictive coding techniques, comprising:
a device for generating frequency coefficients of a prediction needed, wherein the number of frequency coefficients are no more than N/2×N/2 and a fraction of the number in high resolution compressed Intra frames being sampled;
a device for generating corresponding frequency coefficients of a residual error;
a device for reconstructing only those pixels of a particular block that will be used as reference pixels for decoding future blocks;
a device for adding the frequency coefficients of the prediction needed to corresponding frequency coefficients of the residual error;
a device for taking an inverse transform of the sum of said frequency coefficients of prediction and said frequency coefficients of a reconstructed residual error;
a device for normalizing the result of said inverse transform;
a device for deciding if a down-sampled frame generated is to be used as a reference frame, then any reference DC coefficients for a next frame are generated by a weighted average of four reference DC coefficients, so the DC coefficient of the reference block of the next frame are within a region covered by the four reference DC coefficients, wherein, using down-sampled Intra frames as reference frames for Intra frame reconstruction introduces drift errors which are accepted;
a video thumbnail device for generating a low resolution video bitstream for use as a supplementary video file for a corresponding high-resolution video bitstream;
a device for generating supplementary information files to index locations and frame properties of key frames in video bitstreams;
a device for associating and storing supplementary video files and supplementary information files along with their corresponding video bitstreams in a single container file format; and
a device for extracting selected low-resolution frames from a high-resolution stored compressed video file, wherein frames to be decoded are indexed in a high-resolution coded bitstream with the help of a supplementary information file.
7. A device for extracting low resolution frames from high resolution compressed frames which have been encoded using predictive coding techniques, comprising:
a device for generating frequency coefficients of a prediction needed, wherein the number of frequency coefficients are no more than N/2×N/2 and a fraction of the number in high resolution compressed Intra frames being sampled;
a device for generating corresponding frequency coefficients of a residual error;
a device for reconstructing only those pixels of a particular block that will be used as reference pixels for decoding future blocks;
a device for adding the frequency coefficients of the prediction needed to corresponding frequency coefficients of the residual error;
a device for taking an inverse transform of the sum of said frequency coefficients of prediction and said frequency coefficients of a reconstructed residual error;
a device for normalizing the result of said inverse transform;
a device for deciding if a down-sampled frame generated is to be used as a reference frame, then any reference DC coefficients for a next frame are generated by a weighted average of four reference DC coefficients, so the DC coefficient of the reference block of the next frame are within a region covered by the four reference DC coefficients, wherein, using down-sampled Intra frames as reference frames for Intra frame reconstruction introduces drift errors which are accepted;
a device for sampling a high-resolution compressed predictive/bi-predictive frame placed immediately before an Intra/ Intra Decoder Refresh (IDR) frame, and which will not be used later as a reference frame, and using it as a basis for generating a low resolution video;
a supplementary video file associated with a corresponding high-resolution video bitstream and providing an index of locations and frame properties of key frames; and
a supplementary information file that indexes a high-resolution coded bitstream from a stored compressed video file so frames to be decoded can be chosen on-the-fly by a user.