Video stream modifier
View Patent ↗A compressed data stream modifier 270 is disclosed. The stream modifier modifies an input data stream that may comprise audio and video data streams conforming to any one of the well-known video compression standards, for example, MPEG or AVC. The input stream is first de-multiplexed to obtain a single video elementary stream. The video elementary stream is then decoded by means of a variable-length decoder and provided to the data stream modifier. A decoding complexity of each frame is estimated by an estimator 210 and provided to a controller 250 . The controller selects a number of regions from each frame based on some psycho-visual criteria, such that a method of modification of these regions can bring the decoding complexity within an available capacity at a decoder. An efficient means of adapting a decoding complexity to an available capacity is thus obtained.
1. A device for modifying a compressed data stream to be decoded at a decoder, the compressed data stream being obtained by encoding a sequence of pictures comprising regions of pixels, the device comprising:
estimating means for estimating a decoding complexity required for decoding a picture from the compressed data stream; and
modifying means for modifying the compressed data stream when the decoding complexity of the picture approaches a capacity of the decoder, characterized in that the modifying means are arranged to modify a method of decoding indicated in the compressed data stream;
wherein the modifying means are arranged to select a region on the basis of a heuristic psycho-visual selection criterion and modify a method of decoding for said region.
2. A device as claimed in claim 1 , wherein the decoding complexity is based on a computational load or a memory access bandwidth for decoding the picture.
3. A device as claimed in claim 1 , wherein the selection criterion is a proximity of the region to boundaries of the picture.
4. A device as claimed in claim 1 , wherein the selection criterion is a speed of movement of the region.
5. A device as claimed in claim 1 , wherein the selection criterion is a measure of texture of the region.
6. A device as claimed in claim 1 , wherein the modifying means are arranged to modify a method of motion-compensated prediction of a region of a picture from bi-directional prediction to unidirectional prediction.
7. A device as claimed in claim 1 , wherein the modifying means are arranged to modify a quantized transform coefficient present in the compressed data stream.
8. A device as claimed in claim 1 , wherein the modifying means are arranged to select a region of rectangular shape.
9. A device as claimed in claim 1 , wherein the modifying means are arranged to select a region of a shape that adapts to an object in the picture.
10. A video-processing system for compression and decompression of a sequence of pictures, the system comprising:
an encoder for encoding the sequence of pictures and output of a compressed data stream;
a device for modifying the compressed data stream according to claim 1 ; and
a decoder for decoding the modified compressed data stream to obtain a sequence of pictures.
11. A video-processing apparatus comprising
receiving means for receiving a signal comprising a compressed data stream corresponding to a sequence of pictures; and
a device for modifying the compressed data stream according to claim 1 .
12. A method of modifying a compressed data stream to be decoded at a decoder, the compressed data stream being obtained by encoding a sequence of pictures comprising regions of pixels, the method comprising:
estimating, via means for estimating, a decoding complexity required for decoding a picture from the compressed data stream; and
modifying, via means for modifying the compressed data stream, the stream when the decoding complexity of the picture approaches a capacity of the decoder, characterized in that modifying the compressed data stream, via the means for modifying, comprises modifying a method of decoding indicated in the stream;
wherein the modifying means are arranged to select a region on the basis of a heuristic psycho-visual selection criterion and modify a method of decoding for said region.
13. A method as claimed in claim 12 , wherein the decoding complexity is based on a computational load or a memory access bandwidth for decoding the picture.
14. A method as claimed in claim 12 , wherein the selection criterion is a proximity of the region to boundaries of the picture, a speed of movement of the region, or a measure of texture of the region.
15. A method as claimed in claim 12 , wherein the modifying means are arranged to modify a method of motion-compensated prediction of a region of a picture from bi-directional prediction to unidirectional prediction.
16. A method as claimed in claim 12 , wherein the modifying means are arranged to modify a quantized transform coefficient present in the compressed data stream or arranged to select a region of a shape that adapts to an object in the picture.
17. A device for modifying a compressed data stream to be decoded at a decoder, the compressed data stream being obtained by encoding a sequence of pictures comprising regions of pixels, the device comprising:
an estimating component that estimates a decoding complexity required for decoding a picture from the compressed data stream; and
a modifying component that modifies the compressed data stream when the decoding complexity of the picture approaches a capacity of the decoder, characterized in that the modifying component is arranged to modify a method of decoding indicated in the compressed data stream;
wherein the modifying component is arranged to select a region on the basis of a heuristic psycho-visual selection criterion and modify a method of decoding for said region.
18. A device as claimed in claim 17 , wherein the decoding complexity is based on a computational load or a memory access bandwidth for decoding the picture.
19. A device as claimed in claim 17 , wherein the selection criterion includes a proximity of the region to boundaries of the picture, a speed of movement of the region, or a measure of texture of the region.
20. A device as claimed in claim 17 , wherein the modifying component is arranged to modify a quantized transform coefficient present in the compressed data stream or arranged to select a region of a shape that adapts to an object in the picture.