Manipulating sub-pictures of a compressed video signal
View Patent ↗The invention relates to manipulation of sub-pictures ( 303 ) in a picture such as a mosaic screen ( 301 ). An apparatus comprises a sub-picture generator ( 105 ) connected to a mosaic screen generator ( 107 ), which generates the mosaic screen ( 301 ) from the sub-pictures. The mosaic screen ( 301 ) is by a video compressor ( 111 ) divided into uncompressed picture blocks such that each block only comprise video data from one sub-picture. The picture blocks are compressed using a block compression scheme such as MPEG-2. The apparatus further comprises a video manipulation processor ( 113 ), which manipulates the sub-pictures by manipulating the association between control data in the video signal and the compressed picture blocks. The video data of the compressed picture blocks are not affected whereby de-compression and new compression is avoided.
1. A method of video processing, comprising:
generating a video signal comprising a plurality of frames;
dividing at least a first frame of the video signal into a plurality of uncompressed picture blocks such that each uncompressed picture block comprises control data related to only one sub-picture;
generating a compressed video signal by using a video block based compression scheme to generate a plurality of compressed picture blocks from the uncompressed picture blocks, wherein the control data is followed by an associated compressed picture block of the plurality of compressed picture blocks; and
manipulating at least a first sub-picture of the compressed video signal by manipulating the association of control data with a compressed picture block related to the first sub-picture without modifying the control data associated with the compressed picture block.
2. The method of claim 1 , wherein manipulating at least the first sub-picture comprises replacing compressed picture blocks of the first sub-picture with compressed picture blocks of a different picture without changing the control data.
3. The method of claim 1 , wherein manipulating at least the first sub-picture comprises associating the control data of a second sub-picture with the compressed picture blocks of the first sub-picture.
4. The method of claim 1 , wherein the control data comprises information related to the position of an associated sub-picture.
5. The method of claim 1 , wherein the control data comprises identification data and the method comprises selecting the compressed data blocks of the first sub-picture by parsing the compressed video signal to detect identification data corresponding to the first sub-picture.
6. The method of claim 1 , wherein the compressed video signal comprises a plurality of slices each slice comprising a slice header and a number of consecutive compressed picture blocks.
7. The method of claim 6 , wherein each slice comprises a single compressed picture block.
8. The method of claim 6 , wherein each slice comprises a number of compressed picture blocks corresponding to a width of a sub-picture.
9. The method of claim 6 , wherein the slice header comprises a slice number and the manipulation of at least the first sub-picture comprises manipulating the vertical position of the first sub-picture by modifying slice numbers for slices comprising compressed picture blocks of the first sub-picture.
10. The method of claim 1 , wherein manipulating at least the first sub-picture comprises replacing compressed picture blocks with pre-defined compressed picture blocks without modifying the control data, pre-determined sub-pictures being inserted in the compressed video signal.
11. An apparatus for video processing, the apparatus comprising:
a processor; and
a memory storing instructions which when executed cause the processor to:
divide a video signal into a plurality of uncompressed picture blocks, that each uncompressed picture block of the plurality of uncompressed picture blocks comprising control data related to a sub-picture;
generate a compressed video signal by using a video block based compression scheme to generate a plurality of compressed picture blocks from the plurality of uncompressed picture blocks, wherein the control data is followed by an associated compressed picture block of the plurality of compressed picture blocks; and
manipulate at least a first sub-picture of the compressed video signal by manipulating an association between control data and a compressed picture block related to the first sub-picture without modifying the control data associated with the compressed picture block.
12. The apparatus of claim 11 , wherein manipulating at least the first sub-picture comprises replacing compressed picture blocks of the first sub-picture with compressed picture blocks of a different picture without changing the control data.
13. The apparatus of claim 11 , wherein manipulating at least the first sub-picture comprises associating the control data of a second sub-picture with the compressed picture blocks of the first sub-picture.
14. The apparatus of claim 11 , wherein the control data comprises information related to the position of an associated sub-picture.
15. The apparatus of claim 11 , wherein, when executed, the instructions cause the processor to select the compressed data blocks of the first sub-picture by parsing the compressed video signal to detect identification data corresponding to the first sub-picture, the control data comprising the identification data.
16. The apparatus of claim 11 , wherein the compressed video signal comprises a plurality of slices each slice comprising a slice header and a number of consecutive compressed picture blocks.
17. The apparatus of claim 16 , wherein each slice comprises a single compressed picture block.
18. The apparatus of claim 16 , wherein each slice comprises a number of compressed picture blocks corresponding to a width of a sub-picture.
19. The apparatus of claim 16 , wherein the slice header comprises a slice number and the manipulation of at least the first sub-picture comprises manipulating the vertical position of the first sub-picture by modifying slice numbers for slices comprising compressed picture blocks of the first sub-picture.
20. The apparatus of claim 11 , wherein manipulating at least the first sub-picture comprises replacing compressed picture blocks with pre-defined compressed picture blocks without modifying the control data, pre-determined sub-pictures being inserted in the compressed video signal.