Block-based picture fusion for contextual segmentation and processing
An encoder includes circuitry configured to receive a video frame, partition the video frame into blocks, determine a first area within the video frame including a first grouping of a first subset of the blocks, determine a first average measure of information of the first area, and encode the video frame, the encoding including controlling a quantization parameter based on the first average measure of information of the first area. Related apparatus, systems, techniques and articles are also described.
1. A video signal processor, the video signal processor comprising:
an inverse quantizer;
an inverse transform processor;
an in-loop filter; and
a decoded picture buffer;
wherein the video signal processor is configured to receive, using the inverse quantizer, a video signal including a picture comprising quantized pixels, wherein the picture includes:
a first region comprising a first plurality of blocks and having a first quantization parameter which has been controlled by an encoder based on a first average measure of information of the first plurality of blocks, the first average measure of information being a first average measure of spatial activity determined using a discrete cosine transform of the blocks in the first plurality; and
a second region comprising a second plurality of blocks and having a second quantization parameter which has been controlled by the encoder based on a second average measure of information of the second plurality of blocks.
2. The processor of claim 1 wherein the picture comprises at least one 128×128 coding unit.
3. The processor of claim 1 , wherein the first average measure of information is determined by calculating a sum of a plurality of information measures of the plurality of blocks.
4. The processor of claim 3 , wherein the first average measure of information is further determined by multiplying the sum by a significance coefficient.
5. The processor of claim 4 , wherein the significance coefficient is determined based on a characteristic of the first area.
6. The processor of claim 1 , wherein the first region has a quantization size determined based on the first measure of information.
7. The processor of claim 1 , wherein the second average measure of information is a second average measure of spatial activity.
8. The processor of claim 7 wherein the second average measure of spatial activity is determined using a discrete cosine transform of the blocks in the second plurality.
9. A method, the method comprising:
receiving, by a video signal processor including an inverse quantizer, an inverse transform processor, an in-loop filter, and a decoded picture buffer, a video signal including a picture comprising quantized pixels, wherein the picture includes:
a first region comprising a first plurality of blocks and having a first quantization parameter which has been controlled by an encoder based on a first average measure of information of the first plurality of blocks, the first average measure of information being a first average measure of spatial activity determined using a discrete cosine transform of the blocks in the first plurality; and
a second region comprising a second plurality of blocks and having a second quantization parameter which has been controlled by the encoder based on a second average measure of information of the second plurality of blocks.
10. The method of claim 9 wherein the picture comprises at least one 128×128 coding unit.
11. The method of claim 9 , wherein the first average measure of information is determined by calculating a sum of a plurality of information measures of the plurality of blocks.
12. The method of claim 11 , wherein the first average measure of information is further determined by multiplying the sum by a significance coefficient.
13. The method of claim 12 , wherein the significance coefficient is determined based on a characteristic of the first area.
14. The method of claim 9 , wherein the first region has a quantization size determined based on the first measure of information.
15. The method of claim 9 , wherein the second average measure of information is a second average measure of spatial activity.
16. The method of claim 15 wherein the second average measure of spatial activity is determined using a discrete cosine transform of the blocks in the second plurality.