ENCODER AND DECODER FOR VIDEO CODING FOR MACHINES (VCM)

1 . A video coding for machines (VCM) encoder, the VCM encoder comprising:

a first video encoder, the first video encoder configured to encode an input video into a bitstream;

a feature extractor, the feature extractor configured to detect at least a feature in the input video; and

a second encoder, the second encoder configured to encode a feature bitstream as a function of the input video and at least a feature.

2 . The VCM encoder of claim 1 , wherein the feature extractor further comprises a machine-learning model configured to output at least a feature map.

3 . The VCM encoder of claim 2 , wherein the machine-learning model further comprises a convolutional neural network.

4 . The VCM encoder of claim 3 , wherein the convolutional neural network include: a plurality of convolutional layers; and

a plurality of pooling layers.

5 . The VCM encoder of claim 2 , wherein the feature extractor further comprises a classifier, the classifier configured to classify an output of the machine-learning model to at least a feature.

6 . The VCM encoder of claim 5 , wherein the classifier further comprises a deep neural network.

7 . The VCM encoder of claim 5 , wherein the second encoder is further configured to group feature maps of the at least a feature map according to a classification to at least a feature.

8 . The VCM encoder of claim 1 , wherein the second encoder further comprises a feature encoder.

9 . The VCM encoder of claim 1 , wherein the second encoder further comprises a video encoder.

10 . The VCM encoder of claim 1 , wherein the first video encoder is coupled to the feature extractor and receives a feature signal therefrom.

11 . The VCM encoder of claim 1 further comprising a multiplexor, the multiplexor configured to combine the video bitstream and the feature bitstream.

12 . The VCM encoder of claim 1 , wherein the feature extractor is configured to generate a plurality of feature maps and wherein the feature maps are spatially arranged prior to encoding.

13 . The VCM encoder of claim 12 , wherein the feature maps are spatially arranged based at least in part on a texture component of the feature maps.

14 . A VCM decoder configured to receive an encoded hybrid bitstream, the decoder comprising:

a demultiplexor receiving the hybrid bitstream;

a feature decoder, the feature decoder receiving an encoded feature bitstream from the demultiplexor and providing a decoded set of features for machine processing;

a machine model couple to the feature decoder; and

a video decoder, the video decoder receiving an encoded video bitstream from the demultiplexor and providing a decoded video signal for human consumption.

15 . The VCM decoder of claim 14 , wherein the feature decoder is configured to receive a bitstream comprising a plurality of spatially arranged feature maps, decode the spatially arranged feature maps, and reconstruct the original sequence of feature maps.