VIDEO CODING FOR MACHINES (VCM) ENCODER AND DECODER FOR COMBINED LOSSLESS AND LOSSY ENCODING
A video coding for machines (VCM) encoder for combined lossless and lossy encoding includes a feature encoder, the feature encoder configured to encode a sub-picture containing a feature in an input video and provide an indication of the sub-picture, and a video encoder, the video encoder configured to receive an indication of the sub-picture from the feature encoder and encode the sub-picture using a lossy encoding protocol.
1 . A video coding for machines (VCM) encoder comprising:
a feature encoder, the feature encoder configured to receive source video and encode a sub-picture containing a feature in an input video and provide an indication of the sub-picture; and
a video encoder, the video encoder configured to receive source video, receive an indication of the sub-picture from the feature encoder, and encode the sub-picture using a lossy encoding protocol; and
a multiplexor coupled to the feature encoder and video encoder and providing a encoded bitstream
2 . The VCM encoder of claim 1 further comprising a feature extractor configured to identify the sub-picture.
3 . The VCM encoder of claim 1 , wherein the feature encoder is further configured to encode the sub-picture using a lossless encoding protocol.
4 . The VCM encoder of claim 3 , wherein the lossless encoding protocol is a transform skip residual coding protocol
5 . The VDM encoder of claim 3 , wherein the encoder enables block differential pulse-code modulation.
6 . The VCM encoder of claim 1 , wherein the feature encoder is further configured to encode the sub-picture using a lossy encoding protocol.
7 . The VCM encoder of claim 1 , wherein the lossy encoding protocol includes a discrete cosine transform encoding protocol.
8 . The VCM encoder of claim 4 , wherein the discrete cosine transform encoding protocol includes a shape-adaptive discrete cosign transform encoding protocol.
9 . The VCM encoder of claim 1 , further configured to signal the sub-picture to a decoder.
10 . The VCM encoder of claim 8 , wherein signaling the sub-picture further comprises signaling a sequence of frames including the sub-picture.
11 . The VCM encoder of claim 8 , wherein signaling the sub-picture further comprises signaling a type of feature included in the sub-picture.
12 . A VCM decoder comprising:
a feature decoder, the feature decoder receiving an encoded bitstream having encoded feature data and video data therein, the decoder providing decoded feature data for machine consumption;
a video decoder, the video decoder receiving the encoded bitstream and feature data from the feature decoder, the video decoder providing decoded video suitable for a human viewer.
13 . The VCM decoder of claim 12 , wherein the video decoder is configured to decode an encoded bitstream coded with the VVC standard.
14 . The VCM decoder of claim 12 , wherein the video decoder is configured to decode the bitstream encoded using a transform skip residual coding protocol
15 . The VCM decoder of claim 12 , wherein the decoder is further configured to decode a bitstream encoded using block differential pulse-code modulation.