SYSTEMS AND METHODS FOR OPTIMIZING A LOSS FUNCTION FOR VIDEO CODING FOR MACHINES

1 . A system for optimizing a loss function for video coding for machines, the system comprising a computing device including circuitry and configured to:

receive an input video;

extract a feature map as a function of the input video and at least a feature extraction parameter;

encode a feature layer as a function of the feature map;

calculate a loss function as a function of the feature layer; and

optimize the at least a feature extraction parameter as a function of the loss function.

2 . The system of claim 1 , wherein the loss function comprises a rate-distortion optimization function.

3 . The system of claim 2 , wherein the rate-distortion optimization function aggregates a distortion metric and a compression metric.

4 . The system of claim 1 , wherein optimizing the feature extraction parameters includes an optimization machine learning process.

5 . The system of claim 1 , wherein extracting the feature map includes a feature extraction machine learning process.

6 . The system of claim 1 , wherein the computing device is further configured to:

extract an optimized feature map as a function of the input video and the at least an optimized feature extraction parameter;

encode an optimized feature layer as a function of the optimized feature map;

multiplexing an output bitstream as a function of the optimized base feature layer and at least another layer; and

transmit the output bitstream.

7 . The system of claim 6 , wherein the computing device is further configured to:

receive the output bitstream;

demultiplex the optimized feature layer as a function of the output bitstream; and

decode the optimized feature layer.

8 . The system of claim 7 , wherein the computing device is further configured to output the optimized feature layer to a machine.

9 . The system of claim 8 , wherein the computing device is further configured to signal a machine parameter to the machine, wherein the machine parameter is a function of the at least an optimized feature extraction parameter.

10 . The system of claim 1 , wherein the computing device comprises one or more of a decoder.

11 . A method of optimizing a loss function for video coding for machines, the method comprising:

receiving, using a computing device, an input video;

extracting, using the computing device, a feature map as a function of the input video and at least a feature extraction parameter;

encoding, using the computing device, a feature layer as a function of the feature map;

calculating, using the computing device, a loss function as a function of the base feature layer; and

optimizing, using the computing device, the at least a feature extraction parameter as a function of the loss function.

12 . The method of claim 11 , wherein the loss function comprises a rate-distortion optimization function.

13 . The method of claim 12 , wherein the rate-distortion optimization aggregates a distortion metric and a compression metric.

14 . The method of claim 11 , wherein optimizing the feature extraction parameters includes an optimization machine learning process.

15 . The method of claim 11 , wherein extracting the feature map includes a feature extraction machine learning process.

16 . The method of claim 11 , further comprising:

extracting, using the computing device, an optimized feature map as a function of the input video and the at least an optimized feature extraction parameter;

encoding, using the computing device, an optimized feature layer as a function of the optimized feature map;

multiplexing, using the computing device, an output bitstream as a function of the optimized feature layer and at least another layer; and

transmitting, using the computing device, the output bitstream.

17 . The method of claim 16 , further comprising:

receiving, using the computing device, the output bitstream;

demultiplexing, using the computing device, the optimized feature layer as a function of the output bitstream; and

decoding, using the computing device, the optimized feature layer.

18 . The method of claim 17 , further comprising outputting, using the computing device, the optimized feature layer to a machine.

19 . The method of claim 18 , further comprising signaling a machine parameter to the machine, wherein the machine parameter is a function of the at least an optimized feature extraction parameter.

20 . The method of claim 11 , wherein the computing device comprises one or more of a decoder and an encoder.