SYSTEMS AND METHODS FOR DECODER-SIDE SYNTHESIS OF VIDEO SEQUENCES
A method of decoder-side synthesis of video sequences includes receiving, by an encoder, an input video, detecting, by the encoder and in the input video, a first region including synthesizable content, and encoding, by the encoder and in a bitstream, the video, wherein encoding further comprises signaling the first region.
1 . A method of encoding video for decoder-side synthesis of video sequences, the method comprising:
receiving an input video;
detecting a first region in the video including synthesizable content; and
encoding the video, wherein encoding further comprises signaling the first region in the bitstream.
2 . The method of claim 1 , wherein the first region includes at least a frame.
3 . The method of claim 1 , wherein the first region includes at least a sub-frame.
4 . The method of claim 1 , wherein signaling further comprises signaling a transformation of the first region.
5 . The method of claim 4 , wherein the transformation further comprises one of an affine transformation and a translation.
6 . The method of claim 1 , wherein signaling further comprises signaling a model identifier identifying a motion model describing the synthesizable content.
7 . The method of claim 1 , wherein signaling further comprises signaling a presence of model parameters.
8 . The method of claim 1 , wherein signaling further comprises signaling at least a model parameter.
9 . The method of claim 1 further comprising detecting a second region not including synthesizable content.
10 . The method of claim 9 , wherein encoding the video further comprises encoding the second region.
11 . The method of claim 10 , wherein encoding the video further comprises skipping encoding of the first region.
12 . The method of claim 1 further comprising signaling, in the bitstream, at least a reference image for the first region.
13 . A method of decoder-side synthesis of video sequences, the method comprising:
receiving a coded bitstream, wherein the bitstream includes at least a parameter signaling a first region including synthesizable content; and
decoding the video, wherein decoding the video further comprises:
determining a synthesizable content model for the first region using the at least a parameter; and
generating the content of the first region using the synthesizable content model.
14 . The method of claim 13 , wherein the first region includes at least a frame.
15 . The method of claim 13 , wherein the first region includes at least a sub-frame.
16 . The method of claim 13 , wherein receiving further comprises receiving a transformation of the first region, the transformation being selected from one of affine transformation and translation.
17 . The method of claim 13 , wherein receiving further comprises detecting at least a signal indicating at least a model parameter.
18 . The method of claim 13 , wherein the bitstream encodes a second region not including synthesizable content and wherein decoding the video further comprises decoding the second region.
19 . The method of claim 18 , wherein decoding the video further comprises skipping encoding of the first region.
20 . The method of claim 19 further comprising detecting, in the bitstream, at least a reference image for the first region.