Resolution-adaptive video coding
Systems and methods are provided for implementing methods for resolution-adaptive video coding in a motion prediction coding format by obtaining a current frame of a bitstream, obtaining one or more reference pictures from a reference frame buffer, up-sampling or down-sampling the obtained one or more reference pictures that have resolutions different from a resolution of the current frame, and generating a reconstructed frame from the current frame based on the one or more reference pictures and a selected motion candidate of the current frame, thereby achieving substantial reduction of network transport costs in video coding and delivery without requiring the transport of additional data that would offset or compromise these savings.
1. A method comprising:
obtaining a current frame of a bitstream;
obtaining one or more reference pictures from a reference frame buffer;
generating a reconstructed frame from the current frame based on the one or more reference pictures and motion information of one or more blocks of the current frame, the motion information including at least one reference to motion information of another frame;
deriving a motion candidate list for a block of the current frame, the motion candidate list including a plurality of motion candidates; and
prioritizing motion candidates which reference another frame having a same resolution as a resolution of the current frame.
2. The method of claim 1 , further comprising:
up-sampling or down-sampling the obtained one or more reference pictures that have resolutions different from the resolution of the current frame.
3. The method of claim 2 , wherein up-sampling or down-sampling the one or more reference pictures is performed in accordance with a ratio of the resolution of the current frame and the resolution of the one or more reference pictures, to match the resolution of the current frame, and further comprising:
inputting the reconstructed frame into the reference frame buffer as a reference picture.
4. The method of claim 3 , further comprising scaling motion vectors of the one or more reference pictures in accordance with the ratio.
5. The method of claim 1 , wherein deriving the motion candidate list further comprises deriving an SbTMVP predictor.
6. The method of claim 1 , further comprising:
selecting a motion candidate from the derived motion candidate list; and
deriving motion information of the motion candidate as motion information of the block of the current frame.
7. The method of claim 6 , wherein the motion candidate comprises a reference to a reference picture, and deriving motion information of the motion candidate further comprises:
fetching motion information of a block of the reference picture temporally collocated with the block of the current frame.
8. A system comprising:
one or more processors; and
memory communicatively coupled to the one or more processors, the memory storing computer-executable modules executable by the one or more processors that, when executed by the one or more processors, perform associated operations, the computer-executable modules including:
a frame obtaining module configured to obtain a current frame of a bitstream;
a reference frame obtaining module configured to obtain one or more reference pictures from a reference frame buffer;
a reconstructed frame generating module configured to generate a reconstructed frame from the current frame based on the one or more reference pictures and motion information of one or more blocks of the current frame, the motion information including at least one reference to motion information of another frame;
a candidate list deriving module configured to:
derive a motion candidate list for a block of the current frame, the motion candidate list including a plurality of motion candidates, and
prioritize motion candidates which reference another frame having a same resolution as a resolution of the current frame.
9. The system of claim 8 , wherein the computer-executable modules further include:
an up-sampling or down-sampling module configured to up-sample or down-sample the obtained one or more reference pictures that have resolutions different from the resolution of the current frame.
10. The system of claim 9 , wherein the up-sampling or down-sampling module is further configured to up-sample or down-sample the one or more reference pictures based on the resolution of the current frame in accordance with a ratio of the resolution of the current frame and the resolution of the one or more reference pictures, to match the resolution of the current frame, and
the computer-executable modules further include:
a buffer inputting module configured to input the reconstructed frame into the reference frame buffer as a reference picture.
11. The system of claim 10 , wherein the computer-executable modules further include:
a scaling module configured to scale motion vectors of the one or more reference pictures in accordance with the ratio.
12. The system of claim 8 , wherein the candidate list deriving module is further configured to derive an SbTMVP predictor.
13. The system of claim 8 , wherein the computer-executable modules further include a motion predicting module configured to select a motion candidate from the derived motion candidate list and derive motion information of the motion candidate as motion information of the block of the reconstructed frame.
14. The system of claim 13 , wherein the motion candidate comprises a reference to motion information of a reference picture, and the motion predicting module is further configured to:
fetch motion information of a block of the reference picture temporally collocated with the block of the current frame.
15. One or more computer-readable storage media storing thereon computer-executable instructions that, when executed by one or more processors, cause the one or more processors to perform operations comprising:
obtaining a current frame of a bitstream;
obtaining one or more reference pictures from a reference frame buffer;
generating a reconstructed frame from the current frame based on the one or more reference pictures and motion information of one or more blocks of the current frame, the motion information including at least one reference to motion information of another frame;
deriving a motion candidate list for a block of the current frame, the motion candidate list including a plurality of motion candidates; and
prioritizing motion candidates which reference another frame having a same resolution as a resolution of the current frame.
16. The one or more computer-readable storage media of claim 15 , wherein the operations further comprise:
up-sampling or down-sampling the obtained one or more reference pictures that have resolutions different from the resolution of the current frame.
17. The one or more computer-readable storage media of claim 16 , wherein up-sampling or down-sampling the one or more reference pictures is performed in accordance with a ratio of the resolution of the current frame and the resolution of the one or more reference pictures, to match the resolution of the current frame, and
the operations further comprise:
inputting the reconstructed frame into the reference frame buffer as a reference picture.
18. The one or more computer-readable storage media of claim 17 , wherein the operations further comprise:
scaling motion vectors of the one or more reference pictures in accordance with the ratio.
19. The one or more computer-readable storage media of claim 15 , wherein the motion candidate list further comprises deriving an SbTMVP predictor.
20. The one or more computer-readable storage media of claim 15 , wherein the operations further comprise:
selecting a motion candidate from the derived motion candidate list; and
deriving motion information of the motion candidate as motion information of the block of the current frame.