Prediction for video encoding and decoding using external reference
Various embodiments relate to a video coding system in which some elements required for decoding are generated according to a process that not specified within the video coding system. This process is hereafter referenced to as being the “external” process. This external process may generate “external” reference pictures to be used by a decoder that is adapted to use these external pictures. Encoding method, decoding method, encoding apparatus, decoding apparatus based on this post-processing method are proposed.
1. An apparatus comprising:
at least one processor configured to:
perform a first process for decoding an encoded stream comprising data representing a video, the first process comprising, for a current picture of the video: obtaining, from the encoded stream, information representative of a use of an external reference picture for reconstructing the current picture;
obtaining, from the encoded stream, information representative of an index in a set of reference pictures of an external reference picture to be used for reconstructing the current picture; and
reconstructing the current picture based on the external reference picture obtained from the set of reference pictures based on the obtained index, wherein the external reference picture is generated locally and not comprised in the encoded stream; and
perform a second process to generate at least one external reference picture.
2. The apparatus of claim 1 , wherein the video is a multi-view video, wherein the external reference picture comprises a texture of a first view and a motion vector map representing disparity information between the first view and a second view and wherein the at least one processor is further configured to reconstruct the second view based on using motion compensation based on the texture of the first view and the disparity information.
3. The apparatus of claim 2 , wherein the at least one processor is further configured to:
copy the first view into a decoded picture buffer of the second view;
associate the first view with a picture order count;
copy the disparity information into the motion information map of a reference picture being co-located; and
predict the second view based on the copied information.
4. The apparatus of claim 3 , wherein the at least one processor is further configured to predict the second view using a temporal motion vector prediction mode.
5. A method for decoding an encoded stream comprising data representing a video, the method comprising, for a current picture of the video:
obtaining, from the encoded stream, information representative of a use of an external reference picture for reconstructing the current picture;
obtaining, from the encoded stream, information representative of an index in a set of reference pictures of an external reference picture to be used for reconstructing the current picture; and
reconstructing the current picture based on the external reference picture obtained from the set of reference pictures based on the obtained index, wherein the external reference picture is generated locally and not comprised in the encoded stream.
6. The method of claim 5 , wherein the video is a multi-view video, wherein the external reference picture comprises a texture of a first view and a motion vector map representing disparity information between the first view and a second view and wherein reconstructing the second view is based on using motion compensation based on the texture of the first view and the disparity information.
7. The method of claim 6 , further comprising:
copying the first view into a decoded picture buffer of the second view;
associating the first view with a picture order count;
copying the disparity information into the motion information map of a reference picture being co-located; and
predicting the second view based on the copied information.
8. The method of claim 7 , wherein the predicting the second view uses a temporal motion vector prediction mode.
9. A non-transitory computer readable medium comprising program code instructions that, when executed by at least one processor, cause the least one processor to:
perform a first process for decoding an encoded stream comprising data representing a video, the instructions causing the at least one processor to, for a current picture of the video:
obtain, from the encoded stream, information representative of a use of an external reference picture for reconstructing the current picture;
obtain, from the encoded stream, information representative of an index in a set of reference pictures of an external reference picture to be used for reconstructing the current picture; and
reconstruct the current picture based on the external reference picture obtained from the set of reference pictures based on the obtained index, wherein the external reference picture is generated locally and not comprised in the encoded stream; and
perform a second process to generate at least one external reference picture.
10. The non-transitory computer readable medium of claim 9 , wherein the video is a multi-view video, wherein the external reference picture comprises a texture of a first view and a motion vector map representing disparity information between the first view and a second view, and wherein reconstructing the second view is based on using motion compensation based on the texture of the first view and the disparity information.
11. The non-transitory computer readable medium of claim 10 , wherein the program code instructions further cause the at least one processor to decode data representing the video by:
copying the first view into a decoded picture buffer of the second view;
associating the first view with a picture order count;
copying the disparity information into the motion information map of a reference picture being co-located; and
predicting the second view based on the copied information.
12. The non-transitory computer readable medium of claim 11 , wherein the predicting the second view uses a temporal motion vector prediction mode.