Zero motion vector in adaptive reordering of merge candidates (ARMC)
Aspects of the disclosure provide a method and an apparatus including processing circuitry that adds merge candidates into a merge candidate list of a current block in a current picture. The merge candidates include available merge candidates including one or more of spatial motion vector predictors (MVP(s)), temporal MVP(s), non-adjacent MVP(s), history-based MVP(s), and pairwise average MVP(s). Whether the merge candidate list includes all available SMVP, TMVP, NA-MVP, HMVP, and PAMVP, and no merge candidate in the merge candidate list has a zero motion vector (zero MV) are determined. If the merge candidate list includes all available SMVP, TMVP, NA-MVP, HMVP, and PAMVP, and no merge candidate in the merge candidate list has the zero MV, the merge candidate having the zero MV is added to the merge candidate list. Merge candidates in the merge candidate list including the merge candidate having the zero MV are reordered using template matching.
1. A method for video decoding, comprising:
receiving a video bitstream comprising a current block in a current picture;
adding merge candidates into a merge candidate list of the current block in the current picture, the merge candidates being available merge candidates including one or more of (i) at least one spatial motion vector predictor (MVP) (SMVP), (ii) at least one temporal MVP (TMVP), (iii) at least one non-adjacent MVP (NA-MVP), (iv) at least one history-based MVP (HMVP), and (v) at least one pairwise average MVP (PAMVP);
determining whether the merge candidate list includes a merge candidate that has a zero motion vector (zero MV);
when no merge candidate in the merge candidate list has the zero MV, adding a merge candidate having the zero MV to the merge candidate list, at least one reference index of the added merge candidate having the zero MV being 0, the at least one reference index being 0 indicating a first reference picture in one of (i) a first reference picture list L0 and (ii) a second reference picture list L1;
reordering the merge candidates including the merge candidate having the zero MV in the merge candidate list using template matching (TM); and
reconstructing the current block based on the reordered merge candidate list.
2. The method of claim 1 , wherein the reconstructing comprises:
selecting a merge candidate from the reordered merge candidate list that includes the merge candidate having the zero MV; and
reconstructing the current block based on the selected merge candidate.
3. The method of claim 1 , wherein the reordering comprises:
determining TM costs corresponding to each merge candidate in the merge candidate list including the merge candidate having the zero MV, each TM cost being determined based on a current template of the current block and at least one reference template in at least one reference picture corresponding to a respective merge candidate, the at least one reference picture corresponding to the merge candidate having the zero MV including the first reference picture; and
reordering the merge candidate list including the merge candidate having the zero MV based on the determined TM costs.
4. The method of claim 3 , wherein the determining whether the merge candidate list includes the merge candidate that has the zero MV comprises:
determining that the merge candidate list includes the merge candidate having the zero MV when one of conditions is satisfied, the conditions being
(i) one of the merge candidates in the merge candidate list being a merge candidate for uni-prediction having the zero MV associated with a reference picture in one of the first reference picture list L0 and the second reference picture list L1, and
(ii) one of the merge candidates in the merge candidate list being a merge candidate for bi-prediction that has (a) the zero MV associated with the reference picture in the first reference picture list L0 and (b) another zero MV associated with a reference picture in the second reference picture list L1; and
determining that no merge candidate in the merge candidate list has the zero MV when none of the conditions is satisfied.
5. The method of claim 3 , wherein the adding the merge candidate having the zero MV comprises:
adding the merge candidate having the zero MV to the merge candidate list, an absolute value of a picture order count (POC) difference between the first reference picture and the current picture being the smallest among POC differences between the current picture and reference pictures of the current picture.
6. The method of claim 3 , wherein the adding the merge candidate having the zero MV comprises:
adding the merge candidate having the zero MV and another zero MV to the merge candidate list, the at least one reference index including (i) a first reference index associated with the zero MV indicating the first reference picture in the one of the first reference picture list L0 and the second reference picture list L1, and a second reference index associated with the other zero MV indicating a second reference picture in the other of the first reference picture list L0 and the second reference picture list L1, the current picture being a bi-predicted picture, the first reference picture and the second reference picture being available.
7. A method for video decoding, comprising:
adding merge candidates into a merge candidate list of a current block in a current picture, the merge candidates being available merge candidates including one or more of (i) at least one spatial motion vector predictor (MVP) (SMVP), (ii) at least one temporal MVP (TMVP), (iii) at least one non-adjacent MVP (NA-MVP), (iv) at least one history-based MVP (HMVP), or (v) at least one pairwise average MVP (PAMVP);
determining whether the merge candidate list includes a merge candidate having a first zero motion vector (MV) and a second zero MV associated with a first reference picture in a first reference picture list L0 and a second reference picture in a second reference picture list L1, respectively;
when no merge candidate in the merge candidate list has the first zero MV and the second zero MV, adding the merge candidate having the first zero MV and the second zero MV to the merge candidate list, a first reference index associated with the first zero MV indicating the first reference picture in the first reference picture list L0, and a second reference index associated with the second zero MV indicating the second reference picture in the second reference picture list L1, at least one of the first reference index and the second reference index being 0;
reordering the merge candidates including the merge candidate having the first zero MV and the second zero MV in the merge candidate list using template matching (TM); and
reconstructing the current block based on the reordered merge candidate list.
8. The method of claim 7 , wherein the reconstructing comprises:
selecting a merge candidate based on the reordered merge candidate list including the first zero MV and the second zero MV; and
reconstructing the current block based on the selected merge candidate.
9. The method of claim 7 , wherein the reordering comprises:
determining TM costs corresponding to each merge candidate in the merge candidate list including the merge candidate having the first zero MV and the second zero MV, each TM cost being determined based on a current template of the current block and at least one reference template in at least one reference picture corresponding to a respective merge candidate, the at least one reference picture corresponding to the merge candidate having the first zero MV and the second zero MV including the first reference picture and the second reference picture; and
reordering the merge candidate list including the merge candidate having the first zero MV and the second zero MV based on the determined TM costs.
10. The method of claim 7 , wherein
an absolute value of a picture order count (POC) difference between the first reference picture and the current picture being is the smallest among POC differences between the current picture and reference pictures in the first reference picture list L0, and/or
an absolute value of a POC difference between the second reference picture and the current picture is the smallest among POC differences between the current picture and reference pictures in the second reference picture list L1.
11. The method of claim 1 , wherein the at least one reference index of the added merge candidate comprises a first reference index and a second reference index, the first reference index is 0 and indicates the first reference picture in the first reference picture list L0, and the second reference index is 0 and indicates a second reference picture in the second reference picture list L1, the first reference picture list L0 being different from the second reference picture list L1.
12. A method for video encoding, comprising:
adding merge candidates into a merge candidate list of a current block in a current picture, the merge candidates being available merge candidates including one or more of (i) at least one spatial motion vector predictor (MVP) (SMVP), (ii) at least one temporal MVP (TMVP), (iii) at least one non-adjacent MVP (NA-MVP), (iv) at least one history-based MVP (HMVP), and (v) at least one pairwise average MVP (PAMVP);
determining whether the merge candidate list includes a merge candidate that has a zero motion vector (zero MV);
when no merge candidate in the merge candidate list has the zero MV, adding a merge candidate having the zero MV to the merge candidate list, at least one reference index of the added merge candidate having the zero MV being 0, the at least one reference index being 0 indicating a first reference picture in one of (i) a first reference picture list L0 and (ii) a second reference picture list L1;
reordering the merge candidates including the merge candidate having the zero MV in the merge candidate list using template matching (TM); and
encoding, in a video bitstream, the current block based on the reordered merge candidate list.
13. The method of claim 12 , wherein the encoding comprises:
selecting a merge candidate from the reordered merge candidate list that includes the merge candidate having the zero MV; and
encoding the current block based on the selected merge candidate.
14. The method of claim 12 , wherein the reordering comprises:
determining TM costs corresponding to each merge candidate in the merge candidate list including the merge candidate having the zero MV, each TM cost being determined based on a current template of the current block and at least one reference template in at least one reference picture corresponding to a respective merge candidate, the at least one reference picture corresponding to the merge candidate having the zero MV including the first reference picture; and
reordering the merge candidate list including the merge candidate having the zero MV based on the determined TM costs.
15. The method of claim 14 , wherein the adding the merge candidate having the zero MV comprises:
adding the merge candidate having the zero MV to the merge candidate list, an absolute value of a picture order count (POC) difference between the first reference picture and the current picture being the smallest among POC differences between the current picture and reference pictures of the current picture.