Displacement vector prediction method and apparatus in video encoding and decoding and device
View Patent ↗This application provides a displacement vector prediction method and apparatus in video encoding/decoding and a device and relates to the field of video codec technologies. In this application, candidate displacement vectors are constructed by combining displacement vectors related to a plurality of prediction modes, and then a predicted displacement vector of a current unit is derived from the candidate displacement vectors. Information about an encoded/decoded unit having a same prediction mode as the current unit can be used and information about an encoded/decoded unit having different prediction modes from the current unit is also allowed to be combined to derive the predicted displacement vector of the current unit, so that the candidate displacement vector has a higher possibility to be selected as the predicted displacement vector, thereby improving the encoding performance of the displacement vector.
1 . A method for displacement vector prediction in video decoding, the method comprising:
determining a prediction mode of a current unit, the prediction mode indicating an intra block copy (IBC) prediction mode;
obtaining at least one candidate displacement vector based on at least one of: a history-based displacement vector prediction list, a class-based displacement vector prediction list, a displacement vector of an adjacent unit of the current unit, or a preset displacement vector, the at least one candidate displacement vector related to an intra string copy (ISC) prediction mode;
deriving a predicted displacement vector of the current unit from the at least one candidate displacement vector; and
decoding the current unit based on the predicted displacement vector.
2 . The method according to claim 1 , wherein the obtaining the at least one candidate displacement vector comprises:
constructing a history-based displacement vector prediction list, the history-based displacement vector prediction list comprising a displacement vector of a historical unit in the ISC prediction mode; and
deriving the at least one candidate displacement vector from the history-based displacement vector prediction list.
3 . The method according to claim 2 , further comprising:
performing a duplicate checking operation on a first displacement vector;
in response to a result of the duplicate checking indicating no duplicate, adding the first displacement vector to the history-based displacement vector prediction list; and
in response to the result of the duplicate checking indicating a duplicate:
skipping adding the first displacement vector to the history-based displacement vector prediction list, or
removing a displacement vector that is the same as the first displacement vector in the history-based displacement vector prediction list, and adding the first displacement vector to the history-based displacement vector prediction list.
4 . The method according to claim 1 , wherein the obtaining the at least one candidate displacement vector comprises:
constructing a history-based displacement vector prediction list, the history-based displacement vector prediction list comprising a displacement vector and auxiliary information of a historical unit in the ISC prediction mode;
classifying displacement vectors in the history-based displacement vector prediction list according to the auxiliary information;
generating a class-based displacement vector prediction list based on displacement vectors in classes; and
deriving the at least one candidate displacement vector from the class-based displacement vector prediction list.
5 . The method according to claim 4 , wherein the classifying the displacement vectors in the history-based displacement vector prediction list according to the auxiliary information comprises at least one of the following:
classifying the displacement vectors in the history-based displacement vector prediction list according to size information;
classifying the displacement vectors in the history-based displacement vector prediction list according to position information; or
classifying the displacement vectors in the history-based displacement vector prediction list according to a quantity of duplicates.
6 . The method according to claim 1 , wherein the obtaining the at least one candidate displacement vector comprises:
obtaining a displacement vector of an adjacent unit of the current unit in the ISC prediction mode as the at least one candidate displacement vector.
7 . The method according to claim 6 , wherein the obtaining the displacement vector of the adjacent unit of the current unit in the ISC prediction mode as the at least one candidate displacement vector comprises any one of the following manners:
deriving a string vector of a string comprising position information of the current unit in the adjacent unit;
deriving a string vector of a string of which a length is greater than a preset threshold in the adjacent unit;
deriving a string vector of a string with a maximum length in the adjacent unit;
deriving a string vector of a first string or a last string in the adjacent unit; or
deriving string vectors of all strings in the adjacent unit.
8 . The method according to claim 1 , wherein the obtaining the at least one candidate displacement vector comprises:
obtaining a preset displacement vector related to the ISC prediction mode as the at least one candidate displacement vector.
9 . The method according to claim 8 , wherein:
in response to the prediction mode of the current unit being the IBC prediction mode, the candidate displacement vector comprises at least one of the following preset displacement vectors: (−w, −h), (−w, 0), (0, −h), (−2*w, 0), or (0, −2*h), wherein w is a width of the current unit and h is a height of the current unit.
10 . An apparatus for displacement vector prediction in video decoding, the apparatus comprising:
a memory storing instructions; and
a processor in communication with the memory, wherein, when the processor executes the instructions, the processor is configured to cause the apparatus to perform:
determining a prediction mode of a current unit, the prediction mode indicating an intra block copy (IBC) prediction mode;
obtaining at least one candidate displacement vector based on at least one of: a history-based displacement vector prediction list, a class-based displacement vector prediction list, a displacement vector of an adjacent unit of the current unit, or a preset displacement vector, the at least one candidate displacement vector related to an intra string copy (ISC) prediction mode;
deriving a predicted displacement vector of the current unit from the at least one candidate displacement vector; and
decoding the current unit based on the predicted displacement vector.
11 . The apparatus according to claim 10 , wherein, when the processor is configured to cause the apparatus to perform obtaining the at least one candidate displacement vector, the processor is configured to cause the apparatus to perform:
constructing a history-based displacement vector prediction list, the history-based displacement vector prediction list comprising a displacement vector of a historical unit in the ISC prediction mode; and
deriving the at least one candidate displacement vector from the history-based displacement vector prediction list.
12 . The apparatus according to claim 11 , wherein, when the processor executes the instructions, the processor is configured to further cause the apparatus to perform:
performing a duplicate checking operation on a first displacement vector;
in response to a result of the duplicate checking indicating no duplicate, adding the first displacement vector to the history-based displacement vector prediction list; and
in response to the result of the duplicate checking indicating a duplicate:
skipping adding the first displacement vector to the history-based displacement vector prediction list, or
removing a displacement vector that is the same as the first displacement vector in the history-based displacement vector prediction list, and adding the first displacement vector to the history-based displacement vector prediction list.
13 . The apparatus according to claim 10 , wherein, when the processor is configured to cause the apparatus to perform obtaining the at least one candidate displacement vector, the processor is configured to cause the apparatus to perform:
constructing a history-based displacement vector prediction list, the history-based displacement vector prediction list comprising a displacement vector and auxiliary information of a historical unit in the ISC prediction mode;
classifying displacement vectors in the history-based displacement vector prediction list according to the auxiliary information;
generating a class-based displacement vector prediction list based on displacement vectors in classes; and
deriving the at least one candidate displacement vector from the class-based displacement vector prediction list.
14 . The apparatus according to claim 13 , wherein, when the processor is configured to cause the apparatus to perform the classifying the displacement vectors in the history-based displacement vector prediction list according to the auxiliary information, the processor is configured to cause the apparatus to perform at least one of the following:
classifying the displacement vectors in the history-based displacement vector prediction list according to size information;
classifying the displacement vectors in the history-based displacement vector prediction list according to position information; or
classifying the displacement vectors in the history-based displacement vector prediction list according to a quantity of duplicates.
15 . The apparatus according to claim 10 , wherein, when the processor is configured to cause the apparatus to perform obtaining the at least one candidate displacement vector, the processor is configured to cause the apparatus to perform:
obtaining a displacement vector of an adjacent unit of the current unit in the ISC prediction mode as the at least one candidate displacement vector.
16 . The apparatus according to claim 15 , wherein, when the processor is configured to cause the apparatus to perform obtaining the displacement vector of the adjacent unit of the current unit in the ISC prediction mode as the at least one candidate displacement vector, the processor is configured to cause the apparatus to perform any one of the following manners:
deriving a string vector of a string comprising position information of the current unit in the adjacent unit;
deriving a string vector of a string of which a length is greater than a preset threshold in the adjacent unit;
deriving a string vector of a string with a maximum length in the adjacent unit;
deriving a string vector of a first string or a last string in the adjacent unit; or
deriving string vectors of all strings in the adjacent unit.
17 . The apparatus according to claim 10 , wherein, when the processor is configured to cause the apparatus to perform obtaining the at least one candidate displacement vector, the processor is configured to cause the apparatus to perform:
obtaining a preset displacement vector related to the ISC prediction mode as the at least one candidate displacement vector.
18 . The apparatus according to claim 17 , wherein:
in response to the prediction mode of the current unit being the IBC prediction mode, the candidate displacement vector comprises at least one of the following preset displacement vectors: (−w, −h), (−w, 0), (0, −h), (−2*w, 0), or (0, −2*h), wherein w is a width of the current unit and h is a height of the current unit.
19 . A non-transitory computer-readable storage medium, storing computer-readable instructions, wherein, the computer-readable instructions, when executed by a processor, are configured to cause the processor to perform:
determining a prediction mode of a current unit, the prediction mode indicating an intra block copy (IBC) prediction mode;
obtaining at least one candidate displacement vector based on at least one of: a history-based displacement vector prediction list, a class-based displacement vector prediction list, a displacement vector of an adjacent unit of the current unit, or a preset displacement vector, the at least one candidate displacement vector related to an intra string copy (ISC) prediction mode;
deriving a predicted displacement vector of the current unit from the at least one candidate displacement vector; and
decoding the current unit based on the predicted displacement vector.
20 . The non-transitory computer-readable storage medium according to claim 19 , wherein, when the computer-readable instructions are configured to cause the processor to perform obtaining the at least one candidate displacement vector, the computer-readable instructions are configured to cause the processor to perform:
constructing a history-based displacement vector prediction list, the history-based displacement vector prediction list comprising a displacement vector of a historical unit in the ISC prediction mode; and
deriving the at least one candidate displacement vector from the history-based displacement vector prediction list.