Explicit signaling for block based adaptive weighting factors
This disclosure relates generally to video coding/decoding and particularly for enhancing block adaptive weighted prediction. One method includes receiving a video bitstream comprising a current block and a reference block, the reference block being used for predicting the current block and being identified by a motion vector associated with the current block; receiving, from the video bitstream, a syntax element indicating a scale factor (α); determining the scale factor (α) based on a value of the syntax element; predicting the current block using an equation p′(x′)=α*p(x)+β, where: p′(x′) is a predicted sample in the current block, p(x) is a collocated reference sample in the reference block corresponding to p′(x′), α is the determined scale factor based on the value of the syntax element, and β is an offset; and reconstructing the current block based on the predicted current block.
1 . A method for processing video data in a decoder, the method comprising:
receiving a video bitstream comprising a current block in a current frame and a reference block in a reference frame, the reference block being used for predicting the current block and being identified by a motion vector associated with the current block;
receiving, from the video bitstream, a syntax element indicating a scale factor (α);
determining the scale factor (α) based on a value of the syntax element, wherein the scale factor (α) is used for predicting the current block;
predicting the current block using an equation as following:
p
′
(
x
′
)
=
α
*
p
(
x
)
+
β
wherein: p′(x′) is a predicted sample in the current block, p(x) is a collocated reference sample in the reference block corresponding to p′(x′), a correspondence between p′(x′) and p(x) is established by the motion vector, α is the determined scale factor based on the value of the syntax element, and β is an offset; and
reconstructing the current block based on the predicted current block.
2 . The method of claim 1 , wherein the decoder maintains a lookup table for storing candidate scale factors, and the signaling carries an index identifying the scale factor in the lookup table.
3 . The method of claim 2 , wherein the candidate scale factors in the lookup table are sorted based on a difference between each of the candidate scale factors and a threshold value.
4 . The method of claim 1 , wherein:
the decoder maintains two or more lookup tables for storing candidate scale factors;
each of the two or more lookup tables supports a different scale factor range; and
the signaling carries a first index identifying a target lookup table among the two or more lookup tables, and a second index identifying the scale factor in the target lookup table.
5 . The method of claim 4 , wherein the candidate scale factors in the each of the two or more lookup tables are sorted based on a difference between each of the candidate scale factors and a threshold value.
6 . The method of claim 5 , wherein the threshold value equals to 1.
7 . The method of claim 5 , further comprising:
receiving, from the video bitstream, a high level syntax indicating the threshold value, the high level syntax being signaled in at least one of following levels:
a sequence level;
a frame level; or
a slice level.
8 . The method of claim 5 , further comprising:
updating and sorting the each of the two or more lookup tables in response to the threshold value being updated.
9 . The method of claim 4 , wherein, for any pair of a first lookup table and a second lookup table in the two or more lookup tables, a first precision of the first lookup table storing candidate scale factors with higher magnitude is lower compared with a second precision of the second lookup table storing candidate scale factors with lower magnitude, each of the first precision and the second precision being measured by a step size between two adjacent scale factors in a respective lookup table.
10 . The method of claim 4 , wherein:
for any pair of a first lookup table and a second lookup table in the two or more lookup tables, a first precision of the first lookup table storing a candidate scale factor with a longer distance to a predefined threshold value is lower compared with a second precision of the second lookup table storing a candidate scale factor with shorter distances to the predefined threshold value;
a distance between a scale factor and the predefined threshold value is determined by an absolute value of a difference between the scale factor and the predefined threshold value; and
each of the first precision and the second precision is measured by a step size between two adjacent scale factors in a lookup table.
11 . The method of claim 1 , wherein the current block is coded in one of following modes: a Block Adaptive Weighted Prediction (BAWP) mode; or a Local Illumination Compensation (LIC) mode.
12 . The method of claim 1 , further comprising:
deriving the offset as an average value of a template of the current block.
13 . The method of claim 1 , further comprising:
in response to a width of the current block being greater than a height of the current block, determining the offset based on above samples of a template of the current block; and
in response to the height of the current block being greater than the width of the current block, determining the offset based on left samples of the template of the current block.
14 . The method of claim 1 , further comprising deriving the offset as an average value of one of:
an average value of the reference block; or
an average value of a template of the reference block.
15 . The method of claim 1 , further comprising receiving a high level syntax indicating whether the signaling indicating or associating with the scale factor (α) is used in the video bitstream, wherein the high level syntax is transmitted in at least one of following levels:
a sequence level;
a frame level;
a slice level; or
a super block level.
16 . The method of claim 15 , further comprising in response to the high level syntax indicating that the signaling is used in the video bitstream:
determining that the scale factor is explicitly indicated by the signaling; and
setting the offset to one of: 0; or average value of a template of the current block.
17 . The method of claim 1 , wherein the decoder maintains a lookup table for storing candidate value pairs formed by scale factor and offset, and the signaling carries an index identifying a target value pair in the lookup table, the target value pair comprising the scale factor and the offset to be used in the linear equation.
18 . The method of claim 1 , wherein:
the syntax element indicates the scale factor explicitly or implicitly; and
p(x) is derived from on p′(x′) based on the motion vector.
19 . A device for processing video data, the device comprising a memory for storing computer instructions and a processor in communication with the memory, wherein, when the processor executes the computer instructions, the processor is configured to cause the device to:
receive a video bitstream comprising a current block in a current frame and a reference block in a reference frame, the reference block being used for predicting the current block and being identified by a motion vector associated with the current block;
receive, from the video bitstream, a syntax element indicating a scale factor (α);
determine the scale factor (α) based on a value of the syntax element, wherein the scale factor (α) is used for predicting the current block;
predict the current block using an equation as following:
p
′
(
x
′
)
=
α
*
p
(
x
)
+
β
wherein: p′(x′) is a predicted sample in the current block, p(x) is a collocated reference sample in the reference block corresponding to p′(x′), a correspondence between p′(x′) and p(x) is established by the motion vector, α is the determined scale factor based on the value of the syntax element, and β is an offset; and
reconstruct the current block based on the predicted current block.
20 . A non-transitory storage medium for storing computer readable instructions, the computer readable instructions, when executed by a processor, causing the processor to:
receive a video bitstream comprising a current block in a current frame and a reference block in a reference frame, the reference block being used for predicting the current block and being identified by a motion vector associated with the current block;
receive, from the video bitstream, a syntax element indicating a scale factor (α);
determine the scale factor (α) based on a value of the syntax element, wherein the scale factor (α) is used for predicting the current block;
predict the current block using an equation as following:
p
′
(
x
′
)
=
α
*
p
(
x
)
+
β
wherein: p′(x′) is a predicted sample in the current block, p(x) is a collocated reference sample in the reference block corresponding to p′(x′), a correspondence between p′(x′) and p(x) is established by the motion vector, α is the determined scale factor based on the value of the syntax element, and β is an offset; and
reconstruct the current block based on the predicted current block.