Systems and methods for generalized multi-hypothesis prediction for video coding
Systems and methods are described for video coding using generalized bi-prediction. In an exemplary embodiment, to code a current block of a video in a bitstream, a first reference block is selected from a first reference picture and a second reference block is selected from a second reference picture. Each reference block is associated with a weight, where the weight may be an arbitrary weight ranging, e.g., between 0 and 1. The current block is predicted using a weighted sum of the reference blocks. The weights may be selected from among a plurality of candidate weights. Candidate weights may be signaled in the bitstream or may be derived implicitly based on a template. Candidate weights may be pruned to avoid out-of-range or substantially duplicate candidate weights. Generalized bi-prediction may additionally be used in frame rate up conversion.
1. A video encoding method comprising:
for at least a current block in a current picture, encoding block-level information identifying a first weight and a second weight, wherein at least one of the first and second weights has a value not equal to 0, 0.5 or 1; and
for each sub-block in the current block:
obtaining a first sub-block motion vector and a second sub-block motion vector based on an affine motion model of the current block; and
predicting the sub-block as a weighted sum of a first reference block in a first reference picture pointed to by the first sub-block motion vector and a second reference block in a second reference picture pointed to by the second sub-block motion vector, wherein the first reference block is weighted by the first weight and the second reference block is weighted by the second weight;
wherein the first weight and the second weight are shared across each of the sub-blocks in the current block.
2. The method of claim 1 , wherein encoding of the block-level information comprises mapping a weight index to a codeword using a truncated unary code and entropy encoding the codeword in a bitstream.
3. The method of claim 1 , wherein the second weight is identified by subtracting the first weight from one.
4. The method of claim 1 , wherein the first weight and the second weight are identified from among a predetermined set of weights.
5. A video decoding method comprising:
for at least a current block in a current picture, decoding block-level information identifying a first weight and a second weight, wherein at least one of the first and second weights has a value not equal to 0, 0.5 or 1; and
for each sub-block in the current block:
obtaining a first sub-block motion vector and a second sub-block motion vector based on an affine motion model of the current block; and
predicting the sub-block as a weighted sum of a first reference block in a first reference picture pointed to by the first sub-block motion vector and a second reference block in a second reference picture pointed to by the second sub-block motion vector, wherein the first reference block is weighted by the first weight and the second reference block is weighted by the second weight;
wherein the first weight and the second weight are shared across each of the sub-blocks in the current block.
6. The method of claim 5 , wherein the decoding of the block-level information comprises entropy decoding a codeword from a bitstream and recovering a weight index from the codeword using a truncated unary code.
7. The method of claim 5 , wherein the second weight is identified by subtracting the first weight from one.
8. The method of claim 5 , wherein the first weight and the second weight are identified from among a predetermined set of weights.
9. A video encoding apparatus comprising a processor configured to perform at least:
for at least a current block in a current picture, encoding block-level information identifying a first weight and a second weight, wherein at least one of the first and second weights has a value not equal to 0, 0.5 or 1; and
for each sub-block in the current block:
obtaining a first sub-block motion vector and a second sub-block motion vector based on an affine motion model of the current block; and
predicting the sub-block as a weighted sum of a first reference block in a first reference picture pointed to by the first sub-block motion vector and a second reference block in a second reference picture pointed to by the second sub-block motion vector, wherein the first reference block is weighted by the first weight and the second reference block is weighted by the second weight;
wherein the first weight and the second weight are shared across each of the sub-blocks in the current block.
10. The apparatus of claim 9 , wherein encoding of the block-level information comprises mapping a weight index to a codeword using a truncated unary code and entropy encoding the codeword in a bitstream.
11. The apparatus of claim 9 , wherein the second weight is identified by subtracting the first weight from one.
12. The apparatus of claim 9 , wherein the first weight and the second weight are identified from among a predetermined set of weights.
13. A video decoding apparatus comprising a processor configured to perform at least:
for at least a current block in a current picture, decoding block-level information identifying a first weight and a second weight, wherein at least one of the first and second weights has a value not equal to 0, 0.5 or 1; and
for each sub-block in the current block:
obtaining a first sub-block motion vector and a second sub-block motion vector based on an affine motion model of the current block; and
predicting the sub-block as a weighted sum of a first reference block in a first reference picture pointed to by the first sub-block motion vector and a second reference block in a second reference picture pointed to by the second sub-block motion vector, wherein the first reference block is weighted by the first weight and the second reference block is weighted by the second weight;
wherein the first weight and the second weight are shared across each of the sub-blocks in the current block.
14. The apparatus of claim 13 , wherein the decoding of the block-level information comprises entropy decoding a codeword from a bitstream and recovering a weight index from the codeword using a truncated unary code.
15. The apparatus of claim 13 , wherein the second weight is identified by subtracting the first weight from one.
16. The apparatus of claim 13 , wherein the first weight and the second weight are identified from among a predetermined set of weights.
17. A non-transitory computer-readable medium including instructions for causing one or more processors to perform a method comprising:
for at least a current block in a current picture, decoding block-level information identifying a first weight and a second weight, wherein at least one of the first and second weights has a value not equal to 0, 0.5 or 1; and
for each sub-block in the current block:
obtaining a first sub-block motion vector and a second sub-block motion vector based on an affine motion model of the current block; and
predicting the sub-block as a weighted sum of a first reference block in a first reference picture pointed to by the first sub-block motion vector and a second reference block in a second reference picture pointed to by the second sub-block motion vector, wherein the first reference block is weighted by the first weight and the second reference block is weighted by the second weight;
wherein the first weight and the second weight are shared across each of the sub-blocks in the current block.
18. The computer-readable medium of claim 17 , wherein the decoding of the block-level information comprises entropy decoding a codeword from a bitstream and recovering a weight index from the codeword using a truncated unary code.
19. The computer-readable medium of claim 17 , wherein the second weight is identified by subtracting the first weight from one.
20. The computer-readable medium of claim 17 , wherein the first weight and the second weight are identified from among a predetermined set of weights.