Multiple predictor candidates for motion compensation
Different implementations are described, particularly implementations for selecting a predictor candidate from a set of multiple predictor candidates for motion compensation of a picture block based on a motion model. The motion model, may be, e.g., an affine model in a merge mode for a video content encoder or decoder. In an embodiment, a predictor candidate is selected from the set based on a motion model for each of the multiple predictor candidates, and may be based on a criterion such as, e.g., a rate distortion cost. The corresponding motion field is determined based on, e.g., one or more corresponding control point motion vectors for the block being encoded or decoded. The corresponding motion field of an embodiment identifies motion vectors used for prediction of sub-blocks of the block being encoded or decoded.
1. A method for video encoding, comprising:
accessing, for a block being encoded in a picture, a set of predictor candidates having multiple predictor candidates, wherein said block is encoded in an affine merge mode;
selecting a predictor candidate from the set of predictor candidates, wherein said predictor candidate corresponds to a spatial or a temporal neighboring block that has been encoded;
obtaining, using a set of control point motion vectors stored for the selected predictor candidate from the set of predictor candidates, a set of control point motion vectors for the block, wherein motion vectors for motion-compensated prediction of all sub-blocks of said neighboring block are obtained using said set of control point motion vectors for said neighboring block based on an affine motion model, wherein said set of control point motion vectors for said neighboring block are stored separately from said motion vectors for motion-compensated prediction of all sub-blocks of said neighboring block;
obtaining, based on the set of control point motion vectors for said block being encoded, a motion field based on said affine motion model, wherein the motion field identifies motion vectors used for motion-compensated prediction of all sub-blocks of the block being encoded;
storing the set of control point motion vectors for the block separately from the motion vectors of the motion field for the block, as motion information for the block;
encoding the block based on the motion field; and
encoding an index for the selected predictor candidate from the set of predictor candidates.
2. The method of claim 1 , wherein the stored motion vectors of the motion field are for motion compensation of the block.
3. The method of claim 1 , wherein a complete motion vector field for said neighboring block is stored.
4. The method of claim 1 , wherein said block has a size of 4 in width or height.
5. The method of claim 1 , wherein said set of control point motion vectors for said block is derived from said set of control point motion vectors for said predictor candidate, width and height of said block and width and height of said predictor candidate.
6. A method for video decoding, comprising:
accessing, for a block being decoded in a picture, an index corresponding to a predictor candidate of a plurality of predictor candidates, wherein the predictor candidate corresponds to a spatial or a temporal neighboring block that has been decoded, and wherein said block is decoded in an affine merge mode;
obtaining, using a set of control point motion vectors stored for the predictor candidate, a set of control point motion vectors for the block being decoded, wherein motion vectors for motion-compensated prediction of all sub-blocks of said neighboring block are obtained using said set of control point motion vectors for said neighboring block based on an affine motion model, wherein said set of control point motion vectors for said neighboring block are stored separately from said motion vectors for motion-compensated prediction of all sub-blocks of said neighboring block;
obtaining, based on the set of control point motion vectors for the block being decoded, a motion field based on said affine motion model, wherein the motion field identifies motion vectors used for motion-compensated prediction of all sub-blocks of the block being decoded;
storing the set of control point motion vectors for the block separately from the motion vectors of the motion field for the block, as motion information for the block; and
decoding the block based on the motion field.
7. The method of claim 6 , wherein the stored motion vectors of the motion field are for motion compensation of the block.
8. The method of claim 6 , wherein a complete motion vector field for said neighboring block is stored.
9. The method of claim 6 , wherein said block has a size of 4 in width or height.
10. The method of claim 6 , wherein said set of control point motion vectors for said block is derived from said set of control point motion vectors for said predictor candidate, width and height of said block and width and height of said predictor candidate.
11. An apparatus for video encoding, comprising:
one or more processors, wherein said one or more processors are configured to:
access, for a block being encoded in a picture, a set of predictor candidates having multiple predictor candidates, wherein said block is encoded in an affine merge mode;
select a predictor candidate from the set of predictor candidates, wherein said predictor candidate corresponds to a spatial or a temporal neighboring block that has been encoded;
obtain, using a set of control point motion vectors stored for the selected predictor candidate from the set of predictor candidates, a set of control point motion vectors for the block, wherein motion vectors for motion-compensated prediction of all sub-blocks of said neighboring block are obtained using said set of control point motion vectors for said neighboring block based on an affine motion model, wherein said set of control point motion vectors for said neighboring block are stored separately from said motion vectors for motion-compensated prediction of all sub-blocks of said neighboring block;
obtain, based on the set of control point motion vectors for the block being encoded, a motion field based on said affine motion model, wherein the motion field identifies motion vectors used for prediction of all sub-blocks of the block being encoded;
store the set of control point motion vectors for the block separately from the motion vectors of the motion field for the block, as motion information for the block;
encode the block based on the motion field; and
encode an index for the selected predictor candidate from the set of predictor candidates.
12. The apparatus of claim 11 , wherein the stored motion vectors of the motion field are for motion compensation of the block.
13. The apparatus of claim 11 , wherein a complete motion vector field for said neighboring block is stored.
14. The apparatus of claim 11 , wherein said block has a size of 4 in width or height.
15. The apparatus of claim 11 , wherein said set of control point motion vectors for said block is derived from said set of control point motion vectors for said predictor candidate, width and height of said block and width and height of said predictor candidate.
16. An apparatus for video decoding, comprising:
one or more processors, wherein the one or more processors are configured to:
access, for a block being decoded in a picture, an index corresponding to a predictor candidate of a plurality of predictor candidates, wherein the predictor candidate corresponds to a spatial or a temporal neighboring block that has been decoded, and wherein said block is decoded in an affine merge mode;
obtain, using a set of control point motion vectors stored for the predictor candidate, a set of control point motion vectors for the block being decoded, wherein motion vectors for motion-compensated prediction of all sub-blocks of said neighboring block are obtained using said set of control point motion vectors for said neighboring block based on an affine motion model, wherein said set of control point motion vectors for said neighboring block are stored separately from said motion vectors for motion-compensated prediction of all sub-blocks of said neighboring block;
obtain, based on the set of control point motion vectors for the block being decoded, a motion field based on said affine motion model, wherein the motion field identifies motion vectors used for motion-compensated prediction of all sub-blocks of the block being decoded;
store the set of control point motion vectors for the block separately from the motion vectors of the motion field for the block, as motion information for the block; and
decode the block based on the motion field.
17. The apparatus of claim 16 , wherein the stored motion vectors of the motion field are for motion compensation of the block.
18. The apparatus of claim 16 , wherein a complete motion vector field for said neighboring block is stored.
19. The apparatus of claim 16 , wherein said block has a size of 4 in width or height.
20. The apparatus of claim 16 , wherein said set of control point motion vectors for said block is derived from said set of control point motion vectors for said predictor candidate, width and height of said block and width and height of said predictor candidate.