IP Library › Granted Patent US 11,483,553
Granted Patent B2
US 11,483,553 · App. 17/560,722 · Granted Oct 25, 2022

Image decoding method and device therefor

Inventors: Naeri Park (Seoul, KR); Junghak Nam (Seoul, KR); Hyeongmoon Jang (Seoul, KR)
Assignee: LG ELECTRONICS INC.
H04N19/105H04N19/132H04N19/159H04N19/176H04N19/52
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,483,553
App. No.
17/560,722
Granted
Oct 25, 2022
Kind
B2
Abstract

According to the disclosure of the present document, weight index information for sub-block merge candidates of a current block can be derived and coding efficiency can be increased.

Claims (75)

1. An image decoding method performed by a decoding apparatus, the method comprising:

obtaining image information comprising inter prediction mode information and residual information through a bitstream;

generating residual samples based on the residual information;

generating a sub-block merge candidate list for a current block based on the inter prediction mode information;

selecting one candidate from among candidates included in the sub-block merge candidate list;

generating L0 prediction samples and L1 prediction samples of the current block based on the selected candidate;

generating prediction samples by weighted averaging the L0 prediction samples and the L1 prediction samples based on a weight index for the selected candidate, wherein the weight index is for the weighted averaging; and

generating reconstructed samples based on the prediction samples and the residual samples,

wherein the sub-block merge candidate list comprises a constructed affine merge candidate,

wherein the constructed affine merge candidate comprises at least one of CPMV0 for a control point CP0, CPMV1 for a control point CP1, and CPMV2 for a control point CP2,

wherein the CPMV0 is derived based on a top-left neighboring block of the current block, a first left neighboring block adjacent to a bottom side of the top-left neighboring block, or a first top neighboring block adjacent to a right side of the top-left neighboring block,

wherein the CPMV1 is derived based on a top-right neighboring block of the current block or a second top neighboring block adjacent to a left side of the top-right neighboring block,

wherein the CPMV2 is derived based on a bottom-left neighboring block of the current block or a second left neighboring block adjacent to a top side of the bottom-left neighboring block, and

wherein based on a case that the constructed affine merge candidate comprises the CPMV0, a weight index for the constructed affine merge candidate is equal to a weight index for the CP0.

2. The image decoding method of claim 1 ,

wherein the weight index for the CP0 corresponds to a weight index of a block that is used for deriving the CPMV0 among the top-left neighboring block, the first left neighboring block, and the first top neighboring block of the current block.

3. The image decoding method of claim 1 ,

wherein based on a case that the constructed affine merge candidate does not comprise the CPMV0 but comprises the CPMV1, the weight index for the constructed affine merge candidate is derived based on a weight index for the CP1.

4. The image decoding method of claim 3 ,

wherein the weight index for the CP1 corresponds to a weight index of a block that is used for deriving the CPMV1 among the top-right neighboring block and the second top neighboring block of the current block.

5. The image decoding method of claim 1 ,

wherein the candidates comprise a pair-wise candidate, and the pair-wise candidate is derived based on a first candidate and a second candidate in the merge candidate list,

wherein a weight index for the pair-wise candidate is derived based on a weight index of the first candidate.

6. The image decoding method of claim 1 , wherein the candidates comprise a pair-wise candidate, and the pair-wise candidate is derived based on a first candidate and a second candidate in the merge candidate list,

wherein based on a case that a weight index for the first candidate and a weight index for the second candidate are identical to each other, a weight index for the pair-wise candidate is derived based on a weight index of the first candidate,

wherein based on a case that the weight index for the first candidate and the weight index for the second candidate are not same, the weight index for the pair-wise candidate is derived based on a default weight index, and

wherein the default weight index corresponds to a weight index for giving a same weight to each of the L0 prediction samples and the L1 prediction samples.

7. The image decoding method of claim 1 ,

wherein the candidates comprise a subblock-based temporal motion vector prediction (SbTMVP) candidate, and

wherein a weight index for the SbTMVP candidate is derived as 0.

8. The image decoding method of claim 1 ,

wherein the candidates comprise a subblock-based temporal motion vector prediction (SbTMVP) candidate,

wherein a weight index for the SbTMVP candidate is derived based on weight index information for a center block in a col block,

wherein the col block comprises a block which is located in a reference picture different from a current picture in which the current block is located, and which is derived based on a motion vector of a left neighboring block of the current block, and

wherein the center block comprises a bottom-right subblock among four subblocks located in a center of the col block.

9. An image encoding method performed by an encoding apparatus, the method comprising:

determining an inter prediction mode of a current block and generating inter prediction mode information indicating the inter prediction mode;

generating a sub-block merge candidate list for the current block based on the inter prediction mode;

generating selection information indicating one candidate among candidates included in the sub-block merge candidate list;

generating residual information based on residual samples of the current block; and

encoding image information comprising the inter prediction mode information, the selection information, and the residual information,

wherein the sub-block merge candidate list comprises a constructed affine merge candidate,

wherein the constructed affine merge candidate comprises at least one of CPMV0 for a control point CP0, CPMV1 for a control point CP1, and CPMV2 for a control point CP2,

wherein the CPMV0 is derived based on a top-left neighboring block of the current block, a first left neighboring block adjacent to a bottom side of the top-left neighboring block, or a first top neighboring block adjacent to a right side of the top-left neighboring block,

wherein the CPMV1 is derived based on a top-right neighboring block of the current block or a second top neighboring block adjacent to a left side of the top-right neighboring block,

wherein the CPMV2 is derived based on a bottom-left neighboring block of the current block or a second left neighboring block adjacent to a top side of the bottom-left neighboring block, and

wherein based on a case that the constructed affine merge candidate comprises the CPMV0, a weight index for the constructed affine merge candidate is equal to a weight index for the CP0, and

wherein the weight index for the constructed affine merge candidate is for a weighted averaging based on L0 prediction samples and L1 prediction samples.

10. The image decoding method of claim 1 ,

wherein based on a case that the constructed affine merge candidate is generated based on {CP0, CP1}, the constructed affine merge candidate comprises the CPMV0 and the weight index for the constructed affine merge candidate is equal to the weight index for the CP0.

11. The image decoding method of claim 1 ,

wherein based on a case that the constructed affine merge candidate is generated based on {CP1, CP2, CP3}, the constructed affine merge candidate comprises the CPMV1 without comprising the CPMV0 and the weight index for the constructed affine merge candidate is equal to the weight index for the CP1.

12. The image encoding method of claim 9 ,

wherein based on a case that the constructed affine merge candidate does not comprise the CPMV0 but comprises the CPMV1, the weight index for the constructed affine merge candidate is derived based on a weight index for the CP1.

13. A non-transitory computer readable digital storage medium storing a bitstream generated by an image encoding method, the method comprising:

determining an inter prediction mode of a current block and generating inter prediction mode information indicating the inter prediction mode;

generating a sub-block merge candidate list for the current block based on the inter prediction mode;

generating selection information indicating one candidate among candidates included in the sub-block merge candidate list;

generating residual information based on residual samples of the current block; and

encoding image information to generate the bitstream, wherein the image information comprises the inter prediction mode information, the selection information, and the residual information,

wherein the sub-block merge candidate list comprises a constructed affine merge candidate,

wherein the constructed affine merge candidate comprises at least one of CPMV0 for a control point CP0, CPMV1 for a control point CP1, and CPMV2 for a control point CP2,

wherein the CPMV0 is derived based on a top-left neighboring block of the current block, a first left neighboring block adjacent to a bottom side of the top-left neighboring block, or a first top neighboring block adjacent to a right side of the top-left neighboring block,

wherein the CPMV1 is derived based on a top-right neighboring block of the current block or a second top neighboring block adjacent to a left side of the top-right neighboring block,

wherein the CPMV2 is derived based on a bottom-left neighboring block of the current block or a second left neighboring block adjacent to a top side of the bottom-left neighboring block,

wherein based on a case that the constructed affine merge candidate comprises the CPMV0, a weight index for the constructed affine merge candidate is equal to a weight index for the CP0, and

wherein the weight index for the constructed affine merge candidate is for a weighted averaging based on L0 prediction samples and L1 prediction samples.

14. The image encoding method of claim 9 ,

wherein based on a case that the constructed affine merge candidate is generated based on {CP0, CP1}, the constructed affine merge candidate comprises the CPMV0 and the weight index for the constructed affine merge candidate is equal to the weight index for the CP0.

15. The image decoding method of claim 9 ,

wherein based on a case that the constructed affine merge candidate is generated based on {CP1, CP2, CP3}, the constructed affine merge candidate comprises the CPMV1 without comprising the CPMV0 and the weight index for the constructed affine merge candidate is equal to the weight index for the CP1.

16. The non-transitory computer readable digital storage medium of claim 13 ,

wherein based on a case that the constructed affine merge candidate is generated based on {CP0, CP1}, the constructed affine merge candidate comprises the CPMV0 and the weight index for the constructed affine merge candidate is equal to the weight index for the CP0.

17. The non-transitory computer readable digital storage medium of claim 13 ,

wherein based on a case that the constructed affine merge candidate is generated based on {CP1, CP2, CP3}, the constructed affine merge candidate comprises the CPMV1 without comprising the CPMV0 and the weight index for the constructed affine merge candidate is equal to the weight index for the CP1.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 23, 2021
From: PARK, NAERI; NAM, JUNGHAK; JANG, HYEONGMOON
To: LG ELECTRONICS INC.
Reel/Frame 058470/0573 →
Continuity (3)
Continuation PCTKR2020008107 · Jun 24, 2020
Provisional Application 62865964 · Jun 24, 2019
Related Publication 20220150473A1 · May 12, 2022
Cited By (1)
US 12,335,465