IP Library Granted Patent US 11,627,310
Granted Patent B2
US 11,627,310 · App. 17/420,241 · Granted Apr 11, 2023

Affine motion prediction-based video decoding method and device using subblock-based temporal merge candidate in video coding system

Inventor: Hyeongmoon Jang (Seoul, KR)
Assignee: LG ELECTRONICS INC.
H04N19/105H04N19/132H04N19/137H04N19/176
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,627,310
App. No.
17/420,241
Granted
Apr 11, 2023
Kind
B2
Abstract

A video decoding method performed by a decoding device according to the present document is characterized by including: a step for deriving reference subblocks in a reference picture on the basis of the motion vector of an adjacent block on the left side of the current block; a step for deriving a subblock-based temporal merge candidate for the current block on the basis of motion information about the reference subblocks; a step for forming an affine merge candidate list for the current block, the affine merge candidate list including the subblock-based temporal merge candidate; a step for deriving motion information about subblocks of the current block on the basis of the affine merge candidate list; a step for deriving prediction samples for the current block on the basis of the motion information about the subblocks; and a step for generating a reconstructed picture on the basis of the prediction samples.

Claims (43)

1. An image decoding method performed by a decoding apparatus, the method comprising:

deriving a reference block in a reference picture based on a left neighboring block of a current block;

deriving a subblock-based temporal merging candidate for the current block based on the reference block;

deriving an inherited affine candidate for the current block;

deriving a constructed affine candidate for the current block;

constructing a subblock merge candidate list for the current block including the subblock-based temporal merging candidate, the inherited affine candidate and the constructed affine candidate;

deriving motion information of sub-blocks of the current block based on the subblock merge candidate list;

deriving prediction samples for the current block based on motion information of the sub-blocks; and

generating a reconstructed picture based on the prediction samples,

wherein based on a size of the current block being W×H, and an x component of a top-left sample position of the current block being a and a v component of the top-left sample position being b, the left neighboring block is a block including a sample at (a−1, b+H−1) coordinates.

2. The image decoding method of claim 1 , wherein a position of the reference block is derived based on a motion vector of the left neighboring block.

3. The image decoding method of claim 2 , wherein the motion vector for deriving the position of the reference block is fixed to the motion vector of the left neighboring block.

4. The image decoding method of claim 1 ; wherein the deriving the motion information of the sub-blocks of the current block comprises:

selecting the subblock-based temporal merging candidate from the subblock merge candidate list; and

deriving the motion information of the sub-blocks of the current block based on the subblock-based temporal merging candidate.

5. The image decoding method of claim 4 , wherein motion information of a target sub-block among the sub-blocks is derived based on motion information of a collocated sub-block for the target sub-block included in the subblock-based temporal merging candidate.

6. An image encoding method performed by an encoding apparatus, the method comprising:

deriving a reference block in a reference picture based on a left neighboring block of a current block;

deriving a subblock-based temporal merging candidate for the current block based on motion information of the reference block;

deriving an inherited affine candidate for the current block;

deriving a constructed affine candidate for the current block;

constructing a subblock merge candidate list for the current block including the subblock-based temporal merging candidate, the inherited affine candidate and the constructed affine candidate;

deriving motion information of sub-blocks of the current block based on the subblock merge candidate list;

deriving prediction samples for the current block based on the motion information of the sub-blocks; and

encoding image information including prediction information for the current block,

wherein based on a size of the current block being W×H, and an x component of a top-left sample position of the current block being a and a y component of the top-left sample position being b, the left neighboring block is a block including a sample at (a−1, b+H−1) coordinates.

7. The image encoding method of claim 6 , wherein a position of the reference block is derived based on a motion vector of the left neighboring block.

8. The image encoding method of claim 7 , wherein the motion vector for deriving the position of the reference block is fixed to the motion vector of the left neighboring block.

9. The image encoding method of claim 6 , wherein the deriving the motion information of the sub-blocks of the current block comprises:

selecting the subblock-based temporal merging candidate from the subblock merge candidate list; and

deriving the motion information of the sub-blocks of the current block based on the subblock-based temporal merging candidate.

10. The image encoding method of claim 9 , wherein motion information of a target sub-block among the sub-blocks is derived based on motion information of a collocated sub-block for the target sub-block included in the subblock-based temporal merging candidate.

11. A non-transitory computer-readable storage medium storing bitstream generated by a method, the method comprising:

deriving a reference block in a reference picture based on a left neighboring block of a current block;

deriving a subblock-based temporal merging candidate for the current block based on motion information of the reference block;

deriving an inherited affine candidate for the current block;

deriving a constructed affine candidate for the current block;

constructing a subblock merge candidate list for the current block including the subblock-based temporal merging candidate, the inherited affine candidate and the constructed affine candidate;

deriving motion information of sub-blocks of the current block based on the subblock merge candidate list;

deriving prediction samples for the current block based on the motion information of the sub-blocks;

encoding image information including prediction information for the current block; and

generating the bitstream including the image information,

wherein based on a size of the current block being W×H, and an x component of a top-left sample position of the current block being a and a y component of the top-left sample position being b, the left neighboring block is a block including a sample at (a−1, b+H−1) coordinates.

Assignments (3)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 9, 2025
From: LG ELECTRONICS INC.
To: NOKIA TECHNOLOGIES OY
Reel/Frame 072859/0365 →
CORRECTIVE ASSIGNMENT TO CORRECT THE ASSIGNEE'S COUNTRY OF RECORD PREVIOUSLY RECORDED ON REEL 056753 FRAME 0938. ASSIGNOR(S) HEREBY CONFIRMS THE ASSIGNMENT. Recorded Nov 19, 2021
From: JANG, HYEONGMOON
To: LG ELECTRONICS INC.
Reel/Frame 058214/0787 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 5, 2021
From: JANG, HYEONGMOON
To: LG ELECTRONICS INC.
Reel/Frame 056753/0938 →
Continuity (2)
Provisional Application 62787741 · Jan 2, 2019
Related Publication 20220070442A1 · Mar 3, 2022