IP Library Granted Patent US 12,401,800
Granted Patent B2
US 12,401,800 · App. 18/614,268 · Granted Aug 26, 2025

Method and apparatus for encoding/decoding a video using a motion compensation

Inventors: Dong San Jun (Daejeon, KR); Ha Hyun Lee (Seoul, KR); Jung Won Kang (Daejeon, KR); Hyun Suk Ko (Daejeon, KR); Sung Chang Lim (Daejeon, KR); Jin Ho Lee (Daejeon, KR); Seung Hyun Cho (Daejeon, KR); Hui Yong Kim (Daejeon, KR); Jin Soo Choi (Daejeon, KR)
Assignee: LX Semicon Co., Ltd.
H04N19/159H04N19/105H04N19/126H04N19/13H04N19/176H04N19/463H04N19/513H04N19/593H04N19/96
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,401,800
App. No.
18/614,268
Filed
Mar 22, 2024
Granted
Aug 26, 2025
Kind
B2
Art Unit
2486
USPC
375/240.13
Abstract

The present invention relates to a method for encoding/decoding a video. To this end, the method for decoding a video may include: deriving a spatial merge candidate from at least one of spatial candidate blocks of a current block, deriving a temporal merge candidate from a co-located block of the current block, and generating a prediction block of the current block based on at least one of the derived spatial merge candidate and the derived temporal merge candidate, wherein a reference picture for the temporal merge candidate is selected based on a reference picture list of a current picture including the current block and a reference picture list of a co-located picture including the co-located block.

Claims (41)

1. A decoding apparatus for image decoding, the decoding apparatus comprising:

a memory; and

at least one processor connected to the memory, the at least one processor configured to:

obtain a plurality of sub-blocks by dividing the current block into sub-block units;

derive a plurality of co-located sub-blocks for the plurality of sub-blocks;

derive sub-block-based temporal merge candidates of the current block based on the plurality of co-located sub-blocks; and

generate a predicted block of the current block based on the sub-block-based temporal merge candidates,

wherein the co-located sub-blocks are located in a collocated picture which is one of reference pictures,

wherein in order to derive the sub-block-based temporal merge candidates of the current block,

based on that motion information of a co-located sub-block for a sub-block is available, motion information of the sub-block is derived by using motion information of the co-located sub-block,

based on that the motion information of the co-located sub-block for the sub-block is not available, the motion information of the sub-block is derived by using motion information of a specific sub-block in a co-located block comprising the co-located sub-block,

wherein the co-located block and co-located sub-blocks are derived by using a motion vector of a neighboring block,

wherein the specific sub-block in the co-located block is a below-right center sub-block located in a bottom right side among four sub-blocks adjoining a center of the co-located block,

wherein a reference picture for the sub-block-based temporal merge candidates is selected as a firstly-ordered picture in a reference picture list for the current block, and

wherein the sub-block-based temporal merge candidates are used for the current block of which size is equal to or greater than 8×8.

2. An image encoding method performed by an encoding apparatus, the method comprising:

a memory; and

at least one processor connected to the memory, the at least one processor configured to:

obtain a plurality of sub-blocks by dividing the current block into sub-block units;

derive a plurality of co-located sub-blocks for the plurality of sub-blocks;

derive sub-block-based temporal merge candidates of the current block based on the plurality of co-located sub-blocks; and

generate a predicted block of the current block based on the sub-block-based temporal merge candidates,

wherein the co-located sub-blocks are located in a collocated picture which is one of reference pictures,

wherein in order to derive the sub-block-based temporal merge candidates of the current block,

based on that motion information of a co-located sub-block for a sub-block is available, motion information of the sub-block is derived by using motion information of the co-located sub-block,

based on that the motion information of the co-located sub-block for the sub-block is not available, the motion information of the sub-block is derived by using motion information of a specific sub-block in a co-located block comprising the co-located sub-block,

wherein the co-located block and co-located sub-blocks are derived by using a motion vector of a neighboring block,

wherein the specific sub-block in the co-located block is a below-right center sub-block located in a bottom right side among four sub-blocks adjoining a center of the co-located block,

wherein a reference picture for the sub-block-based temporal merge candidates is selected as a firstly-ordered picture in a reference picture list for the current block, and

wherein the sub-block-based temporal merge candidates are used for the current block of which size is equal to or greater than 8×8.

3. An apparatus for transmitting image data, the apparatus configured to:

obtain a bitstream generated by an image encoding method, the image encoding method based on obtaining a plurality of sub-blocks by dividing the current block into sub-block units, deriving a plurality of co-located sub-blocks for the plurality of sub-blocks, deriving sub-block-based temporal merge candidates of the current block based on the plurality of co-located sub-blocks, and generating a predicted block of the current block based on the sub-block-based temporal merge candidates; and

transmit the image data comprising the bitstream,

wherein the co-located sub-blocks are located in a collocated picture which is one of reference pictures,

wherein in order to derive the sub-block-based temporal merge candidates of the current block,

based on that motion information of a co-located sub-block for a sub-block is available, motion information of the sub-block is derived by using motion information of the co-located sub-block,

based on that the motion information of the co-located sub-block for the sub-block is not available, the motion information of the sub-block is derived by using motion information of a specific sub-block in a co-located block comprising the co-located sub-block,

wherein the co-located block and co-located sub-blocks are derived by using a motion vector of a neighboring block,

wherein the specific sub-block in the co-located block is a below-right center sub-block located in a bottom right side among four sub-blocks adjoining a center of the co-located block,

wherein a reference picture for the sub-block-based temporal merge candidates is selected as a firstly-ordered picture in a reference picture list for the current block, and

wherein the sub-block-based temporal merge candidates are used for the current block of which size is equal to or greater than 8×8.

Priority Claims (2)
KR 10-2016-0102595 · Aug 11, 2016 · national
KR 10-2016-0158620 · Nov 25, 2016 · national
Continuity (4)
Continuation 18219274 · Jul 7, 2023
Continuation 17717366 · Apr 11, 2022
Continuation 16321173
Related Publication 20240357127A1 · Oct 24, 2024
References Cited (52)
US 11336899B2 · Jun et al. · 2022 [cited by applicant]
US 11743473B2 · Jun et al. · 2023 [cited by applicant]
US 11800113B2 · Lim et al. · 2023 [cited by applicant]
US 20060133507A1 · Lim et al. · 2006 [cited by applicant]
US 20120093226A1 · Chien et al. · 2012 [cited by applicant]
US 20130058407A1 · Sole Rojals et al. · 2013 [cited by applicant]
US 20130128982A1 · Kim et al. · 2013 [cited by applicant]
US 20140016701A1 · Chen et al. · 2014 [cited by applicant]
US 20140072041A1 · Seregin et al. · 2014 [cited by applicant]
US 20140139627A1 · Chen et al. · 2014 [cited by applicant]
US 20140161189A1 · Zhang et al. · 2014 [cited by applicant]
US 20140192883A1 · Seregin · 2014 [cited by examiner]
US 20140307789A1 · Kim et al. · 2014 [cited by applicant]
US 20150195525A1 · Sullivan et al. · 2015 [cited by applicant]
US 20150195562A1 · Li et al. · 2015 [cited by applicant]
US 20150208086A1 · Chen · 2015 [cited by examiner]
US 20150373368A1 · Jeong et al. · 2015 [cited by applicant]
US 20160150240A1 · Lim et al. · 2016 [cited by applicant]
US 20160286232A1 · Li et al. · 2016 [cited by applicant]
US 20160337649A1 · Chuang et al. · 2016 [cited by applicant]
US 20160366435A1 · Chien et al. · 2016 [cited by applicant]
US 20170142418A1 · Li et al. · 2017 [cited by applicant]
US 20180098089A1 · Chen et al. · 2018 [cited by applicant]
US 20180124398A1 · Park · 2018 [cited by examiner]
US 20180146213A1 · Andersson et al. · 2018 [cited by applicant]
US 20180176596A1 · Jeong et al. · 2018 [cited by applicant]
US 20180338144A1 · Nam et al. · 2018 [cited by applicant]
US 20190174136A1 · Jun et al. · 2019 [cited by applicant]
US 20190313113A1 · Lee · 2019 [cited by examiner]
US 20220232228A1 · Jun et al. · 2022 [cited by applicant]
CN 103250417A · 2013 [cited by applicant]
CN 103597837A · 2014 [cited by applicant]
KR 100772576B1 · 2007 [cited by applicant]
KR 1020080064007A · 2008 [cited by applicant]
KR 1020110113583A · 2011 [cited by applicant]
KR 1020130135381A · 2013 [cited by applicant]
KR 1020140018891A · 2014 [cited by applicant]
KR 1020140110831A · 2014 [cited by applicant]
KR 1020150060617A · 2015 [cited by applicant]
KR 102634794B1 · 2024 [cited by applicant]
WO WO0186962A1 · 2001 [cited by applicant]
WO WO2012117728A1 · 2012 [cited by applicant]
WO WO2012134956A1 · 2012 [cited by applicant]
WO WO2013088697A1 · 2013 [cited by applicant]
[No Author Listed], “High Efficiency Video Coding,” International Telecommunication Union, Telecommunication Standardization Sector, H.265 (Apr. 2013), Jun. 2013, 317 pages. [cited by applicant]
Chen et al., “Algorithm Description of Joint Exploration Test Model 3,” Joint Video Exploration Team (JVET) off TU-T SG 16 WP 3 and ISOI/EC JTC 1/SC 29/WG 11, 3rd Meeting: Geneva, CH, May 26-Jun. 1, 2016, 37 pages in En… [cited by applicant]
Chen et al., “Algorithm Description of Joint Exploration Test Model 3,” Joint Video Exploration Team (JVET), JVET-C1001_v1, 3rd Meeting: Geneva, CH, May 26-Jun. 1, 2016, 35 pages. [cited by applicant]
Chen et al., “Algorithm Description of Joint Exploration Test Model 5 (JEM 5),” Joint Video Exploration Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11 5th Meeting, Geneva, CH, Jan. 12-20, 2017, 45 pages. [cited by applicant]
Chen et al., “Algorithm Description of Joint Exploration Test Model 7 (JEM 7),” Joint Video Exploration Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, JVET-G1001-v1, 7th Meeting, Torino, IT, Jul. 13-21, … [cited by applicant]
International Preliminary Report on Patentability in International Application No. PCT/KR2017/008596, mailed on Nov. 17, 2017, 23 pages, with English translation. [cited by applicant]
International Search Report issued on Nov. 17, 2017, in corresponding International Application No. PCT/KR2017/008596, 3 pages in English, 3 pages in Korean. [cited by applicant]
No Author Listed, “Series H: Audiovisual and Multimedia Systems: Infrastructure of Audiovisual Services-Coding of Moving Video,” ITU-T Study Group, ITUT Telecommunication Standardization Sector of ITU, Apr. 2013, 317 pa… [cited by applicant]