IP Library Granted Patent US 12,256,062
Granted Patent B2
US 12,256,062 · App. 16/980,781 · Granted Mar 18, 2025

Method and device for encoding/decoding image and recording medium having bitstream stored thereon

Inventors: Sung Chang Lim (Daejeon, KR); Ha Hyun Lee (Seoul, KR); Jung Won Kang (Daejeon, KR); Jin Ho Lee (Daejeon, KR); Hui Yong Kim (Daejeon, KR)
Assignee: LX Semicon Co., Ltd.
H04N19/105H04N19/119H04N19/137H04N19/159H04N19/176H04N19/523
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,256,062
App. No.
16/980,781
Filed
Sep 14, 2020
Granted
Mar 18, 2025
Kind
B2
Art Unit
RD00
USPC
375/240.02
Abstract

The present invention relates to an image decoding method. The image decoding method comprises deriving initial motion information of a current block from at least one of motion information of a spatial neighbor block, motion information of a temporal neighbor block, and pre-defined motion information, generating refined motion information by performing motion information refinement for the initial motion information and generating a prediction block of the current block by using the refined motion information.

Claims (35)

1. A method of decoding an image, the method comprising:

obtaining information indicating a co-located image of a current block;

determining the co-located image of the current block based on the information;

determining whether a merge candidate in a sub-block unit is derived based on a size of the current block;

based on a determination that the merge candidate in the sub-block unit is derived, determining a co-located block in the co-located image by using motion information of a block that is spatially adjacent to the current block, wherein the motion information of the block that is spatially adjacent to the current block is derived based on the co-located image of the current block;

deriving the merge candidate in the sub-block unit from a sub-block within the co-located block; and

generating a merge candidate list by using the merge candidate in the sub-block unit,

wherein the sub-block within the co-located block is determined based on a center location of a current sub-block within the current block,

wherein based on the size of the current block being equal to or greater than a preset value, it is determined that the merge candidate in the sub-block unit is derived, and

wherein based on a picture order count of a reference picture indicated by the motion information of the block that is spatially adjacent to the current block being the same as a picture order count of the co-located image of the current block, the motion information of the block that is spatially adjacent to the current block is derived as motion information to determine the co-located block in the co-located image.

2. The method of claim 1 , wherein the information indicating the co-located image is signaled in at least one unit of a sequence, picture, slice or a tile group.

3. The method of claim 1 , wherein the preset value is 8×8 block size.

4. A method of encoding an image, the method comprising:

determining a co-located image of a current block;

determining whether a merge candidate in a sub-block unit is derived based on a size of the current block;

based on a determination that the merge candidate in the sub-block unit is derived, determining a co-located block in the co-located image by using motion information of a block that is spatially adjacent to the current block, wherein the motion information of the block that is spatially adjacent to the current block is derived based on the co-located image of the current block;

deriving the merge candidate in the sub-block unit from a sub-block within the co-located block; and

generating a merge candidate list by using the merge candidate in the sub-block unit,

wherein the co-located image of the current block is encoded as information and the information is signaled in at least one unit of a sequence, picture, slice or a tile group,

wherein the sub-block within the co-located block is determined based on a center location of a current sub-block within the current block,

wherein based on the size of the current block being equal to or greater than a preset value, it is determined that the merge candidate in the sub-block unit is derived, and

wherein based on a picture order count of a reference picture indicated by the motion information of the block that is spatially adjacent to the current block being the same as a picture order count of the co-located image of the current block, the motion information of the block that is spatially adjacent to the current block is derived as motion information to determine the co-located block in the co-located image.

5. A non-transitory computer readable storage medium including a bitstream, wherein the bitstream is generated by using an image encoding method including:

determining a co-located image of a current block;

determining whether a merge candidate in a sub-block unit is derived based on a size of the current block;

based on a determination that the merge candidate in the sub-block unit is derived, determining a co-located block in the co-located image by using motion information of a block that is spatially adjacent to the current block, wherein the motion information of the block that is spatially adjacent to the current block is derived based on the co-located image of the current block;

deriving the merge candidate in the sub-block unit from a sub-block within the co-located block; and

generating a merge candidate list by using the merge candidate in the sub-block unit,

wherein the co-located image of the current block is encoded as information and the information is signaled in at least one unit of a sequence, picture, slice or a tile group,

wherein the sub-block within the co-located block is determined based on a center location of a current sub-block within the current block,

wherein based on the size of the current block being equal to or greater than a preset value, it is determined that the merge candidate in the sub-block unit is derived, and

wherein based on a picture order count of a reference picture indicated by the motion information of the block that is spatially adjacent to the current block being the same as a picture order count of the co-located image of the current block, the motion information of the block that is spatially adjacent to the current block is derived as motion information to determine the co-located block in the co-located image.

6. The method of claim 1 , wherein a location of the sub-block within the co-located block is derived based on the center location of the current sub-block within the current block and the motion information of the block that is spatially adjacent to the current block.

7. The method of claim 4 , wherein a location of the sub-block within the co-located block is derived based on the center location of the current sub-block within the current block and the motion information of the block that is spatially adjacent to the current block.

8. The non-transitory computer readable storage medium of claim 5 , wherein a location of the sub-block within the co-located block is derived based on the center location of the current sub-block within the current block and the motion information of the block that is spatially adjacent to the current block.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 8, 2022
From: ELECTRONICS AND TELECOMMUNICATIONS RESEARCH INSTITUTE
To: LX SEMICON CO., LTD.
Reel/Frame 062094/0620 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 14, 2020
From: LIM, SUNG CHANG; LEE, HA HYUN; KANG, JUNG WON; LEE, JIN HO; KIM, HUI YONG
To: ELECTRONICS AND TELECOMMUNICATIONS RESEARCH INSTITUTE
Reel/Frame 053765/0216 →
Priority Claims (2)
KR 10-2018-0029860 · Mar 14, 2018 · national
KR 10-2018-0111636 · Sep 18, 2018 · national
Continuity (1)
Related Publication 20200413040A1 · Dec 31, 2020
References Cited (46)
US 9843803B2 · Lim et al. · 2017 [cited by applicant]
US 9860551B2 · Park et al. · 2018 [cited by applicant]
US 11800113B2 · Lim et al. · 2023 [cited by applicant]
US 20120300850A1 · Yie et al. · 2012 [cited by applicant]
US 20130215968A1 · Jeong et al. · 2013 [cited by applicant]
US 20130243088A1 · Lim · 2013 [cited by examiner]
US 20140044171A1 · Takehara et al. · 2014 [cited by applicant]
US 20140105302A1 · Takehara · 2014 [cited by examiner]
US 20150085929A1 · Chen · 2015 [cited by examiner]
US 20150117543A1 · Hong · 2015 [cited by examiner]
US 20180070105A1 · Jin · 2018 [cited by examiner]
US 20180091816A1 · Chien et al. · 2018 [cited by applicant]
US 20180310017A1 · Chen · 2018 [cited by examiner]
US 20180352247A1 · Park et al. · 2018 [cited by applicant]
US 20190222834A1 · Chen et al. · 2019 [cited by applicant]
US 20190238883A1 · Chen et al. · 2019 [cited by applicant]
US 20200053364A1 · Seo et al. · 2020 [cited by applicant]
US 20200244968A1 · Jun · 2020 [cited by examiner]
US 20210176485A1 · Chuang · 2021 [cited by examiner]
US 20210185338A1 · Xiu · 2021 [cited by examiner]
US 20210185353A1 · Xiu · 2021 [cited by examiner]
US 20210266560A1 · Jang · 2021 [cited by examiner]
US 20220078470A1 · Lee · 2022 [cited by examiner]
US 20220286706A1 · Zheng · 2022 [cited by examiner]
CN 105284117 · 2016 [cited by applicant]
CN 106060563 · 2019 [cited by applicant]
JP 2016006966A · 2016 [cited by applicant]
JP 2017118459A · 2017 [cited by applicant]
JP 2018038050A · 2018 [cited by applicant]
KR 1020060118400A · 2006 [cited by applicant]
KR 100772576B1 · 2007 [cited by applicant]
KR 1020120068743 · 2012 [cited by applicant]
KR 1020130002243A · 2013 [cited by applicant]
KR 101347062 · 2013 [cited by applicant]
KR 20150110357 · 2015 [cited by applicant]
KR 101710034B1 · 2017 [cited by applicant]
KR 1020180008445A · 2018 [cited by applicant]
WO 2001086962A1 · 2001 [cited by applicant]
WO 2005027493A2 · 2005 [cited by applicant]
WO 2016200100A1 · 2016 [cited by applicant]
WO WO2018026118 · 2018 [cited by applicant]
WO WO2018030773 · 2018 [cited by applicant]
International Preliminary Report on Patentability in International Appln. No. PCT/KR2019/002875, mailed on Sep. 24, 2020, 17 pages (with English translation). [cited by applicant]
International Search Report and Written Opinion in International Appln. No. PCT/KR2019/002875, mailed on Jun. 19, 2019, 22 pages (with English translation). [cited by applicant]
Chen et al., “Algorithm Description of Joint Exploration Test Model 5 (JEM 5),” Joint Video Exploration Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11 5th Meeting, Geneva, CH, Jan. 12-20, 2017, 45 pages. [cited by applicant]
Chen et al., “Algorithm Description of Joint Exploration Test Model 7 (JEM 7),” Joint Video Exploration Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, 7th Meeting, Torino, Italy, Jul. 13-21, 2017, 22 pag… [cited by applicant]
Cited By (1)
US 12,671,801