IP Library › Granted Patent US 12,470,718
Granted Patent B2
US 12,470,718 · App. 16/650,591 · Granted Nov 11, 2025

Method for encoding/decoding image using bi-directional optical flow prediction

Inventors: Ha Hyun Lee (Seoul, KR); Jung Won Kang (Daejeon, KR); Hyun Suk Ko (Daejeon, KR); Sung Chang Lim (Daejeon, KR); Jin Ho Lee (Daejeon, KR); Dong San Jun (Daejeon, KR); Hui Yong Kim (Daejeon, KR)
Assignee: INTELLECTUAL DISCOVERY CO., LTD
H04N19/137H04N19/117H04N19/119H04N19/159H04N19/176H04N19/186H04N19/513H04N19/52H04N19/521H04N19/573
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,470,718
App. No.
16/650,591
Granted
Nov 11, 2025
Kind
B2
Abstract

An image encoding/decoding method is disclosed. An image decoding method of the present invention may comprises determining step for determining whether or not to derive second motion information when a current block includes first motion information only and for which bi-directional prediction is available, a deriving step for deriving the second motion information based on the first motion information, and a predicting step for generating a prediction block of the current block by performing BIO prediction based on the first motion information and the second motion information.

Claims (42)

1 . A method of decoding an image, the method comprising:

dividing a current block to acquire a subblock of the current block;

determining whether to perform a subblock based BI-DIRECTIONAL OPTICAL FLOW (BIO) prediction on the subblock;

deriving a first direction prediction sample and a second direction prediction sample of the subblock;

deriving a BIO offset of the subblock;

generating a final prediction sample of the subblock block using the first direction prediction sample, the second direction prediction sample and the BIO offset; and

generating a reconstructed sample of the current block based on the final prediction sample,

wherein whether to perform the subblock based BIO prediction determines based on a result of comparing a threshold value and a difference between the first direction prediction sample and the second direction prediction sample,

wherein the threshold value is set using on a size of the current block,

wherein the deriving a BIO offset comprising:

deriving a gradient using neighboring samples;

deriving a motion refining vector; and

deriving the BIO offset based on the gradient and the motion refining vector,

wherein the gradient is, when a position of the neighboring sample is a subpixel position, derived by rounding to an integer pixel position close to the subpixel position.

2 . A method of encoding an image, the method comprising:

dividing a current block to acquire a subblock of the current block;

determining whether to perform a subblock based BI-DIRECTIONAL OPTICAL FLOW (BIO) prediction on the subblock;

deriving a first direction prediction sample and a second direction prediction sample of the subblock;

deriving a BIO offset of the subblock; and

generating a final prediction sample of the subblock using the first direction prediction sample, the second direction prediction sample and the BIO offset, and

encoding a bitstream based on the final prediction sample,

wherein whether to perform the subblock based BIO prediction determines based on a result of comparing a threshold value and a difference between the first direction prediction sample and the second direction prediction sample,

wherein the threshold value is set using on a size of the current block,

wherein the deriving a BIO offset comprising:

deriving a gradient using neighboring samples;

deriving a motion refining vector; and

deriving the BIO offset based on the gradient and the motion refining vector,

wherein the gradient is, when a position of the neighboring sample is a subpixel position, derived by rounding to an integer pixel position close to the subpixel position.

3 . A non-transitory computer-readable recording medium storing instructions, which when executed by at least one processor perform a method for generating and transmitting a bitstream including encoded video data the method comprising:

dividing a current block to acquire a subblock of the current block;

determining whether to perform a subblock based BI-DIRECTIONAL OPTICAL FLOW (BIO) prediction on the subblock;

deriving a first direction prediction sample and a second direction prediction sample of the subblock;

deriving a BIO offset of the subblock; and

generating a final prediction sample of the subblock using the first direction prediction sample, the second direction prediction sample and the BIO offset; and

encoding the bitstream based on the final prediction sample,

wherein whether to perform the subblock based BIO prediction in units of subblock determines based on a result of comparing a threshold value and a difference between the first direction prediction sample and the second direction prediction sample,

wherein the threshold value is set using on a size of the current block,

wherein the deriving a BIO offset comprising:

deriving a gradient using neighboring samples;

deriving a motion refining vector; and

deriving the BIO offset based on the gradient and the motion refining vector,

wherein the gradient is, when a position of the neighboring sample is a subpixel position, derived by rounding to an integer pixel position close to the subpixel position.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 8, 2022
From: ELECTRONICS AND TELECOMMUNICATIONS RESEARCH INSTITUTE
To: INTELLECTUAL DISCOVERY CO., LTD.
Reel/Frame 062023/0959 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 25, 2020
From: LEE, HA HYUN; KANG, JUNG WON; KO, HYUN SUK; LIM, SUNG CHANG; LEE, JIN HO; JUN, DONG SAN; KIM, HUI YONG
To: ELECTRONICS AND TELECOMMUNICATIONS RESEARCH INSTITUTE
Reel/Frame 052223/0883 →
Priority Claims (3)
KR 10-2017-0128129 · Sep 29, 2017 · national
KR 10-2018-0072370 · Jun 22, 2018 · national
KR 10-2018-0113942 · Sep 21, 2018 · national
Continuity (1)
Related Publication 20200236362A1 · Jul 23, 2020
References Cited (24)
US 9661345B2 · Lee et al. · 2017 [cited by applicant]
US 10397599B2 · Lim et al. · 2019 [cited by applicant]
US 20100246680A1 · Tian et al. · 2010 [cited by applicant]
US 20110038414A1 · Song · 2011 [cited by examiner]
US 20130028530A1 · Drugeon · 2013 [cited by examiner]
US 20150350671A1 · Alshin · 2015 [cited by examiner]
US 20170094305A1 · Li et al. · 2017 [cited by applicant]
US 20180192072A1 · Chen · 2018 [cited by examiner]
US 20180241998A1 · Chen · 2018 [cited by examiner]
US 20180249172A1 · Chen · 2018 [cited by examiner]
US 20190045218A1 · Ikai · 2019 [cited by examiner]
US 20200154127A1 · Lee · 2020 [cited by examiner]
US 20200221122A1 · Ye · 2020 [cited by examiner]
US 20200267408A1 · Lee · 2020 [cited by examiner]
US 20210105490A1 · Lim · 2021 [cited by examiner]
KR 100431075B1 · 2004 [cited by applicant]
KR 100991568B1 · 2010 [cited by applicant]
KR 1020140089486A · 2014 [cited by applicant]
KR 1020150090454A · 2015 [cited by applicant]
WO WO2017036399A1 · 2017 [cited by applicant]
WO WO2017082698A1 · 2017 [cited by applicant]
WO WO2017134957A1 · 2017 [cited by applicant]
International Search Report issued on Jan. 10, 2019 in counterpart International Patent Application No. PCT/KR2018/011487 (2 pages in English and 2 pages in Korean). [cited by applicant]
Chen, Jianle et al. “Algorithm Description of Joint Exploration Test Model 7 (JEM 7)”. JVET-G1001-v1. Joint Video Exploration Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11. 7th Meeting: Torino, IT, Jul. … [cited by applicant]