IP Library Granted Patent US 12,519,952
Granted Patent B2
US 12,519,952 · App. 18/734,115 · Granted Jan 6, 2026

Encoder, decoder, encoding method, and decoding method

Inventors: Kiyofumi Abe (Osaka, JP); Takahiro Nishi (Nara, JP); Tadamasa Toma (Osaka, JP); Ryuichi Kanoh (Osaka, JP)
Assignee: PANASONIC INTELLECTUAL PROPERTY CORPORATION OF AMERICA
H04N19/159H04N19/105H04N19/176H04N19/186H04N19/583
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,519,952
App. No.
18/734,115
Granted
Jan 6, 2026
Kind
B2
Abstract

An encoder includes memory, and circuitry accessible to the memory. The circuitry accessible to the memory: determines whether OBMC is applicable to generation of a prediction image of a current block, according to whether BIO is to be applied to the generation of the prediction image of the current block; when BIO is to be applied to the generation of the prediction image of the current block, determines that OBMC is not applicable to the generation of the prediction image of the current block, and applies BIO to the generation of the prediction image of the current block without applying OBMC.

Claims (30)

1 . A decoding method comprising:

for a current block,

deriving motion vectors of the current block;

determining whether a first process is to be applied and whether a second process is to be applied so that at least one of the first process and the second process is determined not to be applied, the first process being a bi-directional optical flow process in which a spatial gradient of luminance is referred to;

in a first condition in which the first process is determined to be applied and the second process is determined not to be applied,

generating prediction images of the current block based on reference pictures and the motion vectors, and

generating a final prediction image based on the prediction images and the spatial gradient of luminance; and

in a second condition in which the first process is determined not to be applied and the second process is determined to be applied,

generating prediction images of the current block based on reference pictures and the motion vectors, and

generating a final prediction image by weighting the prediction images.

2 . An encoding method comprising:

for a current block,

deriving motion vectors of the current block;

determining whether a first process is to be applied and whether a second process is to be applied so that at least one of the first process and the second process is determined not to be applied, the first process being a bi-directional optical flow process in which a spatial gradient of luminance is referred to;

in a first condition in which the first process is determined to be applied and the second process is determined not to be applied,

generating prediction images of the current block based on reference pictures and the motion vectors, and

generating a final prediction image based on the prediction images and the spatial gradient of luminance; and

in a second condition in which the first process is determined not to be applied and the second process is determined to be applied,

generating prediction images of the current block based on reference pictures and the motion vectors, and

generating a final prediction image by weighting the prediction images.

3 . A decoding method comprising:

in a decoding process on a first block in a picture,

selecting either of a first process or a second process, the first process being a bi-directional optical flow process;

generating a first prediction image of the first block, based on first images generated from respective reference images and a spatial gradient of luminance when the first process is selected; and

generating a second prediction image of the first block by weighting second images generated from respective reference images when the second process is selected.

4 . An encoding method comprising:

in an encoding process on a first block in a picture,

selecting either of a first process or a second process, the first process being a bi-directional optical flow process;

generating a first prediction image of the first block, based on first images generated from respective reference images and a spatial gradient of luminance when the first process is selected; and

generating a second prediction image of the first block by weighting second images generated from respective reference images when the second process is selected.

Continuity (7)
Continuation 18135997 · Apr 18, 2023
Continuation 17520137 · Nov 5, 2021
Continuation 17031087 · Sep 24, 2020
Continuation 16684012 · Nov 14, 2019
Continuation PCTJP2018018443 · May 14, 2018
Provisional Application 62508515 · May 19, 2017
Related Publication 20240323401A1 · Sep 26, 2024
References Cited (40)
US 9002124B2 · Abe · 2015 [cited by applicant]
US 10390041B2 · Sugio · 2019 [cited by applicant]
US 10469854B2 · Gokhale · 2019 [cited by applicant]
US 10652536B2 · Lim · 2020 [cited by applicant]
US 10728543B2 · Abe · 2020 [cited by applicant]
US 10735721B2 · Abe · 2020 [cited by applicant]
US 10819985B2 · Abe · 2020 [cited by applicant]
US 11006110B2 · Kanoh · 2021 [cited by applicant]
US 11076150B2 · Ohkawa · 2021 [cited by applicant]
US 11206410B2 · Abe · 2021 [cited by examiner]
US 11425411B2 · Li · 2022 [cited by applicant]
US 11425413B2 · Abe · 2022 [cited by applicant]
US 11665355B2 · Abe · 2023 [cited by examiner]
US 11758166B2 · Abe · 2023 [cited by applicant]
US 12047587B2 · Abe · 2024 [cited by examiner]
US 20070121731A1 · Tanizawa et al. · 2007 [cited by applicant]
US 20110293014A1 · Nakagami et al. · 2011 [cited by applicant]
US 20150139323A1 · Lee · 2015 [cited by applicant]
US 20180278950A1 · Chen · 2018 [cited by applicant]
US 20180376153A1 · Gokhale · 2018 [cited by applicant]
US 20190014342A1 · Li · 2019 [cited by applicant]
US 20190320167A1 · Abe · 2019 [cited by applicant]
US 20190342550A1 · Lim · 2019 [cited by applicant]
US 20200084470A1 · Abe · 2020 [cited by applicant]
US 20200092563A1 · Drugeon · 2020 [cited by applicant]
US 20200107018A1 · Abe · 2020 [cited by applicant]
US 20200204802A1 · Kanoh · 2020 [cited by applicant]
KR 1020080067363 · 2008 [cited by applicant]
KR 1020080087147 · 2008 [cited by applicant]
KR 1020160108602 · 2016 [cited by applicant]
WO 2007043821 · 2007 [cited by applicant]
WO 2007079964 · 2007 [cited by applicant]
WO 2012077795 · 2012 [cited by applicant]
International Search Report (ISR) issued on Aug. 14, 2018 in International (PCT) Application No. PCT/JP2018/018443. [cited by applicant]
H.265 (ISO/IEC 23008-2 HEVC (High Efficiency Video Coding)), Dec. 1, 2013. [cited by applicant]
Jianle Chen et al., “Algorithm Description of Joint Exploration Test Model 5 (JEM 5)”, Joint Video Exploration Team (JVET), JVET-E1001-v2 (version 2), Feb. 2017, pp. 17-18, 24-26. [cited by applicant]
Office Action and Search Report issued Nov. 2, 2021 in corresponding Taiwanese Patent Application No. 107116647, with English-language translation of the Search Report. [cited by applicant]
Jianle Chen et al., “Algorithm Description of Joint Exploration Test Model 5 (JEM 5)”, Joint Video Exploration Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, JVET-E1001-v2, Jan. 2017, pp. 15, 17, 24, 25. [cited by applicant]
Hsiao-Chiang Chuang et al., “A block-based design for Bi-directional optical flow (BIO)”, Joint Video Exploration Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, JVET-F0022, Mar. 2017, section 1. [cited by applicant]
Office Action issued Mar. 2, 2022 in corresponding Indian Patent Application No. 201947046314. [cited by applicant]