IP Library Granted Patent US 12,439,079
Granted Patent B2
US 12,439,079 · App. 18/646,616 · Granted Oct 7, 2025

Image decoding device, image decoding method, and program

Inventors: Kyohei Unno (Fujimino, JP); Kei Kawamura (Fujimino, JP); Sei Naito (Fujimino, JP)
Assignee: KDDI CORPORATION
H04N19/577H04N19/137H04N19/176H04N19/64H04N19/513
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,439,079
App. No.
18/646,616
Granted
Oct 7, 2025
Kind
B2
Abstract

An image decoding device includes: a prediction signal generation unit configured to determine whether or not an application condition of Bi-Directional Optical Flow (BDOF) processing is satisfied for each block, generate a prediction signal by executing the BDOF processing in a case where it is determined that the application condition is satisfied, and set the application condition based on a weight coefficient in a case where calculation is performed using pixel values of two reference frames or values calculated from the pixel values in the BDOF processing such that the application condition includes a condition on time distances between the two reference frames and a target frame.

Claims (21)

1. An image decoding device comprising:

a memory storing instructions; and

one or more processors configured to:

determine whether or not an application condition of BDOF (Bi-Directional Optical Flow) processing is satisfied for each block based on:

a first time distance between a target frame and a first reference frame of two reference frames being equal to a second time distance between the target frame and a second reference frame of the two reference frames, and

a first weight coefficient of the first reference frame and a second weight coefficient of the second reference frame;

divide each block into sub-blocks; and

if it is determined that the application condition of BDOF processing is satisfied, perform the BDOF processing to generate a prediction signal for each of the sub-blocks.

2. An image decoding method comprising:

storing instructions in a memory;

determining whether or not an application condition of BDOF processing is satisfied for each block based on:

a first time distance between a target frame and a first reference frame of two reference frames being equal to a second time distance between the target frame and a second reference frame of the two reference frames, and

a first weight coefficient of the first reference frame and a second weight coefficient of the second reference frame;

dividing each block into sub-blocks; and

if it is determined that the application condition of BDOF processing is satisfied, performing the BDOF processing to generate a prediction signal for each of the sub-blocks.

3. A non-transitory computer readable medium with instructions thereon that when executed by one or more processors of an image decoding device, cause the processor program causing a computer to function as an image decoding device, the image decoding device being configured to:

determining whether or not an application condition of BDOF processing is satisfied for each block based on:

a first time distance between a target frame and a first reference frame of two reference frames being equal to a second time distance between the target frame and a second reference frame of the two reference frames, and

a first weight coefficient of the first reference frame and a second weight coefficient of the second reference frame;

dividing each block into sub-blocks; and

if it is determined that the application condition of BDOF processing is satisfied, performing the BDOF processing to generate a prediction signal for each of the sub-blocks.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 26, 2024
From: UNNO, KYOHEI; KAWAMURA, KEI; NAITO, SEI
To: KDDI CORPORATION
Reel/Frame 067235/0465 →
Priority Claims (1)
JP 2019-172133 · Sep 20, 2019 · national
Continuity (3)
Continuation 17674347 · Feb 17, 2022
Continuation PCTJP2020031563 · Aug 21, 2020
Related Publication 20240283972A1 · Aug 22, 2024
References Cited (45)
US 11153599B2 · Su · 2021 [cited by examiner]
US 20170094305A1 · Li · 2017 [cited by examiner]
US 20190141333A1 · Lee · 2019 [cited by applicant]
US 20190246143A1 · Zhang · 2019 [cited by examiner]
US 20190320197A1 · Chen · 2019 [cited by examiner]
US 20210092404A1 · Huang · 2021 [cited by examiner]
US 20210136401A1 · Liu · 2021 [cited by examiner]
US 20210144400A1 · Liu · 2021 [cited by examiner]
US 20210152846A1 · Zhang · 2021 [cited by examiner]
US 20210227209A1 · Liu · 2021 [cited by examiner]
US 20210227250A1 · Liu · 2021 [cited by examiner]
US 20210235073A1 · Liu · 2021 [cited by examiner]
US 20210235083A1 · Liu · 2021 [cited by examiner]
US 20210235110A1 · Liu · 2021 [cited by examiner]
US 20210266585A1 · Liu · 2021 [cited by examiner]
US 20210266587A1 · Liu · 2021 [cited by examiner]
US 20210266588A1 · Liu · 2021 [cited by examiner]
US 20210297673A1 · Zhang · 2021 [cited by examiner]
US 20210329257A1 · Sethuraman · 2021 [cited by examiner]
US 20210344909A1 · Liu · 2021 [cited by examiner]
US 20210360279A1 · Liu · 2021 [cited by examiner]
US 20210385481A1 · Liu · 2021 [cited by examiner]
US 20210385482A1 · Liu · 2021 [cited by examiner]
US 20220174314A1 · Unno · 2022 [cited by examiner]
US 20230121088A1 · Jeong · 2023 [cited by examiner]
Xiu et al., “CE4-related: Harmonization of BDOF and PROF,” Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, 15th Meeting: Gothenburg, Sweden, Jul. 3-12, 2019, Document: JVET-O0593-r2 (Y… [cited by examiner]
Li et al., “CE4-related: Alignment of BDOF refinement process with PROF,” Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, 15th Meeting: Gothenburg, Sweden, Jul. 3-12, 2019, Document: J… [cited by examiner]
Chen et al., “Non-CE9: Modified enabling condition for DMVR and BDOF,” Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, 14th Meeting: Geneva, Switzerland, Mar. 19-27, 2019, Document: JV… [cited by examiner]
Chen, Fangdong et al., Non-CE9: Modified enabling condition for DMVR and BDOF, Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11 14th Meeting: Geneva, CH, 19-27, Mar. 19, 2019, pp. 1-4 in… [cited by applicant]
Xiu, Xiaoyu et al., CE4-related: Harmonization of BDOF and PROF, Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11 15th Meeting: Gothenburg, SE, 3-12, Jul. 7, 2019, (version 4), pp. 1-6 i… [cited by applicant]
Unno, Kyohei et al., Non-CE4: An applying condition of BDOF, Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11 16th Meeting: Geneva, CH, 1-11, Oct. 5, 2019, (version 3), pp. 1-3 in partic… [cited by applicant]
Chen, Wei et al., Non-CE4: Unification of DMVR and BDOF enabling conditions, Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11 16th Meeting: Geneva, CH, 1-11, Oct. 9, 2019, (version 2), p… [cited by applicant]
Chen, Chun-Chi et al., CE4-related: Harmonized CU-level Condition Check in BDOF and DMVR, Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11 16th Meeting: Geneva, CH, Oct. 1-11, 2019, (ver… [cited by applicant]
Li, Jingya et al., CE4-related: Alignment of BDOF refinement process with PROF, Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11 15th Meeting: Gothenburg, SE, Jul. 3-12, 2019, Jun. 29, 2… [cited by applicant]
Xiu, Xiaoyu et al., CE4: Harmonization of BDOF and PROF (test 4-2. 1 and 4-2.2), Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11 16th Meeting: Geneva, CH, Oct. 1-11, 2019, (version 1), … [cited by applicant]
Xiu, Xiaoyu et al., CE4/9-related: Combined Test of JVET-O0593/JVET-O0252/ JVET-O0281/JVET-O0615 on harmonization on BDOF and PROF, Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11 15th … [cited by applicant]
Liu, Hongbin et al., Non-CE9: Unified gradient calculations in BDOF, Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11 15th Meeting: Gothenburg, SE, Jul. 3-12, 2019, (version 4), Jul. 9, … [cited by applicant]
Lai, Chen-Yen et al., CE4-related: Alignment of displacement bitdepths for BDOF and PROF, Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11 15th Meeting: Gothenburg, SE, Jul. 3-12, 2019, … [cited by applicant]
Huang, Han, CE4-related: Alignment and simplification of PROF and BDOF, Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/ WG 11 15th Meeting: Gothenburg, SE (version 2), Jul. 3, 2019, pp. 1-7 … [cited by applicant]
International Search Report issued in corresponding International Patent Application No. PCT/JP2020/031563 dated Nov. 17, 2020. [cited by applicant]
Bross, Benjamin, Versatile Video Coding (Draft 6), JVET-N1001, Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29 WG 11, 15 Meeting: Gothenburg, SE, Jul. 3-12, 2019. [cited by applicant]
Extended European Search Report dated Feb. 22, 2023, from correspondonding EP Application No. 20865177.8. [cited by applicant]
Chujoh T et al: “Non-CE9: On conditions for DMVR and BDOF”, 14. JVET Meeting; Mar. 19, 2019-Mar. 27, 2019; Geneva; (The Joint Video Exploration Team of ISO/IEC JTC1/SC29/WG11 and ITU-T SG. 16), No. JVET-N0146 Mar. 26, 2… [cited by applicant]
Bross Benjamin et al: “Versatile Video Coding (Draft 6)”, 15. JVET Meeting; Jul. 3, 2019-Jul. 12, 2019; Gothenburg; (The Joint Video Exploration Team of ISO/IEC JTC1/SC29/WG11 and ITU-T SG.16 ), No. JVET-02001 Jul. 15, … [cited by applicant]
Li et al., “CE4-related: Alignment of BDOF refinement process with PROF,” Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, 15th Meeting: Gothenburg, Sweden, Jul. 3-12, 2019, Document: J… [cited by applicant]