IP Library › Granted Patent US 12,634,443
Granted Patent B2
US 12,634,443 · App. 18/903,761 · Granted May 19, 2026

Image decoding device, image decoding method, and program

Inventors: Kyohei Unno (Fujimino, JP); Kei Kawamura (Fujimino, JP); Sei Naito (Fujimino, JP)
Assignee: KDDI CORPORATION
H04N19/105H04N19/139H04N19/176H04N19/521
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,634,443
App. No.
18/903,761
Granted
May 19, 2026
Kind
B2
Abstract

An image decoding device includes: a motion vector decoding unit that decodes a motion vector from encoded data; a refinement unit that performs refinement processing to correct the decoded motion vector; and a predictive signal generation unit that generates a predictive signal on the basis of the corrected motion vector outputted from the refinement unit. The predictive signal generation unit determines whether or not to apply BDOF processing for each block, on the basis of information calculated in the course of the refinement processing.

Claims (36)

1 . An image decoding device, comprising:

a motion vector decoding unit that decodes a motion vector from encoded data;

a refinement unit that performs refinement processing to correct the decoded motion vector, wherein the refinement processing comprises:

performing a search with integer pixel precision using a search image generated from information of the motion vector;

determining a corrected motion vector at integer pixel interval positions through the search; and

performing a motion vector search using non-integer pixel precision, and

a predictive signal generation unit that generates a predictive signal on the basis of the corrected motion vector outputted from the refinement unit, wherein

the predictive signal generation unit determines whether or not to perform BDOF processing for each sub-block to which the refinement processing is to be performed, on the basis of information calculated in the course of the refinement processing,

the sub-block is generated by splitting a block,

the predictive signal generation unit determines, for each of the sub-blocks, that the BDOF processing is not to be performed when a minimum search cost of the refinement processing is less than or equal to a predefined threshold value,

the predictive signal generation unit provides a decoded image, and

each of the horizontal size of the sub-block and the vertical size of the sub-block is less than or equal to 16 pixels.

2 . An image decoding method, comprising the steps of:

(A) decoding a motion vector from encoded data;

(B) performing refinement processing to correct the decoded motion vector, wherein the refinement processing comprises:

performing a search with integer pixel precision using a search image generated from information of the motion vector;

determining a corrected motion vector at integer pixel interval positions through the search; and

performing a motion vector search using non-integer pixel precision, and

(C) generating a predictive signal on the basis of the corrected motion vector outputted from the refinement unit, wherein

it is determined in the step (C), for each sub-block to which the refinement processing is to be performed, whether or not to perform BDOF processing, on the basis of information calculated in the course of the refinement processing,

the sub-block is generated by splitting a block,

it is determined in the step (C), for each sub-block, that the BDOF processing is not to be performed when a minimum search cost of the refinement processing is less than or equal to a predefined threshold value,

the predictive signal is a decoded image, and

each of the horizontal size of the sub-block and the vertical size of the sub-block is less than or equal to 16 pixels.

3 . A non-transitory computer readable medium having stored thereon instructions comprising executable code, which when executed by at least one processor, cause a computer to execute the steps of:

(A) decoding a motion vector from encoded data;

(B) performing refinement processing to correct the decoded motion vector, wherein the refinement processing comprises:

performing a search with integer pixel precision using a search image generated from information of the motion vector;

determining a corrected motion vector at integer pixel interval positions through the search; and

performing a motion vector search using non-integer pixel precision, and

(C) generating a predictive signal on the basis of the corrected motion vector outputted from the refinement unit, wherein

it is determined in step (C), for each sub-block to which the refinement processing is to be performed, whether or not to perform BDOF processing, on the basis of information calculated in the course of the refinement processing,

the sub-block is generated by splitting a block,

it is determined in the step (C), for each sub-block, that the BDOF processing is not to be performed when a minimum search cost of the refinement processing is less than or equal to a predefined threshold value,

the predictive signal is a decoded image, and

each of the horizontal size of the sub-block and the vertical size of the sub-block is less than or equal to 16 pixels.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Oct 1, 2024
From: UNNO, KYOHEI; KAWAMURA, KEI; NAITO, SEI
To: KDDI CORPORATION
Reel/Frame 068758/0502 →
Priority Claims (1)
JP 2019-043966 · Mar 11, 2019 · national
Continuity (3)
Continuation 18180041 · Mar 7, 2023
Continuation 17437991
Related Publication 20250024026A1 · Jan 16, 2025
References Cited (32)
US 9681150B2 · Garud · 2017 [cited by examiner]
US 10798385B2 · Lee · 2020 [cited by examiner]
US 10931969B2 · Chen et al. · 2021 [cited by applicant]
US 10977809B2 · Choudhury et al. · 2021 [cited by applicant]
US 11172216B1 · Zhang et al. · 2021 [cited by applicant]
US 11178422B2 · Liu et al. · 2021 [cited by applicant]
US 11297344B2 · Lim et al. · 2022 [cited by applicant]
US 11490096B2 · Sethuraman et al. · 2022 [cited by applicant]
US 11627311B2 · Unno · 2023 [cited by examiner]
US 11889099B2 · Chen · 2024 [cited by examiner]
US 12137210B2 · Unno · 2024 [cited by examiner]
US 20160345011A1 · Naing et al. · 2016 [cited by applicant]
US 20180192072A1 · Chen et al. · 2018 [cited by applicant]
US 20200221122A1 · Ye et al. · 2020 [cited by applicant]
US 20210029378A1 · He et al. · 2021 [cited by applicant]
US 20210266595A1 · Su et al. · 2021 [cited by applicant]
US 20210329257A1 · Sethuraman et al. · 2021 [cited by applicant]
WO 2020184487A1 · 2020 [cited by applicant]
Bi-Directional Optical flow for Improving Motion Compensation; Alshin—2010. (Year: 2010). [cited by examiner]
Bi-directional Optical Flow for Inter-layer Texture Prediction; Alshin et al.—2013. (Year: 2013). [cited by examiner]
Complexity reduction and bit-width control for bi-directional optical flow; Oct. 2018. (Year: 2018). [cited by examiner]
Co-existing analysis for DMVR with BDOF; Jan. 2019. (Year: 2019). [cited by examiner]
International Search Report issued in corresponding International Patent Application No. PCT/JP2020/009245 dated May 26, 2020. [cited by applicant]
Sethuraman, S., et al. “Non-CE9: Co-existence analysis for DMVR with BDOF” Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO.IEC JTC 1/SC 29/WG 11, JVET-M0223-v4, 6 pages (Jan. 2019) cited in ISR submitted her… [cited by applicant]
Xiu, X., et al., “CE-9-related: Complexity reduction and bit-width control for bi-directional optical flow (BIO)” Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO.IEC JTC 1/SC 29/WG 11, JVET-L0256-v2, 16 page… [cited by applicant]
Kondo, K., et al., “Non-CE9: On early termination for BDOF” Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO.IEC JTC 1/SC 29/WG 11, JVET-M0073-r2, 6 pages (Jan. 2019) cited in ISR submitted herewith. [cited by applicant]
Chujoh, T., et al., “CE9-related: Early termination for BDOF” Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO.IEC JTC 1/SC 29/WG 11, JVET-N0148-v3, 7 pages (Mar. 2019) cited in ISR submitted herewith. [cited by applicant]
Unno, K., et al., “CE9-related: Alternative method of SAD based early termination for BDOF” Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO.IEC JTC 1/SC 29/WG 11, JVET-N0158-v2, 5 pages (Mar. 2019) cited in … [cited by applicant]
Bross, B., et al., “Versatile Video Coding (Draft 4)” Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO.IEC JTC 1/SC 29/WG 11, JVET-M1001-v6, 299 pages (Jan. 2019): Chapter 8.4.5.3 Decoding process for palette… [cited by applicant]
Chen, H., et al., “CE9-related: BDOF buffer reduction and enabling VPDU based application” Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO.IEC JTC 1/SC 29/WG 11, JVET-M0890-v2, 3 pages (Jan. 2019) cited in S… [cited by applicant]
Extended European Search Report dated Dec. 8, 2022, from corresponding EP Application No. 20768908.4. [cited by applicant]
Luo Al: “CE2-related: Simplified symmetric MVD based on CE4.4.3”, 13th JVET Meeting Marrakech; Jan. 9-18, 2019; (The Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC1/SC29/WG11), No. JVET-M0444. [cited by applicant]