IP Library Granted Patent US 12,513,327
Granted Patent B2
US 12,513,327 · App. 18/894,788 · Granted Dec 30, 2025

Prediction image correcting device, image encoding device, image decoding device, and program

Inventors: Shunsuke Iwamura (Tokyo, JP); Atsuro Ichigaya (Tokyo, JP); Shimpei Nemoto (Tokyo, JP)
Assignee: NIPPON HOSO KYOKAI
H04N19/521H04N19/105H04N19/139H04N19/159H04N19/176
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,513,327
App. No.
18/894,788
Granted
Dec 30, 2025
Kind
B2
Abstract

A prediction image correcting device comprises a predictor ( 108 ) configured to predict a target image block obtained by dividing a present image frame by using a plurality of reference images to generate a prediction image corresponding to the target image block a prediction accuracy evaluator ( 109 ) configured to evaluate prediction accuracy of the prediction image based on a degree of similarity between the plurality of reference images used for generating the prediction image and a corrector ( 110 ) configured to perform correction processing on the prediction image by using a decoded neighboring block adjacent to the target image block, wherein the corrector is configured to control the correction processing based at least on an evaluation result of the prediction accuracy evaluator.

Claims (19)

1 . A prediction image correcting device comprising:

a predictor configured to predict a block of a target image obtained by dividing an image frame by using a plurality of blocks of reference images to generate a block of a prediction image corresponding to the block of the target image;

a calculator configured to calculate, for each image portion that is a part of the block and includes a plurality of pixels, sum of absolute differences between the plurality of blocks of reference images used for generating the block of the prediction image, wherein the calculator is configured to calculate the sum of absolute differences only when the predictor performs a bi-directional prediction; and

a corrector configured to perform, in the block of the prediction image, a correction processing only on the image portion that the sum of absolute differences exceeds a predetermined threshold, wherein the correction processing is a process of correcting the image portion of the prediction image.

2 . An image encoding device comprising the prediction image correcting device according to claim 1 .

3 . An image decoding device comprising the prediction image correcting device according to claim 1 .

4 . A non-transitory computer-readable storage medium storing a program including instructions that, when executed by a processor, cause the processor to function as the prediction image correcting device according to claim 1 .

5 . A prediction image correcting device according to claim 1 , further comprising: a combiner configured to output a reconstructed image by adding a prediction residual to the block of the prediction image after the correction processing.

6 . The prediction image correcting device according to claim 1 , wherein

the calculator is configured to calculate, for each of a plurality of image portions each of which is a part of the block and includes a plurality of pixels, the sum of absolute differences between the plurality of blocks of reference images used for generating the block of the prediction image; and

the corrector is configured to perform, among the plurality of image portions of the block of the prediction image, the correction processing only on the image portion that the sum of absolute differences exceeds the predetermined threshold.

7 . A prediction image correcting method comprising:

a step of generating a block of a prediction image corresponding to a block of a target image by predicting the block of the target image obtained by dividing an image frame by using a plurality of blocks of reference images;

a step of calculating, for each image portion that is a part of the block and includes a plurality of pixels, sum of absolute differences between the plurality of blocks of reference images used for generating the block of the prediction image, wherein the step of calculating calculates the sum of absolute differences only when the step of generating performs a bi-directional prediction; and

a step of performing, in the block of the prediction image, a correction processing only on the image portion that the sum of absolute differences exceeds a predetermined threshold, wherein the correction processing is a process of correcting the image portion of the prediction image.

8 . A prediction image correcting method according to claim 7 , further comprising: outputting a reconstructed image by adding a prediction residual to the block of the prediction image after the correction processing.

9 . The prediction image correcting method according to claim 7 , wherein

the step of calculating calculates, for each of a plurality of image portions each of which is a part of the block and includes a plurality of pixels, the sum of absolute differences between the plurality of blocks of reference images used for generating the block of the prediction image; and

the step of performing the correction processing performs, among the plurality of image portions of the block of the prediction image, the correction processing only on the image portion that the sum of absolute differences exceeds the predetermined threshold.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 24, 2024
From: IWAMURA, SHUNSUKE; ICHIGAYA, ATSURO; NEMOTO, SHIMPEI
To: NIPPON HOSO KYOKAI
Reel/Frame 068681/0287 →
Priority Claims (1)
JP 2018-072451 · Apr 4, 2018 · national
Continuity (5)
Continuation 18500756 · Nov 2, 2023
Continuation 18172974 · Feb 22, 2023
Continuation 17062306 · Oct 2, 2020
Continuation PCTJP2019014364 · Mar 29, 2019
Related Publication 20250016362A1 · Jan 9, 2025
References Cited (32)
US 10298961B2 · Rosewarne et al. · 2019 [cited by applicant]
US 10681346B2 · Iwamura et al. · 2020 [cited by applicant]
US 11076149B2 · Ichigaya et al. · 2021 [cited by applicant]
US 20050094003A1 · Thorell · 2005 [cited by applicant]
US 20110122953A1 · Nakagami et al. · 2011 [cited by applicant]
US 20120263237A1 · Koyama et al. · 2012 [cited by applicant]
US 20130051467A1 · Zhou et al. · 2013 [cited by applicant]
US 20150103904A1 · Rapaka et al. · 2015 [cited by applicant]
US 20170127090A1 · Rosewarne · 2017 [cited by examiner]
US 20180176560A1 · Mishurovskiy · 2018 [cited by examiner]
US 20180359470A1 · Lee et al. · 2018 [cited by applicant]
US 20190132606A1 · Su · 2019 [cited by examiner]
US 20200260073A1 · Iwamura et al. · 2020 [cited by applicant]
US 20200314432A1 · Wang et al. · 2020 [cited by applicant]
US 20210021862A1 · Iwamura et al. · 2021 [cited by applicant]
US 20210321128A1 · Ichigaya et al. · 2021 [cited by applicant]
US 20220224936A1 · Iwamura et al. · 2022 [cited by applicant]
CN 106464866A · 2017 [cited by applicant]
EP 2306733A1 · 2011 [cited by applicant]
JP 2000059785A · 2000 [cited by applicant]
JP 6895586B2 · 2021 [cited by applicant]
JP 6910575B2 · 2021 [cited by applicant]
WO 2005022919A1 · 2005 [cited by applicant]
WO 2008048489A2 · 2008 [cited by applicant]
WO 2010010942A1 · 2010 [cited by applicant]
WO 2011080807A1 · 2011 [cited by applicant]
WO 2016160605A1 · 2016 [cited by applicant]
WO 2017030198A1 · 2017 [cited by applicant]
Shunsuke Iwamura et al., “Description of SDR and HDR video coding technology proposal by NHK and SHARP”, Joint Video Exploration Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, JVET-J0027_vl, 10th Meeting… [cited by applicant]
International Search Report issued in PCT/JP2019/014364; mailed Jun. 18, 2019. [cited by applicant]
Office Action issued in JP 2020-512227; mailed by the Japanese Patent Office on May 11, 2021. [cited by applicant]
Office Action issued in JP 2020-512227; mailed by the Japanese Patent Office on Mar. 30, 2021. [cited by applicant]