IP Library Granted Patent US 12,192,448
Granted Patent B2
US 12,192,448 · App. 18/489,457 · Granted Jan 7, 2025

Image encoding device, image decoding device, and program thereof

Inventors: Shunsuke Iwamura (Tokyo, JP); Atsuro Ichigaya (Tokyo, JP); Shinichi Sakaida (Tokyo, JP)
Assignee: NIPPON HOSO KYOKAI
H04N19/105H04N19/117H04N19/12H04N19/124H04N19/147H04N19/176H04N19/45H04N19/46H04N19/593H04N19/619H04N19/625
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,192,448
App. No.
18/489,457
Granted
Jan 7, 2025
Kind
B2
Abstract

An image encoding device for block-dividing and encoding an original image of a frame unit constituting a moving image is disclosed that includes a predictor circuitry configured to generate a predicted image, a weighted average processor configured to generate a block of a new predicted image, a prediction residual signal generator circuitry configured to calculate an error of each prediction signal of the block of the predicted image and to generate a prediction residual signal, a sub-block divider circuitry configured to divide the prediction residual signal configured to divide the predict residual signal, and a transformation selection applier circuitry configured to selectively apply a plurality of types of transformation processes for a divided sub-block of the prediction residual signal.

Claims (14)

1. An image decoding device for decoding a signal encoded by block-dividing a frame constituting a moving image, the image decoding device comprising:

a predicter circuitry configured to generate an inter predicted block corresponding to a decoding target block by an inter prediction that performs signal prediction for each pixel signal of the decoding target block;

a weighted average filter processor configured to perform a weighted average filter process to the inter predicted block before performing a block configuring process that generates a decoded block, wherein the weighted average filter processor is configured to modify the inter predicted block by using weighting factors and decoded neighboring pixels neighboring to the inter predicted block;

an inverse orthogonal transformer comprising:

an inverse transformation selection applier circuitry configured to selectively apply a plurality of types of inverse transformation processes according to a sub-block division to transformation coefficients of a prediction residual block that has been sub-block-divided by an image encoding side, and to generate a sub-block of the prediction residual block; and

a block reconfigurer circuitry configured to generate the prediction residual block corresponding to the decoding target block based on the sub-block of the prediction residual block, wherein the sub-block of the prediction residual block is a part of the prediction residual block corresponding to the decoding target block; and

the image decoding device further comprises a decoded image generator configured to generate and output the decoded block by receiving, as inputs: the inter predicted block and an output of the block reconfigurer circuitry.

2. An image decoding method for decoding a signal encoded by block-dividing a frame constituting a moving image, the image decoding method comprising:

generating an inter predicted block corresponding to a decoding target block by an inter prediction that performs signal prediction for each pixel signal of the decoding target block;

performing a weighted average filter process to the inter predicted block before performing a block configuring process that generates a decoded block,

wherein the weighted average filter process is configured to modify the inter predicted block by using weighting factors and decoded neighboring pixels neighboring to the inter predicted block;

selectively applying, by an inverse orthogonal transformer, a plurality of types of inverse transformation processes according to a sub-block division to transformation coefficients of a prediction residual block that has been sub-block-divided by an image encoding side, and generating a sub-block of the prediction residual block;

generating, by the inverse orthogonal transformer, the prediction residual block corresponding to the decoding target block based on the sub-block of the prediction residual block, wherein the sub-block of the prediction residual block is a part of the prediction residual block corresponding to the decoding target block; and

generating the decoded block by using, as inputs: the inter predicted block and the prediction residual block.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Oct 18, 2023
From: IWAMURA, SHUNSUKE; ICHIGAYA, ATSURO; SAKAIDA, SHINICHI
To: NIPPON HOSO KYOKAI
Reel/Frame 065270/0042 →
Priority Claims (3)
JP 2015-163257 · Aug 20, 2015 · national
JP 2015-163259 · Aug 20, 2015 · national
JP 2015-163260 · Aug 20, 2015 · national
Continuity (4)
Continuation 16860421 · Apr 28, 2020
Continuation 15899130 · Feb 19, 2018
Continuation PCTJP2016074293 · Aug 19, 2016
Related Publication 20240048690A1 · Feb 8, 2024
References Cited (36)
US 5237410A · Inoue · 1993 [cited by examiner]
US 8681872B2 · Sasai et al. · 2014 [cited by applicant]
US 9277245B2 · Sole et al. · 2016 [cited by applicant]
US 20040005004A1 · Demos · 2004 [cited by applicant]
US 20040008782A1 · Boyce · 2004 [cited by examiner]
US 20080013839A1 · Kimura · 2008 [cited by examiner]
US 20080089417A1 · Bao et al. · 2008 [cited by applicant]
US 20110069752A1 · Watanabe · 2011 [cited by examiner]
US 20120128068A1 · Thoreau · 2012 [cited by examiner]
US 20130077884A1 · Ikai · 2013 [cited by examiner]
US 20130094581A1 · Tanizawa · 2013 [cited by examiner]
US 20130336393A1 · Matsumura · 2013 [cited by examiner]
US 20180176557A1 · Ichigaya · 2018 [cited by examiner]
US 20190124327A1 · Kawai · 2019 [cited by examiner]
US 20210409764A1 · Iwamura · 2021 [cited by examiner]
US 20220116665A1 · Iwamura · 2022 [cited by examiner]
EP 1404136A1 · 2004 [cited by applicant]
JP 2011066569A · 2011 [cited by applicant]
JP 2011205602A · 2011 [cited by applicant]
JP 2013522957A · 2013 [cited by applicant]
JP 2014036278A · 2014 [cited by applicant]
WO 2008048489A2 · 2008 [cited by applicant]
WO 2011112239A1 · 2011 [cited by applicant]
Ichigaya (NHK) et al., “Video coding technology proposal by NHK and Mitsubishi” 1. JCT-VC Meeting; Apr. 15-23, 2010; Dresden; (Joint Collaborative Team on Video Coding of ISO/IEC JTC/SC29/WG11 and ITU-TSG.16); obtained … [cited by applicant]
An, J. et al., “Non-CE7: Boundary-Dependent Transform for Inter-Predicted Residue”, Joint Collaborative Team on Video Coding (JCT-VC) of ITU-T SG16 WP3 and ISO/IEC JTC1/SC29/WG11, 7th Meeting: Geneva, CH, Nov. 21-30, 20… [cited by applicant]
Ichigaya, A. et al., “Inter Coding With Orthogonal Transforms Derived from DCT”, NHK Science and Technology Research Laboratories, ITE Annual Convention, 2012, 2 pages (included English language abstract). [cited by applicant]
Zheng, W. et al., “Analysis of Space-Dependent Characteristics of Motion-Compensated Frame Differences Based on a Statistical Motion Distribution Model”, D-II, vol. J84, No. 9, 2001, pp. 2001-2010. [cited by applicant]
Zheng, W. et al., “Analysis of Space-Dependent Characteristics of Motion-Compensated Frame Differences Based on a Statistical Motion Distribution Model”, IEEE Transactions on Image Processing, vol. 11, No. 4, Apr. 2002,… [cited by applicant]
International Search Report, and English language translation thereof, in corresponding International Application No. PCT/JP2016/074293, dated Nov. 8, 2016, 5 pages. [cited by applicant]
Rose et al., “DCT/DST Alternate-Transform Image Coding”, IEEE Transactions on Communications, dated Jan. 1, 1990, pp. 94-101, XP055297931, DOI: 10.1109/26.46533, obtained from the Internet at URL: <http://ieeexplore.iee… [cited by applicant]
Shun-Ichi Sekiguchi et al., “A Novel Video Coding Scheme for Super Hi-Vision”, Picture Coding Symposium 2010; Dec. 8-12, 2010, Nagoya, dated Dec. 8, 2010, XP030081994, 4 pages. [cited by applicant]
Extended European Search Report in Europe Application No. 16837189.6, dated Feb. 18, 2019, 12 pages. [cited by applicant]
Office Action in China Application No. 201680053613.9, including English translation, dated Nov. 20, 2019, 8 pages. [cited by applicant]
Rajan Joshi et al., High Efficiency Video Coding (HEVC) Screen Content Coding Draft 1, Joint Collaborative Team on Video Coding (JCT-VC) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, 18th Meeting: Sapporo, JP, Jun.… [cited by applicant]
Francois Pasteau et al., Adaptive Color Decorrelation for Predictive Image Codecs, European Signal Processing Conference, EUSIPCO, Aug. 2011, Barcelona, Spain, pp. 1-5, dated Sep. 2, 2011, 6 pages. [cited by applicant]
First Office Action in India Application No. 201827006152, dated Feb. 27, 2020, 6 pages. [cited by applicant]