IP Library › Granted Patent US 12,192,453
Granted Patent B2
US 12,192,453 · App. 17/680,945 · Granted Jan 7, 2025

Encoding device, decoding device and program

Inventors: Shunsuke Iwamura (Tokyo, JP); Atsuro Ichigaya (Tokyo, JP); Shimpei Nemoto (Tokyo, JP)
Assignee: NIPPON HOSO KYOKAI
H04N19/117H04N19/176H04N19/46H04N19/82
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,192,453
App. No.
17/680,945
Granted
Jan 7, 2025
Kind
B2
Abstract

An encoding device that performs encoding on each of blocks obtained by dividing an image includes: a weighted bi-predictor 181 a configured to generate a prediction block of an encoding-target block by weighted-averaging a plurality of reference images using weighted coefficients selected from a weighted coefficient set including a plurality of weighted coefficients; and a filter controller 161 configured to control deblocking filter based on the weighted coefficients applied by the weighted bi-predictor 181 a to each of the two blocks adjacent blocks.

Claims (41)

1. An encoding device that performs encoding on each of blocks obtained by dividing an image, the encoding device comprising:

a predictor configured to generate a prediction block of an encoding-target block by weighted-averaging a plurality of reference images using weighted coefficients determined based on a flag controlling the weighted coefficients from a weighted coefficient set including a plurality of weighted coefficients;

a transformer/quantizer configured to perform a transform process and a quantization process on a prediction residual that represents a difference between the encoding-target block and the prediction block;

an inverse quantizer/inverse transformer configured to restore the prediction residual by performing an inverse quantization process and an inverse transform process on transform coefficients obtained by the transformer/quantizer;

a combiner configured to reconstruct the encoding-target block by combining the restored prediction residual and the prediction block;

a deblocking filter configured to perform a filter process on a boundary portion between two blocks including the reconstructed encoding-target block and an adjacent block; and

a filter controller configured to control a strength of the filter process based on the flag controlling the weighted coefficients used in the weighted-averaging in generating the prediction block.

2. The encoding device according to claim 1 , wherein the filter controller is configured to control the deblocking filter based on whether or not the weighted coefficients applied to one of the two blocks is the same as the weighted coefficients applied to the other of the two blocks.

3. The encoding device according to claim 2 , wherein the filter controller is configured to:

control the deblocking filter such that the filter process is not performed, based on a fact that the weighted coefficients applied to one of the two blocks is the same as the weighted coefficients applied to the other of the two blocks; and

control the deblocking filter such that the filter process is performed, based on a fact that the weighted coefficients applied to one of the two blocks is different from the weighted coefficients applied to the other of the two blocks.

4. A decoding device that performs decoding on each of blocks obtained by dividing an image, the decoding device comprising:

an entropy decoder configured to output quantized transform coefficients corresponding to a decoding-target block by decoding an encoded stream;

an inverse quantizer/inverse transformer configured to restore a prediction residual by performing an inverse quantization process and an inverse transform process on the quantized transform coefficients outputted by the entropy decoder;

a predictor configured to generate a prediction block of the decoding-target block by weighted-averaging a plurality of reference images using weighted coefficients selected based on a flag controlling weighted coefficients;

a combiner configured to reconstruct the decoding-target block by combining the restored prediction residual and the prediction block;

a deblocking filter configured to perform a filter process on a boundary portion between two blocks including the reconstructed decoding-target block and an adjacent block; and

a filter controller configured to control a strength of the filter process based on the flag controlling the weighted coefficients used in the weighted-averaging in generating the prediction block.

5. The decoding device according to claim 4 , wherein

the predictor is configured to generate the prediction block by weighted-averaging using the weighted coefficients selected from a weighted coefficient set including a plurality of weighted coefficients, and

the filter controller is configured to control the deblocking filter based on the weighted coefficients applied to the two blocks by the predictor.

6. The decoding device according to claim 5 , wherein the filter controller is configured to control the deblocking filter based on whether or not the weighted coefficients applied to one of the two blocks is the same as the weighted coefficients applied to the other of the two blocks.

7. The decoding device according to claim 6 , wherein the filter controller is configured to:

control the deblocking filter such that the filter process is not performed, based on a fact that the weighted coefficients applied to one of the two blocks is the same as the weighted coefficients applied to the other of the two blocks; and

control the deblocking filter such that the filter process is performed, based on a fact that the weighted coefficients applied to one of the two blocks is different from the weighted coefficients applied to the other of the two blocks.

8. A non-transitory computer-readable medium storing a program causing a computer to function as the encoding device according to claim 1 .

9. A non-transitory computer-readable medium storing a program causing a computer to function as the decoding device according to claim 4 .

10. The encoding device according to claim 1 , wherein

the predictor is further configured to generate another prediction block of another encoding-target block by weighted-averaging a plurality of reference images using other weighted coefficients selected from the weighted coefficient set, the another encoding-target block being adjacent to the encoding-target block,

the transformer/quantizer is further configured to perform a transform process and a quantization process on another prediction residual that represents a difference between the another encoding-target block and the another prediction block,

the inverse quantizer/inverse transformer is further configured to restore the another prediction residual,

the combiner is further configured to reconstruct the another encoding-target block by combining the another restored prediction residual and the another prediction block,

the deblocking filter is configured to perform the filter process on the boundary portion between the two blocks including the reconstructed encoding-target block and the another reconstructed encoding-target block as the adjacent block, and

the filter controller is configured to control the deblocking filter based on the weighted coefficients used in the weighted-averaging to generate the prediction block and the other weighted coefficients used in the weighted-averaging to generate the another prediction block.

11. The decoding device according to claim 4 , wherein

the entropy decoder is further configured to output another quantized transform coefficients corresponding to another decoding-target block, the another decoding-target block being adjacent to the decoding-target block,

the inverse quantizer/inverse transformer is further configured to restore another prediction residual by performing an inverse quantization process and an inverse transform process on the another quantized transform coefficients,

the predictor is further configured to generate another prediction block of the another decoding-target block by weighted-averaging a plurality of reference images using weighted coefficients selected based on another flag controlling weighted coefficients,

the combiner is further configured to reconstruct the another decoding-target block by combining the another restored prediction residual and the another prediction block,

the deblocking filter is configured to perform the filter process on the boundary portion between the two blocks including the reconstructed decoding-target block and the another reconstructed decoding-target block as the adjacent block, and

the filter controller is configured to control the deblocking filter based on the flag and the another flag.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Feb 25, 2022
From: IWAMURA, SHUNSUKE; ICHIGAYA, ATSURO; NEMOTO, SHIMPEI
To: NIPPON HOSO KYOKAI
Reel/Frame 059251/0206 →
Priority Claims (1)
JP 2019-157240 · Aug 29, 2019 · national
Continuity (2)
Continuation PCTJP2020032782 · Aug 28, 2020
Related Publication 20220182621A1 · Jun 9, 2022
References Cited (14)
US 8805100B2 · Ikai · 2014 [cited by examiner]
US 20180218512A1 · Chan · 2018 [cited by examiner]
US 20190313094A1 · Kanoh · 2019 [cited by examiner]
US 20190313095A1 · Ikeda · 2019 [cited by examiner]
US 20200077089A1 · Lee · 2020 [cited by examiner]
CN 101222645A · 2008 [cited by examiner]
WO 2018123444A1 · 2018 [cited by applicant]
International Search Report issued in PCT/JP2020/032782; mailed Oct. 13, 2020. [cited by applicant]
Recommendation ITU-T H.265, High efficiency video coding, International Telecommunication Union, Dec. 2016, pp. 1-664. [cited by applicant]
Wamura, Shunsuke, et al., Non-CE5: Boundary strength derivation of deblocking filter for transform-skipped block, Joint Video Experts Team (JVET) of ITU-TSG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, JVET-00656, 15th Meetin… [cited by applicant]
Kotra, Anand Meher et al., AHG18/Non-CE5: Boundary strength fix for coding units using BCW, Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, JVET-P0109-v2, 16th Meeting: Geneva, CH, Oct… [cited by applicant]
Tsai, Chia-Ming et al., CE5-related: Deblocking considering prediction weights in BCW and TPM, Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, JVET-P0161-v2, 16th Meeting: Geneva, CH, … [cited by applicant]
Meng, Xuewei et al., AHG18/Non-CE5: Deblocking for TPM and BCW, Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, JVET, P0269-v2, 16th Meeting: Geneva, CH, Oct. 1-11, 2019, pp. 1-8. [cited by applicant]
Wamura, Shunsuke et al., [AHG18] [Non-CE5] Proposed cleanup of deblocking filter process, Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, JVET-P0586-v2, 16th Meeting: Geneva, CH, Oct. … [cited by applicant]