IP Library Granted Patent US 12,267,492
Granted Patent B2
US 12,267,492 · App. 18/399,315 · Granted Apr 1, 2025

Image encoding/decoding method and device employing in-loop filtering

Inventors: Sung Chang Lim (Daejeon, KR); Jung Won Kang (Daejeon, KR); Ha Hyun Lee (Seoul, KR); Dong San Jun (Daejeon, KR); Hyun Suk Ko (Daejeon, KR); Jin Ho Lee (Daejeon, KR); Hui Yong Kim (Daejeon, KR)
Assignee: INTELLECTUAL DISCOVERY CO., LTD.
H04N19/117H04N19/105H04N19/132H04N19/176H04N19/186H04N19/1883H04N19/82
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,267,492
App. No.
18/399,315
Granted
Apr 1, 2025
Kind
B2
Abstract

The present invention relates to a video encoding/decoding method and apparatus. The video decoding method according to the present invention may comprise decoding filter information on a coding unit; classifying samples in the coding unit into classes on a per block classification unit basis; and filtering the coding unit having the samples classified into the classes on a per block classification unit basis by using the filter information.

Claims (48)

1. A video decoding method comprising:

obtaining reconstruction samples by summing prediction samples and residual samples;

decoding filter information;

classifying the reconstruction samples in a coding tree block into classes on a per block classification unit basis;

assigning block class indices to the coding tree block having the reconstruction samples classified into the classes on a per block classification unit basis; and

applying a filtering on the coding tree block having the reconstruction samples classified into the classes on a per block classification unit basis by using the filter information and the block class indices,

wherein the block class indices are determined according to directionality information and activity information,

wherein at least one of the directionality information and the activity information is determined on the basis of a gradient value with respect to at least one of a vertical direction, a horizontal direction, a first directional direction, and a second directional direction,

wherein the gradient value is obtained using a one-dimensional Laplacian operation for the block classification unit,

wherein the one-dimensional Laplacian operation is performed only for a specific sample position included in the block classification unit, and

wherein a horizontal position and a vertical position of the specific sample are both even or both odd based on each block classification unit.

2. The video decoding method according to claim 1 , wherein the activity information is derived based on summation of one-dimensional Laplacian operations in an operation region determined based on the position of a current reconstruction sample.

3. The video decoding method according to claim 2 , wherein when the position of the current reconstruction sample is (i,j), a width of the operation region is determined from i−2 to i+5, and a height of the operation region is determined from j−2 to j+5.

4. The video decoding method according to claim 1 , wherein when the coding tree block is a luma component block, the filtering is applied using a 7×7 rhombus filter, and

wherein when the coding tree block is a chroma component block, the filtering is applied using a 5×5 rhombus filter.

5. The video decoding method according to claim 1 , wherein when there is a non-available neighboring sample among neighboring samples of a reconstruction sample of the coding tree block to which the filtering is applied, the filtering is applied by performing padding on the non-available neighboring sample.

6. The video decoding method according to claim 1 , wherein a filter coefficient value used for the filtering is a value represented in 8 bits.

7. The video decoding method according to claim 6 , wherein the filter information comprises:

at least one piece of information selected from among information on whether filtering is executed, a filter coefficient value, the number of filters, the number of filter taps (a filter length), filter shape information, filter type information, information on whether a fixed filter is used for the block class index, and filter symmetry type information.

8. The video decoding method according to claim 7 , wherein the information on whether filtering is executed, includes information indicating whether to execute filtering for each color component of the coding tree block,

wherein the information indicating whether to execute filtering for each color component is entropy-decoded in a unit of coding tree block.

9. The video decoding method according to claim 7 , wherein the information on the filter coefficient value includes information on the filter coefficient value for each color component of the coding tree block, and

wherein the filter coefficient value used for the filtering is determined for each color component based on the information on the filter coefficient value for each color component.

10. A video encoding method comprising:

obtaining reconstruction samples by summing prediction samples and residual samples;

classifying the reconstruction samples in a coding tree block into classes on a per block classification unit basis;

assigning block class indices to the coding tree block having the reconstruction samples classified into the classes on a per block classification unit basis;

applying the filtering on the coding tree block having the reconstruction samples classified into the classes on a per block classification unit basis by using filter information and the block class indices; and

encoding the filter information,

wherein the block class indices are determined according to directionality information and activity information,

wherein at least one of the directionality information and the activity information is determined on the basis of a gradient value with respect to at least one of a vertical direction, a horizontal direction, a first directional direction, and a second directional direction,

wherein the gradient value is obtained using a one-dimensional Laplacian operation for the block classification unit,

wherein the one-dimensional Laplacian operation is performed only for a specific sample position included in the block classification unit, and

wherein a horizontal position and a vertical position of the specific sample are both even or both odd based on each block classification unit.

11. A device for transmitting a bitstream, comprising:

a processor configured to cause obtaining the bitstream; and

a transmitting unit operably coupled to the processor, the transmitting unit configured to cause transmitting the bitstream,

wherein the obtaining the bitstream comprises:

obtaining reconstruction samples by summing prediction samples and residual samples;

classifying the reconstruction samples in a coding tree block into classes on a per block classification unit basis;

assigning block class indices to the coding tree block having the reconstruction samples classified into the classes on a per block classification unit basis;

applying the filtering on the coding tree block having the reconstruction samples classified into the classes on a per block classification unit basis by using filter information and the block class indices; and

encoding the filter information,

wherein the block class indices are determined according to directionality information and activity information,

wherein at least one of the directionality information and the activity information is determined on the basis of a gradient value with respect to at least one of a vertical direction, a horizontal direction, a first directional direction, and a second directional direction,

wherein the gradient value is obtained using a one-dimensional Laplacian operation for the block classification unit,

wherein the one-dimensional Laplacian operation is performed only for a specific sample position included in the block classification unit, and

wherein a horizontal position and a vertical position of the specific sample are both even or both odd based on each block classification unit.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 16, 2024
From: ELECTRONICS AND TELECOMMUNICATIONS RESEARCH INSTITUTE
To: INTELLECTUAL DISCOVERY CO., LTD.
Reel/Frame 067117/0977 →
Priority Claims (8)
KR 10-2017-0162230 · Nov 29, 2017 · national
KR 10-2018-0068908 · Jun 15, 2018 · national
KR 10-2018-0082117 · Jul 16, 2018 · national
KR 10-2018-0106849 · Sep 7, 2018 · national
KR 10-2018-0114424 · Sep 21, 2018 · national
KR 10-2018-0115327 · Sep 27, 2018 · national
KR 10-2018-0118377 · Oct 4, 2018 · national
KR 10-2018-0129908 · Oct 29, 2018 · national
Continuity (3)
Continuation 17676698 · Feb 21, 2022
Continuation 16768634
Related Publication 20240137507A1 · Apr 25, 2024
References Cited (38)
US 20100091127A1 · Hampton · 2010 [cited by examiner]
US 20110243249A1 · Lee · 2011 [cited by examiner]
US 20130101018A1 · Chong et al. · 2013 [cited by applicant]
US 20140168362A1 · Hannuksela · 2014 [cited by examiner]
US 20140328387A1 · Puri et al. · 2014 [cited by applicant]
US 20150146779A1 · Bang et al. · 2015 [cited by applicant]
US 20150271517A1 · Pang · 2015 [cited by examiner]
US 20150350685A1 · Lee et al. · 2015 [cited by applicant]
US 20160234492A1 · Li et al. · 2016 [cited by applicant]
US 20160277762A1 · Zhang · 2016 [cited by examiner]
US 20170237982A1 · Karczewicz et al. · 2017 [cited by applicant]
US 20180091825A1 · Zhao · 2018 [cited by examiner]
US 20180270480A1 · Zhang · 2018 [cited by examiner]
US 20190082179A1 · Ahn · 2019 [cited by examiner]
US 20200137404A1 · Yoo · 2020 [cited by examiner]
US 20200260120A1 · Hanhart · 2020 [cited by examiner]
CN 103096060A · 2013 [cited by applicant]
CN 103621083A · 2014 [cited by applicant]
CN 107211154A · 2017 [cited by applicant]
CN 108605126 · 2018 [cited by applicant]
JP 201265120A · 2012 [cited by applicant]
JP 2012065120A · 2012 [cited by applicant]
JP 2015515829A · 2015 [cited by applicant]
JP 2016158283A · 2016 [cited by applicant]
KR 100772576B1 · 2007 [cited by applicant]
KR 1020130030254A · 2013 [cited by applicant]
KR 1020170116595A · 2017 [cited by applicant]
KR 1020170117062A · 2017 [cited by applicant]
WO 2011112237A1 · 2011 [cited by applicant]
WO 2016130801A1 · 2016 [cited by applicant]
WO 2017201011A1 · 2017 [cited by applicant]
Jicheng An et al., Unified Adaptive Loop Filter for Luma and Chroma, Document: JVET-G0095, Joint Video Exploration Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, 7th Meeting: Torino, IT, Jul. 13-21, 2017. [cited by applicant]
Marta Karczewicz et al., “Improvements on adaptive loop filter”, Joint Video Exploration Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, 2nd Meeting, Feb. 20-26, 2016, pp. 1-6 JVET-B0060, Qualcomm Inc., S… [cited by applicant]
Wang Lai et al., CE8 Subtest 1: Block-based filter adaptation with features on subset of pixels, Joint Collaborative Team on Video Coding (JCT-VC) of ITU-T SG16 WP3 and ISO/IEC JTC1/SC29/WG11, 6th Meeting, Jul. 14-22, 2… [cited by applicant]
Jianle Chen et al., Algorithm Description of Joint Exploration Test Model 7 (JEM 7), Joint Video Exploration Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, Document: JVET-G1001-v1, 7th Meeting: Torino, I… [cited by applicant]
Office Action for JP 2023-129198 by Japanese Patent Office dated Aug. 6, 2024. [cited by applicant]
Office Action for EP 18882727.3 by European Patent Office dated Jul. 31, 2024. [cited by applicant]
Chen, Jianle et al. “Algorithm Description of Joint Exploration Test Model 7 (JEM 7),” Joint Video Exploration Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11 , JVET-G1001-v1. Jul. 2017. [cited by applicant]