IP Library › Granted Patent US 12,278,956
Granted Patent B2
US 12,278,956 · App. 18/675,649 · Granted Apr 15, 2025

Method and device for encoding/decoding image, and recording medium in which bitstream is stored

Inventors: Jin Ho Lee (Daejeon, KR); Jung Won Kang (Daejeon, KR); Hyun Suk Ko (Daejeon, KR); Sung Chang Lim (Daejeon, KR); Ha Hyun Lee (Seoul, KR); Dong San Jun (Daejeon, KR); Hui Yong Kim (Daejeon, KR)
Assignee: LX SEMICON CO., LTD.
H04N19/11H04N19/105H04N19/117H04N19/176H04N19/593
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,278,956
App. No.
18/675,649
Granted
Apr 15, 2025
Kind
B2
Abstract

An image encoding/decoding method and apparatus for performing intra prediction using a plurality of reference sample lines are provided. An image decoding method may comprise configuring a plurality of reference sample lines, reconstructing an intra prediction mode of a current block, and performing intra prediction for the current block based on the intra prediction mode and the plurality of reference sample lines.

Claims (45)

1. An image decoding method performed by an image decoding apparatus, the method comprising:

determining at least one reference sample line for intra prediction of a current block among a plurality of reference sample lines by selecting the at least one reference sample line,

wherein based on an upper boundary part of the current block corresponding to an upper boundary part of a current coding tree block including the current block, only a first reference sample line among the plurality of reference sample lines is determined as the at least one reference sample line for intra prediction of the current block,

wherein the first reference sample line includes upper reference samples adjacent to the current block and left reference samples adjacent to the current block,

deriving reference samples for intra prediction of the current block based on the selection of at least one reference sample line; and

performing intra prediction for the current block based on an intra prediction mode and the reference samples,

wherein the performing the intra prediction for the current block comprises:

determining an interpolation filter for the intra prediction between a first interpolation filter and a second interpolation filter; and

performing the intra prediction for the current block based on the interpolation filter,

wherein filter coefficients of the interpolation filter are determined differently depending on whether the determined at least one reference sample line is the first reference sample line,

wherein the interpolation filter is determined further based on the size of the current block, the intra prediction mode of the current block, and a color component of the current block, and

wherein the first interpolation filter is determined as the interpolation filter for the current block in case the selected reference sample line is not the first reference sample line.

2. The image decoding method of claim 1 , wherein the deriving the reference samples further comprises filtering reference samples, and

the reference samples are filtered when the determined at least one reference sample line is the first reference sample line, among the plurality of reference sample lines.

3. The image decoding method of claim 1 , wherein the reference sample line is selected among the plurality of reference sample lines adjacent to the current block based on a color component of the current block.

4. The image decoding method of claim 1 , wherein based on a color component of the current block being a luma component, the interpolation filter is a 4-tap filter, and

wherein based on the color component of the current block being a chroma component, the interpolation filter is a 2-tap filter.

5. An image encoding method performed by an image encoding apparatus, the image encoding method comprising:

determining at least one reference sample line for intra prediction of a current block among a plurality of reference sample lines by selecting the at least one reference sample line,

wherein based on an upper boundary part of the current block corresponding to an upper boundary part of a current coding tree block including the current block, only a first reference sample line among the plurality of reference sample lines is determined as the at least one reference sample line for intra prediction of the current block,

wherein the first reference sample line includes upper reference samples adjacent to the current block and left reference samples adjacent to the current block,

determining an intra prediction mode of the current block;

deriving reference samples for intra prediction of the current block based on the selection of at least one reference sample line;

performing intra prediction for the current block based on the intra prediction mode and the reference samples; and

encoding image information including intra prediction mode information and reference sample line information,

wherein the performing the intra prediction for the current block comprises:

determining an interpolation filter for the intra prediction between a first interpolation filter and a second interpolation filter;

performing the intra prediction for the current block based on the interpolation filter,

wherein filter coefficients of the interpolation filter are determined differently depending on whether the determined at least one reference sample line is the first reference sample line,

wherein the interpolation filter is determined further based on the size of the current block, the intra prediction mode of the current block, and a color component of the current block, and

wherein the first interpolation filter is determined as the interpolation filter for the current block in case the selected reference sample line is not the first reference sample line.

6. The image encoding method of claim 5 , wherein the deriving the reference samples further comprises filtering reference samples, and

the reference samples are filtered when the determined at least one reference sample line is the first reference sample line, among the plurality of reference sample lines.

7. The image encoding method of claim 5 , wherein the reference sample line is selected among the plurality of reference sample lines adjacent to the current block based on a color component of the current block.

8. The image encoding method of claim 5 , wherein based on a color component of the current block being a luma component, the interpolation filter is a 4-tap filter, and

wherein based on the color component of the current block being a chroma component, the interpolation filter is a 2-tap filter.

9. A transmitting method for image data, the method comprising:

obtaining a bitstream of encoded image information, wherein the encoded image information is generated based on determining at least one reference sample line for intra prediction of a current block among a plurality of reference sample lines by selecting the at least one reference sample line, wherein based on an upper boundary part of the current block corresponding to an upper boundary part of a current coding tree block including the current block, only a first reference sample line among the plurality of reference sample lines is determined as the at least one reference sample line for intra prediction of the current block, wherein the first reference sample line includes upper reference samples adjacent to the current block and left reference samples adjacent to the current block, determining an intra prediction mode of the current block, deriving reference samples for intra prediction of the current block based on the selection of at least one reference sample line, performing intra prediction for the current block based on the intra prediction mode and the reference samples, and encoding image information including intra prediction mode information and reference sample line information, and

transmitting the image data comprising the bitstream,

wherein the performing the intra prediction for the current block comprises:

determining an interpolation filter for the intra prediction between a first interpolation filter and a second interpolation filter;

performing the intra prediction for the current block based on the interpolation filter,

wherein filter coefficients of the interpolation filter are determined differently depending on whether the determined at least one reference sample line is the first reference sample line,

wherein the interpolation filter is determined further based on the size of the current block, the intra prediction mode of the current block, and a color component of the current block, and

wherein the first interpolation filter is determined as the interpolation filter for the current block in case the selected reference sample line is not the first reference sample line.

Priority Claims (2)
KR 10-2017-0086113 · Jul 6, 2017 · national
KR 10-2017-0171377 · Dec 13, 2017 · national
Continuity (3)
Continuation 18222756 · Jul 17, 2023
Continuation 16628850
Related Publication 20240314306A1 · Sep 19, 2024
References Cited (95)
US 8787456B2 · Murakami et al. · 2014 [cited by applicant]
US 10003820B2 · Lee et al. · 2018 [cited by applicant]
US 10390021B2 · Xu et al. · 2019 [cited by applicant]
US 10721479B2 · Heo et al. · 2020 [cited by applicant]
US 10750174B2 · Lee et al. · 2020 [cited by applicant]
US 11265578B2 · Choi et al. · 2022 [cited by applicant]
US 11743456B2 · Lee et al. · 2023 [cited by applicant]
US 20040190632A1 · Cismas · 2004 [cited by applicant]
US 20050013376A1 · Dattani et al. · 2005 [cited by applicant]
US 20060126962A1 · Sun · 2006 [cited by applicant]
US 20080094505A1 · Pai et al. · 2008 [cited by applicant]
US 20100027655A1 · Matsuo et al. · 2010 [cited by applicant]
US 20110249754A1 · Karczewicz et al. · 2011 [cited by applicant]
US 20120287995A1 · Budagavi · 2012 [cited by applicant]
US 20120328013A1 · Budagavi et al. · 2012 [cited by applicant]
US 20130022119A1 · Chien et al. · 2013 [cited by applicant]
US 20130044814A1 · Guo et al. · 2013 [cited by applicant]
US 20130136174A1 · Xu et al. · 2013 [cited by applicant]
US 20130229485A1 · Rusanovskyy et al. · 2013 [cited by applicant]
US 20140205000A1 · Lee et al. · 2014 [cited by applicant]
US 20140233650A1 · Zhang et al. · 2014 [cited by applicant]
US 20150063438A1 · Kim et al. · 2015 [cited by applicant]
US 20150063460A1 · Gamei et al. · 2015 [cited by applicant]
US 20150201213A1 · Suzuki et al. · 2015 [cited by applicant]
US 20150208092A1 · Lee et al. · 2015 [cited by applicant]
US 20160021382A1 · Lee et al. · 2016 [cited by applicant]
US 20160073132A1 · Zhang et al. · 2016 [cited by applicant]
US 20160234498A1 · Misra et al. · 2016 [cited by applicant]
US 20170099490A1 · Seregin et al. · 2017 [cited by applicant]
US 20170347102A1 · Panusopone et al. · 2017 [cited by applicant]
US 20170353719A1 · Liu et al. · 2017 [cited by applicant]
US 20180041768A1 · Koo et al. · 2018 [cited by applicant]
US 20180048896A1 · Park et al. · 2018 [cited by applicant]
US 20180139453A1 · Park et al. · 2018 [cited by applicant]
US 20180160113A1 · Jeong et al. · 2018 [cited by applicant]
US 20180332284A1 · Liu et al. · 2018 [cited by applicant]
US 20180343469A1 · Jin et al. · 2018 [cited by applicant]
US 20190052886A1 · Chiang et al. · 2019 [cited by applicant]
US 20190068967A1 · Ikai et al. · 2019 [cited by applicant]
US 20190116381A1 · Lee et al. · 2019 [cited by applicant]
US 20190124339A1 · Young · 2019 [cited by examiner]
US 20190141318A1 · Li et al. · 2019 [cited by applicant]
US 20190158835A1 · Lee · 2019 [cited by examiner]
US 20190166375A1 · Jun et al. · 2019 [cited by applicant]
US 20190208199A1 · Cho et al. · 2019 [cited by applicant]
US 20190238835A1 · Lee · 2019 [cited by examiner]
US 20190320200A1 · Heo · 2019 [cited by applicant]
US 20190364279A1 · Yasugi et al. · 2019 [cited by applicant]
US 20200021828A1 · Cho et al. · 2020 [cited by applicant]
US 20200137424A1 · Zhao et al. · 2020 [cited by applicant]
US 20200204799A1 · Lee et al. · 2020 [cited by applicant]
US 20200204824A1 · Lai et al. · 2020 [cited by applicant]
CN 103096066 · 2013 [cited by applicant]
CN 103200401 · 2013 [cited by applicant]
EP 2920964 · 2014 [cited by applicant]
EP 3361726 · 2018 [cited by applicant]
JP 2013034163 · 2013 [cited by applicant]
JP 2013141187 · 2013 [cited by applicant]
JP 2015008341 · 2015 [cited by applicant]
KR 1020090110336 · 2009 [cited by applicant]
KR 1020130029130A · 2013 [cited by applicant]
KR 1020130106337 · 2013 [cited by applicant]
KR 1020140008503A · 2014 [cited by applicant]
KR 1020140080498 · 2014 [cited by applicant]
KR 1020140124442 · 2014 [cited by applicant]
KR 1020140129423 · 2014 [cited by applicant]
KR 1020150038688 · 2016 [cited by applicant]
KR 1020150048637 · 2016 [cited by applicant]
KR 1020170077203 · 2017 [cited by applicant]
KR 1020170084055 · 2017 [cited by applicant]
KR 1020180068334A · 2018 [cited by applicant]
WO WO2012165040 · 2012 [cited by applicant]
WO WO2012175003 · 2012 [cited by applicant]
WO WO2013065678 · 2013 [cited by applicant]
WO WO2014154094 · 2014 [cited by applicant]
WO WO2016154008 · 2016 [cited by applicant]
WO WO2017082670A1 · 2017 [cited by applicant]
WO WO2017090993 · 2017 [cited by applicant]
WO WO2019009540 · 2019 [cited by applicant]
Chang et al. “Arbitrary Reference Tier for Intra Directional Modes” Joint Video Exploration Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29IWG 11 3rd Meeting: Geneva, CH, May 26-Jun. 1, 2016 JVET-C0043rl pp. 1-5… [cited by applicant]
Chang et al., “Arbitrary Reference Tier for Intra Directional Modes,” ITRI International, Jun. 2016, pp. 1-7 (7 pages in English). [cited by applicant]
Chang et al., “Arbitrary reference tier for intra directional modes,” Joint Video Exploration Team (JVET) of ITU-T and ISO/IEC, JVET of ITU-T and ISO/IEC, JVET-C0043, 3rd Meeting: Geneva, CH, May 26-Jun. 1, 2016, 5 page… [cited by applicant]
Chang et al., “EE6: Arbitrary Reference Tier for Intra Directional Modes, with Supplementary Results”, ITRI International, Oct. 2016, pp. 1-8 (8 pages in English). [cited by applicant]
Chang et al., “EE6: Arbitrary Reference Tier for Intra Directional Modes, with Supplementary Results,” Joint Video Exploration Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, JVET-D0099r2, 4th Meeting: Ch… [cited by applicant]
Chen et al., “Algorithm Description of Joint Exploration Test Model 3,” Joint Video Exploration Team (JVET) of ITU-T SG 16 WP 3 and ISO/EC JTC 1/SC 29IWG 11 3rd Meeting: Geneva, CH, May 26-Jun. 1, 2016 JVET-C1001v1 pp. … [cited by applicant]
Hsu et al., “Description of SDR video coding technology proposal by MediaTek,” Joint Video Experts Team (JVET) of ITU-T and ISO/IEC, JVET-J0018, 10th Meeting: San Diego, US, Apr. 10-20, 2018, 64 pages. [cited by applicant]
International Preliminary Report on Patentability in International Appln. No. PCT/KR2018/007016, issued on Jan. 7, 2020, 17 pages (with English translation). [cited by applicant]
International Search Report conducted on Sep. 18, 2018 in Corresponding International Patent Application No. PCT/KR2018/007016 (4 pages in English). [cited by applicant]
Li et al., “Multiple Line-Based Intra Prediction,” Joint Video Exploration Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29IWG 11 3rd Meeting: Geneva, CH, May 26-Jun. 1, 2016 JVET-C0071 pp. 1-6 (6 pages in Englis… [cited by applicant]
Li et al., “Multi-Type-Tree,” Joint Video Exploration Team (JVET) of ITU-T and ISO/IEC, JVET-D0117r1, 4th Meeting: Chengdu, CN, Oct. 15-21, 2016, 3 pages. [cited by applicant]
Matsuo et al., “Intra Prediction with Spatial Gradients and Multiple Reference Lines,” 2009 Picture Coding Symposium, May 2009, 161-164, 4 pages. [cited by applicant]
Ye et al., “Algorithm descriptions of projection format conversion and video quality metrics in 360Lib Version 5,” Joint Video Exploration Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, Oct. 2017, (6 pag… [cited by applicant]
Zhang et al., “Chroma Intra Prediction Based on Inter-Channel Correlation for Hevc,” IEEE Transactions On Image Processing, Jan. 2014, 23(1):274-286. [cited by applicant]
Zhang et al., “Enhanced Cross-component Linear Model Intra-prediction,” Joint Video Exploration Team (JVET) of ITU-T and ISO/IEC, JVET-D0110, 4th Meeting: Chengdu, CN, Oct. 15-21, 2016, 6 pages. [cited by applicant]
Matsuo et al., “Improved Intra Angular Prediction by DCT-Based Interpolation Filter,” 20th European Signal Processing Conference (EUSIPCO 2012), Bucharest, Romania, Aug. 27-31, 2012, 5 pages toal. [cited by applicant]