IP Library › Granted Patent US 12,701,224
Granted Patent B2
US 12,701,224 · App. 19/022,560 · Granted Aug 4, 2026

Method and device for encoding/decoding image, and recording medium in which bitstream is stored

Inventors: Jin Ho Lee (Daejeon, KR); Jung Won Kang (Daejeon, KR); Hyun Suk Ko (Daejeon, KR); Sung Chang Lim (Daejeon, KR); Ha Hyun Lee (Seoul, KR); Dong San Jun (Daejeon, KR); Hui Yong Kim (Daejeon, KR)
Assignee: LX SEMICON CO., LTD.
H04N19/11H04N19/105H04N19/117H04N19/176H04N19/593
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,701,224
App. No.
19/022,560
Filed
Jan 15, 2025
Granted
Aug 4, 2026
Kind
B2
Examiner
LE, PETER D
Art Unit
2488
USPC
375/240.02
Abstract

An image encoding/decoding method and apparatus for performing intra prediction using a plurality of reference sample lines are provided. An image decoding method may include receiving image information including intra prediction mode information, deriving an intra prediction mode of a current block based on the intra prediction mode information, and determining at least one reference sample line for intra prediction of a current block among a plurality of reference sample lines by selecting the at least one reference sample line. Based on an upper boundary of the current block corresponding to an upper boundary of a current coding tree block including the current block, a first reference sample line among the plurality of reference sample lines can be determined as the at least one reference sample line for intra prediction of the current block.

Claims (39)

1 . An image decoding method performed by an image decoding apparatus, the method comprising:

receiving image information including intra prediction mode information;

deriving an intra prediction mode of a current block based on the intra prediction mode information;

determining at least one reference sample line for intra prediction of a current block among a plurality of reference sample lines by selecting the at least one reference sample line,

wherein based on an upper boundary of the current block corresponding to an upper boundary of a current coding tree block including the current block, only a first reference sample line among the plurality of reference sample lines is determined as the at least one reference sample line for intra prediction of the current block, and

wherein the first reference sample line includes upper reference samples adjacent to the current block and left reference samples adjacent to the current block;

deriving reference samples for intra prediction of the current block based on the selection of at least one reference sample line,

wherein whether a filtering is performed on the reference samples is determined based on the intra prediction mode of the current block and a size of the current block; and

performing intra prediction for the current block based on the intra prediction mode and the reference samples,

wherein the performing the intra prediction for the current block comprises:

determining an interpolation filter for the intra prediction between a first interpolation filter and a second interpolation filter; and

performing the intra prediction for the current block based on the interpolation filter,

wherein filter coefficients of the interpolation filter are determined differently depending on whether the determined at least one reference sample line is the first reference sample line,

wherein the interpolation filter is determined further based on the size of the current block, and the intra prediction mode, and

wherein the first interpolation filter is determined as the interpolation filter for the current block in case the selected reference sample line is not the first reference sample line.

2 . An image encoding method performed by an image encoding apparatus, the image encoding method comprising:

determining an intra prediction mode of a current block;

determining at least one reference sample line for intra prediction of the current block among a plurality of reference sample lines by selecting the at least one reference sample line,

wherein based on an upper boundary of the current block corresponding to an upper boundary of a current coding tree block including the current block, only a first reference sample line among the plurality of reference sample lines is determined as the at least one reference sample line for intra prediction of the current block, and

wherein the first reference sample line includes upper reference samples adjacent to the current block and left reference samples adjacent to the current block;

deriving reference samples for intra prediction of the current block based on the selection of at least one reference sample line,

wherein whether a filtering is performed on the reference samples is determined based on the intra prediction mode of the current block and a size of the current block;

performing intra prediction for the current block based on the intra prediction mode and the reference samples; and

encoding image information including intra prediction mode information and reference sample line information,

wherein the performing the intra prediction for the current block comprises:

determining an interpolation filter for the intra prediction between a first interpolation filter and a second interpolation filter;

performing the intra prediction for the current block based on the interpolation filter,

wherein filter coefficients of the interpolation filter are determined differently depending on whether the determined at least one reference sample line is the first reference sample line,

wherein the interpolation filter is determined further based on the size of the current block, and the intra prediction mode, and

wherein the first interpolation filter is determined as the interpolation filter for the current block in case the selected reference sample line is not the first reference sample line.

3 . A transmitting method for image data, the method comprising:

obtaining a bitstream of encoded image information, wherein the encoded image information is generated based on determining an intra prediction mode of a current block, determining at least one reference sample line for intra prediction of the current block among a plurality of reference sample lines by selecting the at least one reference sample line, wherein based on an upper boundary of the current block corresponding to an upper boundary of a current coding tree block including the current block, only a first reference sample line among the plurality of reference sample lines is determined as the at least one reference sample line for intra prediction of the current block, and wherein the first reference sample line includes upper reference samples adjacent to the current block and left reference samples adjacent to the current block deriving reference samples for intra prediction of the current block based on the selection of at least one reference sample line, wherein whether a filtering is performed on the reference samples is determined based on the intra prediction mode of the current block and a size of the current block, performing intra prediction for the current block based on the intra prediction mode and the reference samples, and encoding image information including intra prediction mode information and reference sample line information; and

transmitting the image data comprising the bitstream,

wherein the performing the intra prediction for the current block comprises:

determining an interpolation filter for the intra prediction between a first interpolation filter and a second interpolation filter; and

performing the intra prediction for the current block based on the interpolation filter,

wherein filter coefficients of the interpolation filter are determined differently depending on whether the determined at least one reference sample line is the first reference sample line,

wherein the interpolation filter is determined further based on the size of the current block, and the intra prediction mode, and

wherein the first interpolation filter is determined as the interpolation filter for the current block in case the selected reference sample line is not the first reference sample line.

Priority Claims (2)
KR 10-2017-0086113 · Jul 6, 2017 · national
KR 10-2017-0171377 · Dec 13, 2017 · national
Continuity (4)
Continuation 18675649 · May 28, 2024
Continuation 18222756 · Jul 17, 2023
Continuation 16628850 · Jun 21, 2018
Related Publication 20250159144A1 · May 15, 2025
References Cited (173)
US 8787456B2 · Murakami et al. · 2014 [cited by applicant]
US 9609343B1 · Chen et al. · 2017 [cited by applicant]
US 10003820B2 · Lee et al. · 2018 [cited by applicant]
US 10390021B2 · Xu et al. · 2019 [cited by applicant]
US 10721479B2 · Heo et al. · 2020 [cited by applicant]
US 10750174B2 · Lee et al. · 2020 [cited by applicant]
US 10965938B2 · Urban et al. · 2021 [cited by applicant]
US 11234015B2 · Lee · 2022 [cited by applicant]
US 11265578B2 · Choi et al. · 2022 [cited by applicant]
US 11722664B2 · Yasugi et al. · 2023 [cited by applicant]
US 11743456B2 · Lee et al. · 2023 [cited by applicant]
US 20040190632A1 · Cismas · 2004 [cited by applicant]
US 20050013376A1 · Dattani et al. · 2005 [cited by applicant]
US 20060126962A1 · Sun · 2006 [cited by applicant]
US 20080094505A1 · Pai et al. · 2008 [cited by applicant]
US 20080130754A1 · Winger · 2008 [cited by applicant]
US 20100027655A1 · Matsuo et al. · 2010 [cited by applicant]
US 20100091860A1 · Anisimov · 2010 [cited by applicant]
US 20110007979A1 · Goma · 2011 [cited by applicant]
US 20110249754A1 · Karczewicz et al. · 2011 [cited by applicant]
US 20110299788A1 · Suzuki et al. · 2011 [cited by applicant]
US 20120177113A1 · Guo et al. · 2012 [cited by applicant]
US 20120243608A1 · Yu et al. · 2012 [cited by applicant]
US 20120287995A1 · Budagavi · 2012 [cited by applicant]
US 20120300838A1 · Ma et al. · 2012 [cited by applicant]
US 20120328013A1 · Budagavi et al. · 2012 [cited by applicant]
US 20130022119A1 · Chien et al. · 2013 [cited by applicant]
US 20130044814A1 · Guo et al. · 2013 [cited by applicant]
US 20130089149A1 · Hayashi et al. · 2013 [cited by applicant]
US 20130114707A1 · Seregin et al. · 2013 [cited by applicant]
US 20130136174A1 · Xu et al. · 2013 [cited by applicant]
US 20130182761A1 · Chen et al. · 2013 [cited by applicant]
US 20130229485A1 · Rusanovskyy et al. · 2013 [cited by applicant]
US 20130259128A1 · Song et al. · 2013 [cited by applicant]
US 20130301720A1 · Lee et al. · 2013 [cited by applicant]
US 20130322530A1 · Rossato et al. · 2013 [cited by applicant]
US 20140003495A1 · Chuang et al. · 2014 [cited by applicant]
US 20140010305A1 · Mironovich et al. · 2014 [cited by applicant]
US 20140079332A1 · Zheng · 2014 [cited by applicant]
US 20140092983A1 · Joshi et al. · 2014 [cited by applicant]
US 20140153646A1 · Yang et al. · 2014 [cited by applicant]
US 20140198855A1 · Sole Rojals et al. · 2014 [cited by applicant]
US 20140205000A1 · Lee et al. · 2014 [cited by applicant]
US 20140226717A1 · Lim et al. · 2014 [cited by applicant]
US 20140233650A1 · Zhang et al. · 2014 [cited by applicant]
US 20140355667A1 · Lei et al. · 2014 [cited by applicant]
US 20150063438A1 · Kim et al. · 2015 [cited by applicant]
US 20150063460A1 · Gamei et al. · 2015 [cited by applicant]
US 20150201213A1 · Suzuki et al. · 2015 [cited by applicant]
US 20150208092A1 · Lee et al. · 2015 [cited by applicant]
US 20150358618A1 · Kim et al. · 2015 [cited by applicant]
US 20160021382A1 · Lee et al. · 2016 [cited by applicant]
US 20160073132A1 · Zhang et al. · 2016 [cited by applicant]
US 20160234498A1 · Misra et al. · 2016 [cited by applicant]
US 20160309184A1 · Choe et al. · 2016 [cited by applicant]
US 20160330477A1 · Kim et al. · 2016 [cited by applicant]
US 20170099490A1 · Seregin et al. · 2017 [cited by applicant]
US 20170208336A1 · Li et al. · 2017 [cited by applicant]
US 20170347102A1 · Panusopone et al. · 2017 [cited by applicant]
US 20170353719A1 · Liu et al. · 2017 [cited by applicant]
US 20180041768A1 · Koo et al. · 2018 [cited by applicant]
US 20180048896A1 · Park et al. · 2018 [cited by applicant]
US 20180139453A1 · Park et al. · 2018 [cited by applicant]
US 20180160113A1 · Jeong et al. · 2018 [cited by applicant]
US 20180332284A1 · Liu et al. · 2018 [cited by applicant]
US 20180332288A1 · Hsiang et al. · 2018 [cited by applicant]
US 20180343469A1 · Jin et al. · 2018 [cited by applicant]
US 20190052886A1 · Chiang et al. · 2019 [cited by applicant]
US 20190068967A1 · Ikai et al. · 2019 [cited by applicant]
US 20190075328A1 · Huang et al. · 2019 [cited by applicant]
US 20190116381A1 · Lee et al. · 2019 [cited by applicant]
US 20190124339A1 · Young · 2019 [cited by applicant]
US 20190141318A1 · Li et al. · 2019 [cited by applicant]
US 20190158835A1 · Lee · 2019 [cited by applicant]
US 20190166375A1 · Jun et al. · 2019 [cited by applicant]
US 20190208199A1 · Cho et al. · 2019 [cited by applicant]
US 20190238835A1 · Lee · 2019 [cited by applicant]
US 20190320200A1 · Heo · 2019 [cited by applicant]
US 20190364279A1 · Yasugi et al. · 2019 [cited by applicant]
US 20200021828A1 · Cho et al. · 2020 [cited by applicant]
US 20200021841A1 · Leontaris et al. · 2020 [cited by applicant]
US 20200036985A1 · Jang et al. · 2020 [cited by applicant]
US 20200036992A1 · Lim et al. · 2020 [cited by applicant]
US 20200137424A1 · Zhao et al. · 2020 [cited by applicant]
US 20200204799A1 · Lee et al. · 2020 [cited by applicant]
US 20200204824A1 · Lai et al. · 2020 [cited by applicant]
CN 1784015A · 2006 [cited by applicant]
CN 102098519A · 2011 [cited by applicant]
CN 102648631A · 2012 [cited by applicant]
CN 102970526A · 2013 [cited by applicant]
CN 103119945A · 2013 [cited by applicant]
CN 103200401A · 2013 [cited by applicant]
CN 103238333A · 2013 [cited by applicant]
CN 103238334A · 2013 [cited by applicant]
CN 103404151A · 2013 [cited by applicant]
CN 103621079A · 2014 [cited by applicant]
CN 103931186A · 2014 [cited by applicant]
CN 103988506A · 2014 [cited by applicant]
CN 104137549A · 2014 [cited by applicant]
CN 104247425A · 2014 [cited by applicant]
CN 105141957A · 2015 [cited by applicant]
CN 105208383A · 2015 [cited by applicant]
CN 103096066B · 2017 [cited by applicant]
CN 104737537B · 2018 [cited by applicant]
EP 2699000A1 · 2014 [cited by applicant]
EP 2920964B1 · 2018 [cited by applicant]
EP 3361726A1 · 2018 [cited by applicant]
JP 201334163A · 2013 [cited by applicant]
JP 2013141187A · 2013 [cited by applicant]
JP 20158341A · 2015 [cited by applicant]
KR 1020070077609A · 2007 [cited by applicant]
KR 1020090110336A · 2009 [cited by applicant]
KR 1020130020511A · 2013 [cited by applicant]
KR 1020130029130A · 2013 [cited by applicant]
KR 1020130106337A · 2013 [cited by applicant]
KR 1020140008503A · 2014 [cited by applicant]
KR 1020140080498A · 2014 [cited by applicant]
KR 1020140124442A · 2014 [cited by applicant]
KR 1020140129423A · 2014 [cited by applicant]
KR 1020150038688A · 2015 [cited by applicant]
KR 1020150048637A · 2015 [cited by applicant]
KR 1020150070848A · 2015 [cited by applicant]
KR 101597052B1 · 2016 [cited by applicant]
KR 1020170077203A · 2017 [cited by applicant]
KR 1020170084055A · 2017 [cited by applicant]
KR 1020180068334A · 2018 [cited by applicant]
WO WO2012165040A1 · 2012 [cited by applicant]
WO WO2012175003A1 · 2012 [cited by applicant]
WO WO2012175646A1 · 2012 [cited by applicant]
WO WO2013005962A2 · 2013 [cited by applicant]
WO WO2013005962A3 · 2013 [cited by applicant]
WO WO2013065678A1 · 2013 [cited by applicant]
WO WO2013069972A1 · 2013 [cited by applicant]
WO WO2013160693A2 · 2013 [cited by applicant]
WO WO2014039802A2 · 2014 [cited by applicant]
WO WO2014154094A1 · 2014 [cited by applicant]
WO WO2016074147A1 · 2016 [cited by applicant]
WO WO2016090568A1 · 2016 [cited by applicant]
WO WO2016091161A1 · 2016 [cited by applicant]
WO WO2016154008A1 · 2016 [cited by applicant]
WO WO2016155641A1 · 2016 [cited by applicant]
WO WO2017008263A1 · 2017 [cited by applicant]
WO WO2017082670A1 · 2017 [cited by applicant]
WO WO2017088170A1 · 2017 [cited by applicant]
WO WO2017088810A1 · 2017 [cited by applicant]
WO WO2017090957A1 · 2017 [cited by applicant]
WO WO2017090993A1 · 2017 [cited by applicant]
WO WO2019009540A1 · 2019 [cited by applicant]
Indian Office Action for Indian Application No. 202418015544, dated Sep. 30, 2025, with English translation. [cited by applicant]
Chang et al., “Arbitrary Reference Tier for Intra Directional Modes” Joint Video Exploration Team (JVET) of ITU-T SG WP 3 and ISO/IEC JTC 1/SC 29IWG 11 3rd Meeting: Geneva, CH, May 26-Jun. 1, 2016 JVET-C0043rl pp. 1-5 (… [cited by applicant]
Chang et al., “Arbitrary Reference Tier for Intra Directional Modes,” ITRI Internatinal, Jun. 2016, pp. 1-7 (7 pages in English). [cited by applicant]
Chang et al., “Arbitrary reference tier for intra directional modes,” Joint Video Exploration Team (JVET) of ITU-T and ISO/IEC, JVET of ITU-T and ISO/IEC, JVET-C0043, 3rd Meeting: Geneva, CH, May 26-Jun. 1, 2016, 5 page… [cited by applicant]
Chang et al., “EE6: Arbitrary Reference Tier for Intra Directional Modes, with Supplementary Results,” Joint Video Exploration Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, JVET-D0099r2, 4th Meeting: Ch… [cited by applicant]
Chang et al., “EE6: Arbitrary Reference Tier for Intra Directional Modes,” with Supplementary Results, ITRI International, Oct. 2016, pp. 1-8 (8 pages in English). [cited by applicant]
Chen et al., “Algorithm Description of Joint Exploration Test Model 3,” Joint Video Exploration Team (JVET) of ITU-T SG 16 WP 3 and ISO/EC JTC 1/SC 29IWG 11 3rd Meeting: Geneva, CH, May 26-Jun. 1, 2016 JVET-C1001v1 pp. … [cited by applicant]
Hsu et al., “Description of SDR video coding technology proposal by Media Tek,” Joint Video Experts Team (JVET) of ITU-T and ISO/IEC, JVET-J0018, 10th Meeting: San Diego, US, Apr. 10-20, 2018, 64 pages. [cited by applicant]
International Preliminary Report on Patentability in International Application No. PCT/KR2018/007016, issued on Jan. 7, 2020, 17 pages (with English translation). [cited by applicant]
International Search Report conducted on Sep. 18, 2018 in Corresponding International Patent Application No. PCT/KR2018/007016 (4 pages in English). [cited by applicant]
Li et al., “Multiple Line-Based Intra Prediction,” Joint Video Exploration Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29IWG 11 3rd Meeting: Geneva, CH, May 26-Jun. 2016 JVET-C0071 pp. 1-6 (6 pages in English, … [cited by applicant]
Li et al., “Multi-Type-Tree,” Joint Video Exploration Team (JVET) of ITU-T and ISO/IEC, JVET-D0117rl, 4th Meeting: Chengdu, CN, Oct. 15-21, 2016, 3 pages. [cited by applicant]
Matsuo et al., “Improved Intra Angular Prediction by DCT-Based Interpolation Filter,” 20th European Signal Processing Conference (Eusipco 2012), IEEE, NTT Cyber Space Laboratories, NTT Corporation, Aug. 27-31, 2012, pp.… [cited by applicant]
Matsuo et al., “Intra Prediction with Spatial Gradients and Multiple Reference Lines,” 2009 Picture Coding Symposium, May 2009, 161-164, 4 pages. [cited by applicant]
Ye et al., “Alogrithm descriptions of projection format conversion and video quality metrics in 360Lib Version 5,” Joint Video Exploration Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, Oct. 2017, (6 pag… [cited by applicant]
Zhang et al., “Chroma Intra Prediction Based on Inter-Channel Correlation for HEVC,” IEEE Transactions on Image Processing, Jan. 2014, 23(1): 274-286. [cited by applicant]
Zhang et al., “Enhanced Cross-component Linear Model Intra-prediction,” Joint Video Exploration Team (JVET) of ITU-T and ISO/IEC, JVET-D0110, 4th Meeting: Chengdu, CN, Oct. 15-21, 2016, 6 pages. [cited by applicant]
“High Efficiency Video Coding,” International Telecommunication Union, ITU-T H.265, Url: https://www.itu.int/rec/T-RECH.265-201304-S/e, Apr. 2013, 317 pages total. [cited by applicant]
Chen et al., “Algorithm Description of Joint Exploration Test Model 6 (JEM 6),” Joint Video Exploration Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, 6th Meeting: Hobart, AU, JVET-F1001-v3, Mar. 31-Apr.… [cited by applicant]
Cha et al., “An Efficient Combined Inter and Intra Prediction Scheme for Video Coding,” APSIPA Annual Summit and Conference, 2011, 5 pages total. [cited by applicant]
Chen et al., “Algorithm Description of Joint Exploration Test Model 3,” Joint Video Exploration Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, JVET-C1001_v3, May 26-Jun. 1, 2016, pp. 1-34 (37 p. total). [cited by applicant]
Jin et al., “Combined Inter-Intra Prediction for High Definition Video Coding,” Picture Coding Symposium (PCS 2007), 2007, 5 pages total. [cited by applicant]
Said et al., “Position Dependent Prediction Combination for Intra-Frame Video Coding,” 2016 IEEE International Conference on Image Processing (ICIP), May 29, 2025, 6 pages total. [cited by applicant]
U.S. Office Action for U.S. Appl. No. 19/028,370, dated Mar. 10, 2026. [cited by applicant]
Xu et al., “Multiple line-based intra prediction,” Joint Video Exploration Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WVG 11, JVET-C0071, May 26-Jun. 1, 2016, pp. 1-6 (7 pages total). [cited by applicant]