IP Library Granted Patent US 12,641,223
Granted Patent B2
US 12,641,223 · App. 18/411,146 · Granted May 26, 2026

Image encoding/decoding method and device, and recording medium having bitstream stored therein

Inventors: Jin Ho Lee (Daejeon, KR); Jung Won Kang (Daejeon, KR); Hyun Suk Ko (Daejeon, KR); Sung Chang Lim (Daejeon, KR); Ha Hyun Lee (Seoul, KR); Dong San Jun (Daejeon, KR); Hui Yong Kim (Daejeon, KR)
Assignee: Intellectual Discovery Co., Ltd.
H04N19/11H04N19/124H04N19/132H04N19/176
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,641,223
App. No.
18/411,146
Granted
May 26, 2026
Kind
B2
Abstract

An image encoding/decoding method and apparatus for performing representative sample-based intra prediction are provided. An image decoding method may comprise deriving an intra prediction mode of a current block, configuring a reference sample of the current block, and performing intra prediction for the current block based on the intra prediction mode and the reference sample, wherein the intra prediction is representative sample-based prediction.

Claims (51)

1 . An image decoding method performed by an image decoding apparatus, the method comprising:

configuring a reference sample for intra prediction of a current block by selecting a reference sample line among a plurality of reference sample lines adjacent to the current block; and

generating an intra prediction block of the current block by performing intra prediction for the current block based on an intra prediction mode of the current block and the reference sample,

wherein, based on a first Most Probable Mode (MPM) flag and a second MPM flag, the intra prediction mode of the current block is obtained from one of a plurality of candidate lists,

wherein the plurality of candidate lists includes a first MPM list and a second MPM list,

wherein an intra prediction mode included in the first MPM list is not included in the second MPM list,

wherein whether to configure the second MPM list is determined based on the first MPM flag,

wherein whether the intra prediction mode of the current block is included in the second MPM list or not is determined based on the second MPM flag,

wherein, in response to the selected reference sample line being a first reference sample line among the plurality of reference sample lines, the first MPM flag is signaled from a bitstream,

wherein, in response to the selected reference sample line not being the first reference sample line among the plurality of reference sample lines, the first MPM flag and the second MPM flag is not signaled from the bitstream, and the intra prediction mode of the current block is obtained based on an MPM index, and

wherein the first reference sample line is a reference sample line adjacent to the current block.

2 . The method of claim 1 ,

wherein the second MPM list includes an intra prediction mode of a neighboring block of the current block.

3 . The method of claim 1 ,

wherein the first MPM list includes a planar mode.

4 . The method of claim 1 ,

wherein the plurality of reference sample lines include a first reference sample line, a second reference sample line, and a third reference sample line,

wherein the first reference sample line with an index of 0 is adjacent to the current block,

wherein the second reference sample line with an index of 1 is adjacent to the first reference sample line, and

wherein the third reference sample line with an index of 2 is adjacent to the second reference sample line.

5 . The method of claim 4 ,

wherein whether a Multi-Reference Line (MRL) index specifying an index of the reference sample line among the plurality of reference sample lines is signaled from a bitstream is determined based on whether a top boundary of the current block corresponds a boundary of a coding tree block including the current block.

6 . The method of claim 4 ,

wherein whether a Multi-Reference Line (MRL) index specifying an index of the reference sample line among the plurality of reference sample lines is signaled from a bitstream is determined based on a color component of the current block.

7 . The method of claim 1 ,

wherein the second MPM list includes a intra prediction mode in which an offset is added or subtracted from a directional intra prediction mode included in the second MPM list.

8 . The method of claim 7 ,

wherein the offset is 4.

9 . An image encoding method performed by an image encoding apparatus, the method comprising:

configuring a reference sample for intra prediction of a current block by selecting a reference sample line among a plurality of reference sample lines adjacent to the current block; and

generating an intra prediction block of the current block by performing intra prediction for the current block based on an intra prediction mode of the current block and the reference sample,

wherein, based on the intra prediction mode of the current block obtained from one of a plurality of candidate lists, a first Most Probable Mode (MPM) flag and a second MPM flag are encoded,

wherein the plurality of candidate lists includes a first MPM list and a second MPM list,

wherein an intra prediction mode included in the first MPM list is not included in the second MPM list,

wherein, based on whether to configure the second MPM list, a value of the first MPM flag is determined,

wherein, based on whether the intra prediction mode of the current block is included in the second MPM list or not, a value of the second MPM flag is determined,

wherein, in response to the selected reference sample line being a first reference sample line among the plurality of reference sample lines, the first MPM flag encoded into a bitstream,

wherein, in response to the selected reference sample line not being the first reference sample line among the plurality of reference sample lines, the first MPM flag and the second MPM flag is not encoded into the bitstream, and an MPM index is determined based on the intra prediction mode of the current block, and

wherein the first reference sample line is a reference sample line adjacent to the current block.

10 . A method of transmitting a bitstream, comprising:

configuring a reference sample for intra prediction of a current block by selecting a reference sample line among a plurality of reference sample lines adjacent to the current block;

generating an intra prediction block of the current block by performing intra prediction for the current block based on an intra prediction mode of the current block and the reference sample; and

transmitting the bitstream obtained based on intra prediction block of the current block,

wherein, based on the intra prediction mode of the current block obtained from one of a plurality of candidate lists, a first Most Probable Mode (MPM) flag and a second MPM flag are encoded,

wherein the plurality of candidate lists includes a first MPM list and a second MPM list,

wherein an intra prediction mode included in the first MPM list is not included in the second MPM list,

wherein, based on whether to configure the second MPM list, a value of the first MPM flag is determined,

wherein, based on whether the intra prediction mode of the current block is included in the second MPM list or not, a value of the second MPM flag is determined,

wherein, in response to the selected reference sample line being a first reference sample line among the plurality of reference sample lines, the first MPM flag encoded into the bitstream,

wherein, in response to the selected reference sample line not being the first reference sample line among the plurality of reference sample lines, the first MPM flag and the second MPM flag is not encoded into the bitstream, and an MPM index is determined based on the intra prediction mode of the current block, and

wherein the first reference sample line is a reference sample line adjacent to the current block.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 22, 2024
From: ELECTRONICS AND TELECOMMUNICATIONS RESEARCH INSTITUTE
To: INTELLECTUAL DISCOVERY CO., LTD.
Reel/Frame 067176/0248 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 18, 2024
From: LEE, JIN HO; KANG, JUNG WON; KO, HYUN SUK; LIM, SUNG CHANG; LEE, HA HYUN; JUN, DONG SAN; KIM, HUI YONG
To: ELECTRONICS AND TELECOMMUNICATIONS RESEARCH INSTITUTE
Reel/Frame 067155/0347 →
Priority Claims (2)
KR 10-2017-0135124 · Oct 18, 2017 · national
KR 10-2018-0109320 · Sep 13, 2018 · national
Continuity (3)
Continuation 17746000 · May 17, 2022
Continuation 16755962
Related Publication 20240155117A1 · May 9, 2024
References Cited (75)
US 9838711B2 · Lee et al. · 2017 [cited by applicant]
US 11128862B2 · Cho et al. · 2021 [cited by applicant]
US 20110280304A1 · Jeon et al. · 2011 [cited by applicant]
US 20120287995A1 · Budagavi · 2012 [cited by applicant]
US 20130114707A1 · Seregin et al. · 2013 [cited by applicant]
US 20130156335A1 · Lim et al. · 2013 [cited by applicant]
US 20140301447A1 · Flynn · 2014 [cited by applicant]
US 20140321543A1 · Kim et al. · 2014 [cited by applicant]
US 20150382008A1 · Lim et al. · 2015 [cited by applicant]
US 20160366435A1 · Chien · 2016 [cited by examiner]
US 20160373785A1 · Said et al. · 2016 [cited by applicant]
US 20170251213A1 · Ye et al. · 2017 [cited by applicant]
US 20170272757A1 · Xu · 2017 [cited by examiner]
US 20170289548A1 · Kim et al. · 2017 [cited by applicant]
US 20180098064A1 · Seregin · 2018 [cited by examiner]
US 20180249156A1 · Heo et al. · 2018 [cited by applicant]
US 20180288410A1 · Park et al. · 2018 [cited by applicant]
US 20180324418A1 · Koo et al. · 2018 [cited by applicant]
US 20190116381A1 · Lee · 2019 [cited by examiner]
US 20190182481A1 · Lee · 2019 [cited by examiner]
US 20190208199A1 · Cho · 2019 [cited by examiner]
US 20190215512A1 · Lee · 2019 [cited by examiner]
US 20190313116A1 · Lee · 2019 [cited by applicant]
US 20190379891A1 · Moon · 2019 [cited by examiner]
US 20200051288A1 · Lim et al. · 2020 [cited by applicant]
CN 101778288A · 2010 [cited by applicant]
CN 103096055A · 2013 [cited by applicant]
CN 103404151A · 2013 [cited by applicant]
CN 103460700A · 2013 [cited by applicant]
CN 103891291A · 2014 [cited by applicant]
CN 105594213A · 2016 [cited by applicant]
CN 106464887A · 2017 [cited by applicant]
CN 107113425A · 2017 [cited by applicant]
EP 3217663A1 · 2017 [cited by applicant]
JP 2013141187A · 2013 [cited by applicant]
KR 1020120103517A · 2012 [cited by applicant]
KR 1020130020562A · 2013 [cited by applicant]
KR 1020130118250A · 2013 [cited by applicant]
KR 1020140124442A · 2014 [cited by applicant]
KR 1020150038688A · 2015 [cited by applicant]
KR 101640873B1 · 2016 [cited by applicant]
KR 101663235B1 · 2016 [cited by applicant]
KR 101713250B1 · 2017 [cited by applicant]
KR 1020170058837A · 2017 [cited by applicant]
KR 1020170084055A · 2017 [cited by applicant]
KR 1020170110162A · 2017 [cited by applicant]
KR 102555345B1 · 2023 [cited by applicant]
WO WO2011149265A2 · 2011 [cited by applicant]
WO 2014010943A1 · 2014 [cited by applicant]
WO WO2016072775A1 · 2016 [cited by applicant]
WO WO2017119540A1 · 2017 [cited by applicant]
WO WO2017142327A1 · 2017 [cited by applicant]
WO 2017176030A1 · 2017 [cited by applicant]
WO WO2019098758A1 · 2019 [cited by applicant]
WO WO2020060185A1 · 2020 [cited by applicant]
International Search Report issued on Jan. 23, 2019 in counterpart International Patent Application No. PCT/KR2018/012310 (2 pages in English and 2 pages in Korean). [cited by applicant]
Matsuo, et al. “Extension of intra prediction using multiple reference lines.” [cited by applicant]
Li, et al. “Efficient multiple-line-based intra prediction for HEVC.” [cited by applicant]
Lee, et al. “CE3: Multiple reference line prediction (Test 1.2.3 and Test 1.2.4)” [cited by applicant]
Li, Jiahao, et al. “Multiple line-based intra prediction.” Joint Video Exploration Team (JVET) of ITU-T SG 16 (2016): pp. 1-6. [cited by applicant]
Chang, Yao-Jen, et al. “Arbitrary reference tier for intra directional modes.” Joint Video Exploration Team (JVET) of ITU-T SG16 WP3 and ISO/IET JTC 1 (2016): pp. 1-5. [cited by applicant]
Chiang, M. S., et al. “CE10. 1: Combined and Multi-Hypothesis Prediction.” document JVET-K0257 (2018): pp. 1-6. [cited by applicant]
Chiang, Man-Shu, et al. “CE10.1.1: Multi-hypothesis prediction for improving AMVP mode, skip or merge mode, and intra mode” Document: JVET-L0100-v1, Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/… [cited by applicant]
U.S. Appl. No. 17/746,000, filed May 17, 2022, Jin Ho Lee et al., Electronics and Telecommunications Research Institute. [cited by applicant]
Office Action for CN 202210861388.9 by China National Intellectual Property Administration dated Feb. 20, 2025. [cited by applicant]
Jin, Zhipeng (2016), “Fast intra mode decision algorithm based on gradient and all-zero block detection”, Computer Engineering and Applications, 52 (6), pp. 209-213. doi: 10.3778/j.issn.1002-8331.1404-0127. [cited by applicant]
Office Action for KR 10-2024-0126781 by Korean Intellectual Property Office dated Dec. 12, 2024. [cited by applicant]
Guo, Mei et al., “Intra Chroma LM Mode with Reduced Line Buffer”, Joint Collaborative Team on Video Coding (JCT-VC) of ITU-T SG16 WP3 and ISO/IEC JTC1/SC29/WG11, JCTVC-F121, Jul. 2011. [cited by applicant]
Jiang, Hui-Yu et al., “CE3-related: Advanced MPM based on intra reference line selection scheme”, Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, JVET-K0175v3, Jul. 2018. [cited by applicant]
Office Action for CN 202210861387.4 by China National Intellectual Property Administration dated Jan. 13, 2025. [cited by applicant]
Office Action for CN 202210863160.3 by China National Intellectual Property Administration dated Jan. 17, 2025. [cited by applicant]
Notice of Allowance for CN 202210861387.4 by China National Intellectual Property Administration dated Jun. 19, 2025. [cited by applicant]
Xiaohui, Yan et al. “Bitrate decrease by interleave intra prediction coding for HEVC”, Video Engineering, 41(9/10), pp. 27-32, DOI: 10. 16280/j.videoe.2017.h9.005, 2017. [cited by applicant]
Office Action for CN 202210863160.3 by China National Intellectual Property Administration dated Jul. 21, 2025. [cited by applicant]
Notice of Allowance for KR 10-2024-0126781 by Korean Intellectual Property Office dated Aug. 14, 2025. [cited by applicant]