IP Library Granted Patent US 12,587,656
Granted Patent B2
US 12,587,656 · App. 18/697,628 · Granted Mar 24, 2026

Intra prediction mode derivation-based intra prediction method and device

Inventors: Seunghwan Kim (Seoul, KR); Jie Zhao (Seoul, KR); Seethal Paluri (Seoul, KR)
Assignee: LG Electronics Inc.
H04N19/159H04N19/105H04N19/147H04N19/176H04N19/70
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,587,656
App. No.
18/697,628
Granted
Mar 24, 2026
Kind
B2
Abstract

According to one embodiment of the present disclosure, a method by which a decoding device decodes an image is provided. The method comprises the steps of: acquiring image information from a bit-stream; determining whether at least one from among a template-based inter mode derivation (TIMD) mode and decoder-side intra mode derivation (DIMD) mode is applied to the current block; generating a prediction sample of the current block on the basis of the at least one from among the TIMD mode and DIMD mode; and generating a reconstructed sample of the current block on the basis of the prediction sample of the current block, wherein the TIMD mode is derived from a template of the current block and the DIMD mode is derived on the basis of the gradient of adjacent reference samples of the current block.

Claims (61)

1 . An image decoding method performed by a decoding apparatus, the image decoding method comprising:

obtaining image information from a bitstream;

determining whether at least one of Template-based Intra Mode Derivation (TIMD) mode or Decoder Side Intra Mode Derivation (DIMD) mode is applied to a current block;

generating a prediction sample of the current block based on at least one of the TIMD mode or the DIMD mode; and

generating a reconstructed sample of the current block based on the prediction sample of the current block,

wherein the TIMD mode is derived based on a template of the current block,

wherein the DIMD mode is derived based on a gradient of neighboring reference samples of the current block,

wherein the image decoding method further comprises constructing a most probable mode (MPM) list including a candidate intra prediction mode,

wherein an intra prediction mode is derived based on the MPM list,

wherein the MPM list includes a primary MPM list and a secondary MPM list, and

wherein, based on the TIMD mode being applied to the current block, the candidate intra prediction mode derived based on the TIMD mode is inserted into the MPM list.

2 . The image decoding method of claim 1 , wherein the prediction sample is generated based on performing weighted averaging or blending based on a first prediction mode and a second prediction mode,

wherein the first prediction mode is derived based on the TIMD mode, and

wherein the second prediction mode is derived based on the DIMD mode.

3 . The image decoding method of claim 2 , wherein a weight for the weighted averaging is determined based on rate distortion cost.

4 . The image decoding method of claim 2 , wherein the prediction sample is generated based on performing the weighted averaging or the blending further based on a third prediction mode,

wherein the third prediction mode is derived as a planner mode, and

wherein the second prediction mode is different from the planar mode.

5 . The image decoding method of claim 2 , wherein the image information includes a syntax element indicating a fusion mode or an intra merge mode for the weighted averaging or the blending.

6 . The image decoding method of claim 5 , wherein the syntax element is based on a context coded model or fixed length coding.

7 . The image decoding method of claim 1 , wherein the image information includes a sequence parameter set (SPS) and a picture parameter set (PPS),

wherein information on whether the TIMD mode is applied to the current block is included in at least one of the SPS or the PPS, and

wherein information on whether the DIMD mode is applied to the current block is included in at least one of the SPS or the PPS.

8 . The image decoding method of claim 1 , wherein an intra prediction mode for the TIMD mode is derived as at least one of intra modes of the current block, and

wherein a maximum number of the intra modes of the current block is 131.

9 . The image decoding method of claim 1 , wherein an intra prediction mode for the DIMD mode is derived as at least one of intra modes of the current block, and

wherein a maximum number of the intra modes of the current block is 131.

10 . The image decoding method of claim 1 , further comprising constructing a most probable mode (MPM) list including a candidate intra prediction mode,

wherein the intra prediction mode is derived based on the MPM list,

wherein the MPM list includes a primary MPM list and a secondary MPM list, and

wherein, based on the DIMD mode being applied to the current block, the intra prediction mode derived based on the DIMD mode is inserted into the MPM list.

11 . An image encoding method performed by a encoding apparatus, the image encoding method comprising:

determining whether at least one of Template-based Intra Mode Derivation (TIMD) mode or Decoder Side Intra Mode Derivation (DIMD) mode is applied to a current block;

generating a prediction sample of the current block based on at least one of the TIMD mode or the DIMD mode;

generating prediction-related information based on the prediction sample of the current block; and

encoding image information including the prediction-related information,

wherein the TIMD mode is derived based on a template of the current block,

wherein the DIMD mode is derived based on a gradient of neighboring reference samples of the current block,

wherein the image decoding method further comprises constructing a most probable mode (MPM) list including a candidate intra prediction mode,

wherein an intra prediction mode is derived based on the MPM list,

wherein the MPM list includes a primary MPM list and a secondary MPM list, and

wherein, based on the TIMD mode being applied to the current block, the candidate intra prediction mode derived based on the TIMD mode is inserted into the MPM list.

12 . The image encoding method of claim 11 , wherein the prediction sample is generated based on performing weighted averaging or blending based on a first prediction mode and a second prediction mode,

wherein the first prediction mode is derived based on the TIMD mode, and

wherein the second prediction mode is derived based on the DIMD mode.

13 . The image encoding method of claim 12 , wherein a weight for the weighted averaging is determined based on rate distortion cost.

14 . The image encoding method of claim 12 , wherein the prediction sample is generated based on performing the weighted averaging or the blending further based on a third prediction mode,

wherein the third prediction mode is derived as a planner mode, and

wherein the second prediction mode is different from the planar mode.

15 . The image encoding method of claim 12 , wherein the image information includes a syntax element indicating a fusion mode or an intra merge mode for the weighted averaging or the blending.

16 . The image encoding method of claim 11 , wherein an intra prediction mode for the TIMD mode is derived as at least one of intra modes of the current block, and

wherein a maximum number of the intra modes of the current block is 131.

17 . A method of transmitting data for image, the method comprising:

obtaining a bitstream for the image, wherein the bitstream is generated based on determining whether at least one of Template-based Intra Mode Derivation (TIMD) mode or Decoder Side Intra Mode Derivation (DIMD) mode is applied to a current block, generating a prediction sample of the current block based on at least one of the TIMD mode or the DIMD mode, generating prediction-related information based on the prediction sample of the current block, and encoding image information including the prediction-related information; and

transmitting the data including the bitstream,

wherein the TIMD mode is derived based on a template of the current block,

wherein the DIMD mode is derived based on a gradient of neighboring reference samples of the current block,

wherein the image decoding method further comprises constructing a most probable mode MPM) list including a candidate intra prediction mode,

wherein an intra prediction mode is derived based on the MPM list,

wherein the MPM list includes a primary MPM list and a secondary MPM list, and

wherein, based on the TIMD mode being applied to the current block, the candidate intra prediction mode derived based on the TIMD mode is inserted into the MPM list.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 24, 2024
From: KIM, SEUNGHWAN; ZHAO, JIE; PALURI, SEETHAL
To: LG ELECTRONICS INC.
Reel/Frame 067209/0699 →
Continuity (2)
Provisional Application 63251044 · Oct 1, 2021
Related Publication 20240414354A1 · Dec 12, 2024
References Cited (34)
US 11676308B2 · Mora · 2023 [cited by examiner]
US 11729398B2 · Ohkawa · 2023 [cited by examiner]
US 20120044996A1 · Sato · 2012 [cited by examiner]
US 20120106862A1 · Sato · 2012 [cited by examiner]
US 20120147960A1 · Sato · 2012 [cited by examiner]
US 20170353719A1 · Liu · 2017 [cited by examiner]
US 20170353730A1 · Liu · 2017 [cited by examiner]
US 20170374369A1 · Chuang · 2017 [cited by examiner]
US 20190215521A1 · Chuang et al. · 2019 [cited by applicant]
US 20200145668A1 · Kotra et al. · 2020 [cited by applicant]
US 20200252610A1 · Zhao · 2020 [cited by examiner]
US 20200304816A1 · Zhao · 2020 [cited by examiner]
US 20200374513A1 · Xiu · 2020 [cited by examiner]
US 20210014514A1 · Nagaoka · 2021 [cited by examiner]
US 20210243452A1 · Zhao et al. · 2021 [cited by applicant]
US 20210258601A1 · Kim · 2021 [cited by examiner]
US 20210274214A1 · Moon · 2021 [cited by examiner]
US 20210281838A1 · Lee · 2021 [cited by examiner]
US 20220070451A1 · Abdoli · 2022 [cited by examiner]
US 20220224913A1 · Wang · 2022 [cited by examiner]
US 20220224922A1 · Wang · 2022 [cited by examiner]
US 20220239897A1 · Deng · 2022 [cited by examiner]
US 20220248025A1 · Deng · 2022 [cited by examiner]
US 20230262223A1 · Ghaznavi Youvalari · 2023 [cited by examiner]
KR 1020180084662 · 2018 [cited by applicant]
KR 1020180084664 · 2018 [cited by applicant]
International Search Report and Written Opinion in International Appln. No. PCT/KR2022/014750, mailed on Jan. 16, 2023, 6 pages (with English translation). [cited by applicant]
Abdoli et al., “Non-CE3: Decoder-side Intra Mode Derivation with Prediction Fusion Using Planar,” Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, 15th Meeting: Gothenburg, Sweden, JVET… [cited by applicant]
Cao et al., “EE2-related: Fusion for template-based intra mode derivation,” Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29, 23rd Meeting, by teleconference, JVET-W0123-v1, Jul. 2021, 4 pages. [cited by applicant]
Extended European Search Report in European Appin. No. 22876939.4, mailed on Sep. 9, 2025, 15 pages. [cited by applicant]
Wang et al., “EE2-related: Template-based intra mode derivation using MPMs,” Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29, 22nd Meeting, by teleconference, JVET-V0098-v2, Apr. 2021, 4 page… [cited by applicant]
Zhao et al., “EE2 Related - DIMD with implicitly derived multiple blending modes,” Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29, 23rd Meeting, by teleconference, JVET-W0126, Jul. 2021, 4 p… [cited by applicant]
Zhao et al., “EE2-Related: Improvements of Decoder-Side Intra Mode Derivation,” Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29, 22nd Meeting, by teleconference, JVET-V0087, Apr. 2021, 5 page… [cited by applicant]
Zhou et al., “EE2-related: Optimization on the second mode derivation of DIMD blending mode,” Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29, 24th Meeting, by teleconference, JVET-X0115-v1, … [cited by applicant]