IP Library › Granted Patent US 12,328,435
Granted Patent B2
US 12,328,435 · App. 18/589,157 · Granted Jun 10, 2025

Intra prediction in image processing

Inventors: Yong Joon Jeon (Seoul, KR); Seung Wook Park (Seoul, KR); Jung Sun Kim (Seoul, KR); Joon Young Park (Seoul, KR); Byeong Moon Jeon (Seoul, KR); Jae Hyun Lim (Seoul, KR)
Assignee: LG ELECTRONICS INC.
H04N19/159H04N19/00H04N19/117H04N19/176H04N19/593H04N19/86H04N19/105H04N19/82
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,328,435
App. No.
18/589,157
Granted
Jun 10, 2025
Kind
B2
Abstract

An intra prediction method and a device using the intra prediction method are provided. The intra prediction method includes the steps of: deriving a current prediction mode as a prediction mode of a current block; constructing neighboring samples of the current block with available reference samples; filtering the available reference samples; and generating predicted samples of the current block on the basis of the filtered available reference samples. The filtering step includes performing the filtering using the available reference sample located in the prediction direction of the current prediction mode and a predetermined number of available reference samples neighboring to the prediction direction of the current prediction mode.

Claims (393)

1. An image encoding method comprising:

determining an intra prediction mode for a current block, wherein the intra prediction mode is one of intra prediction modes including a plurality of directional intra prediction modes, and the intra prediction mode for the current block is induced into at least one of at least one of a left top diagonal directional intra prediction mode or a horizontal directional intra prediction mode;

deriving neighboring reference samples of the current block;

filtering the neighboring reference samples;

generating a prediction sample for the current block based on one of the filtered neighboring reference samples;

generating a residual sample for the current block based on the prediction sample; and

generating a bitstream including prediction information for the current block and residual information for the residual sample,

wherein, in the filtering step, filtering is performed by using a first neighboring reference sample located in a prediction direction of the intra prediction mode with regard to the prediction sample and neighboring reference samples adjacent to the first neighboring reference sample,

wherein, when the intra prediction mode for the current block is induced into the left top diagonal directional intra prediction mode and the first neighboring reference sample is located on a top side of the current block, a filtered sample value for the first neighboring reference sample is derived based on following equation by using the first neighboring reference sample, a second neighboring reference sample located on a left side of the first neighboring reference sample and a third neighboring reference sample located on a right side of the first neighboring reference sample,

(

r

⁡

(

x

-

1

)

+

2

*

r

⁡

(

x

)

+

r

⁡

(

x

+

1

)

+

2

)

≫

2

wherein, the r(x) represents a sample value of the first neighboring reference sample, the r(x−1) represents a value of the second neighboring reference sample and the r(x+1) represents a sample value of the third neighboring reference sample,

wherein, when the intra prediction mode for the current block is induced into the left top diagonal directional intra prediction mode and the first neighboring reference sample is located on a left side of the current block, a filtered sample value for the first neighboring reference sample is derived based on following equation by using the first neighboring reference sample, a fourth neighboring reference sample located on an upper side of the first neighboring reference sample and a fifth neighboring reference sample located on a lower side of the first neighboring reference sample,

(

r

⁡

(

y

-

1

)

+

2

*

r

⁡

(

y

)

+

r

⁡

(

y

+

1

)

+

2

)

≫

2

wherein, the r(y) represents a sample value of the first neighboring reference sample, the r(y−1) represents a value of the fourth neighboring reference sample and the r(y+1) represents a sample value of the fifth neighboring reference sample,

wherein, when the intra prediction mode for the current block is induced into the horizontal directional intra prediction mode and the first neighboring reference sample is located on a left side of the current block, a filtered sample value for the first neighboring reference sample is derived based on following equation by using the first neighboring reference sample, a sixth neighboring reference sample located on an upper side of the first neighboring reference sample and a seventh neighboring reference sample located on a lower side of the first neighboring reference sample,

(

r

⁡

(

y

-

1

)

+

2

*

r

⁡

(

y

)

+

r

⁡

(

y

+

1

)

+

2

)

≫

2

wherein, the r(y) represents a sample value of the first neighboring reference sample, the r(y−1) represents a value of the sixth neighboring reference sample and the r(y+1) represents a sample value of the seventh neighboring reference sample,

wherein, when the intra prediction mode for the current block is induced into the vertical directional intra prediction mode and the first neighboring reference sample is located on a top side of the current block, a filtered sample value for the first neighboring reference sample is derived based on following equation by using the first neighboring reference sample, a eighth neighboring reference sample located on a left side of the first neighboring reference sample and a nineth neighboring reference sample located on a right side of the first neighboring reference sample,

(

r

⁡

(

x

-

1

)

+

2

*

r

⁡

(

x

)

+

r

⁡

(

x

+

1

)

+

2

)

≫

2

wherein, the r(x) represents a sample value of the first neighboring reference sample, the r(x−1) represents a value of the eighth neighboring reference sample and the r (x+1) represents a sample value of the nineth neighboring reference sample.

2. An image decoding method comprising:

obtaining prediction information for a current block and residual information for the current block through a bitstream;

deriving an intra prediction mode for the current block based on the prediction information, wherein the intra prediction mode is one of intra prediction modes including a plurality of directional intra prediction modes, and the intra prediction mode for the current block is induced into at least one of at least one of a left top diagonal directional intra prediction mode or a horizontal directional intra prediction mode;

deriving neighboring reference samples of the current block;

filtering the neighboring reference samples;

generating a prediction sample for the current block based on one of the filtered neighboring reference samples;

generating a residual sample for the current block based on the residual information; and

generating a reconstructed picture based on the prediction sample and the residual sample, wherein, in the filtering step, filtering is performed by using a first neighboring reference sample located in a prediction direction of the intra prediction mode with regard to the prediction sample and neighboring reference samples adjacent to the first neighboring reference sample,

wherein, when the intra prediction mode for the current block is induced into the left top diagonal directional intra prediction mode and the first neighboring reference sample is located on a top side of the current block, a filtered sample value for the first neighboring reference sample is derived based on following equation by using the first neighboring reference sample, a second neighboring reference sample located on a left side of the first neighboring reference sample and a third neighboring reference sample located on a right side of the first neighboring reference sample,

(

r

⁡

(

x

-

1

)

+

2

*

r

⁡

(

x

)

+

r

⁡

(

x

+

1

)

+

2

)

≫

2

wherein, the r(x) represents a sample value of the first neighboring reference sample, the r(x−1) represents a value of the second neighboring reference sample and the r(x+1) represents a sample value of the third neighboring reference sample,

wherein, when the intra prediction mode for the current block is induced into the left top diagonal directional intra prediction mode and the first neighboring reference sample is located on a left side of the current block, a filtered sample value for the first neighboring reference sample is derived based on following equation by using the first neighboring reference sample, a fourth neighboring reference sample located on an upper side of the first neighboring reference sample and a fifth neighboring reference sample located on a lower side of the first neighboring reference sample,

(

r

⁡

(

y

-

1

)

+

2

*

r

⁡

(

y

)

+

r

⁡

(

y

+

1

)

+

2

)

≫

2

wherein, the r(y) represents a sample value of the first neighboring reference sample, the r(y−1) represents a value of the fourth neighboring reference sample and the r(y+1) represents a sample value of the fifth neighboring reference sample,

wherein, when the intra prediction mode for the current block is induced into the horizontal directional intra prediction mode and the first neighboring reference sample is located on a left side of the current block, a filtered sample value for the first neighboring reference sample is derived based on following equation by using the first neighboring reference sample, a sixth neighboring reference sample located on an upper side of the first neighboring reference sample and a seventh neighboring reference sample located on a lower side of the first neighboring reference sample,

(

r

⁡

(

y

-

1

)

+

2

*

r

⁡

(

y

)

+

r

⁡

(

y

+

1

)

+

2

)

≫

2

wherein, the r(y) represents a sample value of the first neighboring reference sample, the r(y−1) represents a value of the sixth neighboring reference sample and the r(y+1) represents a sample value of the seventh neighboring reference sample,

wherein, when the intra prediction mode for the current block is induced into the vertical directional intra prediction mode and the first neighboring reference sample is located on a top side of the current block, a filtered sample value for the first neighboring reference sample is derived based on following equation by using the first neighboring reference sample, a eighth neighboring reference sample located on a left side of the first neighboring reference sample and a nineth neighboring reference sample located on a right side of the first neighboring reference sample,

(

r

⁡

(

x

-

1

)

+

2

*

r

⁡

(

x

)

+

r

⁡

(

x

+

1

)

+

2

)

≫

2

wherein, the r(x) represents a sample value of the first neighboring reference sample, the r(x−1) represents a value of the eighth neighboring reference sample and the r(x+1) represents a sample value of the nineth neighboring reference sample.

3. A transmission method of data for image, the method comprising:

obtaining a bitstream for the image,

wherein the bitstream is generated based on obtaining prediction information for a current block and residual information for the current block through a bitstream, deriving an intra prediction mode for the current block based on the prediction information, wherein the intra prediction mode is one of intra prediction modes including a plurality of directional intra prediction modes, and the intra prediction mode for the current block is induced into at least one of at least one of a left top diagonal directional intra prediction mode or a horizontal directional intra prediction mode, deriving neighboring reference samples of the current block, filtering the neighboring reference samples, generating a prediction sample for the current block based on one of the filtered neighboring reference samples, generating a residual sample for the current block based on the residual information, and generating a reconstructed picture based on the prediction sample and the residual sample;

transmitting the data including the bitstream,

wherein, in the filtering step, filtering is performed by using a first neighboring reference sample located in a prediction direction of the intra prediction mode with regard to the prediction sample and neighboring reference samples adjacent to the first neighboring reference sample,

wherein, when the intra prediction mode for the current block is induced into the left top diagonal directional intra prediction mode and the first neighboring reference sample is located on a top side of the current block, a filtered sample value for the first neighboring reference sample is derived based on following equation by using the first neighboring reference sample, a second neighboring reference sample located on a left side of the first neighboring reference sample and a third neighboring reference sample located on a right side of the first neighboring reference sample,

(

r

⁡

(

x

-

1

)

+

2

*

r

⁡

(

x

)

+

r

⁡

(

x

+

1

)

+

2

)

≫

2

wherein, the r(x) represents a sample value of the first neighboring reference sample, the r(x−1) represents a value of the second neighboring reference sample and the r(x+1) represents a sample value of the third neighboring reference sample,

wherein, when the intra prediction mode for the current block is induced into the left top diagonal directional intra prediction mode and the first neighboring reference sample is located on a left side of the current block, a filtered sample value for the first neighboring reference sample is derived based on following equation by using the first neighboring reference sample, a fourth neighboring reference sample located on an upper side of the first neighboring reference sample and a fifth neighboring reference sample located on a lower side of the first neighboring reference sample,

(

r

⁡

(

y

-

1

)

+

2

*

r

⁡

(

y

)

+

r

⁡

(

y

+

1

)

+

2

)

≫

2

wherein, the r(y) represents a sample value of the first neighboring reference sample, the r(y−1) represents a value of the fourth neighboring reference sample and the r(y+1) represents a sample value of the fifth neighboring reference sample,

wherein, when the intra prediction mode for the current block is induced into the horizontal directional intra prediction mode and the first neighboring reference sample is located on a left side of the current block, a filtered sample value for the first neighboring reference sample is derived based on following equation by using the first neighboring reference sample, a sixth neighboring reference sample located on an upper side of the first neighboring reference sample and a seventh neighboring reference sample located on a lower side of the first neighboring reference sample,

(

r

⁡

(

y

-

1

)

+

2

*

r

⁡

(

y

)

+

r

⁡

(

y

+

1

)

+

2

)

≫

2

wherein, the r(y) represents a sample value of the first neighboring reference sample, the r(y−1) represents a value of the sixth neighboring reference sample and the r (y+1) represents a sample value of the seventh neighboring reference sample,

wherein, when the intra prediction mode for the current block is induced into the vertical directional intra prediction mode and the first neighboring reference sample is located on a top side of the current block, a filtered sample value for the first neighboring reference sample is derived based on following equation by using the first neighboring reference sample, a eighth neighboring reference sample located on a left side of the first neighboring reference sample and a nineth neighboring reference sample located on a right side of the first neighboring reference sample,

(

r

⁡

(

x

-

1

)

+

2

*

r

⁡

(

x

)

+

r

⁡

(

x

+

1

)

+

2

)

≫

2

wherein, the r(x) represents a sample value of the first neighboring reference sample, the r(x−1) represents a value of the eighth neighboring reference sample and the r(x+1) represents a sample value of the nineth neighboring reference sample.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Feb 28, 2024
From: JEON, YONG JOON; PARK, SEUNG WOOK; KIM, JUNG SUN; PARK, JOON YOUNG; JEON, BYEONG MOON; LIM, JAE HYUN
To: LG ELECTRONICS INC.
Reel/Frame 066591/0177 →
Continuity (12)
Continuation 18142386 · May 2, 2023
Continuation 17377005 · Jul 15, 2021
Continuation 16805528 · Feb 28, 2020
Continuation 16191026 · Nov 14, 2018
Continuation 15797895 · Oct 30, 2017
Continuation 15344118 · Nov 4, 2016
Continuation 14730939 · Jun 4, 2015
Continuation 13992468
Provisional Application 61475225 · Apr 13, 2011
Provisional Application 61475223 · Apr 13, 2011
Provisional Application 61421191 · Dec 8, 2010
Related Publication 20240283943A1 · Aug 22, 2024
References Cited (13)
US 9100621B2 · Jeon · 2015 [cited by examiner]
US 9451254B2 · Joshi · 2016 [cited by examiner]
US 9661332B2 · Jeon · 2017 [cited by examiner]
US 9832472B2 · Jeon · 2017 [cited by examiner]
US 10313705B2 · Filippov · 2019 [cited by examiner]
US 10469844B2 · Jeon · 2019 [cited by examiner]
US 10785487B2 · Jeon · 2020 [cited by examiner]
US 11102491B2 · Jeon · 2021 [cited by examiner]
US 11405620B2 · Jun · 2022 [cited by examiner]
US 11677961B2 · Jeon · 2023 [cited by examiner]
US 11949885B2 · Jeon · 2024 [cited by examiner]
US 12108035B2 · Lee · 2024 [cited by examiner]
Leleannec et al., “WO 2019104004 A1”; Method and Apparatus for Low-Complexity Bi-Directional Intra Prediction in Video Encoding and Decoding; May 31, 2019. [cited by examiner]