IP Library Granted Patent US 12,457,322
Granted Patent B2
US 12,457,322 · App. 17/608,399 · Granted Oct 28, 2025

Method and apparatus for encoding/decoding image in intra prediction and recording medium for storing bitstream

Inventors: Sung Chang Lim (Daejeon, KR); Jung Won Kang (Daejeon, KR); Ha Hyun Lee (Seoul, KR); Jin Ho Lee (Daejeon, KR); Hui Yong Kim (Daejeon, KR); Dae Yeon Kim (Seoul, KR)
Assignees: Electronics and Telecommunications Research Institute; CHIPS & MEDIA, INC
H04N19/105H04N19/119H04N19/132H04N19/176H04N19/186H04N19/1883H04N19/80
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,457,322
App. No.
17/608,399
Granted
Oct 28, 2025
Kind
B2
Abstract

Disclosed herein is an image encoding/decoding method. A method of decoding an image includes determining an intra prediction mode of a current block, and generating a prediction block of the current block, by performing prediction based on the intra prediction mode. When the intra prediction mode of the current block is a matrix-based intra prediction (MIP) mode, a length of a reference sample used for intra prediction is derived based on a length of the current block.

Claims (58)

1. A method of decoding an image, the method comprising:

determining an intra prediction mode of a current block; and

generating a prediction block of the current block, by performing prediction based on the intra prediction mode,

wherein when the current block is a chroma block and the intra prediction mode of the current block is a cross-component prediction mode, the generating the prediction block of the current block includes:

generating neighboring samples of a luma block corresponding to the current block;

performing down-sampling with respect to the neighboring samples of the luma block by applying at least one filter to neighboring samples at specific locations among the neighboring samples of the luma block;

deriving a cross-component parameter based on the down-sampled neighboring samples; and

generating the prediction block of the current block based on the cross-component parameter,

wherein the neighboring samples of the luma block includes at least one of top neighboring samples or left neighboring samples,

wherein a number of samples used in a filter used for down-sampling of the top neighboring samples varies depending on whether a top boundary of the current block is a coding tree unit (CTU) boundary or not, and

wherein an interval between the specific locations is determined based on a type of the cross-component prediction mode and the number of available neighboring samples of the current block.

2. The method of claim 1 , wherein when the intra prediction mode of the current block is a matrix-based intra (MIP) mode, a length of top reference samples is derived as a width of the current block+1, and a length of left reference samples is derived as a height of the current block+1.

3. The method of claim 1 , wherein when the intra prediction mode of the current block is a matrix-based intra (MIP) mode, a length of top reference samples is derived as twice a width of the current block and a length of left reference samples is derived as twice a height of the current block.

4. The method of claim 1 ,

wherein, when the neighboring samples of the luma block are not available, the unavailable neighboring block is replaced with inner samples of the luma block.

5. The method of claim 4 ,

wherein, when the unavailable neighboring samples are the top neighboring samples, the inner samples of the luma block are inner samples adjacent to a top boundary of the luma block, and

wherein, when the unavailable neighboring samples the left neighboring samples, the inner samples of the luma block are inner samples adjacent to a left boundary of the luma block.

6. The method of claim 5 ,

wherein the unavailable top neighboring samples and the inner samples adjacent to the top boundary of the luma block have the same x coordinate, and

wherein the unavailable left neighboring samples and the inner samples adjacent to the left boundary of the luma block have the same y coordinate.

7. The method of claim 4 ,

wherein the generating the prediction block of the current block further includes performing down-sampling with respect to the inner samples of the luma block, and

wherein the filter used for down-sampling of the inner samples of the luma block is differently determined further based on whether the neighboring samples are available.

8. The method of claim 1 , wherein a number of the neighboring samples of the luma block and weights to be applied to the neighboring samples of the luma block with respect to the filter become different based on whether the positions of the chroma signal and the luma signal corresponding thereto are same.

9. A method of encoding an image, the method comprising:

determining an intra prediction mode of a current block; and

generating a prediction block of the current block, by performing prediction based on the intra prediction mode,

wherein when the current block is a chroma block and the intra prediction mode of the current block is a cross-component prediction mode, the generating the prediction block of the current block includes:

generating neighboring samples of a luma block corresponding to the current block;

performing down-sampling with respect to the neighboring samples of the luma block by applying at least one filter to neighboring samples at specific locations among the neighboring samples of the luma block;

deriving a cross-component parameter based on the down-sampled neighboring samples; and

generating the prediction block of the current block based on the cross-component parameter,

wherein the neighboring samples of the luma block includes at least one of top neighboring samples or left neighboring samples,

wherein a number of samples used in a filter used for down-sampling of the top neighboring samples varies depending on whether a top boundary of the current block is a coding tree unit (CTU) boundary or not, and

wherein an interval between the specific locations is determined based on a type of the cross-component prediction mode and the number of available neighboring samples of the current block.

10. The method of claim 9 , wherein when the intra prediction mode of the current block is a matrix-based intra (MIP) mode, a length of top reference samples is derived as a width of the current block+1, and a length of left reference samples is derived as a height of the current block+1.

11. The method of claim 9 , wherein when the intra prediction mode of the current block is a matrix-based intra (MIP) mode, a length of top reference samples is derived as twice a width of the current block and a length of left reference samples is derived as twice a height of the current block.

12. The method of claim 9 ,

wherein, when the neighboring samples of the luma block are not available, the unavailable neighboring block is replaced with inner samples of the luma block.

13. The method of claim 12 ,

wherein, when the unavailable neighboring samples are the top neighboring samples, the inner samples of the luma block are inner samples adjacent to a top boundary of the luma block, and

wherein, when the unavailable neighboring samples the left neighboring samples, the inner samples of the luma block are inner samples adjacent to a left boundary of the luma block.

14. The method of claim 12 ,

wherein the generating the prediction block of the current block further includes performing down-sampling with respect to the inner samples of the luma block, and

wherein the filter used for down-sampling of the inner samples of the luma block is differently determined further based on whether the neighboring samples are available.

15. The method of claim 9 , wherein a number of the neighboring samples of the luma block and weights to be applied to the neighboring samples of the luma block with respect to the filter become different based on whether the positions of the chroma signal and the luma signal corresponding thereto are same.

16. A non-transitory computer-readable recording medium for storing a bitstream generated by an image encoding method, the image encoding method comprises:

determining an intra prediction mode of a current block; and

generating a prediction block of the current block, by performing prediction based on the intra prediction mode,

wherein when the current block is a chroma block and the intra prediction mode of the current block is a cross-component prediction mode, the generating the prediction block of the current block includes:

generating neighboring samples of a luma block corresponding to the current block;

performing down-sampling with respect to the neighboring samples of the luma block by applying at least one filter to neighboring samples at specific locations among the neighboring samples of the luma block;

deriving a cross-component parameter based on the down-sampled neighboring samples; and

generating the prediction block of the current block based on the cross-component parameter,

wherein the neighboring samples of the luma block includes at least one of top neighboring samples or left neighboring samples,

wherein a number of samples used in a filter used for down-sampling of the top neighboring samples varies depending on whether a top boundary of the current block is a coding tree unit (CTU) boundary or not, and

wherein an interval between the specific locations is determined based on a type of the cross-component prediction mode and the number of available neighboring samples of the current block.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Nov 2, 2021
From: LIM, SUNG CHANG; KANG, JUNG WON; LEE, HA HYUN; LEE, JIN HO; KIM, HUI YONG; KIM, DAE YEON
To: ELECTRONICS AND TELECOMMUNICATIONS RESEARCH INSTITUTE; CHIPS&MEDIA, INC
Reel/Frame 057998/0367 →
Priority Claims (7)
KR 10-2019-0052145 · May 3, 2019 · national
KR 10-2019-0073909 · Jun 21, 2019 · national
KR 10-2019-0075285 · Jun 24, 2019 · national
KR 10-2019-0084156 · Jul 12, 2019 · national
KR 10-2019-0084793 · Jul 12, 2019 · national
KR 10-2019-0117079 · Sep 23, 2019 · national
KR 10-2020-0004039 · Jan 13, 2020 · national
Continuity (1)
Related Publication 20220279161A1 · Sep 1, 2022
References Cited (34)
US 11290713B1 · Choi · 2022 [cited by examiner]
US 20110280304A1 · Jeon · 2011 [cited by examiner]
US 20140105283A1 · Li et al. · 2014 [cited by applicant]
US 20140369426A1 · Li · 2014 [cited by examiner]
US 20160277762A1 · Zhang · 2016 [cited by examiner]
US 20190191155A1 · Ko et al. · 2019 [cited by applicant]
US 20200099925A1 · Lee · 2020 [cited by applicant]
US 20200236356A1 · Bordes · 2020 [cited by examiner]
US 20200344468A1 · Lin · 2020 [cited by examiner]
US 20210092395A1 · Zhang · 2021 [cited by examiner]
US 20210160514A1 · Ma · 2021 [cited by examiner]
US 20210235127A1 · Chen · 2021 [cited by examiner]
US 20210258608A1 · Filippov · 2021 [cited by examiner]
US 20210297688A1 · Xu · 2021 [cited by examiner]
US 20210385482A1 · Liu · 2021 [cited by examiner]
US 20220141477A1 · Kim · 2022 [cited by examiner]
US 20230050376A1 · Filippov · 2023 [cited by examiner]
CN 102972028A · 2013 [cited by applicant]
CN 105284113A · 2016 [cited by applicant]
CN 109417617A · 2019 [cited by applicant]
KR 100772576B1 · 2007 [cited by applicant]
KR 1020180123674A · 2018 [cited by applicant]
KR 1020190028325A · 2019 [cited by applicant]
KR 1020190044554A · 2019 [cited by applicant]
WO 2001086962A1 · 2001 [cited by applicant]
WO 2017148345A1 · 2017 [cited by applicant]
WO 2019050292A1 · 2019 [cited by applicant]
Chun-Chi Chen et al., CE9: Removal of 4×N/8×8 CUs and Boundary Padding Process from DMVR (Test 9.1.1), Document: JVET-N0407-v2, Qualcomm Inc., Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/… [cited by applicant]
Dae-Yeon Kim et al., CE3-related: CCLM with unified filter shape, Joint Video Experts Team (JVET), Document: JVET P0265 rl, Chips&Media and Electronics and Telecommunications Research Institute (ETRI), Joint Video Exper… [cited by applicant]
Dae-Yeon Kim et al., CE3-related: Simplification on CCLM process, Document: JVET-00343, Chips&Media and Electronics and Telecommunications Research Institute (ETRI), Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 a… [cited by applicant]
Geert Van Der Auwera et al., Description of Core Experiment 3: Intra Prediction and Mode Coding, Document: JVET-J1023, CE coordinators, Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, … [cited by applicant]
Yi-Wen Chen et al., AHG16: On derivation of CCLM predictors, Document: JVET-Q0500, Kwai Inc., Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, 17th Meeting: Brussels, BE, Jan. 7-17, 202… [cited by applicant]
Bross, Benjamin et al. “Versatile Video Coding (Draft 4).” JVET-M1001-v7. Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11. 13th Meeting: Marrakech, MA, Jan. 9-18, 2019. [cited by applicant]
Pfaff, Jonathan et al., “CE3: Affine linear weighted intra prediction (CE3-4.1, CE3-4.2),” Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, Mar. 2019. doc: JVET-N0217. [cited by applicant]