IP Library Granted Patent US 12,301,867
Granted Patent B2
US 12,301,867 · App. 18/220,646 · Granted May 13, 2025

Intra prediction device and method involving matrix-based intra prediction

Inventors: Jangwon Choi (Seoul, KR); Seunghwan Kim (Seoul, KR); Jin Heo (Seoul, KR); Jungah Choi (Seoul, KR); Sunmi Yoo (Seoul, KR)
Assignee: LG Electronics Inc.
H04N19/593H04N19/105H04N19/132H04N19/159H04N19/176H04N19/18H04N19/59H04N19/70
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,301,867
App. No.
18/220,646
Granted
May 13, 2025
Kind
B2
Abstract

An image decoding method includes obtaining image information including residual information and prediction-related information through a bitstream, deriving transform coefficients based on the residual information, generating residual samples for a current block based on the transform coefficients, deriving an intra prediction mode for the current block based on the prediction-related information, generating prediction samples for the current block based on the intra prediction mode, generating reconstructed samples for the current block based on the prediction samples and the residual samples, wherein the image information includes flag information related to whether an intra prediction mode type for the current block is a matrix-based intra prediction (MIP), wherein the intra prediction mode type for the current block is determined as the MIP based on the flag information, and wherein the prediction samples for the current block are generated based on MIP samples.

Claims (37)

1. A decoding apparatus for an image decoding, the decoding apparatus comprising:

a memory; and

at least one processor connected to the memory, the at least one processor configured to:

obtain image information including residual information and prediction-related information through a bitstream;

generate residual samples for a current block based on the residual information;

generate prediction samples for the current block based on the prediction-related information; and

generate reconstructed samples for the current block based on the prediction samples and the residual samples,

wherein the image information includes flag information related to whether an intra prediction mode type for the current block is a matrix-based intra prediction (MIP), wherein for the current block of which size is equal to 64×8, the flag information related to whether the intra prediction mode type for the current block is the MIP is included in the image information,

wherein whether the intra prediction mode type for the current block is the MIP is determined based on the flag information,

wherein a value of the flag information being equal to 1 is related to representing that the intra prediction mode type for the current block is the MIP, and a value of the flag information being equal to 0 is related to representing that the intra prediction mode type for the current block is not the MIP,

wherein based on the value of the flag information being equal to 1, the image information includes MIP mode information, wherein the MIP mode information is related to an MIP mode applied to the current block and the MIP mode is used to derive an MIP matrix for the current block,

wherein the MIP matrix is derived based on (i) a width and a height of the current block for the MIP and (ii) the MIP mode information, and

wherein the prediction samples for the current block are generated based on the MIP matrix.

2. An encoding apparatus for an image encoding, the encoding apparatus comprising:

a memory; and

at least one processor connected to the memory, the at least one processor configured to:

determine whether a matrix-based intra prediction (MIP) is applied to a current block;

generate prediction samples for the current block based on the determination that the MIP is applied to the current block;

generate prediction-related information based on the determination that the MIP is applied to the current block;

generate residual samples for the current block based on the prediction samples;

generate residual information based on residual samples; and

encode image information including the prediction-related information and the residual information,

wherein the prediction-related information includes flag information related to whether an intra prediction mode type for the current block is the MIP, wherein for the current block of which size is equal to 64×8, the flag information related to whether the intra prediction mode type for the current block is the MIP is included in the image information,

wherein whether the intra prediction mode type for the current block is the MIP is determined based on the flag information,

wherein a value of the flag information being equal to 1 is related to representing that the intra prediction mode type for the current block is the MIP, and a value of the flag information being equal to 0 is related to representing that the intra prediction mode type for the current block is not the MIP,

wherein based on the value of the flag information being equal to 1, the image information includes MIP mode information, wherein the MIP mode information is related to an MIP mode applied to the current block and the MIP mode is used to derive an MIP matrix for the current block,

wherein the MIP matrix is derived based on (i) a width and a height of the current block and (ii) the MIP mode information, and

wherein the prediction samples for the current block are generated based on the MIP matrix.

3. An apparatus for transmitting data for an image, the apparatus comprising:

at least one processor configured to obtain a bitstream for the image, wherein the bitstream is generated based on determining whether a matrix-based intra prediction (MIP) is applied to a current block, generating prediction samples for the current block based on the determination that the MIP is applied to the current block, generating prediction-related information based on the determination that the MIP is applied to the current block, generating residual samples for the current block based on the prediction samples, generating residual information based on residual samples, encoding image information including the prediction-related information and the residual information; and

a transmitter configured to transmit the data comprising the bitstream,

wherein the prediction-related information includes flag information related to whether an intra prediction mode type for the current block is the MIP, wherein for the current block of which size is equal to 64×8, the flag information related to whether the intra prediction mode type for the current block is the MIP is included in the image information,

wherein whether the intra prediction mode type for the current block is the MIP is determined based on the flag information,

wherein a value of the flag information being equal to 1 is related to representing that the intra prediction mode type for the current block is the MIP, and a value of the flag information being equal to 0 is related to representing that the intra prediction mode type for the current block is not the MIP,

wherein based on the value of the flag information being equal to 1, the image information includes MIP mode information, wherein the MIP mode information is related to an MIP mode applied to the current block and the MIP mode is used to derive an MIP matrix for the current block,

wherein the MIP matrix is derived based on (i) a width and a height of the current block and (ii) the MIP mode information, and

wherein the prediction samples for the current block are generated based on the MIP matrix.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 9, 2025
From: LG ELECTRONICS INC.
To: NOKIA TECHNOLOGIES OY
Reel/Frame 072859/0365 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 6, 2023
From: CHOI, JANGWON; KIM, SEUNGHWAN; HEO, JIN; CHOI, JUNGAH; YOO, SUNMI
To: LG ELECTRONICS INC.
Reel/Frame 064817/0202 →
Continuity (4)
Continuation 17677602 · Feb 22, 2022
Continuation PCTKR2020011239 · Aug 24, 2020
Provisional Application 62890584 · Aug 22, 2019
Related Publication 20230362406A1 · Nov 9, 2023
References Cited (11)
US 20180288409A1 · Heo et al. · 2018 [cited by applicant]
US 20200322620A1 · Zhao · 2020 [cited by examiner]
US 20200404324A1 · Pham Van · 2020 [cited by examiner]
US 20200404325A1 · Ramasubramonian · 2020 [cited by examiner]
US 20210314562A1 · Kang · 2021 [cited by examiner]
US 20210385438A1 · Deng · 2021 [cited by examiner]
WO WO2016040865A1 · 2016 [cited by applicant]
WO WO2017209328A1 · 2017 [cited by applicant]
Bross et al., “Versatile Video Coding (Draft 5),” JVET-N1001-v10, Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, Meeting #14, Geneva, CH, Mar. 19-27, 2019, 6 pages. [cited by applicant]
Office Action in Chinese Appln. No. 202080072351.7, mailed on Mar. 29, 2024, 17 pages (with English translation). [cited by applicant]
Office Action in Chinese Appln. No. 202080072351.7, mailed on Aug. 8, 2024, 7 pages (with English translation). [cited by applicant]