IP Library Granted Patent US 11,641,471
Granted Patent B2
US 11,641,471 · App. 17/610,985 · Granted May 2, 2023

Image coding method and device on basis of wide-angle intra prediction and transform

Inventors: Moonmo Koo (Seoul, KR); Jaehyun Lim (Seoul, KR); Junghak Nam (Seoul, KR); Seunghwan Kim (Seoul, KR)
Assignee: LG ELECTRONICS INC.
H04N19/132H04N19/159H04N19/176H04N19/18
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,641,471
App. No.
17/610,985
Granted
May 2, 2023
Kind
B2
Abstract

An image decoding method according to the present document comprises the steps of: obtaining intra prediction mode information and an LFNST index; deriving an intra prediction mode of a current block on the basis of intra prediction mode information; when wide-angle intra prediction is applied to the current block, deriving a modified intra prediction mode by means of intra prediction mode remapping; deciding an LFNST set comprising LFNST matrices on the basis of the modified intra prediction mode; selecting one of the LFNST matrices on the basis of the LFNST set and LFNST index; and deriving transform coefficients for the current block on the basis of the selected LFNST matrix.

Claims (41)

1. An image decoding method performed by a decoding apparatus, the method comprising:

obtaining intra prediction mode information and a low-frequency non-separable transform (LFNST) index from a bitstream;

deriving an intra prediction mode for a current block based on the intra prediction mode information;

deriving a modified intra prediction mode through intra prediction mode remapping based on wide-angle intra prediction being applied to the current block;

determining an LFNST set among four LFNST sets, the LFNST set comprising LFNST matrices based on the modified intra prediction mode;

selecting one of the LFNST matrices based on the determined LFNST set and the LFNST index;

deriving transform coefficients for the current block based on the selected LFNST matrix; and

deriving residual samples for the current block based on the transform coefficients,

wherein the intra prediction mode information indicates any one of a planar mode (0), a DC mode (1), and directional modes 2 to 66,

wherein the modified intra prediction mode is derived to range from 67 to 80 based on the width of the current block being greater than the height of the current block,

wherein the modified intra prediction mode is derived to range from −1 to −14 based on the height of the current block being greater than the width of the current block, and

wherein an LFNST set in a case where the modified intra prediction mode ranges from 67 to 80 and an LFNST set in a case where the modified intra prediction mode ranges from −1 to −14 are the same, and

a first LFNST set of the four LFNST sets is used for the intra prediction mode ranging from 0 to 1, a second LFNST set of the four LFNST sets is used for the modified intra prediction mode ranging from −1 to −14 and 67-80, and the intra prediction mode ranging from 2 to 12 and 56-66, a third LFNST set of the four LFNST sets is used for the intra prediction mode ranging from 13 to 23 and ranging from 45 to 55, a fourth LFNST set of the four LFNST sets is used for the intra prediction mode of ranging from 24 to 44.

2. The image decoding method of claim 1 , wherein the modified intra prediction mode is derived based on which of the height and the width of the current block is greater, a ratio between the height and the width of the current block, and the intra prediction mode for the current block.

3. The image decoding method of claim 1 , wherein the LFNST index indicates whether an LFNST is applied and one of the LFNST matrices comprised in the LFNST set.

4. An image encoding method performed by an image encoding apparatus, the method comprising:

deriving an intra prediction mode for a current block;

deriving a modified intra prediction mode through intra prediction mode remapping based on whether wide-angle intra prediction is applied to the current block;

deriving prediction samples based on the modified intra prediction mode;

deriving residual samples for the current block based on the prediction samples;

determining a low frequency non-separable transform (LFNST) set among four LFNST sets, the LFNST set comprising LFNST matrices based on the modified intra prediction mode;

deriving transform coefficients for the current block based on the residual samples, the determined LFNST set, and the LFNST matrices; and

encoding image information comprising the intra prediction mode and an LFNST index indicating the LFNST matrices,

wherein the intra prediction mode information indicates any one of a planar mode (0), a DC mode (1), and directional modes 2 to 66,

wherein the modified intra prediction mode is derived to range from 67 to 80 based on the width of the current block being greater than the height of the current block,

wherein the modified intra prediction mode is derived to range from −1 to −14 based on the height of the current block being greater than the width of the current block, and

wherein an LFNST set in a case where the modified intra prediction mode ranges from 67 to 80 and an LFNST set in a case where the modified intra prediction mode ranges from −1 to −14 are the same, and

a first LFNST set of the four LFNST sets is used for the intra prediction mode ranging from 0 to 1, a second LFNST set of the four LFNST sets is used for the modified intra prediction mode ranging from −1 to −14 and 67-80, and the intra prediction mode ranging from 2 to 12 and 56-66, a third LFNST set of the four LFNST sets is used for the intra prediction mode ranging from 13 to 23 and ranging from 45 to 55, a fourth LFNST set of the four LFNST sets is used for the intra prediction mode ranges from 24 to 44.

5. A non-transitory computer-readable digital storage medium that stores a bitstream generated by a method, the method comprising:

deriving an intra prediction mode for a current block;

deriving a modified intra prediction mode through intra prediction mode remapping based on whether wide-angle intra prediction is applied to the current block;

deriving prediction samples based on the modified intra prediction mode;

deriving residual samples for the current block based on the prediction samples;

determining a low frequency non-separable transform (LFNST) set among four LFNST sets, the LFNST set comprising LFNST matrices based on the modified intra prediction mode;

deriving transform coefficients for the current block based on the residual samples, the determined LFNST set, and the LFNST matrices; and

encoding image information comprising the intra prediction mode and an LFNST index indicating the LFNST matrices to generate the bitstream,

wherein the intra prediction mode information indicates any one of a planar mode (0), a DC mode (1), and directional modes 2 to 66,

wherein the modified intra prediction mode is derived to range from 67 to 80 based on the width of the current block being greater than the height of the current block,

wherein the modified intra prediction mode is derived to range from −1 to −14 based on the height of the current block being greater than the width of the current block, and

wherein an LFNST set in a case where the modified intra prediction mode ranges from 67 to 80 and an LFNST set in a case where the modified intra prediction mode ranges from −1 to −14 are the same, and

a first LFNST set of the four LFNST sets is used for the intra prediction mode ranging from 0 to 1, a second LFNST set of the four LFNST sets is used for the modified intra prediction mode ranging from −1 to −14 and 67-80, and the intra prediction mode ranging from 2 to 12 and 56-66, a third LFNST set of the four LFNST sets is used for the intra prediction mode ranging from 13 to 23 and ranging from 45 to 55, a fourth LFNST set of the four LFNST sets is used for the intra prediction mode ranges from 24 to 44.

Assignments (3)
NUNC PRO TUNC ASSIGNMENT Recorded Jan 22, 2025
From: LG ELECTRONICS INC.
To: BEIJING XIAOMI MOBILE SOFTWARE CO., LTD.
Reel/Frame 069988/0424 →
CORRECTIVE ASSIGNMENT TO CORRECT THE ADD THE 4TH INVENTOR PREVIOUSLY RECORDED AT REEL: 058100 FRAME: 0734. ASSIGNOR(S) HEREBY CONFIRMS THE ASSIGNMENT. Recorded Nov 21, 2022
From: KOO, MOONMO; LIM, JAEHYUN; NAM, JUNGHAK; KIM, SEUNGHWAN
To: LG ELECTRONICS INC.
Reel/Frame 062531/0910 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Nov 12, 2021
From: KOO, MOONMO; LIM, JAEHYUN; NAM, JUNGHAK
To: LG ELECTRONICS INC.
Reel/Frame 058100/0734 →
Continuity (4)
Provisional Application 62856134 · Jun 2, 2019
Provisional Application 62853689 · May 28, 2019
Provisional Application 62853155 · May 27, 2019
Related Publication 20220150504A1 · May 12, 2022