IP Library Granted Patent US 11,800,127
Granted Patent B2
US 11,800,127 · App. 18/093,623 · Granted Oct 24, 2023

Method and apparatus for intra-prediction coding of video data

Inventors: Je Won Kang (Seoul, KR); Sang Hyo Park (Seoul, KR); Seung Wook Park (Gyeonggi-do, KR); Wha Pyeong Lim (Gyeonggi-do, KR)
Assignees: Hyundai Motor Company; Kia Corporation; Ewha University-Industry Collaboration Foundation
H04N19/44H04N19/105H04N19/132H04N19/159H04N19/176H04N19/70
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,800,127
App. No.
18/093,623
Granted
Oct 24, 2023
Kind
B2
Abstract

A method and apparatus for intra-prediction coding of video data are provided. The apparatus includes a decoder that is configured to decode, from a bitstream, a syntax element indicating an intra-prediction type of a current block of the video data, and an intra-predictor that is configured to generate a prediction block for the current block by selectively performing matrix based intra-prediction or regular intra-prediction based on the intra-prediction type of the current block indicated by the syntax element.

Claims (64)

1. A method of encoding video data, comprising:

encoding, into a bitstream, a syntax element indicating an intra-prediction type of a current luma block of the video data, the intra-prediction type being indicated from among matrix based intra-prediction (MIP) and regular intra-prediction;

generating a prediction block for the current luma block by selectively performing the MIP or the regular intra-prediction based on the intra-prediction type of the current luma block;

generating a residual block of the current block using the predicted block; and

encoding residual data which specifies the residual block,

wherein the generating of the prediction block for the current luma block by performing the regular intra-prediction includes:

determining a regular intra-prediction mode for the current luma block,

deriving Most Probable Mode (MPM) candidates based on a regular intra-prediction mode of each of neighboring blocks adjacent to the current luma block to configure an MPM list for the current luma block, wherein the regular intra-prediction mode of the neighboring block is set as a PLANAR mode when an intra-prediction type of the neighboring block is the MIP; and

encoding, into the bitstream, at least one syntax element indicating the regular intra-prediction mode for the current luma block based on the MPM list, and

wherein the generating of the prediction block for the current luma block by performing the MIP includes:

encoding, into the bitstream, a syntax element indicating an MIP mode for the current luma block;

deriving a boundary vector using neighboring samples adjacent to the current luma block based on a width and a height of the current luma block;

generating predicted samples for the current luma block based on matrix-vector multiplication between the boundary vector and a matrix predefined for the MIP mode; and

deriving the prediction block for the current luma block based on the predicted samples, and

wherein the deriving of the boundary vector using the neighboring samples adjacent to the current luma block includes:

encoding, into the bitstream, a syntax element indicating a concatenation order of first entries of the boundary vector derived from the left neighboring samples adjacent to the current luma block and second entries of the boundary vector derived from the above neighboring samples adjacent to the current luma block; and

concatenating the first entries and the second entries according to the concatenation order and thereby generating the boundary vector.

2. The method of claim 1 , wherein the syntax element indicating the MIP mode for the current luma block is a truncated binary code which specifies one of a plurality of MIP modes allowed for the width and the height of the current luma block.

3. The method of claim 2 , wherein the deriving of the boundary vector using the neighboring samples adjacent to the current luma block includes:

deriving the boundary vector from one or two sets selected from between a set of left neighboring samples and a set of above neighboring samples adjacent to the current luma block, depending on the MIP mode for the current luma block.

4. The method of claim 2 , wherein entries of the boundary vector are derived based on down-sampled values from left neighboring samples adjacent to the current luma block or the left neighboring samples adjacent to the current luma block according to the width and the height of the current luma block.

5. The method of claim 2 , wherein the deriving of the prediction block for the current luma block based on the predicted samples includes:

allocating the predicted samples to positions in the prediction block; and

generating predicted sample values for positions to which the predicted samples are not allocated in the prediction block, based on using linear interpolation for the predicted samples, left neighboring samples adjacent to the current luma block, and above neighboring samples adjacent to the current luma block.

6. A method for decoding video data, comprising:

decoding, from a bitstream, a syntax element indicating an intra-prediction type of a current luma block of the video data, the intra-prediction type being indicated from among matrix based intra-prediction (MIP) and regular intra-prediction;

generating a prediction block for the current luma block by selectively performing the MIP or the regular intra-prediction based on the intra-prediction type of the current luma block indicated by the syntax element;

decoding, from the bitstream, residual data which specifies a residual block of the current block; and

reconstructing the current block based on the predicted block and the residual block,

wherein the generating of the prediction block for the current luma block by performing the regular intra-prediction includes:

deriving Most Probable Mode (MPM) candidates based on a regular intra-prediction mode of each of neighboring blocks adjacent to the current luma block to configure an MPM list for the current luma block, wherein the regular intra-prediction mode of the neighboring block is set as a PLANAR mode when an intra-prediction type of the neighboring block is the MIP; and

deriving a regular intra-prediction mode for the current luma block based on the MPM list, and

wherein the generating of the prediction block for the current luma block by performing the regular intra-prediction includes:

decoding, from the bitstream, a syntax element indicating an MIP mode for the current luma block;

deriving a boundary vector using neighboring samples adjacent to the current luma block based on a width and a height of the current luma block;

generating predicted samples for the current luma block based on matrix-vector multiplication between the boundary vector and a matrix predefined for the MIP mode; and

deriving the prediction block for the current luma block based on the predicted samples, and

wherein the deriving of the boundary vector using the neighboring samples adjacent to the current luma block includes:

decoding, from the bitstream, a syntax element indicating a concatenation order of first entries of the boundary vector derived from the left neighboring samples adjacent to the current luma block and second entries of the boundary vector derived from the above neighboring samples adjacent to the current luma block; and

concatenating the first entries and the second entries according to the concatenation order and generating the boundary vector.

7. The method of claim 6 , wherein the syntax element indicating the MIP mode for the current luma block is a truncated binary code which specifies one of a plurality of MIP modes allowed for the width and the height of the current luma block.

8. The method of claim 7 , wherein the deriving of the boundary vector using the neighboring samples adjacent to the current luma block includes:

deriving the boundary vector from one or two sets selected from between a set of left neighboring samples and a set of above neighboring samples adjacent to the current luma block, depending on the MIP mode for the current luma block.

9. The method of claim 7 , wherein entries of the boundary vector are derived based on down-sampled values from left neighboring samples adjacent to the current luma block or the left neighboring samples adjacent to the current luma block according to the width and the height of the current luma block.

10. The method of claim 7 , wherein the deriving of the prediction block for the current luma block based on the predicted samples includes:

allocating the predicted samples to positions in the prediction block; and

generating predicted sample values for positions to which the predicted samples are not allocated in the prediction block, based on using linear interpolation for the predicted samples, left neighboring samples adjacent to the current luma block, and above neighboring samples adjacent to the current luma block.

11. A non-transitory computer readable medium storing a bitstream containing encoded data for blocks of video data, the bitstream being generated by processes of:

encoding, into a bitstream, a syntax element indicating an intra-prediction type of a current luma block of the video data, the intra-prediction type being indicated from among matrix based intra-prediction (MIP) and regular intra-prediction;

generating a prediction block for the current luma block by selectively performing the MIP or the regular intra-prediction based on the intra-prediction type of the current luma block;

generating a residual block of the current block using the predicted block; and

encoding residual data which specifies the residual block,

wherein the generating of the prediction block for the current luma block by performing the regular intra-prediction includes:

determining a regular intra-prediction mode for the current luma block,

deriving Most Probable Mode (MPM) candidates based on a regular intra-prediction mode of each of neighboring blocks adjacent to the current luma block to configure an MPM list for the current luma block, wherein the regular intra-prediction mode of the neighboring block is set as a PLANAR mode when an intra-prediction type of the neighboring block is the MIP; and

encoding, into the bitstream, at least one syntax element indicating the regular intra-prediction mode for the current luma block based on the MPM list, and

wherein the generating of the prediction block for the current luma block by performing the MIP includes:

encoding, into the bitstream, a syntax element indicating an MIP mode for the current luma block;

deriving a boundary vector using neighboring samples adjacent to the current luma block based on a width and a height of the current luma block;

generating predicted samples for the current luma block based on matrix-vector multiplication between the boundary vector and a matrix predefined for the MIP mode; and

deriving the prediction block for the current luma block based on the predicted samples, and

wherein the deriving of the boundary vector using the neighboring samples adjacent to the current luma block includes:

encoding, into the bitstream, a syntax element indicating a concatenation order of first entries of the boundary vector derived from the left neighboring samples adjacent to the current luma block and second entries of the boundary vector derived from the above neighboring samples adjacent to the current luma block; and

concatenating the first entries and the second entries according to the concatenation order and thereby generating the boundary vector.

Assignments (2)
CHANGE OF NAME Recorded Aug 8, 2023
From: KIA MOTORS CORPORATION
To: KIA CORPORATION
Reel/Frame 064530/0247 →
CHANGE OF NAME Recorded Aug 5, 2023
From: KIA MOTORS CORPORATION
To: KIA CORPORATION
Reel/Frame 064503/0183 →
Priority Claims (3)
KR 10-2019-0075163 · Jun 24, 2019 · national
KR 10-2019-0080749 · Jul 4, 2019 · national
KR 10-2020-0077014 · Jun 24, 2020 · national
Continuity (2)
Continuation 17415489
Related Publication 20230143740A1 · May 11, 2023