IP Library Granted Patent US 11,284,073
Granted Patent B2
US 11,284,073 · App. 17/276,540 · Granted Mar 22, 2022

Method and apparatus for intra prediction coding of video data involving matrix based intra-prediction

Inventors: Je Won Kang (Seoul, KR); Sang Hyo Park (Seoul, KR); Seung Wook Park (Gyeonggi-do, KR); Wha Pyeong Lim (Gyeonggi-do, KR)
Assignees: Hyundai Motor Company; Kia Motors Corporation; Ewha University—Industry Collaboration Foundation
H04N19/11H04N19/105H04N19/139H04N19/159H04N19/167H04N19/176H04N19/70
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,284,073
App. No.
17/276,540
Granted
Mar 22, 2022
Kind
B2
Abstract

An apparatus for decoding video data includes a decoder configured to decode, from a bitstream, a syntax element indicating an intra-prediction type of a current block of the video data, and an intra-predictor configured to generate a prediction block for the current block by selectively performing matrix based intra-prediction (MIP) or regular intra-prediction based on the intra-prediction type of the current block indicated by the syntax element.

Claims (55)

1. A method of decoding video data, comprising:

decoding, from a bitstream, a syntax element indicating an intra-prediction type of a current block of the video data, the intra-prediction type being indicated from among matrix based intra-prediction (MIP) and regular intra-prediction; and

generating a prediction block for the current block by selectively performing the MIP or the regular intra-prediction based on the intra-prediction type of the current block indicated by the syntax element,

wherein generating the prediction block for the current block by performing the MIP comprises:

decoding, from the bitstream, a syntax element indicating an MIP mode for the current block, the syntax element being represented as a truncated binary code specifying one of a plurality of MIP prediction modes allowed for a width and a height of the current block;

deriving an input boundary vector using neighboring samples adjacent to the current block based on the width and the height of the current block;

generating predicted samples for the current block based on matrix-vector multiplication between the input boundary vector and a matrix predefined for the MIP mode; and

deriving the prediction block for the current block based on the predicted samples,

wherein deriving the input boundary vector using the neighboring samples adjacent to the current block comprises:

generating an initial boundary vector filled with the neighboring samples adjacent to the current block or down-sampled values from the neighboring samples according to the width and the height of the current block; and

from the initial boundary vector, generating an input boundary vector to which the matrix-vector multiplication is applied, and

wherein generating the initial boundary vector comprises:

decoding, from the bitstream, a syntax element indicating a concatenation order of first entries of the initial boundary vector derived from the left neighboring samples adjacent to the current block and second entries of the initial boundary vector derived from the above neighboring samples adjacent to the current block; and

concatenating the first entries and the second entries according to the concatenation order and thereby generating the initial boundary vector.

2. The method of claim 1 , wherein deriving the prediction block for the current block based on the predicted samples comprises:

allocating the predicted samples to positions in the prediction block; and

generating predicted sample values for positions to which the predicted samples are not allocated in the prediction block, by performing horizontal interpolation and vertical interpolation on the predicted samples, left neighboring samples adjacent to the current block, and above neighboring samples adjacent to the current block.

3. The method of claim 2 , wherein the horizontal interpolation is performed prior to the vertical interpolation.

4. The method of claim 2 , wherein, before the horizontal interpolation and the vertical interpolation are performed, clipping is performed on the predicted samples such that the predicted samples lie between 0 and 2 bitDepth −1.

5. The method of claim 1 , wherein the current block is a luma block composed of a luma component,

wherein, when the MIP is performed on the luma block, and the intra-prediction mode of the luma block is used as an intra-prediction mode of a chroma block corresponding to the luma block, an intra-prediction mode of the chroma block is set as a PLANAR mode.

6. The method of claim 1 , wherein generating the prediction block for the current block by performing the regular intra-prediction comprises:

deriving Most Probable Mode (MPM) candidates based on a regular intra-prediction mode of each of neighboring blocks adjacent to the current block and thereby configuring an MPM list for the current block; and

deriving a regular intra-prediction mode for the current block based on the MPM list,

wherein, when an intra-prediction type of the neighboring blocks is the MIP, the regular intra-prediction mode of the neighboring block is regarded as a PLANAR mode.

7. A method of encoding video data, comprising:

encoding a syntax element indicating an intra-prediction type of a current block of the video data, the intra-prediction type being indicated from among matrix based intra-prediction (MIP) and regular intra-prediction;

generating a prediction block for the current block by selectively performing the MIP or the regular intra-prediction based on the intra-prediction type of the current block indicated by the syntax element; and

encoding a residual block that is a difference between the current block and the prediction block,

wherein generating the prediction block for the current block by performing the MIP comprises:

encoding a syntax element indicating an MIP mode for the current block, the syntax element being represented as a truncated binary code specifying one of a plurality of MIP prediction modes allowed for a width and a height of the current block;

deriving an input boundary vector using neighboring samples adjacent to the current block based on the width and the height of the current block;

generating predicted samples for the current block based on matrix-vector multiplication between the input boundary vector and a matrix predefined for the MIP mode; and

deriving the prediction block for the current block based on the predicted samples,

wherein deriving the input boundary vector using the neighboring samples adjacent to the current block comprises:

generating an initial boundary vector filled with the neighboring samples adjacent to the current block or down-sampled values from the neighboring samples according to the width and the height of the current block; and

from the initial boundary vector, generating an input boundary vector to which the matrix-vector multiplication is applied, and

wherein generating the initial boundary vector comprises:

encoding a syntax element indicating a concatenation order of first entries of the initial boundary vector derived from the left neighboring samples adjacent to the current block and second entries of the initial boundary vector derived from the above neighboring samples adjacent to the current block; and

concatenating the first entries and the second entries according to the concatenation order and thereby generating the initial boundary vector.

8. A non-transitory computer readable medium storing a bitstream containing encoded data for video data, the bitstream generated by processes of:

encoding a syntax element indicating an intra-prediction type of a current block of the video data, the intra-prediction type being indicated from among matrix based intra-prediction (MIP) and regular intra-prediction;

generating a prediction block for the current block by selectively performing the MIP or the regular intra-prediction based on the intra-prediction type of the current block indicated by the syntax element; and

encoding a residual block that is a difference between the current block and the prediction block,

wherein generating the prediction block for the current block by performing the MIP comprises:

encoding a syntax element indicating an MIP mode for the current block, the syntax element being represented as a truncated binary code specifying one of a plurality of MIP prediction modes allowed for a width and a height of the current block;

deriving an input boundary vector using neighboring samples adjacent to the current block based on the width and the height of the current block;

generating predicted samples for the current block based on matrix-vector multiplication between the input boundary vector and a matrix predefined for the MIP mode; and

deriving the prediction block for the current block based on the predicted samples,

wherein deriving the input boundary vector using the neighboring samples adjacent to the current block comprises:

generating an initial boundary vector filled with the neighboring samples adjacent to the current block or down-sampled values from the neighboring samples according to the width and the height of the current block; and

from the initial boundary vector, generating an input boundary vector to which the matrix-vector multiplication is applied, and

wherein generating the initial boundary vector comprises:

encoding a syntax element indicating a concatenation order of first entries of the initial boundary vector derived from the left neighboring samples adjacent to the current block and second entries of the initial boundary vector derived from the above neighboring samples adjacent to the current block; and

concatenating the first entries and the second entries according to the concatenation order and thereby generating the initial boundary vector.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 1, 2021
From: KANG, JE WON; PARK, SANG HYO; PARK, SEUNG WOOK; LIM, WHA PYEONG
To: HYUNDAI MOTOR COMPANY; KIA MOTORS CORPORATION; EWHA UNIVERSITY - INDUSTRY COLLABORATION FOUNDATION
Reel/Frame 058262/0988 →
Priority Claims (5)
KR 10-2019-0082130 · Jul 8, 2019 · national
KR 10-2019-0102494 · Aug 21, 2019 · national
KR 10-2019-0102495 · Aug 21, 2019 · national
KR 10-2019-0123492 · Oct 6, 2019 · national
KR 10-2020-0083979 · Jul 8, 2020 · national
Continuity (1)
Related Publication 20210314562A1 · Oct 7, 2021