IP Library Granted Patent US 11,909,962
Granted Patent B2
US 11,909,962 · App. 17/520,031 · Granted Feb 20, 2024

Method and apparatus for intra-prediction coding of video data involving matrix-based intra-prediction

Inventors: Je Won Kang (Seoul, KR); Sang Hyo Park (Seoul, KR); Seung Wook Park (Gyeonggi-do, KR); Wha Pyeong Lim (Gyeonggi-do, KR)
Assignees: Hyundai Motor Company; Kia Corporation; Ewha University—Industry Collaboration Foundation
H04N19/11H04N19/105H04N19/139H04N19/159H04N19/167H04N19/176H04N19/70
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,909,962
App. No.
17/520,031
Granted
Feb 20, 2024
Kind
B2
Abstract

An apparatus for decoding video data includes a decoder configured to decode, from a bitstream, a syntax element indicating an intra-prediction type of a current block of the video data, and an intra-predictor configured to generate a prediction block for the current block by selectively performing matrix based intra-prediction (MIP) or regular intra-prediction based on the intra-prediction type of the current block indicated by the syntax element.

Claims (55)

1. An apparatus for decoding video data, comprising:

a decoder configured to decode, from a bitstream, a syntax element indicating an intra-prediction type of a current block of the video data, the intra-prediction type being indicated from among matrix based intra-prediction (MIP) and regular intra-prediction; and

an intra-predictor configured to generate a prediction block for the current block by selectively performing the MIP or the regular intra-prediction based on the intra-prediction type of the current block indicated by the syntax element,

wherein, in generating the prediction block for the current block by performing the MIP, the intra-predictor is configured to:

decode, from the bitstream, a syntax element indicating an MIP mode for the current block, the syntax element being represented as a truncated binary code specifying one of a plurality of MIP prediction modes allowed for a width and a height of the current block;

derive an input boundary vector using neighboring samples adjacent to the current block based on the width and the height of the current block;

generate predicted samples for the current block based on matrix-vector multiplication between the input boundary vector and a matrix predefined for the MIP mode; and

derive the prediction block for the current block based on the predicted samples,

wherein deriving the input boundary vector using the neighboring samples adjacent to the current block comprises:

generating an initial boundary vector filled with the neighboring samples adjacent to the current block or down-sampled values from the neighboring samples according to the width and the height of the current block; and

from the initial boundary vector, generating an input boundary vector to which the matrix-vector multiplication is applied, and

wherein the input boundary vector is generated by subtracting a value of a first entry from each entry of the initial boundary vector.

2. The apparatus of claim 1 , wherein generating the initial boundary vector comprises:

decoding, from the bitstream, a syntax element indicating a concatenation order of first entries of the initial boundary vector derived from the left neighboring samples adjacent to the current block and second entries of the initial boundary vector derived from the above neighboring samples adjacent to the current block; and

concatenating the first entries and the second entries according to the concatenation order and thereby generating the initial boundary vector.

3. The apparatus of claim 1 , wherein deriving the prediction block for the current block based on the predicted samples comprises:

allocating the predicted samples to positions in the prediction block; and

generating predicted sample values for positions to which the predicted samples are not allocated in the prediction block, by performing horizontal interpolation and vertical interpolation on the predicted samples, left neighboring samples adjacent to the current block, and above neighboring samples adjacent to the current block.

4. The apparatus of claim 3 , wherein the horizontal interpolation is performed prior to the vertical interpolation.

5. The apparatus of claim 3 , wherein, before the horizontal interpolation and the vertical interpolation are performed, clipping is performed on the predicted samples such that the predicted samples lie between 0 and 2bitDepth −1.

6. The apparatus of claim 1 , wherein the current block is a luma block composed of a luma component,

wherein, when the MIP is performed on the luma block, and the intra-prediction mode of the luma block is used as an intra-prediction mode of a chroma block corresponding to the luma block, an intra-prediction mode of the chroma block is set as a PLANAR mode.

7. The apparatus of claim 1 , wherein, in generating the prediction block for the current block by performing the regular intra-prediction, the intra-predictor is configured to:

derive Most Probable Mode (MPM) candidates based on a regular intra-prediction mode of neighboring blocks adjacent to the current block and thereby configuring an MPM list for the current block; and

derive a regular intra-prediction mode for the current block based on the MPM list,

wherein, when an intra-prediction type of the neighboring blocks is the MIP, the regular intra-prediction mode of the neighboring block is regarded as a PLANAR mode.

8. An apparatus of encoding video data, comprising:

an encoder configured to encode a syntax element indicating an intra-prediction type of a current block of the video data, the intra-prediction type being indicated from among matrix based intra-prediction (MIP) and regular intra-prediction, and to encode a residual block that is a difference between the current block and a prediction block;

an intra-predictor configured to generate the prediction block for the current block by selectively performing the MIP or the regular intra-prediction based on the intra-prediction type of the current block indicated by the syntax element; and

wherein, in generating the prediction block for the current block by performing the MIP, the intra-predictor is configured to:

encode a syntax element indicating an MIP mode for the current block, the syntax element being represented as a truncated binary code specifying one of a plurality of MIP prediction modes allowed for a width and a height of the current block;

derive an input boundary vector using neighboring samples adjacent to the current block based on the width and the height of the current block;

generate predicted samples for the current block based on matrix-vector multiplication between the input boundary vector and a matrix predefined for the MIP mode; and

derive the prediction block for the current block based on the predicted samples,

wherein deriving the input boundary vector using the neighboring samples adjacent to the current block comprises:

generating an initial boundary vector filled with the neighboring samples adjacent to the current block or down-sampled values from the neighboring samples according to the width and the height of the current block; and

wherein the input boundary vector is generated by subtracting a value of a first entry from each entry of the initial boundary vector.

9. The apparatus of claim 8 , wherein generating the initial boundary vector comprises:

encoding a syntax element indicating a concatenation order of first entries of the initial boundary vector derived from the left neighboring samples adjacent to the current block and second entries of the initial boundary vector derived from the above neighboring samples adjacent to the current block; and

concatenating the first entries and the second entries according to the concatenation order and thereby generating the initial boundary vector.

10. A non-transitory computer readable medium storing a bitstream containing encoded data for video data, the bitstream being decoded by processes of:

decoding, from a bitstream, a syntax element indicating an intra-prediction type of a current block of the video data, the intra-prediction type being indicated from among matrix based intra-prediction (MIP) and regular intra-prediction; and

generating a prediction block for the current block by selectively performing the MIP or the regular intra-prediction based on the intra-prediction type of the current block indicated by the syntax element,

wherein generating the prediction block for the current block by performing the MIP comprises:

decoding, from the bitstream, a syntax element indicating an MIP mode for the current block, the syntax element being represented as a truncated binary code specifying one of a plurality of MIP prediction modes allowed for a width and a height of the current block;

deriving an input boundary vector using neighboring samples adjacent to the current block based on the width and the height of the current block;

generating predicted samples for the current block based on matrix-vector multiplication between the input boundary vector and a matrix predefined for the MIP mode; and

deriving the prediction block for the current block based on the predicted samples,

wherein deriving the input boundary vector using the neighboring samples adjacent to the current block comprises:

generating an initial boundary vector filled with the neighboring samples adjacent to the current block or down-sampled values from the neighboring samples according to the width and the height of the current block; and

from the initial boundary vector, generating an input boundary vector to which the matrix-vector multiplication is applied, and

wherein the input boundary vector is generated by subtracting a value of a first entry from each entry of the initial boundary vector.

11. The non-transitory computer readable medium of claim 10 , wherein generating the initial boundary vector comprises:

decoding, from the bitstream, a syntax element indicating a concatenation order of first entries of the initial boundary vector derived from the left neighboring samples adjacent to the current block and second entries of the initial boundary vector derived from the above neighboring samples adjacent to the current block; and

concatenating the first entries and the second entries according to the concatenation order and thereby generating the initial boundary vector.

Assignments (1)
CHANGE OF NAME Recorded Nov 14, 2022
From: KIA MOTORS CORPORATION
To: KIA CORPORATION
Reel/Frame 061934/0867 →
Priority Claims (5)
KR 10-2019-0082130 · Jul 8, 2019 · national
KR 10-2019-0102494 · Aug 21, 2019 · national
KR 10-2019-0102495 · Aug 21, 2019 · national
KR 10-2019-0123492 · Oct 6, 2019 · national
KR 10-2020-0083979 · Jul 8, 2020 · national
Continuity (2)
Continuation 17276540
Related Publication 20220078413A1 · Mar 10, 2022