IP Library Granted Patent US 11,838,541
Granted Patent B2
US 11,838,541 · App. 16/940,692 · Granted Dec 5, 2023

Matrix weighted intra prediction of video signals

Inventors: Xinwei Li (San Mateo, CA); Ru-Ling Liao (Beijing, CN); Yamei Chen (Beijing, CN); Jie Chen (Beijing, CN); Yan Ye (San Mateo, CA); Jiancong Luo (San Mateo, CA)
Assignee: Alibaba Group Holding Limited
H04N19/593H04N19/176
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,838,541
App. No.
16/940,692
Granted
Dec 5, 2023
Kind
B2
Abstract

The present disclosure provides methods for performing simplified matrix weighted intra prediction. The method can include: determining a classification of a target block; and generating, based on the classification, a matrix-weighted intra prediction (MIP) signal, wherein determining the classification of the target block comprises: in response to the target block having a size of 4×4, determining that the target block belongs to a first class; or in response to the target block having a size of 8×8, 4×N or N×4, N being an integer between 8 and 64, determining that the target block belongs to a second class.

Claims (49)

1. A computer-implemented method for processing video content, the method implemented in an encoder and comprising:

determining a classification of a target block, wherein:

the target block is classified into a first class when the target block has a size of 4×4,

the target block is classified into a second class when the target block has a size of 8×8, 4×8, or 8×4, and

the target block is classified into the second class when the target block has a size of 4×N or N×4, wherein N is 16, 32, or 64; and

generating, based on the classification, a matrix-weighted intra prediction (MIP) signal.

2. The method according to claim 1 , wherein generating the MIP signal comprises:

generating a first intra prediction signal for the target block, the generating of the first intra prediction signal being based on an input vector, a matrix, and the classification of the target block; and

performing bilinear interpolation on the target block using the first intra prediction signal, to generate the MIP signal.

3. The method according to claim 1 , further comprising:

averaging, according to the classification of the target block, neighboring reconstructed samples of the target block, to generate the input vector.

4. The method according to claim 2 , wherein the input vector has a size of 4×1 when the target block belongs to the first class or a size of 8×1 when the target block belongs to the second class.

5. The method according to claim 2 , wherein the matrix is selected from a set of matrices, according to the classification of the target block and an MIP mode index.

6. The method according to claim 5 , wherein the first intra prediction signal is generated by performing matrix vector multiplication on the matrix and the input vector.

7. The method according to claim 6 , wherein the first intra prediction signal is generated based on one or more offsets associated with the matrix.

8. The method according to claim 7 , wherein the one or more offsets are determined based on an index of the matrix in a lookup table.

9. The method according to claim 1 , wherein determining the classification of the target block further comprises:

in response to the target block having a size other than 4×4, 8×8, 4×N, and N×4, determining that the target block belongs to a third class.

10. The method according to claim 9 , wherein generating the first intra prediction signal for the target block comprises:

in response to the target block belonging to the first class or the second class, determining that the first intra prediction signal has a size of 4×4; and

in response to the target block belonging to the third class, determining that the first intra prediction signal has a size of 8×8.

11. A system for processing video content, the system implemented in a decoder and comprising:

a memory for storing a set of instructions; and

at least one processor configured to execute the set of instructions for causing the system to perform:

determining a classification of a target block, wherein:

the target block is classified into a first class when the target block has a size of 4×4,

the target block is classified into a second class when the target block has a size of 8×8, 4×8, or 8×4, and

the target block is classified into the second class when the target block has a size of 4×N or N×4, wherein N is 16, 32, or 64; and

generating, based on the classification, a matrix-weighted intra prediction (MIP) signal.

12. The system according to claim 11 , wherein in generating the MIP signal, the at least one processor is further configured to execute the set of instructions for causing the system to further perform:

generating a first intra prediction signal for the target block, the generating of the first intra prediction signal being based on an input vector, a matrix, and the classification of the target block; and

performing bilinear interpolation on the target block using the first intra prediction signal, to generate the MIP signal.

13. The system according to claim 11 , wherein the at least one processor is further configured to execute the set of instructions for causing the system to further perform:

averaging, according to the classification of the target block, neighboring reconstructed samples of the target block, to generate the input vector.

14. The system according to claim 12 , wherein the input vector has a size of 4×1 when the target block belongs to the first class or a size of 8×1 when the target block belongs to the second class.

15. The system according to claim 11 , wherein the matrix is selected from a set of matrices, according to the classification of the target block and an MIP mode index.

16. The system according to claim 15 , wherein the first intra prediction signal is generated by performing matrix vector multiplication on the matrix and the input vector.

17. The system according to claim 16 , wherein the first intra prediction signal is generated based on one or more offsets associated with the matrix.

18. The system according to claim 17 , wherein the one or more offsets are determined based on an index of the matrix in a lookup table.

19. A non-transitory computer readable medium that stores a bitstream generated according to a method for processing video content, the method comprising:

determining a classification of a target block, wherein:

the target block is classified into a first class when the target block has a size of 4×4,

the target block is classified into a second class when the target block has a size of 8×8, 4×8, or 8×4, and

the target block is classified into the second class when the target block has a size of 4×N or N×4, wherein N is 16, 32, or 64; and

generating, based on the classification, a matrix-weighted intra prediction (MIP) signal.

20. The method according to claim 9 , wherein generating the first intra prediction signal for the target block comprises:

in response to the target block belonging to the first class, determining that the input vector has a size of 4×1;

in response to the target block belonging to the second class, determining that the input vector has a size of 8×1; or

in response to the target block belonging to the third class, determining that the input vector has a size of 7×1.

Assignments (3)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 4, 2026
From: ALIBABA INNOVATION PRIVATE LIMITED
To: HFI INNOVATION INC.
Reel/Frame 075499/0876 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Feb 12, 2026
From: ALIBABA GROUP HOLDING LIMITED
To: ALIBABA INNOVATION PRIVATE LIMITED
Reel/Frame 074832/0914 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Oct 23, 2020
From: LI, XINWEI; LIAO, RU-LING; CHEN, YAMEI; CHEN, JIE; YE, YAN; LUO, JIANCONG
To: ALIBABA GROUP HOLDING LIMITED
Reel/Frame 054154/0985 →
Continuity (2)
Provisional Application 62894489 · Aug 30, 2019
Related Publication 20210067803A1 · Mar 4, 2021