IP Library › Granted Patent US 11,503,292
Granted Patent B2
US 11,503,292 · App. 16/074,372 · Granted Nov 15, 2022

Method and apparatus for encoding/decoding video signal by using graph-based separable transform

Inventors: Hilmi E. Egilmez (Los Angeles, CA); Yung-Hsuan Chao (Los Angeles, CA); Antonio Ortega (Los Angeles, CA); Bumshik Lee (Seoul, KR); Sehoon Yea (Seoul, KR)
Assignees: LG Electronics Inc.; University of Southern California
H04N19/12H04N19/159H04N19/176H04N19/61
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,503,292
App. No.
16/074,372
Granted
Nov 15, 2022
Kind
B2
Abstract

The present invention provides a method for encoding a video signal on the basis of a graph-based separable transform (GBST), the method comprising the steps of: generating an incidence matrix representing a line graph; training a sample covariance matrix for rows and columns from the rows and columns of a residual signal; calculating a graph Laplacian matrix for rows and columns on the basis of the incidence matrix and the sample covariance matrix for rows and columns; and obtaining a GBST by performing eigen decomposition of the graph Laplacian matrix for rows and columns.

Claims (38)

1. A method for encoding a video signal based on a graph-based separable transform(GBST) by an apparatus, the method comprising:

generating prediction data for a current block;

generating residual data by subtracting the prediction data from an original data of the current block;

performing a transform on the residual data to obtain transform coefficients; and

performing a quantization and an entropy encoding on the transform coefficients,

wherein a step of performing the transform on the residual data includes

generating an incidence matrix corresponding to a line graph;

training a sample covariance matrix for a row and a column from a row and a column of the residual data;

calculating a graph Laplacian matrix for a row and a column based on the incidence matrix and the sample covariance matrix for the row and the column; and

obtaining the GBST by performing an eigen decomposition to the graph Laplacian matrix for the row and the column.

2. The method of claim 1 , wherein the graph Laplacian matrix for the row and the column is defined by a link weighting parameter and a recursive loop parameter.

3. The method of claim 1 , wherein two different Gaussian Markov Random fields (GMRFs) are used for modeling of inter residual data and intra residual data.

4. The method of claim 3 , wherein, in the case of the intra residual data, a one-dimensional GMRF comprises at least one of a distortion component of a reference sample, a Gaussian noise component of a current sample, or a spatial correlation coefficient.

5. The method of claim 3 , wherein, in the case of the inter residual data, a one-dimensional GMRF comprises at least one of a distortion component of a reference sample, a Gaussian noise component of a current sample, a temporal correlation coefficient, or a spatial correlation coefficient.

6. A method for decoding a video signal based on a graph-based separable transform (GBST) by an apparatus, the method comprising:

obtaining residual data from the video signal;

performing an inverse-transform on the residual data based on the GBST; and

generating a reconstruction signal based on the residual signalresidual data and prediction data,

wherein the GBST represents a graph-based transform generated based on two separable line graphs, which are obtained by a Gaussian Markov Random Field (GMRF) modelling of a row and a column of the residual data,

wherein the two separable line graphs have been generated based on row-wise and column-wise statistical properties of residual data in each prediction mode, and

wherein the GBST has been generated by performing an eigen decomposition to a graph Laplacian matrix based on an incidence matrix and a sample covariance matrix for the row and the column.

7. An apparatus for decoding a video signal based on a graph-based separable transform (GBST), the apparatus comprising:

a processor configured to

obtain residual data from the video signal;

perform an inverse transform on the residual data based on the GBST; and

generate a reconstruction signal based on the residual data and prediction data,

wherein the GBST corresponds to a graph-based transform generated based on two separable line graphs, which are obtained by GMRF modeling of a row and a column of the residual data,

wherein the two separable line graphs have been generated based on row-wise and column-wise statistical properties of residual data in each prediction mode, and

wherein the GBST has been generated by performing an eigen decomposition to a graph Laplacian matrix based on an incidence matrix and a sample covariance matrix for the row and the column.

8. A non-transitory computer-readable medium storing video information generated by performing the steps of:

generating prediction data for a current block;

generating residual data by subtracting the prediction data from an original data of the current block;

performing a transform on the residual data to obtain transform coefficients; and

performing a quantization and an entropy encoding on the transform coefficients,

wherein a step of performing the transform on the residual data includes generating an incidence matrix corresponding to a line graph;

training a sample covariance matrix for a row and a column from a row and a column of the residual data;

calculating a graph Laplacian matrix for a row and a column based on the incidence matrix and the sample covariance matrix for the row and the column; and

obtaining a graph-based separable transform(GBST) by performing an eigen decomposition to the graph Laplacian matrix for the row and the column.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Feb 7, 2019
From: EGILMEZ, HILMI E.; CHAO, YUNG-HSUAN; ORTEGA, ANTONIO; LEE, BUMSHIK
To: LG ELECTRONICS INC.; UNIVERSITY OF SOUTHERN CALIFORNIA
Reel/Frame 048267/0816 →
Continuity (2)
Provisional Application 62289911 · Feb 1, 2016
Related Publication 20210243441A1 · Aug 5, 2021