IP Library › Granted Patent US 11,490,122
Granted Patent B2
US 11,490,122 · App. 17/322,258 · Granted Nov 1, 2022

Method and apparatus for video coding

Inventors: Madhu Peringassery Krishnan (Mountain View, CA); Xin Zhao (Santa Clara, CA); Shan Liu (San Jose, CA)
Assignee: Tencent America LLC
H04N19/60H04N19/124H04N19/132H04N19/176H04N19/18H04N19/46
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,490,122
App. No.
17/322,258
Granted
Nov 1, 2022
Kind
B2
Abstract

Aspects of the disclosure provide a method and an apparatus including processing circuitry for video decoding. The processing circuitry can decode coding information of a transform block (TB) from a coded video bitstream. The coding information can indicate a transform skip in one direction for the TB. The processing circuitry can de-quantize transform coefficients in the TB based on a plurality of quantization steps. First transform coefficients in the TB can be de-quantized based on a smallest of the plurality of quantization steps. The first transform coefficients in the TB can include one of a first row and a first column of the transform coefficients in the TB that has a DC spatial frequency. The one of the first row and the first column can be along the one direction of the transform skip. The processing circuitry can perform an inverse transform on the de-quantized transform coefficients in the TB.

Claims (91)

1. A method for video decoding in a decoder, comprising:

decoding coding information of a transform block (TB) from a coded video bitstream, the coding information indicating a transform skip in one direction for the TB;

de-quantizing transform coefficients in the TB based on a plurality of quantization steps, first transform coefficients in the TB being de-quantized based on a smallest of the plurality of quantization steps, the first transform coefficients in the TB including one of a first row and a first column of the transform coefficients in the TB that has a DC spatial frequency, the one of the first row and the first column being along the one direction of the transform skip; and

performing an inverse transform on the de-quantized transform coefficients in the TB.

2. The method of claim 1 , wherein

the one direction is a horizontal direction,

the one of the first row and the first column is the first row of the transform coefficients in the TB, and

the de-quantizing includes

de-quantizing the first row of the transform coefficients in the TB based on the smallest of the plurality of quantization steps, and

de-quantizing remaining rows of the transform coefficients in the TB based on another one of the plurality of quantization steps.

3. The method of claim 1 , wherein

the one direction is a horizontal direction,

the one of the first row and the first column is the first row of the transform coefficients in the TB, and

the de-quantizing includes

de-quantizing the first row and one or more additional rows of the transform coefficients in the TB that are adjacent to the first row based on the smallest of the plurality of quantization steps, the first transform coefficients in the TB further including the one or more additional rows of the transform coefficients in the TB, and

de-quantizing remaining rows of the transform coefficients in the TB based on another one of the plurality of quantization steps.

4. The method of claim 1 , wherein

the one direction is a vertical direction,

the one of the first row and the first column is the first column of the transform coefficients in the TB, and

the de-quantizing includes

de-quantizing the first column of the transform coefficients in the TB based on the smallest of the plurality of quantization steps, and

de-quantizing remaining columns of the transform coefficients in the TB based on another one of the plurality of quantization steps.

5. The method of claim 1 , wherein

the one direction is a vertical direction,

the one of the first row and the first column is the first column of the transform coefficients in the TB, and

the de-quantizing includes

de-quantizing the first column and one or more additional columns of the transform coefficients in the TB that are adjacent to the first column based on the smallest of the plurality of quantization steps, the first transform coefficients in the TB further including the one or more additional columns of the transform coefficients in the TB, and

de-quantizing remaining columns of the transform coefficients in the TB based on another one of the plurality of quantization steps.

6. The method of claim 1 , wherein

the decoding the coding information further includes decoding a flag, the flag indicating whether to de-quantize the first transform coefficients based on the smallest of the plurality of quantization steps; and

the first transform coefficients in the TB are de-quantized based on the smallest of the plural of quantization steps in response to the flag indicating that the first transform coefficients are to be de-quantized based on the smallest of the plurality of quantization steps.

7. The method of claim 6 , wherein the flag is associated with one of: the TB, a plurality of TBs including the TB, a coding tree block, and a tile.

8. The method of claim 6 , wherein the flag is indicated in one of a video parameter set (VPS), an sequence parameter set (SPS), an adaptive parameter set (APS), a picture parameter set (PPS), and a slice header.

9. The method of claim 1 , wherein a height and a width of the TB are 2 N and 2 M samples, respectively, N and M being integers larger than 1.

10. The method of claim 1 , wherein

the coding information further indicates that a quantization matrix is enabled,

the quantization matrix includes a respective element corresponding to each of the transform coefficients in the TB,

the elements in each row or column of the quantization matrix along the one direction having a same value, and

the method further includes obtaining the plurality of quantization steps based on initial quantization steps and the quantization matrix.

11. The method of claim 10 , wherein

the first transform coefficients correspond to one of the initial quantization steps,

remaining transform coefficients in the TB that correspond to one of (i) the remaining rows and (ii) the remaining columns in the TB that have AC spatial frequencies correspond to another one of the initial quantization steps, the one of (i) the remaining rows and (ii) the remaining columns in the TB being along the one direction, and

the obtaining the plurality of quantization steps includes

obtaining the smallest of the plurality of quantization steps based on the one of the initial quantization steps and a value of one of a first row and a first column of the quantization matrix, the one of the first row and the first column of the quantization matrix being along the one direction, and

obtaining remaining ones of the plurality of quantization steps for the one of the remaining rows and the remaining columns in the TB based on the other one of the initial quantization steps and respective values of one of remaining rows and remaining columns of the quantization matrix, the one of the remaining rows and the remaining columns of the quantization matrix being along the one direction.

12. The method of claim 10 , wherein

the first transform coefficients further include one of (i) one or more rows of the transform coefficients in the TB that are adjacent to the first row and (ii) one or more columns of the transform coefficients in the TB that are adjacent to the first column, the one of (i) the one or more rows and (ii) the one or more columns in the TB being along the one direction,

the first transform coefficients correspond to one of the initial quantization steps,

remaining transform coefficients in the TB correspond to another one of the initial quantization steps, and

the obtaining the plurality of quantization steps includes

obtaining the smallest of the plurality of quantization steps based on the one of the initial quantization steps and a value of one of a first row and a first column of the quantization matrix, the one of the first row and the first column of the quantization matrix being along the one direction.

13. An apparatus for video decoding, comprising processing circuitry configured to:

decode coding information of a transform block (TB) from a coded video bitstream, the coding information indicating a transform skip in one direction for the TB;

de-quantize transform coefficients in the TB based on a plurality of quantization steps, first transform coefficients in the TB being de-quantized based on a smallest of the plurality of quantization steps, the first transform coefficients in the TB including one of a first row and a first column of the transform coefficients in the TB that has a DC spatial frequency, the one of the first row and the first column being along the one direction of the transform skip; and

perform an inverse transform on the de-quantized transform coefficients in the TB.

14. The apparatus of claim 13 , wherein

the one direction is a horizontal direction,

the one of the first row and the first column is the first row of the transform coefficients in the TB, and

the processing circuitry is configured to:

de-quantize the first row of the transform coefficients in the TB based on the smallest of the plurality of quantization steps, and

de-quantize remaining rows of the transform coefficients in the TB based on another one of the plurality of quantization steps.

15. The apparatus of claim 13 , wherein

the one direction is a horizontal direction,

the one of the first row and the first column is the first row of the transform coefficients in the TB, and

the processing circuitry is configured to:

de-quantize the first row and one or more additional rows of the transform coefficients in the TB that are adjacent to the first row based on the smallest of the plurality of quantization steps, the first transform coefficients in the TB further including the one or more additional rows of the transform coefficients in the TB, and

de-quantize remaining rows of the transform coefficients in the TB based on another one of the plurality of quantization steps.

16. The apparatus of claim 13 , wherein

the one direction is a vertical direction,

the one of the first row and the first column is the first column of the transform coefficients in the TB, and

the processing circuitry is configured to:

de-quantize the first column of the transform coefficients in the TB based on the smallest of the plurality of quantization steps, and

de-quantize remaining columns of the transform coefficients in the TB based on another one of the plurality of quantization steps.

17. The apparatus of claim 13 , wherein

the one direction is a vertical direction,

the one of the first row and the first column is the first column of the transform coefficients in the TB, and

the processing circuitry is configured to:

de-quantize the first column and one or more additional columns of the transform coefficients in the TB that are adjacent to the first column based on the smallest of the plurality of quantization steps, the first transform coefficients in the TB further including the one or more additional columns of the transform coefficients in the TB, and

de-quantize remaining columns of the transform coefficients in the TB based on another one of the plurality of quantization steps.

18. The apparatus of claim 13 , wherein the processing circuitry is configured to:

decode a flag, the flag indicating whether to de-quantize the first transform coefficients based on the smallest of the plurality of quantization steps; and

de-quantize the first transform coefficients in the TB based on the smallest of the plural of quantization steps in response to the flag indicating that the first transform coefficients are to be de-quantized based on the smallest of the plurality of quantization steps.

19. The apparatus of claim 13 , wherein

the coding information further indicates that a quantization matrix is enabled,

the quantization matrix includes a respective element corresponding to each of the transform coefficients in the TB,

the elements in each row or column of the quantization matrix along the one direction having a same value, and

the processing circuitry is configured to obtain the plurality of quantization steps based on initial quantization steps and the quantization matrix.

20. A non-transitory computer-readable storage medium storing a program executable by at least one processor to perform:

decoding coding information of a transform block (TB) from a coded video bitstream, the coding information indicating a transform skip in one direction for the TB;

de-quantizing transform coefficients in the TB based on a plurality of quantization steps, first transform coefficients in the TB being de-quantized based on a smallest of the plurality of quantization steps, the first transform coefficients in the TB including one of a first row and a first column of the transform coefficients in the TB that has a DC spatial frequency, the one of the first row and the first column being along the one direction of the transform skip; and

performing an inverse transform on the de-quantized transform coefficients in the TB.

Assignments (2)
CORRECTIVE ASSIGNMENT TO CORRECT THE FIRST ASSIGNOR'S NAME PREVIOUSLY RECORDED ON REEL 056262 FRAME 0378. ASSIGNOR(S) HEREBY CONFIRMS THE ASSIGNMENT. Recorded Aug 13, 2021
From: KRISHNAN, MADHU PERINGASSERY; ZHAO, XIN; LIU, SHAN
To: TENCENT AMERICA LLC
Reel/Frame 057182/0531 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 17, 2021
From: KRISHNA, MADHU PERINGASSERY; ZHAO, XIN; LIU, SHAN
To: TENCENT AMERICA LLC
Reel/Frame 056262/0378 →
Continuity (2)
Provisional Application 63082812 · Sep 24, 2020
Related Publication 20220094983A1 · Mar 24, 2022