IP Library › Granted Patent US 12,047,593
Granted Patent B2
US 12,047,593 · App. 17/234,507 · Granted Jul 23, 2024

Method and apparatus for video coding

Inventors: Liang Zhao (Sunnyvale, CA); Xin Zhao (Santa Clara, CA); Madhu Peringassery Krishnan (Mountain View, CA); Shan Liu (San Jose, CA)
Assignee: TENCENT AMERICA LLC
H04N19/44H04N19/119H04N19/132H04N19/176H04N19/60
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,047,593
App. No.
17/234,507
Granted
Jul 23, 2024
Kind
B2
Abstract

Aspects of the disclosure provide methods and apparatuses for video encoding/decoding. In some examples, an apparatus for video decoding includes processing circuitry. The processing circuitry decodes from a coded video bitstream, transform coefficients associated with a coding block that is a non rectangular partition of a picture. Further, the processing circuitry determines residuals of the coding block based on the transform coefficients, and reconstructs samples of the coding block based on the residuals of the coding block.

Claims (65)

1. A method for video decoding in a decoder, comprising:

decoding, by a processor and from a coded video bitstream, transform coefficients associated with a coding block that is an L-shaped partition of a picture;

partitioning the L-shaped partition of the picture into a plurality of rectangular sub-blocks based on a determination that the coding block is the L-shaped partition, each corner of the L-shaped partition being a right angle;

determining, by the processor, residuals of each of the plurality of rectangular sub-blocks in the coding block based on the transform coefficients of the respective rectangular sub-block; and

reconstructing, by the processor, samples of the coding block based on the residuals of the coding block.

2. The method of claim 1 , further comprising:

determining, by the processor, first residuals of a first rectangular sub-block of the plurality of rectangular sub-blocks based on first transform coefficients in the transform coefficients, the first rectangular sub-block being a first partition of the L-shaped partition.

3. The method of claim 2 , further comprising:

determining, by the processor, second residuals of a second rectangular sub-block of the plurality of rectangular sub-blocks based on second transform coefficients in the transform coefficients, the second rectangular sub-block being a second partition of the L-shaped partition and having a same size as the first rectangular sub-block.

4. The method of claim 2 , further comprising:

determining, by the processor, second residuals of a second rectangular sub-block of the plurality of rectangular sub-blocks based on second transform coefficients in the transform coefficients, the second rectangular sub-block being a second partition of the L-shaped partition and having a different size from the first rectangular sub-block.

5. The method of claim 1 , further comprising:

determining intermediate transform coefficients of an intermediate transform unit by performing inverse transform of a transform unit in a first direction, the transform unit being formed by the transform coefficients; and

determining the residuals of the coding block by performing inverse transform of the intermediate transform unit in a second direction.

6. The method of claim 5 , further comprising:

performing, first inverse transform operations respectively on first columns of the transform unit, the first inverse transform operations respectively being a first number of points inverse transform;

performing, second inverse transform operations respectively on second columns of the transform unit, the second inverse transform operations respectively being a second number of points inverse transform;

performing, third inverse transform operations respectively on first rows of the intermediate transform unit, the third inverse transform operations respectively being a third number of points inverse transform; and

performing, fourth inverse transform operations respectively on second rows of the intermediate transform unit, the fourth inverse transform operations respectively being a fourth number of points inverse transform.

7. The method of claim 5 , further comprising:

performing, first inverse transform operations respectively on first rows of the transform unit, the first inverse transform operations respectively being a first number of points inverse transform;

performing, second inverse transform operations respectively on second rows of the transform unit, the second inverse transform operations respectively being a second number of points inverse transform;

performing, third inverse transform operations respectively on first columns of the intermediate transform unit, the third inverse transform operations respectively being a third number of points inverse transform; and

performing, fourth inverse transform operations respectively on second columns of the intermediate transform unit, the fourth inverse transform operations respectively being a fourth number of points inverse transform.

8. The method of claim 1 , further comprising:

determining, by the processor, the residuals of the coding block by performing an inverse Karhunen-Loeve transform (KLT) of the transform coefficients.

9. The method of claim 1 , further comprising:

determining, by the processor, first residuals of a rectangular unit that includes the L-shaped partition by performing 2-dimensional inverse transform of the transform coefficients; and

selecting, by the processor, the residuals of the coding block from the first residuals of the rectangular unit.

10. The method of claim 1 , further comprising:

forming a transform unit for the L-shaped partition by following a scan order for a rectangular unit that encompasses the L-shaped partition; and

skipping a scan position that is out of the L-shaped partition.

11. An apparatus for video decoding, comprising:

processing circuitry configured to:

decode from a coded video bitstream, transform coefficients associated with a coding block that is an L-shaped partition of a picture;

partition the L-shaped partition of the picture into a plurality of rectangular sub-blocks based on a determination that the coding block is the L-shaped partition, each corner of the L-shaped partition being a right angle;

determine residuals of each of the plurality of rectangular sub-blocks in the coding block based on the transform coefficients of the respective rectangular sub-block; and

reconstruct samples of the coding block based on the residuals of the coding block.

12. The apparatus of claim 11 , wherein the processing circuitry is further configured to:

determine first residuals of a first rectangular sub-block of the plurality of rectangular sub-blocks based on first transform coefficients in the transform coefficients, the first rectangular sub-block being a first partition of the L-shaped partition.

13. The apparatus of claim 12 , wherein the processing circuitry is further configured to:

determine second residuals of a second rectangular sub-block of the plurality of rectangular sub-blocks based on second transform coefficients in the transform coefficients, the second rectangular sub-block being a second partition of the L-shaped partition and having a same size as the first rectangular sub-block.

14. The apparatus of claim 12 , wherein the processing circuitry is further configured to:

determine second residuals of a second rectangular sub-block of the plurality of rectangular sub-blocks based on second transform coefficients in the transform coefficients, the second rectangular sub-block being a second partition of the L-shaped partition and having a different size from the first rectangular sub-block.

15. The apparatus of claim 11 , wherein the processing circuitry is further configured to:

determine intermediate transform coefficients of an intermediate transform unit by performing inverse transform of a transform unit in a first direction, the transform unit being formed by the transform coefficients; and

determine the residuals of the coding block by performing inverse transform of the intermediate transform unit in a second direction.

16. The apparatus of claim 15 , wherein the processing circuitry is further configured to:

perform, first inverse transform operations respectively on first columns of the transform unit, the first inverse transform operations respectively being a first number of points inverse transform;

perform, second inverse transform operations respectively on second columns of the transform unit, the second inverse transform operations respectively being a second number of points inverse transform;

perform, third inverse transform operations respectively on first rows of the intermediate transform unit, the third inverse transform operations respectively being a third number of points inverse transform; and

perform, fourth inverse transform operations respectively on second rows of the intermediate transform unit, the fourth inverse transform operations respectively being a fourth number of points inverse transform.

17. The apparatus of claim 15 , wherein the processing circuitry is further configured to:

perform, first inverse transform operations respectively on first rows of the transform unit, the first inverse transform operations respectively being a first number of points inverse transform;

perform, second inverse transform operations respectively on second rows of the transform unit, the second inverse transform operations respectively being a second number of points inverse transform;

perform, third inverse transform operations respectively on first columns of the intermediate transform unit, the third inverse transform operations respectively being a third number of points inverse transform; and

perform, fourth inverse transform operations respectively on second columns of the intermediate transform unit, the fourth inverse transform operations respectively being a fourth number of points inverse transform.

18. The apparatus of claim 11 , wherein the processing circuitry is further configured to:

determine the residuals of the coding block by performing an inverse Karhunen-Loeve transform (KLT) of the transform coefficients.

19. The apparatus of claim 11 , wherein the processing circuitry is further configured to:

determine first residuals of a rectangular unit that includes the L-shaped partition by performing 2-dimensional inverse transform of the transform coefficients; and

select the residuals of the coding block from the first residuals of the rectangular unit.

20. The apparatus of claim 11 , wherein the processing circuitry is further configured to:

form a transform unit for the L-shaped partition by following a scan order for a rectangular unit that encompasses the L-shaped partition; and

skip a scan position that is out of the L-shaped partition.

Assignments (4)
CORRECTIVE ASSIGNMENT TO CORRECT THE THIRD INVENTOR'S NAME PREVIOUSLY RECORDED AT REEL: 060158 FRAME: 0121. ASSIGNOR(S) HEREBY CONFIRMS THE ASSIGNMENT . Recorded Jul 12, 2022
From: ZHAO, LIANG; ZHAO, XIN; PERINGASSERY KRISHNAN, MADHU; LIU, SHAN
To: TENCENT AMERICA LLC
Reel/Frame 060635/0032 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 10, 2022
From: ZHAO, LIANG; ZHAO, XIN; KRISHNA, MADHU PERINGASSERY; LIU, SHAN
To: TENCENT AMERICA LLC
Reel/Frame 060158/0121 →
CORRECTIVE ASSIGNMENT TO CORRECT THE THIRD ASSIGNOR'S NAME PREVIOUSLY RECORDED ON REEL 055963 FRAME 0056. ASSIGNOR(S) HEREBY CONFIRMS THE ASSIGNMENT. Recorded Aug 13, 2021
From: ZHAO, LIANG; ZHAO, XIN; KRISHNAN, MADHU PERINGASSERY; LIU, SHAN
To: TENCENT AMERICA LLC
Reel/Frame 057182/0639 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 19, 2021
From: ZHAO, LIANG; ZHAO, XIN; KRISHNA, MADHU PERINGASSERY; LIU, SHAN
To: TENCENT AMERICA LLC
Reel/Frame 055963/0056 →
Continuity (2)
Provisional Application 63087042 · Oct 2, 2020
Related Publication 20220109863A1 · Apr 7, 2022