IP Library Granted Patent US 11,039,139
Granted Patent B2
US 11,039,139 · App. 16/393,289 · Granted Jun 15, 2021

Method and apparatus for identity transform in multiple transform selection

Inventors: Xin Zhao (San Diego, CA); Xiang Li (Los Gatos, CA); Shan Liu (San Jose, CA)
Assignee: TENCENT AMERICA LLC
H04N19/122H04N19/176H04N19/18H04N19/625
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,039,139
App. No.
16/393,289
Granted
Jun 15, 2021
Kind
B2
Abstract

A method of controlling residual coding for decoding or encoding of a video sequence, is performed by at least one processor and includes determining whether to replace a transform type of Multiple Transform Selection (MTS) by using Identity transform (IDT), based on whether either one or both of a block height and a block width meet a predetermined condition; and based on either one or both of the block height and the block width meeting the predetermined condition, replacing the transform type of MTS by using the IDT and keeping a syntax of the MTS unchanged, and the IDT is a linear transform process using an N×N transform core in which each coefficient is non-zero along a diagonal position, and wherein N is an integer.

Claims (31)

1. A method of controlling residual coding for decoding or encoding of a video sequence, the method being performed by at least one processor, and the method comprising:

determining whether to replace a transform type of Multiple Transform Selection (MTS) by using Identity transform (IDT), based on determining whether either one or both of a block height and a block width meet a predetermined condition; and

based on determining that either one or both of the block height and the block width meet the predetermined condition, replacing the transform type of MTS by using the IDT and keeping a syntax of the MTS unchanged,

wherein the IDT is a linear transform process using an N×N transform core in which each coefficient of a main diagonal of the N×N transform core is non-zero and each coefficient of the N×N transform core, other than the main diagonal, is zero, and wherein N is an integer.

2. The method of claim 1 , wherein the transform type of the MTS is discrete cosine transform DCT-4 or DCT-8.

3. The method of claim 1 , wherein the transform type of the MTS is applied as a horizontal transform and the predetermined condition is that the block width is smaller than a predetermined threshold.

4. The method of claim 3 , wherein the predetermined threshold is one from among 2, 4, 8, 16, 32, 64, 128, and 156.

5. The method of claim 1 , wherein the transform type of the MTS is applied as a vertical transform and the predetermined condition is that the block height is smaller than a predetermined threshold.

6. The method of claim 5 , wherein the predetermined threshold is one from among 2, 4, 8, 16, 32, 64, 128, and 156.

7. The method of claim 1 , wherein the predetermined condition is that the transform type of the MTS is used on a horizontal direction or a vertical direction, but is not used on both the horizontal direction and the vertical direction.

8. An apparatus for controlling residual coding for decoding or encoding of a video sequence, the apparatus comprising:

at least one non-transitory computer readable medium that stores computer program code; and

at least one processor configured to access the at least one non-transitory computer readable medium and operate according to the computer program code, the computer program code comprising:

determining code configured to cause the at least one processor to determine whether to replace a transform type of Multiple Transform Selection (MTS) by using Identity transform (IDT), based on determining whether either one or both of a block height and a block width meet a predetermined condition; and

replacing code configured to cause the at least one processor to, based on determining that either one or both of the block height and the block width meet the predetermined condition, replace the transform type of MTS by using the IDT and keeping a syntax of the MTS unchanged,

wherein the IDT is a linear transform process using an N×N transform core in which each coefficient of a main diagonal of the N×N transform core is non-zero and each coefficient of the N×N transform core, other than the main diagonal, is zero, and wherein N is an integer.

9. The apparatus of claim 8 , wherein the transform type of the MTS is discrete cosine transform DCT-4 or DCT-8.

10. The apparatus of claim 8 , wherein the transform type of the MTS is applied as a horizontal transform and the predetermined condition is that the block width is smaller than a predetermined threshold.

11. The apparatus of claim 10 , wherein the predetermined threshold is one from among 2, 4, 8, 16, 32, 64, 128, and 156.

12. The apparatus of claim 8 , wherein the transform type of the MTS is applied as a vertical transform and the predetermined condition is that the block height is smaller than a predetermined threshold.

13. The apparatus of claim 12 , wherein the predetermined threshold is one from among 2, 4, 8, 16, 32, 64, 128, and 156.

14. The apparatus of claim 8 , wherein the predetermined condition is that the transform type of the MTS is used on a horizontal direction or a vertical direction, but is not used on both the horizontal direction and the vertical direction.

15. A non-transitory computer-readable storage medium storing instructions that cause at least one processor to:

determine whether to replace a transform type of Multiple Transform Selection (MTS) by using Identity transform (IDT), based on determining whether either one or both of a block height and a block width meet a predetermined condition; and

based on determining that either one or both of the block height and the block width meet the predetermined condition, replace the transform type of MTS by using the IDT and keeping a syntax of the MTS unchanged,

wherein the IDT is a linear transform process using an N×N transform core in which each coefficient of a main diagonal of the N×N transform core is non-zero and each coefficient of the N×N transform core, other than the main diagonal, is zero, and wherein N is an integer.

16. The non-transitory computer-readable storage medium of claim 15 , wherein the transform type of the MTS is discrete cosine transform DCT-4 or DCT-8.

17. The non-transitory computer-readable storage medium of claim 15 , wherein the transform type of the MTS is applied as a horizontal transform and the predetermined condition is that the block width is smaller than a predetermined threshold.

18. The non-transitory computer-readable storage medium of claim 17 , wherein the predetermined threshold is one from among 2, 4, 8, 16, 32, 64, 128, and 156.

19. The non-transitory computer-readable storage medium of claim 15 , wherein the transform type of the MTS is applied as a vertical transform and the predetermined condition is that the block height is smaller than a predetermined threshold.

20. The non-transitory computer-readable storage medium of claim 19 , wherein the predetermined threshold is one from among 2, 4, 8, 16, 32, 64, 128, and 156.

Assignments (4)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 24, 2020
From: ZHAO, XIN
To: TENCENT AMERICA LLC
Reel/Frame 053872/0238 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 24, 2020
From: LI, XIANG
To: TENCENT AMERICA LLC
Reel/Frame 053872/0432 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 24, 2020
From: LIU, SHAN
To: TENCENT AMERICA LLC
Reel/Frame 053872/0749 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 24, 2019
From: ZHAO, XIN; LI, XIANG; LIU, SHAN
To: TENCENT AMERICA LLC
Reel/Frame 048984/0709 →
Continuity (2)
Provisional Application 62731773 · Sep 14, 2018
Related Publication 20200092555A1 · Mar 19, 2020
Cited By (2)
US 12,323,625 US 12,375,650