IP Library › Granted Patent US 12,166,984
Granted Patent B2
US 12,166,984 · App. 17/541,013 · Granted Dec 10, 2024

Applicability of implicit transform selection

Inventors: Kai Zhang (San Diego, CA); Li Zhang (San Diego, CA); Hongbin Liu (Beijing, CN); Yue Wang (Beijing, CN)
Assignees: BEIJING BYTEDANCE NETWORK TECHNOLOGY CO., LTD.; BYTEDANCE INC.
H04N19/12H04N19/159H04N19/176H04N19/61H04N19/625
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,166,984
App. No.
17/541,013
Granted
Dec 10, 2024
Kind
B2
Abstract

Devices, systems and methods for digital video coding, which includes using multiple transforms, are described. In a representative aspect, a method for video processing includes making a decision, for a current block of a video, regarding an application of a transform to the current block based on an indication in a bitstream representation of the video at a coding unit (CU) level, a coding block (CB) level, or a transform unit (TU) level, and performing, based on the decision, a conversion between the current block and the bitstream representation.

Claims (38)

1. A method of processing video data, comprising:

making a decision, based on coding information associated with a current block of a video, regarding an application of an implicit selected transform of a multiple transform selection process for a primary transform to the current block; and

performing, based on the decision, a conversion between the current block and a bitstream of the video,

wherein the implicit selected transform is not applied to the current block when the current block is an intra-coded block with a derived tree (DT),

wherein, in response to the implicit selected transform being applied to the current block, one or more transform matrices applied to the current block comprising at least one of a horizontal transform matrix or a vertical transform matrix are based on a set of representative coefficients of the current block.

2. The method of claim 1 , wherein the implicit selected transform is applied under at least one condition including that the current block is an intra-coded block or an inter-coded block.

3. The method of claim 1 , wherein the implicit selected transform is applied under at least one condition including that a height and a width of the current block is no greater than a threshold (T), and wherein T is a positive integer.

4. The method of claim 3 , wherein T=32.

5. The method of claim 1 , wherein the set of representative coefficients correspond to a dequantized version.

6. The method of claim 1 , wherein the one or more transform matrices is determined at a transform unit (TU) level.

7. The method of claim 1 , wherein the one or more transform matrices is based on a function of the set of representative coefficients, and an output of the function is a number of the set of representative coefficients.

8. The method of claim 7 , wherein the horizontal transform matrix comprises a first transform matrix and the vertical transform matrix comprises a second transform matrix when the number is even, and wherein the horizontal transform matrix comprises a third transform matrix and the vertical transform matrix comprises a fourth transform matrix when the number is odd.

9. The method of claim 8 , wherein the first transform matrix and the second transform matrix are a Discrete Sine Transform (DST) of Type VII (DST-VII), and the third transform matrix and the fourth transform matrix are a Discrete Cosine Transform (DCT) of Type II (DCT-II).

10. The method of claim 1 , wherein the conversion includes encoding the current block into the bitstream.

11. The method of claim 1 , wherein the conversion includes decoding the current block from the bitstream.

12. An apparatus for processing video data comprising a processor and a non-transitory memory with instructions thereon, wherein the instructions upon execution by the processor, cause the processor to:

make a decision, based on coding information associated with a current block of a video, regarding an application of an implicit selected transform of a multiple transform selection process for a primary transform to the current block; and

perform, based on the decision, a conversion between the current block and a bitstream of the video,

wherein the implicit selected transform is not applied to the current block when the current block is an intra-coded block with a derived tree (DT),

wherein, in response to the implicit selected transform being applied to the current block, one or more transform matrices applied to the current block comprising at least one of a horizontal transform matrix or a vertical transform matrix are based on a set of representative coefficients of the current block.

13. The apparatus of claim 12 , wherein the implicit selected transform is applied under at least one condition including that a height and a width of the current block is no greater than a threshold (T), and wherein T is a positive integer, T=32.

14. The apparatus of claim 12 ,

wherein the set of representative coefficients correspond to a dequantized version and wherein the one or more transform matrices is determined at a transform unit (TU) level.

15. A non-transitory computer-readable storage medium storing instructions that cause a processor to:

make a decision, based on coding information associated with a current block of a video, regarding an application of an implicit selected transform of a multiple transform selection process for a primary transform to the current block; and

perform, based on the decision, a conversion between the current block and a bitstream of the video,

wherein the implicit selected transform is not applied to the current block when the current block is an intra-coded block with a derived tree (DT),

wherein, in response to the implicit selected transform being applied to the current block one or more transform matrices applied to the current block comprising at least one of a horizontal transform matrix or a vertical transform matrix are based on a set of representative coefficients of the current block.

16. The non-transitory computer-readable storage medium of claim 15 , wherein the implicit selected transform is applied under at least one condition including that a height and a width of the current block is no greater than a threshold (T), and wherein T is a positive integer, T=32.

17. The non-transitory computer-readable storage medium of claim 15 ,

wherein the set of representative coefficients correspond to a dequantized version and wherein the one or more transform matrices is determined at a transform unit (TU) level.

18. A non-transitory computer-readable recording medium storing a bitstream of a video which is generated by a method performed by a video processing apparatus, wherein the method comprises:

making a decision, based on coding information associated with a current block of a video, regarding an application of an implicit selected transform of a multiple transform selection process for a primary transform to the current block; and

generating the bitstream of the video based on the decision,

wherein the implicit selected transform is not applied to the current block when the current block is an intra-coded block with a derived tree (DT),

wherein, in response to the implicit selected transform being applied to the current block, one or more transform matrices applied to the current block comprising at least one of a horizontal transform matrix or a vertical transform matrix are based on a set of representative coefficients of the current block.

19. The non-transitory computer-readable recording medium of claim 18 , wherein the implicit selected transform is applied under at least one condition including that a height and a width of the current block is no greater than a threshold (T), and wherein T is a positive integer, T=32,

wherein the set of representative coefficients correspond to a dequantized version and wherein the one or more transform matrices is determined at a transform unit (TU) level.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 2, 2021
From: ZHANG, KAI; ZHANG, LI
To: BYTEDANCE INC.
Reel/Frame 058275/0425 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 2, 2021
From: LIU, HONGBIN; WANG, YUE
To: BEIJING BYTEDANCE NETWORK TECHNOLOGY CO., LTD.
Reel/Frame 058275/0443 →
Priority Claims (2)
WO PCT/CN2019/090261 · Jun 6, 2019 · international
WO PCT/CN2019/091435 · Jun 15, 2019 · international
Continuity (2)
Continuation PCTCN2020094907 · Jun 8, 2020
Related Publication 20220094929A1 · Mar 24, 2022
Cited By (1)
US 12,531,999