IP Library Granted Patent US 12,028,520
Granted Patent B2
US 12,028,520 · App. 16/760,938 · Granted Jul 2, 2024

Multi-type tree coding

Inventors: Yuwen He (San Diego, CA); Fanyi Duanmu (Cupertino, CA); Xiaoyu Xiu (San Diego, CA); Yan Ye (San Diego, CA)
Assignee: VID SCALE, Inc.
H04N19/119H04N19/117H04N19/176H04N19/96
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,028,520
App. No.
16/760,938
Granted
Jul 2, 2024
Kind
B2
Abstract

A block may be identified. The block may be partitioned into one or more (e.g., two) sibling nodes (e.g., sibling nodes BO and B 1 ). A partition direction and a partition type for the block may be determined. If the partition type for the block is binary tree (BT), one or more (e.g., two) partition parameters may be determined for sibling node BO. A partition parameter (e.g., a first partition parameter) may be determined for sibling node B 1 . A decoder may determine whether to receive an indication of a second partition parameter for B 1 based on, for example, the partition direction for the block, the partition type for the block, and the first partition parameter for B 1 . The decoder may derive the second partition parameter based on, for example, the partition direction and type for the block, and the first partition parameter for B 1.

Claims (64)

1. A method for video decoding, the method comprising:

obtaining a block associated with a picture, wherein the block comprises a plurality of nodes;

determining a partition type for the block, a partition direction for the block, and a first partition parameter associated with a node of the plurality of nodes;

determining, based on the partition type for the block, the partition direction for the block, and the first partition parameter associated with the node of the plurality of nodes, whether an indication of a second partition parameter associated with the node is included in video data;

obtaining the second partition parameter based on the determination of whether the indication of the second partition parameter associated with the node is included in the video data, wherein the second partition parameter is indicative of a binary tree (BT) splitting allowability; and

decoding the picture based on the first partition parameter and the second partition parameter associated with the node, wherein decoding the picture further comprises:

determining that multi-type tree (MTT) is used for the picture, wherein the picture comprises a triple tee (TT) block generated using TT partitioning and a BT block generated using BT partitioning, wherein a first minimum partition size is used for the TT partitioning, and a second minimum partition size is used for the BT partitioning, and wherein the first minimum partition size and the second minimum partition size are different;

obtaining a deblocking filter that is applicable to the TT block and the BT block;

determining a boundary of the TT block; and

applying the obtained deblocking filter to the determined boundary of the TT block.

2. The method of claim 1 , wherein, based on a condition that the indication of the second partition parameter associated with the node is determined to be included in the video data, obtaining the second partition parameter comprises:

parsing the indication of the second partition parameter in the video data; and

determining the second partition parameter based on the indication.

3. The method of claim 1 , wherein the partition type for the block is TT, wherein the node is a middle sibling node, and wherein the first partition parameter indicates a partition type for the middle sibling node and the second partition parameter indicates a partition direction for the middle sibling node, and wherein, based on a condition that the partition type for the middle sibling node is BT, the partition direction for the middle sibling node is determined to be orthogonal to the partition direction for the block.

4. The method of claim 1 , wherein the partition type for the block is TT, wherein the node is a middle sibling node, and wherein the first partition parameter indicates a partition type for the middle sibling node, and the second partition parameter indicates a partition direction for the middle sibling node, and wherein, based on a condition that the partition type for the middle sibling node is TT, the partition direction for the middle sibling node is received.

5. The method of claim 1 , wherein the partition type for the block is BT, and wherein the node is a first node of the plurality of nodes, the first partition parameter indicates a partition direction for the first node, and the second partition parameter indicates a partition type for the first node, the plurality of nodes comprises a second node, and wherein, based on a condition that a partition direction for the second node and the partition direction for the first node are different or that the partition type for the second node is TT and the partition direction for the second node and the partition direction for the first node are both the same as the partition direction for the block, the partition type for the first node is received.

6. A non-transitory computer-readable medium including instructions for causing one or more processors to perform the method of claim 1 .

7. The method of claim 1 , wherein the second partition parameter is indicative of a BT vertical splitting allowability.

8. A method for video encoding, the method comprising:

obtaining a block associated with a picture, wherein the block comprises a plurality of nodes;

determining a partition type for the block, a partition direction for the block, and a first partition parameter associated with a node of the plurality of nodes;

determining, based on the partition type for the block, the partition direction for the block, and the first partition parameter associated with the node of the plurality of nodes, whether to include an indication of a second partition parameter associated with the node in video data, wherein the second partition parameter is indicative of a binary tree (BT) splitting allowability;

encoding the picture based on the first partition parameter and the second partition parameter associated with the node, wherein encoding the picture further comprises:

determining that multi-type tree (MTT) is used for the picture, wherein the picture comprises a triple tee (TT) block generated using TT partitioning and a BT block generated using BT partitioning, wherein a first minimum partition size is used for the TT partitioning, and a second minimum partition size is used for the BT partitioning, and wherein the first minimum partition size and the second minimum partition size are different;

obtaining a deblocking filter that is applicable to the TT block and the BT block;

determining a boundary of the TT block; and

applying the obtained deblocking filter to the determined boundary of the TT block;

generating a residual; and

including the residual in the video data.

9. The method of claim 8 , wherein the partition type for the block is TT and wherein the first partition parameter indicates a partition direction for the node, and the second partition parameter indicates a partition type for the node, and wherein, based on a condition that the partition direction for the node is the same as the partition direction for the block, the partition type for the node is not included in the video data.

10. The method of claim 8 , wherein the partition type for the block is TT and wherein the first partition parameter indicates a partition direction for the node, and the second partition parameter indicates a partition type for the node, and wherein, based on a condition that the partition direction for the node is not the same as the partition direction for the block, the partition type for the node is included in the video data.

11. The method of claim 8 , wherein the second partition parameter is indicative of a BT vertical splitting allowability.

12. A device for video decoding, comprising:

a processor configured to:

obtain a block associated with a picture, wherein the block comprises a plurality of nodes;

determine a partition type for the block, a partition direction for the block, and a first partition parameter associated with a node of the plurality of nodes;

determine, based on the partition type for the block, the partition direction for the block, and the first partition parameter associated with the node of the plurality of nodes, whether an indication of a second partition parameter associated with the node is included in video data;

obtain the second partition parameter based on the determination of whether the indication of the second partition parameter associated with the node is included in the video data, wherein the second partition parameter is indicative of a binary tree (BT) splitting allowability; and

decode the picture based on the first partition parameter and the second partition parameter associated with the node, wherein the processor is further configured to:

determine that multi-type tree (MTT) is used for the picture, wherein the picture comprises a triple tee (TT) block generated using TT partitioning and a BT block generated using BT partitioning, wherein a first minimum partition size is used for the TT partitioning, and a second minimum partition size is used for the BT partitioning, and wherein the first minimum partition size and the second minimum partition size are different;

obtain a deblocking filter that is applicable to the TT block and the BT block;

determine a boundary of the TT block; and

apply the obtained deblocking filter to the determined boundary of the TT block.

13. The device of claim 12 , wherein, based on a condition that the indication of the second partition parameter associated with the node is determined to be included in the video data, the processor is further configured to:

receive the indication of the second partition parameter in the video data; and

determine the second partition parameter based on the indication.

14. The device of claim 12 , wherein the partition type for the block is TT, wherein the node is a middle sibling node, and wherein the first partition parameter indicates a partition direction for the middle sibling node and the second partition parameter indicates a partition type for the middle sibling node, and wherein, based on a condition that the partition direction for the middle sibling node is the same as the partition direction for the block, the partition type for the middle sibling node is derived to be TT.

15. The device of claim 12 , wherein the partition type for the block is TT, wherein the node is a middle sibling node, and wherein the first partition parameter indicates a partition direction for the middle sibling node and the second partition parameter indicates a partition type for the middle sibling node, and wherein, based on a condition that the partition direction for the middle sibling node is not the same as the partition direction for the block, the partition type for the middle sibling node is received.

16. The device of claim 12 , wherein, based on a condition that the indication of the second partition parameter is not included in the video data, the second partition parameter associated with the node is obtained based on the first partition parameter and the partition direction for the block.

17. The device of claim 12 , wherein the second partition parameter is indicative of a BT horizontal splitting allowability.

18. A device for video encoding, comprising:

a processor configured to:

obtain a block associated with a picture, wherein the block comprises a plurality of nodes;

determine a partition type for the block, a partition direction for the block, and a first partition parameter associated with a node of the plurality of nodes;

determine, based on the partition type for the block, the partition direction for the block, and the first partition parameter associated with the node of the plurality of nodes, whether to include an indication of a second partition parameter associated with the node in video data, wherein the second partition parameter is indicative of a binary tree (BT) splitting allowability;

encode the picture based on the first partition parameter and the second partition parameter associated with the node, wherein the processor is further configured to:

determine that multi-type tree (MTT) is used for the picture, wherein the picture comprises a triple tee (TT) block generated using TT partitioning and a BT block generated using BT partitioning, wherein a first minimum partition size is used for the TT partitioning, and a second minimum partition size is used for the BT partitioning, and wherein the first minimum partition size and the second minimum partition size are different;

obtain a deblocking filter that is applicable to the TT block and the BT block;

determine a boundary of the TT block; and

apply the obtained deblocking filter to the determined boundary of the TT block;

generate a residual; and

include the residual in the video data.

19. The device of claim 18 , wherein the partition type for the block is TT and wherein the first partition parameter indicates a partition direction for the node, and the second partition parameter indicates a partition type for the node, and wherein, based on a condition that the partition direction for the node is the same as the partition direction for the block, the partition type for the node is not included in the video data.

20. The device of claim 18 , wherein the second partition parameter is indicative of a BT horizontal splitting allowability.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Nov 5, 2024
From: HE, YUWEN; DUANMU, FANYI; XIU, XIAOYU; YE, YAN
To: VID SCALE, INC.
Reel/Frame 069312/0595 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 11, 2024
From: VID SCALE, INC.
To: INTERDIGITAL VC HOLDINGS, INC.
Reel/Frame 068284/0031 →