IP Library › Granted Patent US 11,895,306
Granted Patent B2
US 11,895,306 · App. 17/732,849 · Granted Feb 6, 2024

Component-dependent sub-block dividing

Inventors: Kai Zhang (San Diego, CA); Li Zhang (San Diego, CA); Hongbin Liu (Beijing, CN); Yue Wang (Beijing, CN)
Assignees: BEIJING BYTEDANCE NETWORK TECHNOLOGY CO., LTD; BYTEDANCE INC.
H04N19/186H04N19/119H04N19/136H04N19/176H04N19/52H04N19/55
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,895,306
App. No.
17/732,849
Granted
Feb 6, 2024
Kind
B2
Abstract

Devices, systems and methods for sub-block based prediction are described. In a representative aspect, a method for video encoding includes partitioning, based on a first rule, a luma component of a block of video data into a first set of sub-blocks. The method also includes partitioning, based on a second rule, a first chroma component of the block of video data into a second set of sub-blocks. The first and the second set of sub-blocks include different numbers of sub-blocks. The method also includes performing a subsequent motion prediction based on the first and the second set of sub-blocks.

Claims (39)

1. A method of coding video data, comprising:

determining, during a conversion between a luma block of a video and a bitstream of the video, motion vectors of control points of the luma block based on an affine mode;

dividing the luma block into a first group of sub-blocks;

reconstructing the first group of sub-blocks of the luma block based on the motion vectors of the control points; and

reconstructing a second group of sub-blocks of a chroma block corresponding to the luma block,

wherein, in case that a color format of the luma block and the chroma block is 4:2:0 or 4:2:2, (1) each sub-block of the second group of sub-blocks has a second size with dimensions greater than 2, and (2) a first size of each sub-block of the first group of sub-blocks is equal to the second size of each sub-block of the second group of sub-blocks.

2. The method of claim 1 , wherein the first size and the second size are equal to 4*4.

3. The method of claim 1 , wherein a number of sub-blocks of the second group of sub-blocks is different from a number of sub-blocks of the first group of sub-blocks in a case that the color format is 4:2:0 or 4:2:2.

4. The method of claim 1 , wherein a number of the control points is 2.

5. The method of claim 1 , wherein the control points include a top-left control point and a top-right control point, and motion information of each of the first group of sub-blocks is derived based on the motion vectors of the control points.

6. The method of claim 1 , wherein a number of the control points is 3.

7. The method of claim 1 , wherein the control points include a top-left control point, a top-right control point and a bottom-left corner control point.

8. The method of claim 1 , wherein the conversion includes encoding a current video block of the video into the bitstream, wherein the current video block includes the luma block and the chroma block.

9. The method of claim 1 , wherein the conversion includes decoding a current video block of the video from the bitstream, wherein the current video block includes the luma block and the chroma block.

10. An apparatus for coding video data comprising a processor and a non-transitory memory with instructions thereon, wherein the instructions upon execution by the processor, cause the processor to:

determine, during a conversion between a luma block of a video and a bitstream of the video, motion vectors of control points of the luma block based on an affine mode;

divide the luma block into a first group of sub-blocks;

reconstruct the first group of sub-blocks of the luma block based on the motion vectors of the control points; and

reconstruct a second group of sub-blocks of a chroma block corresponding to the luma block,

wherein, in case that a color format of the luma block and the chroma block is 4:2:0 or 4:2:2, (1) each sub-block of the second group of sub-blocks has a second size with dimensions greater than 2, and (2) a first size of each sub-block of the first group of sub-blocks is equal to the second size of each sub-block of the second group of sub-blocks.

11. The apparatus of claim 10 , wherein the first size and the second size are equal to 4*4.

12. The apparatus of claim 10 , wherein a number of sub-blocks of the second group of sub-blocks is different from a number of sub-blocks of the first group of sub-blocks in a case that the color format is 4:2:0 or 4:2:2.

13. The apparatus of claim 10 , wherein a number of the control points is 2.

14. The apparatus of claim 10 , wherein the control points include a top-left control point and a top-right control point, and motion information of each of the first group of sub-blocks is derived based on the motion vectors of the control points.

15. The apparatus of claim 10 , wherein a number of the control points is 3.

16. The apparatus of claim 10 , wherein the control points include a top-left control point, a top-right control point and a bottom-left corner control point.

17. A non-transitory computer-readable storage medium storing instructions that cause a processor to:

determine, during a conversion between a luma block of a video and a bitstream of the video, motion vectors of control points of the luma block based on an affine mode;

divide the luma block into a first group of sub-blocks;

reconstruct the first group of sub-blocks of the luma block based on the motion vectors of the control points; and

reconstruct a second group of sub-blocks of a chroma block corresponding to the luma block,

wherein, in case that a color format of the luma block and the chroma block is 4:2:0 or 4:2:2, (1) each sub-block of the second group of sub-blocks has a second size with dimensions greater than 2, and (2) a first size of each sub-block of the first group of sub-blocks is equal to the second size of each sub-block of the second group of sub-blocks.

18. A non-transitory computer-readable recording medium storing a bitstream which is generated by a method performed by a video processing apparatus, wherein the method comprises:

determining, for a luma block of a video, motion vectors of control points of the luma block based on an affine mode;

dividing the luma block into a first group of sub-blocks;

reconstructing the first group of sub-blocks of the luma block based on the motion vectors of the control points;

reconstructing a second group of sub-blocks of a chroma block corresponding to the luma block; and

generating the bitstream from a current video block, wherein the current video block includes the luma block and the chroma block,

wherein, in case that a color format of the luma block and the chroma block is 4:2:0 or 4:2:2, (1) each sub-block of the second group of sub-blocks has a second size with dimensions greater than 2, and (2) a first size of each sub-block of the first group of sub-blocks is equal to the second size of each sub-block of the second group of sub-blocks.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 29, 2022
From: ZHANG, KAI; ZHANG, LI
To: BYTEDANCE INC.
Reel/Frame 059715/0929 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 29, 2022
From: LIU, HONGBIN; WANG, YUE
To: BEIJING BYTEDANCE NETWORK TECHNOLOGY CO., LTD.
Reel/Frame 059715/0971 →
Priority Claims (2)
WO PCT/CN2018/092118 · Jun 21, 2018 · international
WO PCT/CN2018/114931 · Nov 10, 2018 · international
Continuity (3)
Continuation 17071357 · Oct 15, 2020
Continuation PCTIB2019055246 · Jun 21, 2019
Related Publication 20220264125A1 · Aug 18, 2022
Cited By (2)
US 12,323,617 US 12,407,835