IP Library › Granted Patent US 11,323,725
Granted Patent B2
US 11,323,725 · App. 17/071,357 · Granted May 3, 2022

Component-dependent sub-block dividing

Inventors: Kai Zhang (San Diego, CA); Li Zhang (San Diego, CA); Hongbin Liu (Beijing, CN); Yue Wang (Beijing, CN)
Assignees: BEIJING BYTEDANCE NETWORK TECHNOLOGY CO., LTD.; BYTEDANCE INC.
H04N19/186H04N19/119H04N19/136H04N19/176H04N19/52H04N19/55
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,323,725
App. No.
17/071,357
Granted
May 3, 2022
Kind
B2
Abstract

Devices, systems and methods for sub-block based prediction are described. In a representative aspect, a method for video encoding includes partitioning, based on a first rule, a luma component of a block of video data into a first set of sub-blocks. The method also includes partitioning, based on a second rule, a first chroma component of the block of video data into a second set of sub-blocks. The first and the second set of sub-blocks include different numbers of sub-blocks. The method also includes performing a subsequent motion prediction based on the first and the second set of sub-blocks.

Claims (44)

1. A method of coding video data, comprising:

determining, during a conversion between a luma block of a video and a bitstream of the video, that motion vectors of control points of the luma block based on an affine mode;

dividing the luma block into a first group of sub-blocks, wherein each sub-block of the first group has a first size;

reconstructing a first group of sub-blocks of the luma block based on the motion vectors of the control points; and

reconstructing a second group of sub-blocks of a chroma block corresponding to the luma block, wherein each sub-block of the second group has a second size, and the second size is equal to the first size in a case that a color format applied for the luma block and the chroma block is 4:2:0 or 4:2:2,

wherein a number of sub-blocks of the second group is different from a number of sub-blocks of the first group in a case that the color format is 4:2:0 or 4:2:2,

wherein motion information of each of the first group of sub-blocks is derived based on the motion vectors of the control points.

2. The method of claim 1 , wherein the first size and second size are equal to 4*4.

3. The method of claim 1 , wherein a number of the control points is 2.

4. The method of claim 1 , wherein the control points include a top-left control point and a top-right control point.

5. The method of claim 1 , wherein a number of the control points is 3.

6. The method of claim 1 , wherein the control points include a top-left control point, a top-right control point and a bottom-left corner control point.

7. The method of claim 1 , wherein the conversion includes encoding a current video block of the video into the bitstream, wherein the current video block includes the luma block and the chroma block.

8. The method of claim 1 , wherein the conversion includes decoding a current video block of the video from the bitstream, wherein the current video block includes the luma block and the chroma block.

9. An apparatus for coding video data comprising a processor and a non-transitory memory with instructions thereon, wherein the instructions upon execution by the processor, cause the processor to:

determine, during a conversion between a luma block of a video and a bitstream of the video, that motion vectors of control points of the luma block based on an affine mode;

divide the luma block into a first group of sub-blocks, wherein each sub-block of the first group has a first size;

reconstruct a first group of sub-blocks of the luma block based on the motion vectors of the control points; and

reconstruct a second group of sub-blocks of a chroma block corresponding to the luma block, wherein each sub-block of the second group has a second size, and the second size is equal to the first size in a case that a color format applied for the luma block and the chroma block is 4:2:0 or 4:2:2,

wherein a number of sub-blocks of the second group is different from a number of sub-blocks of the first group in a case that the color format is 4:2:0 or 4:2:2,

wherein motion information of each of the first group of sub-blocks is derived based on the motion vectors of the control points.

10. The apparatus of claim 9 , wherein the first size and second size are equal to 4*4.

11. The apparatus of claim 9 , wherein a number of sub-blocks of the second group is different from a number of sub-blocks of the first group in a case that the color format is 4:2:0 or 4:2:2.

12. The apparatus of claim 9 , wherein a number of the control points is 2.

13. The apparatus of claim 9 , wherein the control points include a top-left control point and a top-right control point.

14. The apparatus of claim 9 , wherein a number of the control points is 3.

15. The apparatus of claim 9 , wherein the control points include a top-left control point, a top-right control point and a bottom-left corner control point.

16. The apparatus of claim 9 , wherein the conversion includes encoding a current video block of the video into the bitstream, wherein the current video block includes the luma block and the chroma block.

17. The apparatus of claim 9 , wherein the conversion includes decoding a current video block of the video from the bitstream, wherein the current video block includes the luma block and the chroma block.

18. A non-transitory computer-readable storage medium storing instructions that cause a processor to:

determine, during a conversion between a luma block of a video and a bitstream of the video, that motion vectors of control points of the luma block based on an affine mode;

divide the luma block into a first group of sub-blocks, wherein each sub-block of the first group has a first size;

reconstruct a first group of sub-blocks of the luma block based on the motion vectors of the control points; and

reconstruct a second group of sub-blocks of a chroma block corresponding to the luma block, wherein each sub-block of the second group has a second size, and the second size is equal to the first size in a case that a color format applied for the luma block and the chroma block is 4:2:0 or 4:2:2,

wherein a number of sub-blocks of the second group is different from a number of sub-blocks of the first group in a case that the color format is 4:2:0 or 4:2:2,

wherein motion information of each of the first group of sub-blocks is derived based on the motion vectors of the control points.

19. A non-transitory computer-readable recording medium storing a bitstream which is generated by a method performed by a video processing apparatus, wherein the method comprises:

determining, during a conversion between a luma block of a video and a bitstream of the video, that motion vectors of control points of the luma block based on an affine mode;

dividing the luma block into a first group of sub-blocks, wherein each sub-block of the first group has a first size;

reconstructing a first group of sub-blocks of the luma block based on the motion vectors of the control points;

reconstructing a second group of sub-blocks of a chroma block corresponding to the luma block, wherein each sub-block of the second group has a second size, and the second size is equal to the first size in a case that a color format applied for the luma block and the chroma block is 4:2:0 or 4:2:2; and

generating the bitstream from a current video block, wherein the current video block includes the luma block and the chroma block,

wherein a number of sub-blocks of the second group is different from a number of sub-blocks of the first group in a case that the color format is 4:2:0 or 4:2:2,

wherein motion information of each of the first group of sub-blocks is derived based on the motion vectors of the control points.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Oct 15, 2020
From: ZHANG, KAI; ZHANG, LI
To: BYTEDANCE INC.
Reel/Frame 054070/0555 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Oct 15, 2020
From: LIU, HONGBIN; WANG, YUE
To: BEIJING BYTEDANCE NETWORK TECHNOLOGY CO., LTD.
Reel/Frame 054070/0598 →
Priority Claims (2)
CN PCT/CN2018/092118 · Jun 21, 2018 · national
CN PCT/CN2018/114931 · Nov 10, 2018 · national
Continuity (2)
Continuation PCTIB2019055246 · Jun 21, 2019
Related Publication 20210029368A1 · Jan 28, 2021