IP Library Granted Patent US 11,968,377
Granted Patent B2
US 11,968,377 · App. 17/380,278 · Granted Apr 23, 2024

Unified constrains for the merge affine mode and the non-merge affine mode

Inventors: Kai Zhang (San Diego, CA); Li Zhang (San Diego, CA); Hongbin Liu (Beijing, CN); Yue Wang (Beijing, CN)
Assignees: BEIJING BYTEDANCE NETWORK TECHNOLOGY CO., LTD; BYTEDANCE INC.
H04N19/176H04N19/103H04N19/184
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,968,377
App. No.
17/380,278
Granted
Apr 23, 2024
Kind
B2
Abstract

Devices, systems and methods for sub-block based prediction are described. In a representative aspect, a method for video processing includes determining a block size constrain, making a determination, based on the block size constrain, about whether or not a merge affine mode and a non-merge affine mode are allowed for a video block in a video frame, and generating a bitstream representation of the video block based on the making the determination.

Claims (36)

1. A method of processing video data, comprising:

determining, for a conversion between a current video block of a video and a bitstream of the video, that whether or not a first affine mode is allowed for the current video block and whether or not a second affine mode is allowed for the current video block are based on a same dimension constrain; and

performing, based on the determining, the conversion between the current video block and the bitstream,

wherein the first affine mode and the second affine mode are not allowed in response to either a height of the current video block or a width of the current video block being smaller than or equal to 8, and the bitstream omits an indication for the first affine mode and the second affine mode; and

wherein in a case that indications for the first affine mode and the second affine mode are absent in the bitstream, the bitstream is parsed without the indications for the first affine mode and the second affine mode, and the current video block is generated without using an affine mode.

2. The method of claim 1 , wherein in the first affine mode, motion information of control points of the current video block is derived at least based on an affine candidate of the current video block and without applying motion vector differences (MVD).

3. The method of claim 2 , wherein the first affine mode is a merge affine mode, and the second affine mode is a non-merge affine mode.

4. The method of claim 2 , wherein the first affine mode is a direct affine mode, and the second affine mode is a non-direct affine mode.

5. The method of claim 1 , wherein the first affine mode and the second affine mode are not allowed in response to the height and the width of the current video block being both smaller than or equal to 8.

6. The method of claim 1 , wherein the conversion includes encoding the current video block into the bitstream.

7. The method of claim 1 , wherein the conversion includes decoding the current video block from the bitstream.

8. An apparatus for processing video data comprising a processor and a non-transitory memory with instructions thereon, wherein the instructions upon execution by the processor, cause the processor to:

make a determination, for a conversion between a current video block of a video and a bitstream of the video, that whether or not a first affine mode is allowed for the current video block and whether or not a second affine mode is allowed for the current video block are based on a same dimension constrain; and

perform, based on the determination, the conversion between the current video block and the bitstream,

wherein the first affine mode and the second affine mode are not allowed in response to either a height of the current video block or a width of the current video block being smaller than or equal to 8, and the bitstream omits an indication for the first affine mode and the second affine mode; and

wherein in a case that indications for the first affine mode and the second affine mode are absent in the bitstream, the bitstream is parsed without the indications for the first affine mode and the second affine mode, and the current video block is generated without using an affine mode.

9. The apparatus of claim 8 , wherein in the first affine mode, motion information of control points of the current video block is derived at least based on an affine candidate of the current video block and without applying motion vector differences (MVD).

10. The apparatus of claim 9 , wherein the first affine mode is a merge affine mode, and the second affine mode is a non-merge affine mode.

11. The apparatus of claim 9 , wherein the first affine mode is a direct affine mode, and the second affine mode is a non-direct affine mode.

12. The apparatus of claim 8 , wherein the first affine mode and the second affine mode are not allowed in response to the height and the width of the current video block being both smaller than or equal to 8.

13. A non-transitory computer-readable storage medium storing instructions that cause a processor to:

determine, for a conversion between a current video block of a video and a bitstream of the video, that whether or not a first affine mode is allowed for the current video block and whether or not a second affine mode is allowed for the current video block are based on a same dimension constrain; and

perform, based on the determine, the conversion between the current video block and the bitstream,

wherein the first affine mode and the second affine mode are not allowed in response to either a height of the current video block or a width of the current video block being smaller than or equal to 8, and the bitstream omits an indication for the first affine mode and the second affine mode; and

wherein in a case that indications for the first affine mode and the second affine mode are absent in the bitstream, the bitstream is parsed without the indications for the first affine mode and the second affine mode, and the current video block is generated without using an affine mode.

14. The non-transitory computer-readable storage medium of claim 13 , wherein in the first affine mode, motion information of control points of the current video block is derived at least based on an affine candidate of the current video block and without applying motion vector differences (MVD).

15. The non-transitory computer-readable storage medium of claim 14 , wherein the first affine mode is a merge affine mode, and the second affine mode is a non-merge affine mode.

16. The non-transitory computer-readable storage medium of claim 14 , wherein the first affine mode is a direct affine mode, and the second affine mode is a non-direct affine mode.

17. A non-transitory computer-readable recording medium storing a bitstream which is generated by a method performed by a video processing apparatus, wherein the method comprises:

determining, for a conversion between a current video block of a video and the bitstream of the video, that whether or not a first affine mode is allowed for the current video block and whether or not a second affine mode is allowed for the current video block are based on a same dimension constrain; and

generating the bitstream based on the determining,

wherein the first affine mode and the second affine mode are not allowed in response to either a height of the current video block or a width of the current video block being smaller than or equal to 8, and the bitstream omits an indication for the first affine mode and the second affine mode; and

wherein in a case that indications for the first affine mode and the second affine mode are absent in the bitstream, the bitstream is parsed without the indications for the first affine mode and the second affine mode, and the current video block is generated without using an affine mode.

18. The non-transitory computer-readable recording medium of claim 17 , wherein in the first affine mode, motion information of control points of the current video block is derived at least based on an affine candidate of the current video block and without applying motion vector differences (MVD).

19. The non-transitory computer-readable recording medium of claim 18 , wherein the first affine mode is a merge affine mode, and the second affine mode is a non-merge affine mode.

20. The non-transitory computer-readable recording medium of claim 18 , wherein the first affine mode is a direct affine mode, and the second affine mode is a non-direct affine mode.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 20, 2021
From: ZHANG, KAI; ZHANG, LI
To: BYTEDANCE INC.
Reel/Frame 056921/0648 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 20, 2021
From: LIU, HONGBIN; WANG, YUE
To: BEIJING BYTEDANCE NETWORK TECHNOLOGY CO., LTD.
Reel/Frame 056921/0734 →
Priority Claims (1)
WO PCT/CN2018/092118 · Jun 21, 2018 · international
Continuity (3)
Continuation 17099042 · Nov 16, 2020
Continuation PCTIB2019055244 · Jun 21, 2019
Related Publication 20210352302A1 · Nov 11, 2021
Cited By (3)
US 12,407,835 US 12,413,714 US 12,621,450