IP Library Granted Patent US 11,470,309
Granted Patent B2
US 11,470,309 · App. 17/521,043 · Granted Oct 11, 2022

Adaptive motion vector difference resolution for affine mode

Inventors: Kai Zhang (San Diego, CA); Li Zhang (San Diego, CA); Hongbin Liu (Beijing, CN); Yue Wang (Beijing, CN)
Assignees: BEIJING BYTEDANCE NETWORK TECHNOLOGY CO., LTD.; BYTEDANCE INC.
H04N19/109H04N19/105H04N19/139H04N19/157H04N19/176H04N19/46H04N19/513H04N19/52
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,470,309
App. No.
17/521,043
Granted
Oct 11, 2022
Kind
B2
Abstract

A method of visual media processing includes determining whether to use an affine adaptive motion vector resolution (AMVR) technique on visual media data relying on a control information related to the affine AMVR technique in a bitstream representation of the visual media data, wherein the control information is included or excluded from the bitstream representation based on a rule; and performing a conversion between the visual media data and the bitstream representation of the visual media data.

Claims (40)

1. A method of processing video data, comprising:

performing a conversion between a visual media data of a video and a bitstream of the video,

wherein whether to enable an affine prediction mode for the conversion is determined during the conversion,

wherein whether a first indication is included in the bitstream is based on whether to enable the affine prediction mode for the conversion, wherein the first indication indicates whether to enable a tool used to determine, for motion information determined in the affine prediction mode, a first motion precision from a set of allowed multiple motion precisions,

wherein whether the first indication is included in the bitstream is further based on a second indication, wherein the second indication indicates whether to enable a tool used to determine, for motion information determined in the affine prediction mode, the first motion precision from the set of allowed multiple motion precisions, and for motion information determined in a non-affine prediction mode, a second motion precision from the set of allowed multiple motion precisions, and

wherein a third indication is not included in the bitstream in response to the second indication indicating the tool is disabled for the affine prediction mode and the non-affine prediction mode, wherein the third indication is used to determine, for motion information determined in the non-affine prediction mode, the motion precision from the set of allowed multiple motion precisions.

2. The method of claim 1 , wherein the first indication is not included in the bitstream in response to the affine prediction mode being disabled.

3. The method of claim 1 , wherein the tool is disabled for the affine prediction mode in response to the affine prediction mode being disabled.

4. The method of claim 1 , wherein the first indication is ignored and is inferred to indicate the tool is disabled for the affine prediction mode in response to the affine prediction mode being disabled.

5. The method of claim 1 , wherein the first indication is not included in the bitstream in response to the second indication indicating the tool is disabled for the affine prediction mode and the non-affine prediction mode.

6. The method of claim 1 , wherein the second indication is included in the bitstream in a sequence parameter set (SPS) level.

7. The method of claim 1 , wherein the first indication is included in the bitstream in a sequence parameter set (SPS) level.

8. The method of claim 1 , wherein whether to enable the affine prediction mode for the conversion is indicated using a third indication which is included in the bitstream in a sequence parameter set (SPS) level.

9. The method of claim 1 , wherein the conversion comprises encoding the visual media data into the bitstream.

10. The method of claim 1 , wherein the conversion comprises decoding the visual media data from the bitstream.

11. An apparatus for processing video data comprising a processor and a non-transitory memory with instructions thereon, wherein the instructions upon execution by the processor, cause the processor to:

perform a conversion between a visual media data of a video and a bitstream of the video,

wherein whether to enable an affine prediction mode for the conversion is determined during the conversion,

wherein whether a first indication is included in the bitstream is based on whether to enable the affine prediction mode for the conversion, wherein the first indication indicates whether to enable a tool used to determine, for motion information determined in the affine prediction mode, a first motion precision from a set of allowed multiple motion precisions,

wherein whether the first indication is included in the bitstream is further based on a second indication, wherein the second indication indicates whether to enable a tool used to determine, for motion information determined in the affine prediction mode, the first motion precision from the set of allowed multiple motion precisions, and for motion information determined in a non-affine prediction mode, a second motion precision from the set of allowed multiple motion precisions, and

wherein a third indication is not included in the bitstream in response to the second indication indicating the tool is disabled for the affine prediction mode and the non-affine prediction mode, wherein the third indication is used to determine, for motion information determined in the non-affine prediction mode, the motion precision from the set of allowed multiple motion precisions.

12. The apparatus of claim 11 , wherein the first indication is not included in the bitstream in response to the affine prediction mode being disabled.

13. The apparatus of claim 11 , wherein the tool is disabled for the affine prediction mode in response to the affine prediction mode being disabled.

14. The apparatus of claim 11 , wherein the first indication is ignored and is inferred to indicate the tool is disabled for the affine prediction mode in response to the affine prediction mode being disabled.

15. A non-transitory computer-readable storage medium storing instructions that cause a processor to:

perform a conversion between a visual media data of a video and a bitstream of the video,

wherein whether to enable an affine prediction mode for the conversion is determined during the conversion,

wherein whether a first indication is included in the bitstream is based on whether to enable the affine prediction mode for the conversion, wherein the first indication indicates whether to enable a tool used to determine, for motion information determined in the affine prediction mode, a first motion precision from a set of allowed multiple motion precisions,

wherein whether the first indication is included in the bitstream is further based on a second indication, wherein the second indication indicates whether to enable a tool used to determine, for motion information determined in the affine prediction mode, the first motion precision from the set of allowed multiple motion precisions, and for motion information determined in a non-affine prediction mode, a second motion precision from the set of allowed multiple motion precisions, and

wherein a third indication is not included in the bitstream in response to the second indication indicating the tool is disabled for the affine prediction mode and the non-affine prediction mode, wherein the third indication is used to determine, for motion information determined in the non-affine prediction mode, the motion precision from the set of allowed multiple motion precisions.

16. The non-transitory computer-readable storage medium of claim 15 , wherein whether the first indication is included in the bitstream is further based on a second indication, wherein the second indication indicating whether to enable a tool used to determine, for motion information determined in the affine prediction mode, the first motion precision from the set of allowed multiple motion precisions, and for motion information determined in a non-affine prediction mode, a second motion precision from the set of allowed multiple motion precisions.

17. A non-transitory computer-readable recording medium storing a bitstream which is generated by a method performed by a video processing apparatus, wherein the method comprises:

generating the bitstream from a visual media data of a video,

wherein whether to enable an affine prediction mode for the generating is determined during the generating,

wherein whether a first indication is included in the bitstream is based on whether to enable the affine prediction mode for the conversion, wherein the first indication indicates whether to enable a tool used to determine, for motion information determined in the affine prediction mode, a motion precision from a set of allowed multiple motion precisions,

wherein whether the first indication is included in the bitstream is further based on a second indication, wherein the second indication indicates whether to enable a tool used to determine, for motion information determined in the affine prediction mode, the first motion precision from the set of allowed multiple motion precisions, and for motion information determined in a non-affine prediction mode, a second motion precision from the set of allowed multiple motion precisions, and

wherein a third indication is not included in the bitstream in response to the second indication indicating the tool is disabled for the affine prediction mode and the non-affine prediction mode, wherein the third indication is used to determine, for motion information determined in the non-affine prediction mode, the motion precision from the set of allowed multiple motion precisions.

18. The apparatus of claim 11 , wherein the second indication is included in the bitstream in a sequence parameter set (SPS) level.

19. The apparatus of claim 11 , wherein the first indication is included in the bitstream in a sequence parameter set (SPS) level.

20. The apparatus of claim 11 , wherein whether to enable the affine prediction mode for the conversion is indicated using a third indication which is included in the bitstream in a sequence parameter set (SPS) level.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Nov 8, 2021
From: ZHANG, KAI; ZHANG, LI
To: BYTEDANCE INC.
Reel/Frame 058046/0296 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Nov 8, 2021
From: LIU, HONGBIN; WANG, YUE
To: BEIJING BYTEDANCE NETWORK TECHNOLOGY CO., LTD.
Reel/Frame 058046/0356 →
Priority Claims (1)
WO PCT/CN2019/087805 · May 21, 2019 · international
Continuity (2)
Continuation PCTCN2020091537 · May 21, 2020
Related Publication 20220060696A1 · Feb 24, 2022
Cited By (7)
US 12,192,459 US 12,301,799 US 12,348,761 US 12,388,989 US 12,413,714 US 12,513,291 US 12,621,450