IP Library Granted Patent US 11,627,308
Granted Patent B2
US 11,627,308 · App. 17/126,707 · Granted Apr 11, 2023

TMVP derivation

Inventors: Li Zhang (San Diego, CA); Kai Zhang (San Diego, CA); Hongbin Liu (Beijing, CN); Yue Wang (Beijing, CN)
Assignees: BEIJING BYTEDANCE NETWORK TECHNOLOGY CO., LTD.; BYTEDANCE INC.
H04N19/105H04N19/137H04N19/159H04N19/176H04N19/30H04N19/517
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,627,308
App. No.
17/126,707
Granted
Apr 11, 2023
Kind
B2
Abstract

A video processing method includes deriving multiple temporal motion vector prediction (TMVP) candidates for a video block in a current picture based on multiple blocks associated with a second block in one or more pictures that are temporally co-located with the current picture, wherein the current picture is excluded from the one or more pictures, and the second block is temporally collocated with the video block, wherein the second block has a same size as the video block, and wherein a relative position of the second block to a top-left corner of a second picture of the one or more pictures is same as that of the video block to a top-left corner of the current picture; adding the multiple TMVP candidates to a motion candidate list associated with the video block; and performing a conversion between the video block and a bitstream.

Claims (55)

1. A video processing method, comprising:

deriving multiple temporal motion vector prediction (TMVP) candidates for a video block in a current picture based on multiple blocks associated with a second block in one or more pictures that are temporally before or after the current picture, and the second block is collocated with the video block, wherein the second block has a same size as the video block, and wherein a relative position of the second block to a top-left corner of a second picture of the one or more pictures is same as that of the video block to a top-left corner of the current picture;

adding the multiple TMVP candidates to a motion candidate list associated with the video block; and

performing a conversion between the video block and a bitstream,

wherein the multiple blocks are located inside a coding tree block covering the second block, and

wherein the second block is identified by a non-zero motion vector that is derived from a spatial merge candidate of the second block,

the second block is identified by a motion vector derived from a merge candidate of the video block, or

the second block is identified by a motion vector derived from motion information of a spatial neighboring block of the video block.

2. The method of claim 1 , wherein the one or more pictures includes a single picture co-located with the current picture.

3. The method of claim 1 , wherein the multiple blocks are located inside the second block.

4. The method of claim 1 , wherein the multiple blocks are located outside the second block.

5. The method of claim 1 , wherein the non-zero motion vector is derived by scaling a motion vector based on one of the one or more pictures.

6. The method of claim 1 , further comprising:

adjusting one of the one or more pictures to be a reference picture associated with a spatial merge candidate.

7. The method of claim 1 , further comprising:

comparing a new TMVP candidate against all existing TMVP candidates;

determining that the new TMVP candidate is identical to an existing TMVP candidate; and

refraining from adding the new TMVP candidate to the multiple TMVP candidates.

8. The method of claim 1 , further comprising:

comparing a new TMVP candidate against a subset of existing TMVP candidates;

determining that the new TMVP candidate is identical to an existing TMVP candidate; and

refraining from adding the new TMVP candidate to the multiple TMVP candidate.

9. A video encoding apparatus comprising a processor configured to implement a method of video processing, comprising:

deriving multiple temporal motion vector prediction (TMVP) candidates for a video block in a current picture based on multiple blocks associated with a second block in one or more pictures that are temporally before or after the current picture, and the second block is temporally collocated with the video block, wherein the second block has a same size as the video block, and wherein a relative position of the second block to a top-left corner of a second picture of the one or more pictures is same as that of the video block to a top-left corner of the current picture;

adding the multiple TMVP candidates to a motion candidate list associated with the video block; and

performing a conversion between the video block and a bitstream,

wherein the multiple blocks are located inside a coding tree block covering the second block, and

wherein the second block is identified by a non-zero motion vector that is derived from a spatial merge candidate of the second block,

the second block is identified by a motion vector derived from a merge candidate of the video block, or

the second block is identified by a motion vector derived from motion information of a spatial neighboring block of the video block.

10. The apparatus of claim 9 , wherein the one or more pictures includes a single picture co-located with the current picture.

11. The apparatus of claim 9 , wherein the multiple blocks are located inside the second block.

12. The apparatus of claim 9 , wherein the multiple blocks are located outside the second block.

13. The apparatus of claim 9 , wherein the non-zero motion vector is derived by scaling a motion vector based on one of the one or more pictures.

14. A video decoding apparatus comprising a processor configured to implement a method of video processing, comprising:

deriving multiple temporal motion vector prediction (TMVP) candidates for a video block in a current picture based on multiple blocks associated with a second block in one or more pictures that are temporally before or after the current picture, and the second block is collocated with the video block, wherein the second block has a same size as the video block, and wherein a relative position of the second block to a top-left corner of a second picture of the one or more pictures is same as that of the video block to a top-left corner of the current picture;

adding the multiple TMVP candidates to a motion candidate list associated with the video block; and

performing a conversion between the video block and a bitstream,

wherein the multiple blocks are located inside a coding tree block covering the second block, and

wherein the second block is identified by a non-zero motion vector that is derived from a spatial merge candidate of the second block,

the second block is identified by a motion vector derived from a merge candidate of the video block, or

the second block is identified by a motion vector derived from motion information of a spatial neighboring block of the video block.

15. The apparatus of claim 14 , wherein the one or more pictures includes a single picture co-located with the current picture.

16. The apparatus of claim 14 , wherein the multiple blocks are located inside the second block.

17. The apparatus of claim 14 , wherein the multiple blocks are located outside the second block.

18. A non-transitory computer-readable program medium having code stored thereupon, the code comprising instructions that, when executed by a processor, causing the processor to implement a method of video processing, comprising:

deriving multiple temporal motion vector prediction (TMVP) candidates for a video block in a current picture based on multiple blocks associated with a second block in one or more pictures that are temporally before or after the current picture, and the second block is collocated with the video block, wherein the second block has a same size as the video block, and wherein a relative position of the second block to a top-left corner of a second picture of the one or more pictures is same as that of the video block to a top-left corner of the current picture;

adding the multiple TMVP candidates to a motion candidate list associated with the video block; and

performing a conversion between the video block and a bitstream,

wherein the multiple blocks are located inside a coding tree block covering the second block, and

wherein the second block is identified by a non-zero motion vector that is derived from a spatial merge candidate of the second block,

the second block is identified by a motion vector derived from a merge candidate of the video block, or

the second block is identified by a motion vector derived from motion information of a spatial neighboring block of the video block.

19. The non-transitory computer-readable program medium of claim 18 , wherein the one or more pictures includes a single picture co-located with the current picture.

20. The non-transitory computer-readable program medium of claim 18 , wherein the multiple blocks are located inside the second block.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 18, 2020
From: ZHANG, LI; ZHANG, KAI
To: BYTEDANCE INC.
Reel/Frame 054694/0771 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 18, 2020
From: LIU, HONGBIN; WANG, YUE
To: BEIJING BYTEDANCE NETWORK TECHNOLOGY CO., LTD.
Reel/Frame 054694/0839 →
Priority Claims (1)
WO PCT/CN2018/093656 · Jun 29, 2018 · international
Continuity (2)
Continuation PCTIB2019055546 · Jul 1, 2019
Related Publication 20210105482A1 · Apr 8, 2021