IP Library › Granted Patent US 11,082,690
Granted Patent B2
US 11,082,690 · App. 17/005,574 · Granted Aug 3, 2021

Checking order of motion candidates in LUT

Inventors: Li Zhang (San Diego, CA); Kai Zhang (San Diego, CA); Hongbin Liu (Beijing, CN); Yue Wang (Beijing, CN)
Assignees: BEIJING BYTEDANCE NETWORK TECHNOLOGY CO., LTD.; BYTEDANCE INC.
H04N19/105H04N19/137H04N19/157H04N19/159H04N19/176H04N19/184H04N19/436H04N19/52H04N19/61H04N19/70H04N19/96
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,082,690
App. No.
17/005,574
Granted
Aug 3, 2021
Kind
B2
Abstract

A method of video processing includes maintaining tables, wherein each table includes a set of motion candidates and each motion candidate is associated with corresponding motion information; and performing a conversion between a first video block and a bitstream representation of a video including the first video block based on at least some of tables, the performing including checking motion candidates in a table in an order defined in a rule until a checking termination criteria is met.

Claims (45)

1. A video processing method, comprising:

maintaining one or more tables, wherein each table includes one or more candidates derived from one or more video blocks that have been coded;

constructing a candidate list for a current video block of a video, wherein at least one candidate in the table is checked in an order of at least one index of the at least one candidate;

determining motion information of the current video block using the candidate list; and

coding the current video block based on the determined motion information, and

wherein K candidates from the table which have indices equal to a 0 , a 0 −T 0 , a 0 −T 0 −T 1 −T 2 , . . . a 0 −T 0 −T 1 −T 2 − . . . −T K−1 are checked in an order of K indices wherein a 0 and T i are integer values, i being 0 . . . K−1.

2. The method of claim 1 , wherein the coding comprises encoding the current video block into a bitstream representation.

3. The method of claim 1 , wherein the coding comprises decoding the current video block from a bitstream representation.

4. The method of claim 1 , wherein arrangement of the candidates in the each table is based on a sequence of addition of the candidates into the table, wherein indices of the candidates in the table is related with the sequence of addition of the candidates into the table.

5. The method of claim 4 , wherein when a new candidate is added into the table, the new candidate has an index greater than other candidates in the table.

6. The method of claim 1 , wherein the K candidates correspond to at least one of the one or more candidates with K largest indices or K smallest indices.

7. The method of claim 1 , wherein the at least one candidate in the table is checked based on a descending order of the at least one index.

8. The method of claim 1 , wherein a 0 is an index of the last candidate with a maximum index in the table.

9. The method of claim 1 , wherein T i has a same value for each of i=0 . . . K−1.

10. The method of claim 7 , wherein the candidate list is a merge candidate list.

11. The method of claim 1 , wherein the at least one candidate in the table is checked based on an ascending order of at least one index.

12. The method of claim 1 , the multiple tables comprise at two tables which are checked in different orders during constructing a candidate list.

13. The method of claim 1 , wherein the at least one candidate to be checked is determined based on coded information of the current video block.

14. The method of claim 13 , wherein the coded information includes at least one of a coding mode of the current video block, a number of candidates in the table, a number of candidates in a candidate list before adding a new one from the table, distances between the current video block and positions associated with the candidates in the table, a block shape of the current video block, a block size of the current video block.

15. The method of claim 14 , wherein the coding mode of the current video block is one of an AMVP mode, a merge mode, an affine mode, a non-affine AMVP mode, a non-affine merge mode, an affine AMVP (inter) mode, an affine merge mode, a current picture reference (CPR) mode, or a non-CPR mode.

16. The method of claim 1 , wherein the checking is terminated when a checking termination criteria is met wherein the checking termination criteria depends on at least one of: a coding mode of the current video block, a maximum number of allowed candidates to be checked from a table, a maximum number of allowed candidates in the candidate list.

17. The method of claim 1 , wherein a maximum number of candidates in the table to be checked depends on at least one of a coding mode of the current video block, a number of candidates in the table, a maximum number of allowed candidates to be added from the table, or a number of available candidates in a candidate list before checking the candidates from the table, a block size of the current video block, a block shape of the current video block, or a slice type.

18. The method of claim 1 , wherein a maximum number of candidates in the table to be checked is not greater than 4, if a coding mode of the current video block is AMVP mode.

19. The method of claim 1 , wherein a maximum number of candidates in the table to be checked is predefined or signaled.

20. The method of claim 1 , wherein if the current video block is coded with an AMVP mode, a maximum number of allowed candidates to be added into the candidate list from the table is one of 1, 2 or 4.

21. The method of claim 1 , wherein a candidate in the table is associated with motion information including at least one of: a prediction direction, a reference picture index, motion vector values, an intensity compensation flag, an affine flag, a motion vector difference precision, or motion vector difference value.

22. The method of claim 1 , wherein whether to update the candidate list based on the checked candidate is based on the checking result.

23. A video processing apparatus comprising a processor and a non-transitory memory with instructions thereon, wherein the instructions upon execution by the processor, cause the processor to:

maintain one or more tables, wherein each table includes one or more candidates derived from one or more video blocks that have been coded;

construct a candidate list for a current video block of a video, wherein at least one candidate in the table is checked in an order of at least one index of the at least one candidate;

determine motion information of the current video block using the candidate list; and

code the current video block based on the determined motion information, and

wherein K candidates from the table which have indices equal to a 0 , a 0 −T 0 , a 0 −T 0 −T 1 −T 2 , . . . a 0 −T 0 −T 1 −T 2 − . . . −T K−1 are checked in an order of K indices wherein a 0 and T i are integer values, i being 0 . . . K−1.

24. A non-transitory computer-readable storage medium storing instructions that cause a processor to:

maintain one or more tables, wherein each table includes one or more candidates derived from one or more video blocks that have been coded;

construct a candidate list for a current video block of a video, wherein at least one candidate in the table is checked in an order of at least one index of the at least one candidate;

determine motion information of the current video block using the candidate list; and

code the current video block based on the determined motion information, and

wherein K candidates from the table which have indices equal to a 0 , a 0 −T 0 , a 0 −T 0 −T 1 −T 2 , . . . a 0 −T 0 −T 1 −T 2 − . . . −T K−1 are checked in an order of K indices wherein a 0 and T i are integer values, i being 0 . . . K−1.

25. A non-transitory computer-readable recording medium storing a bitstream representation which is generated by a method with a video processing apparatus, wherein the method comprises:

maintaining one or more tables, wherein each table includes one or more candidates derived from one or more video blocks that have been coded;

constructing a candidate list for a current video block of a video, wherein at least one candidate in the table is checked in an order of at least one index of the at least one candidate;

determining motion information of the current video block using the candidate list; and

coding the current video block based on the determined motion information, and

wherein K candidates from the table which have indices equal to a 0 , a 0 −T 0 , a 0 −T 0 −T 1 −T 2 , . . . a 0 −T 0 −T 1 −T 2 − . . . −T K−1 are checked in an order of K indices wherein a 0 and T i are integer values, i being 0 . . . K−1.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 28, 2020
From: ZHANG, LI; ZHANG, KAI
To: BYTEDANCE INC.
Reel/Frame 053632/0855 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 28, 2020
From: LIU, HONGBIN; WANG, YUE
To: BEIJING BYTEDANCE NETWORK TECHNOLOGY CO., LTD.
Reel/Frame 053633/0405 →
Priority Claims (4)
WO PCT/CN2018/093663 · Jun 20, 2018 · international
WO PCT/CN2018/101220 · Aug 18, 2018 · international
WO PCT/CN2018/105193 · Sep 12, 2018 · international
WO PCT/CN2018/117627 · Nov 27, 2018 · international
Continuity (2)
Continuation PCTIB2019055581 · Jul 1, 2019
Related Publication 20200396446A1 · Dec 17, 2020