IP Library › Granted Patent US 11,140,385
Granted Patent B2
US 11,140,385 · App. 17/005,702 · Granted Oct 5, 2021

Checking order of motion candidates in LUT

Inventors: Li Zhang (San Diego, CA); Kai Zhang (San Diego, CA); Hongbin Liu (Beijing, CN); Yue Wang (Beijing, CN)
Assignees: BEIJING BYTEDANCE NETWORK TECHNOLOGY CO., LTD.; BYTEDANCE INC.
H04N19/105H04N19/137H04N19/157H04N19/159H04N19/176H04N19/184H04N19/436H04N19/52H04N19/61H04N19/70H04N19/96
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,140,385
App. No.
17/005,702
Granted
Oct 5, 2021
Kind
B2
Abstract

A method of video processing includes maintaining tables, wherein each table includes a set of motion candidates and each motion candidate is associated with corresponding motion information; and performing a conversion between a first video block and a bitstream representation of a video including the first video block based on at least some of tables, the performing including checking motion candidates in a table in an order defined in a rule until a checking termination criteria is met.

Claims (42)

1. A video processing method, comprising:

maintaining one or more tables, wherein each table includes one or more candidates derived from one or more video blocks that have been coded, and arrangement of the candidates in the each table is based on a sequence of addition of the candidates into the table;

constructing a candidate list for a current video block, wherein at least one candidate in a table of the one or more tables is checked to determine whether to add motion information of a checked candidate from the table to the candidate list during the constructing, wherein the checking is terminated when a condition is met, the condition depending on a coding mode the current video block;

determining motion information of the current video block using the candidate list; and

coding the current video block based on the determined motion information,

wherein the condition comprises:

a number of candidates in the candidate list reaching a maximumly allowed candidate number of the candidate list minus a threshold, wherein the threshold depends on the coding mode of the current video block.

2. The method of claim 1 , wherein the coding comprises encoding the current video block into a bitstream representation.

3. The method of claim 1 , wherein the coding comprises decoding the current video block from a bitstream representation.

4. The method of claim 1 , wherein the coding mode is one of an Advanced Motion Vector Prediction (AMVP) mode or a merge mode.

5. The method of claim 1 , wherein the threshold further depends on at least one of a block shape, a block size of the current video block, a number of available candidates before adding candidates from the table.

6. The method of claim 1 , wherein the threshold is pre-defined as a positive integer.

7. The method of claim 6 , wherein the threshold equals to 1.

8. The method of claim 7 , wherein the candidate list is a merge candidate list.

9. The method of claim 1 , wherein the threshold is signaled in a bitstream.

10. The method of claim 1 , wherein the threshold is signaled in one or more of a Video Parameter Set (VPS), a Sequence Parameter Set (SPS), a Picture Parameter Set (PPS), a slice header, or a tile header.

11. The method of claim 1 , wherein the threshold (Th) depends on a number of available candidates before adding motion candidates from the table.

12. The method of claim 1 , wherein whether to update the motion candidate list based on the checked candidate is based on the checking result.

13. The method of claim 1 , wherein the at least one candidate in the table is checked in an order of at least one index of the at least one candidate.

14. The method of claim 1 , wherein if the current video block is coded with an AMVP mode, a maximum number of allowed candidates to be added into the candidate list from the table is one of 1, 2 or 4.

15. A video processing apparatus comprising a processor and a non-transitory memory with instructions thereon, wherein the instructions upon execution by the processor, cause the processor to:

maintain one or more tables, wherein each table includes one or more candidates derived from one or more video blocks that have been coded, and arrangement of the candidates in the each table is based on a sequence of addition of the candidates into the table;

construct a candidate list for a current video block, wherein at least one candidate in a table of the one or more tables is checked to determine whether to add motion information of a checked candidate from the table to the candidate list during the constructing, wherein the checking is terminated when a condition is met, the condition depending on a coding mode the current video block;

determine motion information of the current video block using the candidate list; and

code the current video block based on the determined motion information,

wherein the condition comprises:

a number of candidates in the candidate list reaching a maximumly allowed candidate number of the candidate list minus a threshold, wherein the threshold depends on the coding mode of the current video block.

16. The apparatus of claim 15 , wherein the coding mode is one of an AMVP mode or a merge mode.

17. A non-transitory computer-readable storage medium storing instructions that cause a processor to:

maintain one or more tables, wherein each table includes one or more candidates derived from one or more video blocks that have been coded, and arrangement of the candidates in the each table is based on a sequence of addition of the candidates into the table;

construct a candidate list for a current video block, wherein at least one candidate in a table of the one or more tables is checked to determine whether to add motion information of the checked candidate from the table to the candidate list during the constructing, wherein the checking is terminated when a condition is met, the condition depending on a coding mode the current video block;

determine motion information of the current video block using the candidate list; and

code the current video block based on the determined motion information,

wherein the condition comprises:

a number of candidates in the candidate list reaching a maximumly allowed candidate number of the candidate list minus a threshold, wherein the threshold depends on the coding mode of the current video block.

18. A non-transitory computer-readable recording medium storing a bitstream representation which is generated by a method with a video processing apparatus, wherein the method comprises:

maintaining one or more tables, wherein each table includes one or more candidates derived from one or more video blocks that have been coded, and arrangement of the candidates in the each table is based on a sequence of addition of the candidates into the table;

constructing a candidate list for a current video block, wherein at least one candidate in a table of the one or more tables is checked to determine whether to add motion information of a checked candidate from the table to the candidate list during the constructing, wherein the checking is terminated when a condition is met, the condition depending on a coding mode the current video block;

determining motion information of the current video block using the candidate list; and

encoding the current video block based on the determined motion information,

wherein the condition comprises:

a number of candidates in the candidate list reaching a maximumly allowed candidate number of the candidate list minus a threshold, wherein the threshold depends on the coding mode of the current video block.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 28, 2020
From: ZHANG, LI; ZHANG, KAI
To: BYTEDANCE INC.
Reel/Frame 053633/0850 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 28, 2020
From: LIU, HONGBIN; WANG, YUE
To: BEIJING BYTEDANCE NETWORK TECHNOLOGY CO., LTD.
Reel/Frame 053633/0878 →
Priority Claims (4)
WO PCT/CN2018/093663 · Jun 29, 2018 · international
WO PCT/CN2018/101220 · Aug 18, 2018 · international
WO PCT/CN2018/105193 · Sep 12, 2018 · international
WO PCT/CN2018/117627 · Nov 27, 2018 · international
Continuity (2)
Continuation PCTIB2019055581 · Jul 1, 2019
Related Publication 20200396447A1 · Dec 17, 2020
Cited By (6)
US 12,368,880 US 12,401,820 US 12,549,756 US 12,556,738 US 12,604,029 US 12,641,216