IP Library › Granted Patent US 11,616,978
Granted Patent B2
US 11,616,978 · App. 17/360,902 · Granted Mar 28, 2023

Simplification of hash-based motion searching

Inventors: Jizheng Xu (San Diego, CA); Jiahao Li (Beijing, CN); Weijia Zhu (San Diego, CA); Kai Zhang (San Diego, CA); Li Zhang (San Diego, CA); Hongbin Liu (Beijing, CN); Yue Wang (Beijing, CN)
Assignees: BEIJING BYTEDANCE NETWORK TECHNOLOGY CO., LTD.; BYTEDANCE INC.
H04N19/56H04N19/105H04N19/137H04N19/139H04N19/147H04N19/176H04N19/513H04N19/52H04N19/537H04N19/543H04N19/132H04N19/567
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,616,978
App. No.
17/360,902
Granted
Mar 28, 2023
Kind
B2
Abstract

Methods, systems and device for hash-based motion estimation in video coding are described. An exemplary method of video processing includes determining, for a conversion between a current block of a video and a bitstream representation of the video, motion information associated with the current block using a hash-based motion search, a size of the current block being M×N, M and N being positive integers and M being not equal to N, applying, based on the motion information and a video picture comprising the current block, a prediction for the current block, and performing, based on the prediction, the conversion.

Claims (47)

1. A method of processing video data, comprising:

determining, for a conversion between a current block of a video and a bitstream of the video, motion information associated with the current block using a hash-based motion search that includes performing a K-pel integer motion vector (MV) precision check for the hash-based motion search, wherein K is a positive integer;

applying, based on the motion information and a video picture comprising the current block, a prediction for the current block; and

performing, based on the prediction, the conversion,

wherein the method further comprises:

determining the hash-based motion search resulted in a hash match,

determining a quantization parameter (QP) of a reference frame is larger than a QP of a video block, and

determining a rate-distortion cost of the prediction based on (a) the hash-based motion search resulting in the hash match and (b) the QP of the reference frame being larger than the QP of the video block,

wherein further processing of the current block is based on the rate-distortion cost, and

wherein determining the rate-distortion cost (a) is based on a dimension of the current block and (b) includes skipping advanced motion vector prediction (AMVP) or stopping finer-grained block partition checking.

2. The method of claim 1 , wherein K=4.

3. The method of claim 1 , wherein a size of the current block is N×N, wherein N is a positive integer less than or equal to a threshold.

4. The method of claim 1 , wherein a size of the current block is M×N, wherein M and N are positive integers and M is not equal to N, and wherein M or N are less than or equal to a threshold.

5. The method of claim 3 , wherein the threshold is 64.

6. The method of claim 4 , wherein the threshold is 64.

7. The method of claim 1 , wherein a size of the current block is 8×4 or 4×8.

8. The method of claim 1 , wherein the hash-based motion search is applied to a luma component of the video.

9. The method of claim 1 , wherein the hash-based motion search is applied to a base color component of the video.

10. The method of claim 1 , wherein the conversion includes encoding the current block into the bitstream.

11. The method of claim 1 , wherein the conversion includes decoding generates the current block from the bitstream.

12. An apparatus for processing video data comprising a processor and a non-transitory memory with instructions thereon, wherein the instructions upon execution by the processor, cause the processor to:

determine, for a conversion between a current block of a video and a bitstream of the video, motion information associated with the current block using a hash-based motion search that includes performing a K-pel integer motion vector (MV) precision check for the hash-based motion search, wherein K is a positive integer;

apply, based on the motion information and a video picture comprising the current block, a prediction for the current block; and

perform, based on the prediction, the conversion,

wherein the instructions upon execution by the processor, further cause the processor to:

determine the hash-based motion search resulted in a hash match,

determine a quantization parameter (QP) of a reference frame is larger than a QP of a video block, and

determine a rate-distortion cost of the prediction based on (a) the hash-based motion search resulting in the hash match and (b) the QP of the reference frame being larger than the QP of the video block,

wherein further processing of the current block is based on the rate-distortion cost, and

wherein determining the rate-distortion cost (a) is based on a dimension of the current block and (b) includes skipping advanced motion vector prediction (AMVP) or stopping finer-grained block partition checking.

13. The apparatus of claim 12 , wherein K=4.

14. The apparatus of claim 12 , wherein a size of the current block is N×N, wherein N is a positive integer less than or equal to a threshold.

15. The apparatus of claim 12 , wherein a size of the current block is M×N, wherein M and N are positive integers and M is not equal to N, and wherein M or N are less than or equal to a threshold.

16. The apparatus of claim 14 , wherein the threshold is 64.

17. The apparatus of claim 15 , wherein the threshold is 64.

18. The apparatus of claim 12 , wherein a size of the current block is 8×4 or 4×8.

19. The apparatus of claim 12 , wherein the hash-based motion search is applied to a luma component of the video.

20. A non-transitory computer-readable recording medium storing a bitstream of a video which is generated by a method performed by a video processing apparatus, wherein the method comprises:

determining, motion information associated with a current block of the video using a hash-based motion search that includes performing a K-pel integer motion vector (MV) precision check for the hash-based motion search, wherein K is a positive integer;

applying, based on the motion information and a video picture comprising the current block, a prediction for the current block; and

generating, based on the prediction, the bitstream,

wherein the method further comprises:

determining the hash-based motion search resulted in a hash match,

determining a quantization parameter (QP) of a reference frame is larger than a QP of a video block, and

determining a rate-distortion cost of the prediction based on (a) the hash-based motion search resulting in the hash match and (b) the QP of the reference frame being larger than the QP of the video block,

wherein further processing of the current block is based on the rate-distortion cost, and

wherein determining the rate-distortion cost (a) is based on a dimension of the current block and (b) includes skipping advanced motion vector prediction (AMVP) or stopping finer-grained block partition checking.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 28, 2021
From: XU, JIZHENG; ZHU, WEIJIA; ZHANG, KAI; ZHANG, LI
To: BYTEDANCE INC.
Reel/Frame 056693/0342 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 28, 2021
From: LI, JIAHAO; LIU, HONGBIN; WANG, YUE
To: BEIJING BYTEDANCE NETWORK TECHNOLOGY CO., LTD.
Reel/Frame 056693/0378 →
Priority Claims (2)
CN PCT/CN2019/070049 · Jan 2, 2019 · national
CN PCT/CN2019/087969 · May 22, 2019 · national
Continuity (2)
Continuation PCTCN2020070123 · Jan 2, 2020
Related Publication 20210329293A1 · Oct 21, 2021