IP Library › Granted Patent US 12,445,643
Granted Patent B2
US 12,445,643 · App. 18/772,861 · Granted Oct 14, 2025

History-based motion vector prediction with default parameters

Inventors: Li Zhang (San Diego, CA); Kai Zhang (San Diego, CA); Hongbin Liu (Beijing, CN); Yue Wang (Beijing, CN)
Assignees: BEIJING BYTEDANCE NETWORK TECHNOLOGY CO., LTD.; BYTEDANCE INC.
H04N19/58H04N19/52H04N19/521H04N19/577H04N19/96
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,445,643
App. No.
18/772,861
Granted
Oct 14, 2025
Kind
B2
Abstract

Video coding and decoding techniques, including history-based motion vector prediction with default parameters, are described. One example video processing method includes resetting, for a conversion between a video unit of a video and a bitstream of the video, a history-based motion vector prediction (HMVP) table of size N by adding K HMVP motion candidates to the HMVP table, where the K HMVP motion candidates have default values, where N and K are positive integers, and where K≤N; and performing the conversion between the video unit and the bitstream using the HMVP table resulting from the resetting.

Claims (58)

1. A method of video processing, comprising:

resetting, for a conversion between a video unit of a video and a bitstream of the video, a history-based motion vector prediction (HMVP) table of size N by adding K HMVP motion candidates to the HMVP table,

wherein the K HMVP motion candidates have default values,

wherein N and K are positive integers, and

wherein K≤N; and

performing the conversion between the video unit and the bitstream using the HMVP table resulting from the resetting,

wherein, for a plurality of P slices or a plurality of P pictures, at least one of the K HMVP motion candidates comprises a motion vector set to (Mv(0,0), i),

wherein i is a reference picture index which is in a range between 0 and a number of reference pictures in list 0 minus 1, inclusive,

wherein the video unit is a P slice from the plurality of P slices or the video unit is a P picture from the plurality of P pictures, and

wherein a counter of available HMVP motion candidates in the HMVP table is excluded from the bitstream of the video in response to K being equal to N.

2. The method of claim 1 , wherein the K HMVP motion candidates are added to the HMVP table in an ascending order up to i, or wherein the K HMVP motion candidates are added to the HMVP table in a descending order starting from i.

3. The method of claim 1 , wherein one or more HMVP motion candidates are added to the HMVP table until the HMVP table includes K candidates in response to a number of reference picture in list 0 (L0) being less than K.

4. The method of claim 3 , wherein, for a plurality of B slices or a plurality of B pictures:

a) the K HMVP motion candidate includes: K0 uni-prediction motion candidates from list X, K1 uni-prediction motion candidates from list Y where Y is equal to (1−X)), and K2 bi-prediction motion candidates where K0+K1+K2=K, and K0/K1/K2>=0, wherein the video unit is a B slice from the plurality of B slices or the video unit is a B picture from the plurality of B pictures; or

b) the K HMVP motion candidate includes only bi-prediction motion candidates, wherein the video unit is a B slice from the plurality of B slices or the video unit is a B picture from the plurality of B pictures; or

c) the K HMVP motion candidate includes uni-prediction motion candidates interleaved with bi-prediction motion candidates, wherein the video unit is a B slice from the plurality of B slices or the video unit is a B picture from the plurality of B pictures; or

d) the K HMVP motion candidate includes uni-prediction motion candidates followed by bi-prediction motion candidates, wherein the video unit is a B slice from the plurality of B slices or the video unit is a B picture from the plurality of B pictures.

5. The method of claim 1 , wherein at least one HMVP motion candidate from the K HMVP motion candidates refers to a reference picture with a reference index equal to a specific value.

6. The method of claim 5 , wherein the specific value is zero.

7. The method of claim 1 , further comprising:

determining, prior to the performing the conversion, that N HMVP motion candidates have been filled in the HMVP table; and

adding, based on the determining, another motion candidate to the HMVP table according to a rule.

8. The method of claim 7 , wherein the rule specifies that the another motion candidate is added to the HMVP table by performing a comparing operation in which the another motion candidate is compared to each candidate in the HMVP table in an ascending order or a descending order of indexes of the N HMVP motion candidates.

9. The method of claim 8 , wherein the performing the comparing operation is terminated when the another motion candidate matches a motion candidate in the HMVP table.

10. The method of claim 8 , wherein the performing the comparing operation includes, upon determining that the another motion candidate is identical to a motion candidate in the HMVP table:

removing the motion candidate from the HMVP table; and

adding the another motion candidate to a last entry in the HMVP table.

11. The method of claim 8 , wherein the performing the comparing operation is terminated after determining, for all of the K HMVP motion candidates in the HMVP table, whether the another motion candidate matches any motion candidate in the HMVP table.

12. The method of claim 11 , wherein the performing the comparing operation includes, upon determining that the another motion candidate is identical to all M motion candidates in the HMVP table:

removing the M motion candidates from the HMVP table; and

repeatedly adding the another motion candidate to the HMVP table until the HMVP table is full.

13. The method of claim 1 , further comprising:

determining that an additional HMVP motion candidate is not to be added to the HMVP table upon determining that the additional HMVP motion candidate is identical or similar to at least one HMVP motion candidate in the HMVP table.

14. The method of claim 13 , wherein the at least one HMVP motion candidate is removed from the HMVP table upon determining that the additional HMVP motion candidate is identical or similar to the at least one HMVP motion candidate in the HMVP table.

15. The method of claim 1 , wherein the conversion includes encoding the video unit into the bitstream.

16. The method of claim 1 , wherein the conversion includes decoding the video unit from the bitstream.

17. An apparatus for processing video data comprising a processor and a non-transitory memory with instructions thereon, wherein the instructions upon execution by the processor, cause the processor to:

reset, for a conversion between a video unit of a video and a bitstream of the video, a history-based motion vector prediction (HMVP) table of size N by adding K HMVP motion candidates to the HMVP table,

wherein the K HMVP motion candidates have default values,

wherein N and K are positive integers, and

wherein K≤N; and

perform the conversion between the video unit and the bitstream using the HMVP table resulting from the resetting,

wherein, for a plurality of P slices or a plurality of P pictures, at least one of the K HMVP motion candidates comprises a motion vector set to (Mv(0,0), i),

wherein i is a reference picture index which is in a range between 0 and a number of reference pictures in list 0 minus 1, inclusive,

wherein the video unit is a P slice from the plurality of P slices or the video unit is a P picture from the plurality of P pictures, and

wherein a counter of available HMVP motion candidates in the HMVP table is excluded from the bitstream of the video in response to K being equal to N.

18. A non-transitory computer-readable recording medium storing a bitstream of a video which is generated by a method performed by a video processing apparatus, wherein the method comprises:

resetting a history-based motion vector prediction (HMVP) table of size N by adding K HMVP motion candidates to the HMVP table,

wherein the K HMVP motion candidates have default values,

wherein N and K are positive integers, and

wherein K≤N; and

generating the bitstream using the HMVP table resulting from the resetting,

wherein, for a plurality of P slices or a plurality of P pictures, at least one of the K HMVP motion candidates comprises a motion vector set to (Mv(0,0), i),

wherein i is a reference picture index which is in a range between 0 and a number of reference pictures in list 0 minus 1, inclusive,

wherein the video unit is a P slice from the plurality of P slices or the video unit is a P picture from the plurality of P pictures, and

wherein a counter of available HMVP motion candidates in the HMVP table is excluded from the bitstream of the video in response to K being equal to N.

19. The apparatus of claim 17 , wherein the K HMVP motion candidates are added to the HMVP table in an ascending order up to i, or wherein the K HMVP motion candidates are added to the HMVP table in a descending order starting from i.

20. The apparatus of claim 17 , wherein one or more HMVP motion candidates are added to the HMVP table until the HMVP table includes K candidates in response to a number of reference picture in list 0 (L0) being less than K.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 1, 2024
From: ZHANG, LI; ZHANG, KAI
To: BYTEDANCE INC.
Reel/Frame 068158/0426 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 1, 2024
From: LIU, HONGBIN; WANG, YUE
To: BEIJING BYTEDANCE NETWORK TECHNOLOGY CO., LTD.
Reel/Frame 068158/0476 →
Priority Claims (2)
WO PCT/CN2019/090451 · Jun 8, 2019 · international
WO PCT/CN2019/094703 · Jul 4, 2019 · international
Continuity (3)
Continuation 17539004 · Nov 30, 2021
Continuation PCTCN2020094842 · Jun 8, 2020
Related Publication 20240373061A1 · Nov 7, 2024
References Cited (59)
US 6249550B1 · Mizuno · 2001 [cited by applicant]
US 12041268B2 · Zhang · 2024 [cited by applicant]
US 20040047418A1 · Tourapis · 2004 [cited by applicant]
US 20120162452A1 · Liu · 2012 [cited by applicant]
US 20130342636A1 · Tian · 2013 [cited by applicant]
US 20180324437A1 · Kim · 2018 [cited by applicant]
US 20200021839A1 · Pham Van · 2020 [cited by examiner]
US 20200107017A1 · Hung · 2020 [cited by examiner]
US 20200169745A1 · Han · 2020 [cited by examiner]
US 20210006787A1 · Zhang et al. · 2021 [cited by applicant]
US 20210037240A1 · Zhang et al. · 2021 [cited by applicant]
US 20210037256A1 · Zhang et al. · 2021 [cited by applicant]
US 20210160532A1 · Zhang et al. · 2021 [cited by applicant]
US 20210203922A1 · Zhang · 2021 [cited by examiner]
US 20210211654A1 · Zhang et al. · 2021 [cited by applicant]
US 20210218980A1 · Zhang et al. · 2021 [cited by applicant]
US 20210266577A1 · Zhang et al. · 2021 [cited by applicant]
US 20210266584A1 · Zhang et al. · 2021 [cited by applicant]
US 20210266591A1 · Zhang et al. · 2021 [cited by applicant]
US 20210274167A1 · Liu et al. · 2021 [cited by applicant]
US 20210281847A1 · Zhang et al. · 2021 [cited by applicant]
US 20210306657A1 · Chen · 2021 [cited by examiner]
US 20210352309A1 · Liu et al. · 2021 [cited by applicant]
US 20210352315A1 · Zhang et al. · 2021 [cited by applicant]
US 20210385451A1 · Zhang et al. · 2021 [cited by applicant]
US 20220007047A1 · Zhang et al. · 2022 [cited by applicant]
US 20220014734A1 · Liu et al. · 2022 [cited by applicant]
US 20220014782A1 · Chon et al. · 2022 [cited by applicant]
CN 1642284A · 2005 [cited by applicant]
CN 107113424A · 2017 [cited by applicant]
CN 107113446A · 2017 [cited by applicant]
CN 109417625A · 2019 [cited by applicant]
EP 1515543A2 · 2005 [cited by applicant]
WO 2010122301A1 · 2010 [cited by applicant]
WO 2012102927A1 · 2012 [cited by applicant]
WO 2013056656A1 · 2013 [cited by applicant]
WO 2013077659A1 · 2013 [cited by applicant]
WO 2016034058A1 · 2016 [cited by applicant]
Zhang et al. “CE4-Related: History-based Motion Vector Prediction,” Joint Video Experts Team (JVET)of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 1111th Meeting: Ljubljana, SI, Jul. 10-18, 2018, document JVET-K0104, 201… [cited by examiner]
Document: JVET-N0843-v1, Xiaozhong Xu et al, CE8-related: Combination test of JVET-N0176/JVET-N0317/JVET-N0382 on simplification of IBC vector prediction, Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC … [cited by applicant]
Document: JVET-N0340_r1, Xianglin Wang et al, CE4-related: An improved method for triangle merge list construction, Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, 14th Meeting: Geneva… [cited by applicant]
Document: JVET-L0054, Seungsoo Jeong et al, CE4 Ultimate motion vector expression (Test 4.5.4), Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, 12th Meeting: Macao, CN, Oct. 3-12, 2018… [cited by applicant]
Document: JVET-L0100-v3, Man-Shu Chiang et al, CE10.1.1: Multi-hypothesis prediction for improving AMVP mode, skip or merge mode, and intra mode, Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC … [cited by applicant]
Document: JVET-M0147-v7, Sriram Sethuraman, CE9: Results of DMVR related Tests CE9.2.1 and CE9.2.2, Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, 13th Meeting: Marrakech, MA, Jan. 9-… [cited by applicant]
ITU-T H.265, Series H: Audiovisual and Multimedia Systems, Infrastructure of audiovisual services—Coding of moving video, High efficiency video coding, Feb. 2018, 692 pages. [cited by applicant]
Document: JCTVC-Y1002, C. Rosewarne et al, High Efficiency Video Coding (HEVC) Test Model 16 (HM 16) Improved Encoder Description Update 7, Joint Collaborative Team on Video Coding (JCT-VC) of ITU-T SG16 WP3 and ISO/IEC… [cited by applicant]
Document: JVET-G1001-v1, Jianle Chen et al, Algorithm Description of Joint Exploration Test Model 7 (JEM 7), Joint Video Exploration Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, 7th Meeting: Torino, IT… [cited by applicant]
JEM-7.0: https://jvet.hhi.fraunhofer.de/svn/svn_HMJEMSoftware/tags/ HM-16.6-JEM-7.0, Retrieved Jul. 12, 2024, 1 page. [cited by applicant]
Document: JVET-N0309-v3, Anastasia Henkel et al, Non-CE4: Switched half-pel interpolation filter, Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, 14th Meeting: Geneva, CH, Mar. 19-27, … [cited by applicant]
Document: JVET-L0106, Yi-Wen Chen et al, CE4-related: Modified History-based MVP to support parallel processing, Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, 12th Meeting: Macao, CN… [cited by applicant]
Document: JVET-K0104-v1v5, Li Zhang et al, CE4-related: History-based Motion Vector Prediction, Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, 11th Meeting: Ljubljana, SI, Jul. 10-18,… [cited by applicant]
Document: JVET-L0266-v1, Li Zhang et al, CE4: History-based Motion Vector Prediction (Test 4.4.7), Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, 12th Meeting: Macao, CN, Oct. 3-12, 2… [cited by applicant]
Office Action from Chinese Patent Application No. 202080042280.6 mailed Apr. 23, 2024 (19 pages). [cited by applicant]
International Search Report and Written Opinion from International Patent Application No. PCT/CN2020/099681 dated Sep. 28, 2020 (10 pages). [cited by applicant]
International Search Report and Written Opinion from International Patent Application No. PCT/CN2020/094842 dated Sep. 16, 2020 (9 pages). [cited by applicant]
Non Final Office Action from U.S. Appl. No. 17/539,004 dated Oct. 25, 2023 (24 pages). [cited by applicant]
Chen J., et al., “Algorithm Description of Joint Exploration Test Model 7 (JEM 7),” Joint Video Exploration Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, 7th Meeting: Torino, IT, Jul. 13-21, 2017, Docum… [cited by applicant]
Henkel, Anastasia et al., “Non-CE4: Switched half-pel interpolation filter”, Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11 14th Meeting: Geneva, CH, Mar. 19-27, 2019, (Mar. 27, 2019),… [cited by applicant]
Zhang L., et al., “CE4: History-Based Motion Vector Prediction (Test 4.4.7),” Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, 12th Meeting: Macao, CN, Oct. 3, 2018-Oct. 12, 2018, Docum… [cited by applicant]