IP Library › Granted Patent US 12,581,059
Granted Patent B2
US 12,581,059 · App. 18/525,393 · Granted Mar 17, 2026

Method and apparatus for restricted long-distance motion vector prediction

Inventors: Timofey Mikhailovich Solovyev (Munich, DE); Jianle Chen (San Diego, CA); Sergey Yurievich Ikonin (Moscow, RU); Maxim Borisovitch Sychev (Moscow, RU)
Assignee: Huawei Technologies Co., Ltd.
H04N19/105H04N19/137H04N19/159H04N19/1883
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,581,059
App. No.
18/525,393
Granted
Mar 17, 2026
Kind
B2
Abstract

The present disclosure relates to encoding and decoding of video images. Motion vectors are used as predictors for prediction of an image for a current coding unit CU, which is within a current coding tree unit CTU. The motion vectors are taken from a list of motion vector candidates MVCs. The list is generated for the current CU using a pattern of positions of allowed motion vectors, and in dependence on the positions of the pattern relative to the current CU, and on the position of the current CU within the current CTU. From the pattern, a subset of positions is selected and positions are restricted to positions within the current CTU, while other pattern positions not available or not stored in a buffer are excluded. Other excluded pattern positions may be substituted and/or adjusted to as to become available and/or are being stored in the buffer.

Claims (27)

1 . An apparatus for encoding a current coding unit (CU), wherein the apparatus comprises:

a processing circuitry configured to:

determine a list of one or more motion vector candidates (MVCs) for the current CU based on:

a position of a pattern relative to a position of the current CU, the pattern defining positions of motion vectors (MVs), wherein only some MV positions of the pattern are available in a buffer or stored in a buffer, wherein the pattern positions are split into subsets, each subset being a series of pattern positions having pattern located along a particular direction, and

the position of the current CU within a coding tree unit (CTU),

determine the list of MVCs for the current CU including selecting a subset of MV positions from the pattern positions based on:

excluding from the pattern positions those MV positions which are not available and stored in a buffer, wherein some of the excluded pattern positions are replaced by positions for which motion information is available by assigning the excluded MV positions to assigned MV positions along an x direction along a width of the current CTU and/or a y direction along a height of the current CTU.

2 . The apparatus according to claim 1 , wherein the selecting of the subset of MV positions includes selecting from the pattern positions those MV positions which are within the current CTU.

3 . The apparatus according to claim 1 , wherein the processing circuitry is further configured to determine the MVCs for the current CU including replacing one or more of the excluded MV positions by substitute MV positions determined in dependency on the excluded MV positions so as to fulfill one or more predetermined conditions.

4 . The apparatus according to claim 3 , wherein the one or more predefined conditions includes a condition that the substitute MV positions are available and/or are stored in the buffer.

5 . The apparatus according to claim 3 , wherein the substitute MV positions are determined to fulfill the condition that a distance between the substitute MV positions and the excluded MV positions is shortest.

6 . The apparatus according to claim 1 , wherein the processing circuitry is further configured to determine the MVCs for the current CU including adjusting the excluded MV positions to adjusted MV positions determined so as to be available and/or stored in the buffer.

7 . The apparatus according to claim 6 , wherein the determining of the adjusted MV positions includes assigning the excluded MV positions to assigned MV positions along a x direction along a width of the current CTU and/or a y direction along a height of the current CTU.

8 . The apparatus according to claim 7 , wherein the determining includes reassigning x positions or y positions of one or more assigned MV positions having the same x position or the same y position to reassigned y positions or x positions using a predetermined prescription.

9 . The apparatus according to claim 8 , wherein the predetermined prescription is shifting the y or x components of the assigned MV positions by an offset value.

10 . The apparatus according to claim 1 , the apparatus further comprising:

an inter-prediction unit for determining prediction of the current CU according to at least one motion vector, MV, out of the MVCs of said list; and

a compression unit for encoding the current CU by using the prediction of the CU.

11 . The apparatus according to claim 1 , wherein an n i pattern positions for a series S i are represented by positions (x 0i , y 0i ), (x 0i +dx i , y 0i +dyi), (x 0i +2*dx i , y 0i +2*dyi), . . . , (x 0i +n*dx i , y 0i +n*dyi), wherein (x 0i , y 0i ) refer to a position of a first position of the series and the dx i and the dy i refer to offsets between neighboring position in the series along the horizontal and vertical direction, respectively, wherein the first position is closest to the current CU.

12 . A method for encoding a current coding unit (CU), wherein the method comprises the steps of:

determining a list of one or more motion vector candidates (MVCs) for the current coding unit (CU) based on:

a position of a pattern relative to a position of the current CU, the pattern defining positions of motion vectors (MVs), wherein only some MV positions of the pattern are available in a buffer or stored in a buffer, wherein the pattern positions are split into subsets, each subset being a series of pattern positions having pattern located along a particular direction, and

the position of the current CU within a coding tree unit (CTU),

determining the list of MVCs for the current CU including selecting a subset of MV positions from the pattern positions based on:

excluding from the pattern positions those MV positions which are not available and stored in a buffer, wherein some of the excluded pattern positions are replaced by positions for which motion information is available by assigning the excluded MV positions to assigned MV positions along an x direction along a width of the current CTU and/or a y direction along a height of the current CTU.

13 . A computer-readable non-transitory medium storing a program, including instructions which when executed on a processor cause the processor to perform the method according to claim 12 .

14 . The method according to claim 12 , wherein an n i pattern positions for a series S i are represented by positions (x 0i , y 0i ), (x 0i +dx i , y 0i +dyi), (x 0i +2*dx i , y 0i +2*dyi), . . . , (x 0i +n*dx i , y 0i +n*dyi), wherein (x 0i , y 0i ) refer to a first position of the series and the dx i and the dy i refer to offsets between neighboring position in the series along the horizontal and vertical direction, respectively, wherein the first position is closest to the current CU.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Nov 30, 2023
From: SOLOVYEV, TIMOFEY MIKHAILOVICH; CHEN, JIANLE; IKONIN, SERGEY YURIEVICH; SYCHEV, MAXIM BORISOVITCH
To: HUAWEI TECHNOLOGIES CO., LTD.
Reel/Frame 065722/0698 →
Continuity (5)
Continuation 16918733 · Jul 1, 2020
Continuation PCTRU2019050073 · May 31, 2019
Provisional Application 62693345 · Jul 2, 2018
Provisional Application 62679009 · May 31, 2018
Related Publication 20240291962A1 · Aug 29, 2024
References Cited (25)
US 20120134415A1 · Lin et al. · 2012 [cited by applicant]
US 20120320984A1 · Zhou · 2012 [cited by applicant]
US 20140016701A1 · Chen et al. · 2014 [cited by applicant]
US 20140092967A1 · Seregin et al. · 2014 [cited by applicant]
US 20150195559A1 · Chen · 2015 [cited by examiner]
US 20160227218A1 · Trudeau et al. · 2016 [cited by applicant]
US 20170127041A1 · Bang et al. · 2017 [cited by applicant]
US 20170310961A1 · Liu et al. · 2017 [cited by applicant]
US 20180098070A1 · Chuang · 2018 [cited by examiner]
US 20190364279A1 · Yasugi et al. · 2019 [cited by applicant]
US 20200077085A1 · Zhang · 2020 [cited by examiner]
CN 107027038A · 2017 [cited by applicant]
WO 2019079611A1 · 2019 [cited by applicant]
An, Jicheng et al., “Enhanced Merge Mode based on JEM7.0”, Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/ IEC JTC 1/SC 29/WG 11, 10th Meeting: San Diengo, US, Apr. 10-20, 2018, JVET-J0059-v1. [cited by examiner]
U.S. Appl. No. 16/918,733, filed Jul. 1, 2020. [cited by applicant]
An et al., “Enhanced Merge Mode based on JEM7.0,” Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, JVET-J0059-v1, Total 14 pages 10th Meeting: San Diego, US (Apr. 10-20, 2018). [cited by applicant]
Ye et al., “Merge mode modification on top of Tencent's software in response to CfP,” Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, JVET-J0058-v1, Total 4 pages, 10th Meeting: San Di… [cited by applicant]
Li et al., “Description of SDR video coding technology proposal by Tencent,” Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, JVET-J0029-v1, Total 34 pages, 10th Meeting: San Diego, US … [cited by applicant]
Chen et al., “Description of SDR, HDR and 360° video coding technology proposal by Qualcomm and Technicolor—low and high complexity versions,” Joint Video Exploration Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC… [cited by applicant]
Sjöberg et al., “Description of SDR and HDR video coding technology proposal by Ericsson and Nokia,” Joint Video Exploration Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, JVET-J0012-v1, Total 32 pages, … [cited by applicant]
“Series H: Audiovisual and Multimedia Systems, Infrastructure of audiovisual services—Coding of moving video, High efficiency video coding,” Recommendation of ITU-T H.265, ITU-T Telecommunication Standardization Sector … [cited by applicant]
“Series H: Audiovisual and Multimedia Systems, Infrastructure of audiovisual services—Coding of moving video, Advanced video coding for generic audiovisual services,” Recommendation of ITU-T H.264, ITU-T Telecommunicati… [cited by applicant]
Garg et al., “Interpolated Candidate Motion Vectors for Boundary Matching Error Concealment Technique in Video,” IEEE Transactions on Circuits and Systems—II: Express Briefs, vol. 53, No. 10, pp. 1039-1043, Institute of… [cited by applicant]
Xin Yakun et al., “Research and optimization of Merge mode candidate decision in HEVC,” Technique and Method, pp. 72-74 (2016). With an English Abstract. [cited by applicant]
Schwarz et al., “Block Structures and Parallelism Features in HEVC,” Chapter 3 in V. Sze et al., (eds.), High Efficiency Video Coding (HEVC): Algorithms and Architectures, Integrated Circuits and Systems, Total 43 pages… [cited by applicant]