IP Library Granted Patent US 12,395,673
Granted Patent B2
US 12,395,673 · App. 18/347,955 · Granted Aug 19, 2025

Motion compensation methods for video coding

Inventors: Jiancong Luo (San Mateo, CA); Zhao Wang (Beijing, CN); Yan Ye (San Mateo, CA)
Assignee: Alibaba Group Holding Limited
H04N19/521H04N19/117H04N19/132H04N19/172
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,395,673
App. No.
18/347,955
Granted
Aug 19, 2025
Kind
B2
Abstract

The present disclosure provides methods and systems for motion compensation. The method can include: determining a plurality of intermediate interpolation coefficients of an interpolation filter, the determining of the plurality of intermediate interpolation coefficients being: based on positions of a plurality of integer samples respectively, and based on fractional reference positions of a plurality of fractional samples respectively; determining a plurality of integer interpolation coefficients of the interpolation filter by rounding the plurality of intermediate interpolation coefficients to a plurality of integers respectively; and applying the plurality of integer interpolation coefficients on a picture to perform motion compensation prediction.

Claims (135)

1. A method of decoding a bitstream to output one or more pictures for a video stream, the method comprising:

receiving a bitstream; and

decoding, using coded information of the bitstream, one or more pictures,

wherein the decoding comprises:

applying a first interpolation filter to a reference picture to perform motion compensated interpolation based on the reference picture,

wherein the first interpolation filter has a plurality of integer interpolation coefficients comprising a first set of coefficients {0, 1, −5, 62, 8, −3, 1, 0} associated with integer reference sample positions.

2. The method according to claim 1 , wherein the first set of coefficients is used for estimating luma values at a ⅛ fractional sample position.

3. The method according to claim 1 , wherein the plurality of integer interpolation coefficients comprises a second set of coefficients {0, 2, −8, 60, 13, −4, 1, 0} associated with integer reference sample positions.

4. The method according to claim 3 , wherein the second set of coefficients is used for estimating luma values at a 3/16 fractional sample position.

5. The method according to claim 1 , wherein the plurality of integer interpolation coefficients comprises a second set of coefficients {0, 3, −11, 45, 34,−10, 3, 0} associated with integer reference sample positions.

6. The method according to claim 5 , wherein the second set of coefficients is used for estimating luma values at a 7/16 fractional sample position.

7. The method according to claim 1 , wherein the plurality of integer interpolation coefficients comprises a second set of coefficients {0, 3,−11, 40, 40,−11, 3, 0} associated with integer reference sample positions.

8. The method according to claim 7 , wherein the second set of coefficients is used for estimating luma values at a ½ fractional sample position.

9. The method according to claim 1 , wherein the plurality of integer interpolation coefficients comprises 15 sets of coefficients, each set of the coefficients being used for estimating luma values at a 1/16 fractional sample position.

10. The method according to claim 1 , wherein the first interpolation filter is a 6-tap filter.

11. The method according to claim 1 , wherein the first interpolation filter is an N-tap filter, and the plurality of integer interpolation coefficients are derived based on:

k

=

0

5

(

W

k

(

α

)

·

D

l

,

k

)

,

wherein l denotes integer reference sample positions and

l

=

-

(

N

2

)

+

1

,

,

N

2

)

,

wherein α denotes fractional sample positions associated with the first interpolation filter,

wherein:

W

k

(

α

)

=

{

1

2

(

k

=

0

)

cos

(

2

·

α

+

5

12

·

k

·

π

)

(

k

=

1

N

-

1

)

wherein

D

l

,

k

=

1

3

·

cos

(

2

·

l

+

5

12

·

k

·

π

)

.

12. A method of encoding a video sequence into a bitstream, the method comprising:

receiving a video sequence;

encoding one or more pictures of the video sequence; and

generating a bitstream,

wherein the encoding comprises:

applying a first interpolation filter to a reference picture to perform motion compensated interpolation based on the reference picture,

wherein the first interpolation filter has a plurality of integer interpolation coefficients comprising a first set of coefficients {0, 1,−5, 62, 8,−3, 1, 0} associated with integer reference sample positions.

13. The method according to claim 12 , wherein the plurality of integer interpolation coefficients comprises a second set of coefficients {0, 2,−8, 60, 13,−4, 1, 0} associated with integer reference sample positions.

14. The method according to claim 12 , wherein the plurality of integer interpolation coefficients comprises a second set of coefficients {0, 3,−11, 45, 34,−10, 3, 0} associated with integer reference sample positions.

15. The method according to claim 12 , wherein the plurality of integer interpolation coefficients comprises a second set of coefficients {0, 3,−11, 40, 40,−11, 3, 0} associated with integer reference sample positions.

16. A method of storing a bitstream of a video, the method comprising:

generating a bitstream comprising coded information, wherein the coded information is generated by applying a first interpolation filter to a reference picture to perform motion compensated interpolation based on the reference picture; and

storing the bitstream in a non-transitory computer readable medium,

wherein the first interpolation filter has a plurality of integer interpolation coefficients comprising a first set of coefficients {0, 1,−5, 62, 8,−3, 1, 0} associated with integer reference sample positions.

17. The method according to claim 16 , wherein the plurality of integer interpolation coefficients comprises a second set of coefficients {0, 2,−8, 60, 13,−4, 1, 0} associated with integer reference sample positions.

18. The method according to claim 16 , wherein the plurality of integer interpolation coefficients comprises a second set of coefficients {0, 3,−11, 45, 34,−10, 3, 0} associated with integer reference sample positions.

19. The method according to claim 16 , wherein the plurality of integer interpolation coefficients comprises a second set of coefficients {0, 3,−11, 40, 40,−11, 3, 0} associated with integer reference sample positions.

20. The method according to claim 16 , wherein the first interpolation filter is a 6-tap filter.

Assignments (3)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 4, 2026
From: ALIBABA INNOVATION PRIVATE LIMITED
To: HFI INNOVATION INC.
Reel/Frame 075499/0876 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Feb 12, 2026
From: ALIBABA GROUP HOLDING LIMITED
To: ALIBABA INNOVATION PRIVATE LIMITED
Reel/Frame 074832/0914 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 6, 2023
From: LUO, JIANCONG; WANG, ZHAO; YE, YAN
To: ALIBABA GROUP HOLDING LIMITED
Reel/Frame 064171/0089 →
Continuity (4)
Continuation 17556231 · Dec 20, 2021
Continuation 17002190 · Aug 25, 2020
Provisional Application 62904718 · Sep 24, 2019
Related Publication 20230353777A1 · Nov 2, 2023
References Cited (53)
US 9460488B2 · Jeon · 2016 [cited by applicant]
US 20040062307A1 · Hallapuro · 2004 [cited by applicant]
US 20050149593A1 · Koster · 2005 [cited by applicant]
US 20070290900A1 · Wang · 2007 [cited by applicant]
US 20080232452A1 · Sullivan · 2008 [cited by applicant]
US 20090062649A1 · Li · 2009 [cited by applicant]
US 20090257493A1 · Ye et al. · 2009 [cited by applicant]
US 20090257503A1 · Ye et al. · 2009 [cited by applicant]
US 20100002770A1 · Motta et al. · 2010 [cited by applicant]
US 20110243471A1 · Alshina et al. · 2011 [cited by applicant]
US 20120147963A1 · Sato · 2012 [cited by applicant]
US 20120163460A1 · Chien · 2012 [cited by applicant]
US 20120229602A1 · Chen et al. · 2012 [cited by applicant]
US 20120314771A1 · Lim et al. · 2012 [cited by applicant]
US 20130156346A1 · Lee et al. · 2013 [cited by applicant]
US 20140003524A1 · Jia · 2014 [cited by applicant]
US 20150172715A1 · Shimizu et al. · 2015 [cited by applicant]
US 20160156912A1 · Alshina et al. · 2016 [cited by applicant]
US 20180027255A1 · Alshina · 2018 [cited by examiner]
US 20180054622A1 · Bossen · 2018 [cited by applicant]
US 20180376166A1 · Chuang · 2018 [cited by applicant]
US 20190028736A1 · Karczewicz et al. · 2019 [cited by applicant]
US 20190268594A1 · Lim et al. · 2019 [cited by applicant]
US 20200221122A1 · Ye · 2020 [cited by applicant]
US 20200296404A1 · Yasugi et al. · 2020 [cited by applicant]
US 20210127110A1 · Filippov · 2021 [cited by examiner]
US 20210337194A1 · Filippov · 2021 [cited by examiner]
CN 1453725A · 2003 [cited by applicant]
CN 102129668A · 2011 [cited by applicant]
JP 2011517237A · 2011 [cited by applicant]
JP 2013524678A · 2013 [cited by applicant]
WO 2011126287A2 · 2011 [cited by applicant]
WO 2012005558A2 · 2012 [cited by applicant]
WO 2019065537A1 · 2019 [cited by applicant]
WO 2020141591A1 · 2020 [cited by applicant]
WO WO2021061322A1 · 2021 [cited by applicant]
“Requirements for a Future Video Coding Standard v5,” International Organisation for Standardisation, Torino, IT, 14 pages (2017). [cited by applicant]
Bross et al., “Versatile Video Coding (Draft 5),” JVET-N1001-v8, 14th Meeting: Geneva, CH Mar. 19-27, 2019, 300 pages. [cited by applicant]
Bross et al., “Versatile Video Coding (Draft 6), ”JVET-O2001-vE, 15th Meeting: Gothenburg, SE, Jul. 3-12, 2019, 455 pages. [cited by applicant]
Chen et al., “Algorithm Description of Joint Exploration Test Model 7 (JEM 7),” JVET-G1001-v1, 7th Meeting: Torino, IT, Jul. 13-21, 2017, 50 pages. [cited by applicant]
International Telecommunications Union “Series H: Audiovisual and Multimedia Systems Infrastructure of audiovisual services—Coding of moving video”, ITU-T Telecommunication Standardization Sector of ITU, Apr. 2013, 317 … [cited by applicant]
JEM, https://jvet.hhi.fraunhofer.de/svn/svn_HMJEMSoftware. [cited by applicant]
Sullivan et al., “Overview of the High Efficiency Video Coding (HEVC) Standard,” IEE Transactions on Circuits and Systems for Video Technology, vol. 22, No. 12, pp. 1649-1668 (2012). [cited by applicant]
Li et al., “CE2: Using the shorter-tap filter for 4x4 sized partitions (Test 2.4.6),” JVET-N0196-v1, 14th Meeting: Geneva, CH Mar. 19-27, 2019, 10 pages. [cited by applicant]
Ugur et al., “Motion Compensated Prediction and Interpolation Filter Design in H. 265/HEVC, IEEE Journal of Selected Topics in Signal Processing,” vol. 7, No. 6, Dec. 2013, pp. 946-956. [cited by applicant]
PCT International Search Report and Written Opinion mailed Nov. 20, 2020, issued in corresponding International Application No. PCT/US2020/047766 (7 pgs.). [cited by applicant]
European Patent Office Communication issued for Application No. 20867233.7 the Supplementary European Search Report (Art. 153(7) EPC) and the European search opinion dated Oct. 5, 2023, 10 pages. [cited by applicant]
Wang et al., “On 6-tap interpolation filter for affine 4x4 blocks,” JVET-Q0372-v1, 17th Meeting: Brussels, BE, Jan. 7-17, 2020,4 pages. [cited by applicant]
Japanese Office Action issued in corresponding Japanese Application No. 2022-515640 on Aug. 8, 2024 (10 pages). [cited by applicant]
Japanese Search Report issued in corresponding Japanese Application No. 2022-515640 on Aug. 1, 2024 (42 pages). [cited by applicant]
Li et al., “CE2-related: Using shorter-tap filter for 4x4 sized partition,” JVET-M0310, 13th Meeting: Marrakech, MA, Jan. 9-18, 2019, 8 pages. [cited by applicant]
Alshin et al., “CE3: DCT derived interpolation filter test by Samsung,” JCTVC-F247, 6th Meeting: Torino, IT, Jul. 14-22, 2011, 10 pages. [cited by applicant]
First Office Action issued in corresponding Chinese Application No. 202080066751.7 on Dec. 30, 2024, (10 pages). [cited by applicant]