IP Library Granted Patent US 11,218,724
Granted Patent B2
US 11,218,724 · App. 17/002,190 · Granted Jan 4, 2022

Motion compensation methods for video coding

Inventors: Jiancong Luo (San Mateo, CA); Zhao Wang (Beijing, CN); Yan Ye (San Mateo, CA)
Assignee: Alibaba Group Holding Limited
H04N19/521H04N19/117H04N19/132H04N19/172
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,218,724
App. No.
17/002,190
Granted
Jan 4, 2022
Kind
B2
Abstract

The present disclosure provides methods and systems for motion compensation. The method can include: determining a plurality of intermediate interpolation coefficients of an interpolation filter, the determining of the plurality of intermediate interpolation coefficients being: based on positions of a plurality of integer samples respectively, and based on fractional reference positions of a plurality of fractional samples respectively; determining a plurality of integer interpolation coefficients of the interpolation filter by rounding the plurality of intermediate interpolation coefficients to a plurality of integers respectively; and applying the plurality of integer interpolation coefficients on a picture to perform motion compensation prediction.

Claims (51)

1. A computer-implemented method for processing video content, comprising:

determining a plurality of intermediate interpolation coefficients of an interpolation filter, wherein the plurality of intermediate interpolation coefficients are determined:

based on positions of a plurality of integer samples respectively, and

based on fractional reference positions of a plurality of fractional samples respectively;

determining a plurality of integer interpolation coefficients of the interpolation filter by rounding the plurality of intermediate interpolation coefficients to a plurality of integers respectively,

wherein, when one or more of the plurality of intermediate interpolation coefficients do not satisfy a condition, the one or more intermediate interpolation coefficients are rounded to minimize a sum of rounding errors of the plurality of intermediate interpolation coefficients; and

applying the plurality of integer interpolation coefficients on a picture to perform motion compensation prediction.

2. The method according to claim 1 , wherein determining the plurality of integer interpolation coefficients of the interpolation filter by rounding the plurality of intermediate interpolation coefficients to the plurality of integers respectively further comprises:

minimizing the sum of rounding errors of the plurality of intermediate interpolation coefficients.

3. The method according to claim 1 , further comprising:

in response to a first intermediate interpolation coefficient satisfying the condition, rounding the first intermediate interpolation coefficient to an integer that is nearest to the first intermediate interpolation coefficient.

4. The method according to claim 1 , wherein the condition comprises:

a difference between an intermediate interpolation coefficient and an integer that is nearest to the intermediate interpolation coefficient is less than a given threshold.

5. The method according to claim 1 , wherein applying the plurality of integer interpolation coefficients on the picture further comprises:

smoothing the plurality of integer interpolation coefficients based on a smoothing window function.

6. The method according to claim 5 , wherein the smoothing window function is at least one of:

a cosine function in association with the positions of the plurality of integer samples, the fractional reference positions of the plurality of fractional samples, and a smoothing parameter; or

a sine function in association with the positions of the plurality of integer samples, the fractional reference positions of the plurality of fractional samples, and a smoothing parameter.

7. The method according to claim 5 , wherein an output of the smoothing window function is a constant value.

8. The method according to claim 7 , wherein the constant value is equal to 1.

9. A system for processing video content, comprising:

a memory for storing a set of instructions; and

at least one processor configured to execute the set of instructions to cause the system to perform:

determining a plurality of intermediate interpolation coefficients of an interpolation filter, wherein the plurality of intermediate interpolation coefficients are determined:

based on positions of a plurality of integer samples respectively, and

based on fractional reference positions of a plurality of fractional samples respectively;

determining a plurality of integer interpolation coefficients of the interpolation filter by rounding the plurality of intermediate interpolation coefficients to a plurality of integers respectively,

wherein, when one or more of the plurality of intermediate interpolation coefficients do not satisfy a condition, the one or more intermediate interpolation coefficients are rounded to minimize a sum of rounding errors of the plurality of intermediate interpolation coefficients; and

applying the plurality of integer interpolation coefficients on a picture to perform motion compensation prediction.

10. The system according to claim 9 , wherein in determining the plurality of integer interpolation coefficients of the interpolation filter by rounding the plurality of intermediate interpolation coefficients to the plurality of integers respectively, the at least one processor is configured to execute the set of instructions to cause the system to further perform:

minimizing the sum of rounding errors of the plurality of intermediate interpolation coefficients.

11. The system according to claim 9 , wherein the at least one processor is configured to execute the set of instructions to cause the system to further perform:

in response to a first intermediate interpolation coefficient satisfying the condition, rounding the first intermediate interpolation coefficient to an integer that is nearest to the first intermediate interpolation coefficient.

12. The system according to claim 9 , wherein the condition comprises:

a difference between an intermediate interpolation coefficient and an integer that is nearest to the intermediate interpolation coefficient is less than a given threshold.

13. The system according to claim 9 , wherein in applying the plurality of integer interpolation coefficients on the picture further, the at least one processor is configured to execute the set of instructions to cause the system to further perform:

smoothing the plurality of integer interpolation coefficients based on a smoothing window function.

14. The system according to claim 13 , wherein the smoothing window function is at least one of:

a cosine function in association with the positions of the plurality of integer samples, the fractional reference positions of the plurality of fractional samples, and a smoothing parameter; or

a sine function in association with the positions of the plurality of integer samples, the fractional reference positions of the plurality of fractional samples, and a smoothing parameter.

15. The system according to claim 13 , wherein an output of the smoothing window function is a constant value.

16. The system according to claim 15 , wherein the constant value is equal to 1.

17. A non-transitory computer readable medium storing instructions that are executable by at least one processor of a computer system, wherein the execution of the instructions causes the computer system to perform a method comprising:

determining a plurality of intermediate interpolation coefficients of an interpolation filter, wherein the plurality of intermediate interpolation coefficients are determined:

based on positions of a plurality of integer samples respectively, and

based on fractional reference positions of a plurality of fractional samples respectively;

determining a plurality of integer interpolation coefficients of the interpolation filter by rounding the plurality of intermediate interpolation coefficients to a plurality of integers respectively,

wherein, when one or more of the plurality of intermediate interpolation coefficients do not satisfy a condition, the one or more intermediate interpolation coefficients are rounded to minimize a sum of rounding errors of the plurality of intermediate interpolation coefficients; and

applying the plurality of integer interpolation coefficients on a picture to perform motion compensation prediction.

18. The non-transitory computer readable medium according to claim 17 , wherein in determining the plurality of integer interpolation coefficients of the interpolation filter by rounding the plurality of intermediate interpolation coefficients to the plurality of integers respectively, the execution of the instructions causes the computer system to further perform:

minimizing the sum of rounding errors of the plurality of intermediate interpolation coefficients.

Assignments (3)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 4, 2026
From: ALIBABA INNOVATION PRIVATE LIMITED
To: HFI INNOVATION INC.
Reel/Frame 075499/0876 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Feb 12, 2026
From: ALIBABA GROUP HOLDING LIMITED
To: ALIBABA INNOVATION PRIVATE LIMITED
Reel/Frame 074832/0914 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Nov 11, 2020
From: LUO, JIANCONG; WANG, ZHAO; YE, YAN
To: ALIBABA GROUP HOLDING LIMITED
Reel/Frame 054335/0956 →
Continuity (2)
Provisional Application 62904718 · Sep 24, 2019
Related Publication 20210092438A1 · Mar 25, 2021