IP Library Granted Patent US 12,348,785
Granted Patent B2
US 12,348,785 · App. 18/399,417 · Granted Jul 1, 2025

Filters for motion compensation interpolation with reference down-sampling

Inventors: Jiancong Luo (San Mateo, CA); Yan Ye (San Mateo, CA); Mohammed Golam Sarwer (San Mateo, CA)
Assignee: Alibaba Group Holding Limited
H04N19/80H04N19/51
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,348,785
App. No.
18/399,417
Granted
Jul 1, 2025
Kind
B2
Abstract

The present disclosure provides systems and methods for processing video content using motion compensation interpolation. The methods include: encoding or decoding a picture block by applying one or more filters to a reference picture, wherein the applying of the one or more filters generates a sample at a fractional sample position, and wherein the one or more filters comprise an 8-tap filter that has a plurality of coefficients [p0, p1, . . . , p7] for each 1/16 fractional sample position p.

Claims (1005)

1. A computer-implemented method for processing video content, comprising:

encoding or decoding a picture block by applying one or more filters to a reference picture,

wherein the applying of the one or more filters generates a sample at a fractional sample position, and

wherein the one or more filters comprise an 8-tap filter that has a plurality of coefficients [p0, p1, . . . , p7] for each 1/16 fractional sample position p, as the following:

Fractional

sample position

Coefficients

p

p0

p1

p2

p3

p4

p5

p6

p7

0

−4

2

20

28

20

2

−4

0

1

−4

0

19

29

21

5

−4

−2

2

−4

−1

18

29

22

6

−4

−2

3

−4

−1

16

29

23

7

−4

−2

4

−4

−1

16

28

24

7

−4

−2

5

−4

−1

14

28

25

8

−4

−2

6

−3

−3

14

27

26

9

−3

−3

7

−3

−1

12

28

25

10

−4

−3

8

−3

−3

11

27

27

11

−3

−3

9

−3

−4

10

25

28

12

−1

−3

10

−3

−3

9

26

27

14

−3

−3

11

−2

−4

8

25

28

14

−1

−4

12

−2

−4

7

24

28

16

−1

−4

13

−2

−4

7

23

29

16

−1

−4

14

−2

−4

6

22

29

18

−1

−4

15

−2

−4

5

21

29

19

0

−4.

2. The method according to claim 1 , wherein the sample is a luma sample.

3. The method according to claim 1 , wherein the one or more filters comprise a 4-tap filter that has a plurality of coefficients [p0, p1, p2, p3] for each 1/p fractional sample position p, as the following:

Fractional sample

position

Coefficients

p

p0

p1

p2

p3

0

17

30

17

0

1

17

30

18

−1

2

16

30

18

0

3

16

30

18

0

4

15

30

18

1

5

14

30

18

2

6

13

29

19

3

7

13

29

19

3

8

12

29

20

3

9

11

28

21

4

10

10

28

22

4

11

10

27

22

5

12

9

27

23

5

13

9

26

24

5

14

8

26

24

6

15

7

26

25

6

16

7

25

25

7

17

6

25

26

7

18

6

24

26

8

19

5

24

26

9

20

5

23

27

9

21

5

22

27

10

22

4

22

28

10

23

4

21

28

11

24

3

20

29

12

25

3

19

29

13

26

3

19

29

13

27

2

18

30

14

28

1

18

30

15

29

0

18

30

16

30

0

18

30

16

31

−1

18

30

17.

4. The method according to claim 3 , wherein the sample is a chroma sample.

5. The method according to claim 1 , wherein the plurality of coefficients is signaled in at least one of a Sequence Parameter Set (SPS), a Picture Parameter Set (PPS), an Adaptation Parameter Set (APS), or a slice header.

6. The method according to claim 1 , wherein applying the one or more filters comprises:

selecting the one or more filter, based on a sampling ratio of the reference picture.

7. A system for processing video content, comprising:

a memory for storing a set of instructions; and

at least one processor configured to execute the set of instructions to cause the system to perform:

encoding or decoding a picture block by applying one or more filters to a reference picture,

wherein the applying of the one or more filters generates a sample at a fractional sample position, and

wherein the one or more filters comprise an 8-tap filter that has a plurality of coefficients [p0, p1, . . . , p7] for each 1/16 fractional sample position p, as the following:

Fractional

sample

Coefficients

position p

p0

p1

p2

p3

p4

p5

p6

p7

 0

−4

 2

20

28

20

 2

−4

 0

 1

−4

 0

19

29

21

 5

−4

−2

 2

−4

−1

18

29

22

 6

−4

−2

 3

−4

−1

16

29

23

 7

−4

−2

 4

−4

−1

16

28

24

 7

−4

−2

 5

−4

−1

14

28

25

 8

−4

−2

 6

−3

−3

14

27

26

 9

−3

−3

 7

−3

−1

12

28

25

10

−4

−3

 8

−3

−3

11

27

27

11

−3

−3

 9

−3

−4

10

25

28

12

−1

−3

10

−3

−3

 9

26

27

14

−3

−3

11

−2

−4

 8

25

28

14

−1

−4

12

−2

−4

 7

24

28

16

−1

−4

13

−2

−4

 7

23

29

16

−1

−4

14

−2

−4

 6

22

29

18

−1

−4

15

−2

−4

 5

21

29

19

 0

−4

8. The system according to claim 7 , wherein the sample is a luma sample.

9. The system according to claim 7 , wherein the one or more filters comprise a 4-tap filter that has a plurality of coefficients [p0, p1, p2, p3] for each 1/p fractional sample position p, as the following:

Fractional sample

position

Coefficients

p

p0

p1

p2

p3

0

17

30

17

0

1

17

30

18

−1

2

16

30

18

0

3

16

30

18

0

4

15

30

18

1

5

14

30

18

2

6

13

29

19

3

7

13

29

19

3

8

12

29

20

3

9

11

28

21

4

10

10

28

22

4

11

10

27

22

5

12

9

27

23

5

13

9

26

24

5

14

8

26

24

6

15

7

26

25

6

16

7

25

25

7

17

6

25

26

7

18

6

24

26

8

19

5

24

26

9

20

5

23

27

9

21

5

22

27

10

22

4

22

28

10

23

4

21

28

11

24

3

20

29

12

25

3

19

29

13

26

3

19

29

13

27

2

18

30

14

28

1

18

30

15

29

0

18

30

16

30

0

18

30

16

31

−1

18

30

17.

10. The system according to claim 9 , wherein the sample is a chroma sample.

11. The system according to claim 7 , wherein the plurality of coefficients is signaled in at least one of a Sequence Parameter Set (SPS), a Picture Parameter Set (PPS), an Adaptation Parameter Set (APS), or a slice header.

12. The system according to claim 7 , wherein in applying the one or more filters, the at least one processor is configured to execute the set of instructions to cause the system to perform:

selecting the one or more filter, based on a sampling ratio of the reference picture.

13. A method of storing a bitstream of a video, the method comprising:

applying one or more filters to a reference picture, wherein the applying of the one or more filters generates a sample at a fractional sample position;

generating a bitstream comprising coded information representing the sample at the fractional sample position; and

storing the bitstream in a non-transitory computer readable medium,

wherein the one or more filters comprise an 8-tap filter that has a plurality of coefficients [p0, p1, . . . , p7] for each 1/16 fractional sample position p, as the following:

Fractional

sample position

Coefficients

p

p0

p1

p2

p3

p4

p5

p6

p7

0

−4

2

20

28

20

2

−4

0

1

−4

0

19

29

21

5

−4

−2

2

−4

−1

18

29

22

6

−4

−2

3

−4

−1

16

29

23

7

−4

−2

4

−4

−1

16

28

24

7

−4

−2

5

−4

−1

14

28

25

8

−4

−2

6

−3

−3

14

27

26

9

−3

−3

7

−3

−1

12

28

25

10

−4

−3

8

−3

−3

11

27

27

11

−3

−3

9

−3

−4

10

25

28

12

−1

−3

10

−3

−3

9

26

27

14

−3

−3

11

−2

−4

8

25

28

14

−1

−4

12

−2

−4

7

24

28

16

−1

−4

13

−2

−4

7

23

29

16

−1

−4

14

−2

−4

6

22

29

18

−1

−4

15

−2

−4

5

21

29

19

0

−4.

14. The method according to claim 13 , wherein the sample is a luma sample.

15. The method according to claim 13 , wherein the one or more filters comprise a 4-tap filter that has a plurality of coefficients [p0, p1, p2, p3] for each 1/p fractional sample position p, as the following:

Fractional sample

position

Coefficients

p

p0

p1

p2

p3

0

17

30

17

0

1

17

30

18

−1

2

16

30

18

0

3

16

30

18

0

4

15

30

18

1

5

14

30

18

2

6

13

29

19

3

7

13

29

19

3

8

12

29

20

3

9

11

28

21

4

10

10

28

22

4

11

10

27

22

5

12

9

27

23

5

13

9

26

24

5

14

8

26

24

6

15

7

26

25

6

16

7

25

25

7

17

6

25

26

7

18

6

24

26

8

19

5

24

26

9

20

5

23

27

9

21

5

22

27

10

22

4

22

28

10

23

4

21

28

11

24

3

20

29

12

25

3

19

29

13

26

3

19

29

13

27

2

18

30

14

28

1

18

30

15

29

0

18

30

16

30

0

18

30

16

31

−1

18

30

17.

16. The method according to claim 15 , wherein the sample is a chroma sample.

17. The method according to claim 13 , wherein the coded information comprises a Sequence Parameter Set (SPS), a Picture Parameter Set (PPS), an Adaptation Parameter Set (APS), and a slice header, the plurality of coefficients being signaled in at least one of the SPS, PPS, APS, or slice header.

18. The method according to claim 13 , wherein applying the one or more filters comprises:

selecting the one or more filter, based on a sampling ratio of the reference picture.

Assignments (3)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 4, 2026
From: ALIBABA INNOVATION PRIVATE LIMITED
To: HFI INNOVATION INC.
Reel/Frame 075499/0876 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Feb 12, 2026
From: ALIBABA GROUP HOLDING LIMITED
To: ALIBABA INNOVATION PRIVATE LIMITED
Reel/Frame 074832/0914 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 17, 2025
From: LUO, JIANCONG; YE, YAN; SARWER, MOHAMMED GOLAM
To: ALIBABA GROUP HOLDING LIMITED
Reel/Frame 070534/0951 →
Continuity (5)
Continuation 17659139 · Apr 13, 2022
Continuation 16998332 · Aug 20, 2020
Provisional Application 62906930 · Sep 27, 2019
Provisional Application 62904608 · Sep 23, 2019
Related Publication 20240137575A1 · Apr 25, 2024
References Cited (48)
US 7535961B2 · Cho et al. · 2009 [cited by applicant]
US 7715573B1 · Yonemoto et al. · 2010 [cited by applicant]
US 8270480B2 · Yin et al. · 2012 [cited by applicant]
US 9179167B2 · Alshin et al. · 2015 [cited by applicant]
US 9319729B2 · Sullivan · 2016 [cited by applicant]
US 9596465B2 · Zhang et al. · 2017 [cited by applicant]
US 9686547B2 · Gamei et al. · 2017 [cited by applicant]
US 20030033338A1 · Lindgren et al. · 2003 [cited by applicant]
US 20050185937A1 · Comer · 2005 [cited by examiner]
US 20070263714A1 · Bois et al. · 2007 [cited by applicant]
US 20080165863A1 · Yan · 2008 [cited by examiner]
US 20130039428A1 · Lakshman et al. · 2013 [cited by applicant]
US 20140192865A1 · Zhang et al. · 2014 [cited by applicant]
US 20180288417A1 · Jung · 2018 [cited by examiner]
US 20180302638A1 · Seo et al. · 2018 [cited by applicant]
US 20180376145A1 · Bordes et al. · 2018 [cited by applicant]
CN 107925772A · 2018 [cited by applicant]
JP 2009522935A · 2009 [cited by applicant]
JP 2019505110A · 2019 [cited by applicant]
JP 2022544164A · 2022 [cited by applicant]
WO WO2017158236A2 · 2017 [cited by applicant]
WO WO2020228660A1 · 2020 [cited by applicant]
WO WO2020263499A1 · 2020 [cited by applicant]
WO WO2021026363A1 · 2021 [cited by applicant]
He et al., “AHG8: Interpolation filters for 360 video geometry conversion and coding,” JVET-D0073, 4 [cited by applicant]
Hendry et al., “AHG19: Adaptive resolution change (ARC) support in VVC,” JVET-N0118-v3, 14th Meeting: Geneva, CH, Mar. 19-27, 2019, 10 pages. [cited by applicant]
Japanese Office Action issued in corresponding Japanese Application No. 2022-514464 on Aug. 8, 2024 (10 pages). [cited by applicant]
Japanese Search Report issued in corresponding Japanese Application No. 2022-514464 on Aug. 6, 2024 (32 pages). [cited by applicant]
Luo et al., “CE1-related: Reference picture resampling filters,” JVET-P0353-v5, 16 [cited by applicant]
“Requirements for a Future Video Coding Standard v5,” International Organisation for Standardisation, Torino, IT, 14 pages (2017). [cited by applicant]
Chen et al., Algorithm description for Versatile Video Coding and Test Model 5 (VTM 5), JVET-N1002-v2, 14 [cited by applicant]
Chen et al., “Algorithm Description of Joint Exploration Test Model 7 (JEM 7),” JVET-G1001-v1, 7 [cited by applicant]
Chen et al., “AHG 19: Adaptive Resolution Change,” JVET-N0279, 14 [cited by applicant]
Chen et al., “AHG8: Integrated Specification Text for Reference Picture Resampling,” JVET-01164-v1, 15 [cited by applicant]
Dong et al., “Downsampling filters for anchor generation for scalable extensions of HEVC,” m24499, May 2012, 4 pages. [cited by applicant]
International Telecommunications Union “Series H: Audiovisual and Multimedia Systems Infrastructure of audiovisual services—Coding of moving video”, ITU-T Telecommunication Standardization Sector of ITU, Apr. 2013, 317 … [cited by applicant]
Jem, https://jvet.hhl.frunhofer_de/svn/svn_HMJEMSoftware. [cited by applicant]
SHM reference software, https://hevc.hhl.fraunhofer.de/svn/svn_SHVCSoftware/tags/SHM-12.4/ [cited by applicant]
Sullivan et al., “Overview of the High Efficiency Video Coding (HEVC) Standard,” IEE Transactions on Circuits and Systems for Video Technology, vol. 22, No. 12, pp. 1649-1668 (2012). [cited by applicant]
PCT International Search Report and Written Opinion mailed Nov. 23, 2020, issued in corresponding International Application No. PCT/US2020/047249 (7 pgs.). [cited by applicant]
European Patent Office Communication issued for Application No. 20868195.7 the Supplementary European Search Report (Art. 153(7) EPC) and the European search opinion dated Jul. 18, 2023, 10 pages. [cited by applicant]
Dai et al., “Advanced Resampling Filters for HEVC Applications,” JCTVC-G862, 17 [cited by applicant]
Pu et al., “SCE4: Results of Test 4.2.2 on Adaptive Re-Sampling Filter,” JCTVC-M0267, 13 [cited by applicant]
Samuelsson et al., “CE1-1: RPR downsampling filter,” JVET-P0088, 16 [cited by applicant]
Samuelsson et al., “AHG 8: Adaptive Resolution Change (ARC) High Level Syntax (HLS),” JVET-00204, 15th Meeting: Gothenburg, SE, Jul. 3-12, 2019, 6 pges. [cited by applicant]
Samuelsson et al., “AHG 8: Adaptive Resolution Change (ARC) with downsampling,” JVET-O0240-v1, 15 [cited by applicant]
Yates, Randy, “Practical Considerations in Fixed-Point FIR Filter Implementations,” Digital Signal Labs, 15 pages, 2010. [cited by applicant]
First Office Action issued in corresponding Chinese Application No. 202080066387.4 on Nov. 4, 2024 (7 pages). [cited by applicant]