IP Library Granted Patent US 11,743,457
Granted Patent B2
US 11,743,457 · App. 17/061,044 · Granted Aug 29, 2023

Intra interpolation filter for multi-line intra prediction

Inventors: Liang Zhao (Sunnyvale, CA); Xin Zhao (San Diego, CA); Xiang Li (Los Gatos, CA); Shan Liu (San Jose, CA)
Assignee: TENCENT AMERICA LLC
H04N19/117G06T5/002G06T5/003G06T5/20H04N19/105H04N19/132H04N19/159G06T2207/20192H04N19/176
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,743,457
App. No.
17/061,044
Granted
Aug 29, 2023
Kind
B2
Abstract

A method and apparatus for selecting an intra interpolation filter for multi-line intra prediction based on a reference line index for decoding a video sequence includes identifying a set of reference lines associated with a coding unit. A first type of interpolation filter is applied to reference samples included in a first reference line, of the set of reference lines, that is adjacent to the coding unit to generate a first set of prediction samples based on the first reference line being associated with a first reference line index. A second type of interpolation filter is applied to reference samples included in a second reference line, of the set of reference lines, that is non-adjacent to the coding unit to generate a second set of prediction samples based on the second reference line being associated with a second reference line index.

Claims (36)

1. A method performed by at least one processor for selecting an intra interpolation filter for multi-line intra prediction based on a reference line index for decoding of a video sequence, the method comprising:

identifying a set of reference lines associated with a coding unit;

applying both an edge smoothing filter with only positive or zero coefficients and an edge preserving filter to reference samples included in a first reference line, of the set of reference lines, that is adjacent to the coding unit to generate a first set of prediction samples based on the first reference line being associated with a first reference line index; and

applying only the edge preserving filter but not the edge smoothing filter to reference samples included in a second reference line, of the set of reference lines, that is non-adjacent to the coding unit to generate a second set of prediction samples based on the second reference line being associated with a second reference line index.

2. The method of claim 1 , wherein the edge smoothing filter comprises a linear interpolation filter having only positive or zero filter coefficients, and

wherein the edge preserving filter comprises at least one of a linear interpolation filter having at least one or two negative filter coefficients, a non-linear filter, or a bilateral filter.

3. The method of claim 1 , wherein the first reference line has a first reference line index having a value of zero.

4. The method of claim 1 , wherein the edge preserving filter comprises at least one of a Cubic filter, a discrete cosine transform (DCT)-based filter, a polynomial-based interpolation filter, a bilateral filter, and a Hermite interpolation filter.

5. The method of claim 1 , wherein the second reference line has a second reference line index having a non-zero value.

6. The method of claim 1 , wherein a first tap number of the edge smoothing filter is different than a second tap number of the edge preserving filter.

7. The method of claim 1 , further comprising:

signaling a reference line index before intra prediction modes, wherein the signaled intra prediction modes excludes planar modes, and wherein the reference line index indicates which reference line is used for intra prediction.

8. A device for selecting an intra interpolation filter for multi-line intra prediction based on a reference line index for decoding of a video sequence, comprising:

at least one memory configured to store program code;

at least one processor configured to read the program code and operate as instructed by the program code, the program code including:

identifying code configured to cause the at least one processor to identify a set of reference lines associated with a coding unit;

first applying code configured to cause the at least one processor to apply both an edge smoothing filter with only positive or zero coefficients and an edge preserving filter to reference samples included in a first reference line, of the set of reference lines, that is adjacent to the coding unit to generate a first set of prediction samples based on the first reference line being associated with a first reference line index; and

second applying code configured to cause the at least one processor to apply only the edge preserving filter but not the edge smoothing filter to reference samples included in a second reference line, of the set of reference lines, that is non-adjacent to the coding unit to generate a second set of prediction samples based on the second reference line being associated with a second reference line index.

9. The device of claim 8 , wherein the edge smoothing filter comprises a linear interpolation filter having only positive or zero filter coefficients, and

wherein the edge preserving filter comprises at least one of a linear interpolation filter having at least one or two negative filter coefficients, a non-linear filter, or a bilateral filter.

10. The device of claim 8 , wherein the first reference line has a first reference line index having a value of zero.

11. The device of claim 8 , wherein the edge preserving filter comprises at least one of a Cubic filter, a discrete cosine transform (DCT)-based filter, a polynomial-based interpolation filter, a bilateral filter, and a Hermite interpolation filter.

12. The device of claim 8 , wherein the second reference line has a second reference line index having a non-zero value.

13. The device of claim 8 , wherein a first tap number of the edge smoothing filter is different than a second tap number of the edge preserving filter.

14. The device of claim 8 , further comprising:

signaling code configured to cause the at least one processor to signal a reference line index before intra prediction modes, wherein the signaled intra prediction modes excludes planar modes, and wherein the reference line index indicates which reference line is used for intra prediction.

15. A non-transitory computer-readable medium storing computer program code for selecting an intra interpolation filter for multi-line intra prediction based on a reference line index for decoding of a video sequence that, when executed by one or more processors of a device, cause the one or more processors to at least:

identify a set of reference lines associated with a coding unit;

apply both an edge smoothing filter with only positive or zero coefficients and an edge preserving filter to reference samples included in a first reference line, of the set of reference lines, that is adjacent to the coding unit to generate a first set of prediction samples based on the first reference line being associated with a first reference line index; and

apply only the edge preserving filter but not the edge smoothing filter to reference samples included in a second reference line, of the set of reference lines, that is non-adjacent to the coding unit to generate a second set of prediction samples based on the second reference line being associated with a second reference line index.

16. The non-transitory computer-readable medium of claim 15 , wherein the edge smoothing filter comprises a linear interpolation filter having only positive or zero filter coefficients, and

wherein the edge preserving filter comprises at least one of a linear interpolation filter having at least one or two negative filter coefficients, a non-linear filter, or a bilateral filter.

17. The non-transitory computer-readable medium of claim 15 , wherein the first reference line has a first reference line index having a value of zero.

18. The non-transitory computer-readable medium of claim 15 , wherein the edge preserving filter comprises at least one of a Cubic filter, a discrete cosine transform (DCT)-based filter, a polynomial-based interpolation filter, a bilateral filter, and a Hermite interpolation filter.

19. The non-transitory computer-readable medium of claim 15 , wherein the second reference line has a second reference line index having a non-zero value.

20. The non-transitory computer-readable medium of claim 15 , wherein a first tap number of the edge smoothing filter is different than a second tap number of the edge preserving filter.

Continuity (3)
Continuation 16202902 · Nov 28, 2018
Provisional Application 62729395 · Sep 10, 2018
Related Publication 20210021822A1 · Jan 21, 2021