IP Library Granted Patent US 12,413,716
Granted Patent B2
US 12,413,716 · App. 18/405,773 · Granted Sep 9, 2025

Multi-line intra prediction

Inventors: Liang Zhao (Sunnyvale, CA); Xin Zhao (San Diego, CA); Xiang Li (Los Gatos, CA); Shan Liu (San Jose, CA)
Assignee: TENCENT AMERICA LLC
H04N19/11H04N19/117H04N19/176
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,413,716
App. No.
18/405,773
Granted
Sep 9, 2025
Kind
B2
Abstract

A method of and an apparatus for controlling intra prediction for decoding of a video sequence are provided. The method may include based on a reference line index signaling a first reference line nearest to a coding unit, among a plurality of reference lines adjacent to the coding unit, applying intra smoothing on one or more first reference lines comprising the first reference line, among the plurality of reference lines, and based on the intra smoothing being applied on the one or more first reference lines, applying a position-dependent intra prediction combination (PDPC) on one or more third reference lines comprising the first reference line, among the plurality of reference lines, while preventing application of the PDPC on one or more fourth reference lines other than the one or more third reference lines, among the plurality of reference lines.

Claims (50)

1. A method of controlling intra prediction for decoding of a video sequence, the method being performed by at least one processor, and the method comprising:

based on a reference line index, obtaining a first reference line nearest to a coding unit and applying intra-frame smoothing to the first reference line, wherein the first reference line is among a plurality of reference lines adjacent to the coding;

based on the intra-frame smoothing being applied to the first reference lines, applying an intra-frame prediction to the coding unit;

applying a position-dependent intra-frame prediction combination (PDPC) to the first reference line based on the intra-frame prediction applied to the coding unit; and

preventing application of PDPC to any reference line among the plurality of reference lines other than the first reference line.

2. The method of claim 1 , wherein method further comprises preventing application of intra-frame smoothing to any reference line among the plurality of reference lines other than the first reference line.

3. The method of claim 1 , wherein the method further comprises preventing application of intra-frame smoothing to any reference line among the plurality of reference lines except for a single reference line among the plurality of reference lines.

4. The method of claim 1 , further comprising:

determining whether an intra prediction angle corresponding to an intra prediction mode for decoding the video sequence is greater than a predetermined angle corresponding to a diagonal direction of the coding unit,

based on the intra prediction angle being determined to be greater than the predetermined angle, determining that the application of the intra smoothing is prevented on other reference lines other than the first reference line, among the plurality of reference lines.

5. The method of claim 1 , the method further comprising based on the intra prediction angle being determined to be greater than the predetermined angle, determining that the application of PDPC is prevented on other reference lines other than the first reference line, among the plurality of reference lines.

6. An apparatus for controlling intra prediction for encoding of a video sequence, the apparatus comprising:

at least one memory configured to store computer program code; and

at least one processor configured to access the at least one memory and operate according to the computer program code, the computer program code comprising:

first applying code configured to cause the at least one processor to, based on a reference line index, signal a first reference line nearest to a coding unit and determine that intra-frame smoothing is to be applied to the first reference line, wherein the first reference line is among a plurality of reference lines adjacent to the coding unit;

second applying code configured to cause the at least one processor to, based on the intra-frame smoothing being applied to the first reference lines, determine that an intra-frame prediction is to be applied to the coding unit;

third applying code configured to cause the at least one processor to determine that a position-dependent intra-frame prediction combination (PDPC) is to be applied to the first reference line based on the intra-frame prediction being applied to the coding unit; and

preventing code configured to cause the at least one processor to determine that an application of PDPC to any reference line among the plurality of reference lines other than the first reference line is to be prevented.

7. A method for transmitting a bitstream generated by an encoding method performed by an encoding apparatus, the method comprising:

based on a reference line index, signaling a first reference line nearest to a coding unit and determining that intra-frame smoothing is to be applied to the first reference line, wherein the first reference line is among a plurality of reference lines adjacent to the coding;

based on the intra-frame smoothing being applied to the first reference lines, determining that an intra-frame prediction is to be applied to the coding unit;

determining a position-dependent intra-frame prediction combination (PDPC) is to be applied to the first reference line based on the intra-frame prediction being applied to the coding unit; and

determining that an application of PDPC to any reference line among the plurality of reference lines other than the first reference line is to be prevented.

8. The method of claim 1 , the method further comprising:

determining an index value range equal to or higher than a specific index value among the plurality of reference lines as a threshold index range, and a plurality of intra-frame prediction modes corresponding to the threshold index range are in the horizontal direction of the coding unit;

determining whether a current index value of a current intra-frame prediction mode for decoding the video sequence is within the threshold index range, and

determining that the intra-frame smoothing is prevented from being applied to a second reference line corresponding to the current index value based on the determination that the current index value is within the threshold index range.

9. The method of claim 1 , the method further comprising:

determining an index value range equal to or higher than a specific index value among the plurality of reference lines as a threshold index range, and a plurality of intra-frame prediction modes corresponding to the threshold index range in the vertical direction of the coding unit;

determining whether a current index value of a current intra-frame prediction mode for decoding the video sequence is within the threshold index range; determining that the intra-frame smoothing is prevented from being applied to a second reference line corresponding to the current index value based on the determination that the current index value is within the threshold index range.

10. The method of claim 1 , wherein the first reference line comprises one or more first reference lines,

wherein the intra-frame smoothing applied to the first reference line comprises applying the intra-frame smoothing to the one or more first reference lines among the plurality of reference lines while preventing the application of intra-frame smoothing to one or more second reference lines among the plurality of reference lines; and

wherein the applying the PDPC to the first reference line comprises applying the PDPC to the one or more first reference lines among the plurality of reference lines while preventing the application of the PDPC to one or more third reference lines among the plurality of reference lines.

11. The method of claim 7 , the method further comprising:

determining an index value range equal to or higher than a specific index value among the plurality of reference lines as a threshold index range, and a plurality of intra-frame prediction modes corresponding to the threshold index range are in the horizontal direction of the coding unit;

determining whether a current index value of a current intra-frame prediction mode for encoding the video sequence is within the threshold index range, and

determining that the intra-frame smoothing is to be prevented from being applied to a second reference line corresponding to the current index value based on the determination that the current index value is within the threshold index range.

12. The method of claim 7 , the method further comprising:

determining an index value range equal to or higher than a specific index value among the plurality of reference lines as a threshold index range, and a plurality of intra-frame prediction modes corresponding to the threshold index range in the vertical direction of the coding unit;

determining whether a current index value of a current intra-frame prediction mode for encoding the video sequence is within the threshold index range;

determining that the intra-frame smoothing is to be prevented from being applied to a second reference line corresponding to the current index value based on the determination that the current index value is within the threshold index range.

13. The method of claim 7 , wherein the first reference line comprises one or more first reference lines,

wherein the intra-frame smoothing to be applied to the first reference line comprises applying the intra-frame smoothing to the one or more first reference lines among the plurality of reference lines while preventing the application of intra-frame smoothing to one or more second reference lines among the plurality of reference lines; and

wherein the PDPC to be applied to the first reference line comprises applying the PDPC to the one or more first reference lines among the plurality of reference lines while preventing the application of the PDPC to one or more third reference lines among the plurality of reference lines.

14. The method of claim 7 , wherein method further comprises determining that the application of intra-frame smoothing to any reference line among the plurality of reference lines other than the first reference line is to be prevented.

15. The method of claim 7 , wherein the method further comprises determining that application of intra-frame smoothing to any reference line among the plurality of reference lines except for a single reference line among the plurality of reference lines is to be prevented.

16. The method of claim 7 , further comprising:

determining whether an intra prediction angle corresponding to an intra prediction mode for encoding the video sequence is greater than a predetermined angle corresponding to a diagonal direction of the coding unit,

based on the intra prediction angle being determined to be greater than the predetermined angle, determining that the application of the intra smoothing is to be prevented on other reference lines other than the first reference line, among the plurality of reference lines.

17. The method of claim 7 , the method further comprising based on the intra prediction angle being determined to be greater than the predetermined angle, determining that the application of PDPC is to be prevented on other reference lines other than the first reference line, among the plurality of reference lines.

Continuity (6)
Continuation 17837805 · Jun 10, 2022
Continuation 17172591 · Feb 10, 2021
Continuation 16662958 · Oct 24, 2019
Continuation 16199891 · Nov 26, 2018
Provisional Application 62724575 · Aug 29, 2018
Related Publication 20240146911A1 · May 2, 2024
References Cited (26)
US 10491893B1 · Zhao · 2019 [cited by examiner]
US 10944964B2 · Zhao · 2021 [cited by examiner]
US 11418778B2 · Zhao · 2022 [cited by examiner]
US 11902514B2 · Zhao · 2024 [cited by examiner]
US 20170359595A1 · Zhang et al. · 2017 [cited by applicant]
US 20180176587A1 · Panusopone et al. · 2018 [cited by applicant]
US 20180288425A1 · Panusopone et al. · 2018 [cited by applicant]
US 20180332284A1 · Liu et al. · 2018 [cited by applicant]
US 20180367814A1 · Seregin et al. · 2018 [cited by applicant]
US 20190141318A1 · Li et al. · 2019 [cited by applicant]
JP 202014198A · 2020 [cited by applicant]
WO 2017190288A1 · 2017 [cited by applicant]
WO 2017222326A1 · 2017 [cited by applicant]
Korean Office Action dated Jul. 11, 2023 in Korean Application No. 10-2022-7024880. [cited by applicant]
Chen et al., “Description of SDR, HDR and 360 video coding technology proposal by Qualcomm and Technicolor—low and high complexity versions”, Joint Video Exploration Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC … [cited by applicant]
Extended European Search Report dated Jun. 15, 2022 in European Application No. 19853798.7. [cited by applicant]
M. Albrecht et al., “Description of SDR, HDR, and 360 video coding technology proposal by Fraunhofer HHI”, Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, 2018, Document: JVET-J0014-v4… [cited by applicant]
Benjamin Bross et al., CE3: Multiple reference line intra prediction (Test 1.1.1,1.1.2,1.1.3 and 1.1.4), Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, 2018, Document: JVET-L0283, pp.… [cited by applicant]
M. Albrecht et al., “Description of SDR, HDR and 360 video coding technology proposal by Fraunhofer HHI”, ISO/IEC JTC 1/SC29/WG11, 2018, JVET-J0014 (56 pages total). [cited by applicant]
Leonardo Chiariglione,“Report of 122nd MPEG Meeting”, ISO/IEC JTC 1/SC 29/WG 11, 2018, N17480 (392 pages total). [cited by applicant]
Communication dated Oct. 14, 2021 from the Korean Patent Office in Korean Application No. 10-2020-7030970. [cited by applicant]
Jianle Chen et al., “Algorithm Description of Joint Exploration Test Model 5 (JEM 5)”, Joint Video Exploration Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, JVET-E1001-v2, 2017, pp. 1-41 (44 pages total… [cited by applicant]
Benjamin Bross et al., “CE3-related: On the combination of multiple reference lines, bilateral reference line filtering, PDPC and 65 directional modes for intra prediction”, Joint Video Experts Team (JVET) of ITU-T SG16… [cited by applicant]
Po-Han Lin et al., “CE3: Number of extended reference line for intra prediction (Test 5.5.1 and 5.5.2)”, Joint Video Exploration Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, JVET-K0277, 2018, pp. 1-3 (… [cited by applicant]
Communication dated Nov. 9, 2021 from the Japanese Patent Office in Application No. 2020-560455. [cited by applicant]
Communication dated May 17, 2022 from the Chinese Patent Office in Chinese Application No. 201980035894.9. [cited by applicant]