IP Library Granted Patent US 12,713,045
Granted Patent B2
US 12,713,045 · App. 18/792,160 · Granted Aug 18, 2026

Simplified signaling method for affine linear weighted intra prediction mode

Inventors: Liang Zhao (Sunnyvale, CA); Xin Zhao (San Jose, CA); Xiang Li (Saratoga, CA); Shan Liu (San Jose, CA)
Assignee: TENCENT AMERICA LLC.
H04N19/44H04N19/105H04N19/11H04N19/159H04N19/176H04N19/186H04N19/119H04N19/46
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,713,045
App. No.
18/792,160
Granted
Aug 18, 2026
Kind
B2
Abstract

Prediction information for a current block in a current picture is decoded, the prediction information indicating whether the current block is coded in matrix based intra prediction (MIP). When the current block is coded in the MIP, an MIP mode index indicating one of a plurality of MIP modes is determined. When the current block is not coded in the MIP and one of a plurality of neighboring blocks is coded in the MIP, an intra prediction candidate mode for the current block is determined to be a Planar intra prediction mode. The current block is reconstructed according to (i) the one of the plurality of MIP modes when the current block is coded in the MIP and (ii) the Planar intra prediction mode when the current block is not coded in the MIP and the one of the plurality of neighboring blocks is coded in the MIP.

Claims (66)

1 . A method for video decoding in a decoder, comprising:

decoding prediction information for a current block in a current picture that is a part of a coded video sequence, the prediction information indicating whether the current block is coded in matrix based intra prediction (MIP);

when the prediction information indicates that the current block is coded in the MIP,

determining an MIP mode index, the MIP mode index indicating one of a plurality of MIP modes;

when the current block is not coded in the MIP and one of a plurality of neighboring blocks is coded in the MIP,

determining an intra prediction candidate mode for the current block to be a Planar intra prediction mode; and

reconstructing the current block according to (i) the one of the plurality of MIP modes when the prediction information indicates that the current block is coded in the MIP and (ii) the Planar intra prediction mode when the prediction information indicates the current block is not coded in the MIP and the one of the plurality of neighboring blocks is coded in the MIP.

2 . The method of claim 1 , wherein the MIP mode index is one of a truncated binary codeword, a fixed length codeword, and a truncated unary codeword.

3 . The method of claim 1 , further comprising:

when the prediction information indicates that the current block is coded in the MIP,

constructing a mode candidate list including at least one fixed mode candidate, the at least one fixed mode candidate being a predetermined subset of the plurality of MIP modes.

4 . The method of claim 1 , wherein a total number of the plurality of MIP modes is a power of 2.

5 . The method of claim 1 , further comprising:

when the prediction information indicates that the current block is not coded in the MIP and the one of the plurality of neighboring blocks is coded in the MIP,

constructing a mode candidate list based on one of (i) a preset intra prediction mode and (ii) an intra prediction mode of another neighboring block of the neighboring blocks, the mode candidate list including the Planar intra prediction mode.

6 . The method of claim 5 , wherein the preset intra prediction mode is one of a Planar intra prediction mode, a DC intra prediction mode, a Horizontal intra prediction mode, and a Vertical intra prediction mode.

7 . The method of claim 5 , wherein the constructing further comprises:

setting the one of the plurality of neighboring blocks as unavailable.

8 . The method of claim 1 , further comprising:

when the prediction information indicates that the current block is coded in the MIP and a derived mode is used for an associated chroma block of the current block,

setting a prediction mode of the associated chroma block to be a preset intra prediction mode.

9 . A method for video decoding in a decoder, comprising:

decoding prediction information for a current block in a current picture that is a part of a coded video sequence, the prediction information indicating that the current block is coded in matrix based intra prediction (MIP);

determining whether a neighboring block adjacent to the current block is coded in the MIP;

when the neighboring block is not coded in the MIP,

constructing a mode candidate list based on one of (i) a preset MIP mode and (ii) an MIP mode of another neighboring block; and

reconstructing the current block based on the mode candidate list.

10 . The method of claim 9 , wherein the constructing further comprises:

when the neighboring block is not coded in the MIP, setting the neighboring block as unavailable.

11 . The method of claim 9 , wherein the neighboring block is adjacent to a top-right corner or a bottom-left corner of the current block.

12 . The method of claim 9 , wherein a size of the mode candidate list is based on coded information of the neighboring block included in the coded video sequence.

13 . The method of claim 9 , wherein the prediction information indicates that a chroma block of the current block is associated with multiple luma blocks, the method further comprises:

determining whether a luma block of the multiple luma blocks is coded in a non-MIP intra prediction mode; and

when the luma block is coded in the non-MIP intra prediction mode, determining a prediction mode of the chroma block of the current block to be a non-ALWIP intra prediction mode of the luma block.

14 . The method of claim 13 , further comprising:

when each of the multiple luma blocks is coded in the MIP, determining the prediction mode of the chroma block of the current block to be a preset intra prediction mode.

15 . A method for video encoding in an encoder, comprising:

when a current block in a current picture is coded in matrix based intra prediction (MIP),

determining an MIP mode index for the current block, the MIP mode index indicating one of a plurality of MIP modes;

when the current block is not coded in the MIP and a first neighboring block of the current block is coded in the MIP,

determining an intra prediction candidate mode for the current block to be a Planar intra prediction mode; and

encoding the current block according to (i) the one of the plurality of MIP modes when the current block is coded in the MIP and (ii) the Planar intra prediction mode when the current block is not coded in the MIP and the first neighboring block of the current block is coded in the MIP.

16 . The method of claim 15 , wherein the MIP mode index is one of a truncated binary codeword, a fixed length codeword, and a truncated unary codeword.

17 . The method of claim 15 , further comprising:

when the current block is coded in the MIP,

constructing a mode candidate list including at least one fixed mode candidate, the at least one fixed mode candidate being a predetermined subset of the plurality of MIP modes.

18 . A method for video encoding in an encoder, comprising:

determining that a current block in a current picture is coded in matrix based intra prediction (MIP);

determining whether a first neighboring block of the current block is coded in the MIP;

when the first neighboring block is not coded in the MIP,

constructing a mode candidate list for the current block based on one of (i) a preset MIP mode and (ii) an MIP mode of a second neighboring block of the current block; and

encoding the current block based on the mode candidate list.

19 . A non-transitory computer-readable storage medium storing instructions which when executed by a processor cause the processor to perform a method of encoding a bitstream, the method comprising:

when a current block in a current picture is coded in matrix based intra prediction (MIP),

determining an MIP mode index for the current block, the MIP mode index indicating one of a plurality of MIP modes;

when the current block is not coded in the MIP and a first neighboring block of the current block is coded in the MIP,

determining an intra prediction candidate mode for the current block to be a Planar intra prediction mode;

encoding, in the bitstream, the current block according to (i) the one of the plurality of MIP modes when the current block is coded in the MIP and (ii) the Planar intra prediction mode when the current block is not coded in the MIP and the first neighboring block of the current block is coded in the MIP; and

transmitting the bitstream.

20 . A non-transitory computer-readable storage medium storing instructions which when executed by a processor cause the processor to perform a method of encoding a bitstream, the method comprising:

determining that a current block in a current picture is coded in matrix based intra prediction (MIP);

determining whether a first neighboring block of the current block is coded in the MIP;

when the first neighboring block is not coded in the MIP,

constructing a mode candidate list for the current block based on one of (i) a preset MIP mode and (ii) an MIP mode of a second neighboring block of the current block;

encoding, in the bitstream, the current block based on the mode candidate list; and

transmitting the bitstream.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 29, 2025
From: ZHAO, LIANG; ZHAO, XIN; LI, XIANG; LIU, SHAN
To: TENCENT AMERICA LLC
Reel/Frame 070047/0457 →
Continuity (5)
Continuation 18308436 · Apr 27, 2023
Continuation 17411922 · Aug 25, 2021
Continuation 16822985 · Mar 18, 2020
Provisional Application 62829439 · Apr 4, 2019
Related Publication 20240397075A1 · Nov 28, 2024
References Cited (32)
US 9363511B2 · Zhang et al. · 2016 [cited by applicant]
US 9769472B2 · Liu et al. · 2017 [cited by applicant]
US 20170332084A1 · Seregin et al. · 2017 [cited by applicant]
US 20170347103A1 · Yu et al. · 2017 [cited by applicant]
US 20180098063A1 · Chen et al. · 2018 [cited by applicant]
US 20180176601A1 · Jeong · 2018 [cited by examiner]
US 20190045184A1 · Zhang et al. · 2019 [cited by applicant]
US 20190306513A1 · Van et al. · 2019 [cited by applicant]
US 20200014922A1 · Ramasubramonian et al. · 2020 [cited by applicant]
US 20200322623A1 · Chiang et al. · 2020 [cited by applicant]
US 20210105464A1 · Choi et al. · 2021 [cited by applicant]
Bross et al., “Versatile Video Coding (Draft 4),” JVET-M1001-v7, 13th Meeting: Marrakech, MA, Jan. 9-18, 2019 (299 pages). [cited by applicant]
Chen J et al: “Algorithm description for Versatile Video Coding and Test Model 4 (VTM 4)”, 13. JVET Meeting; Jan. 9, 2019-Jan. 18, 2019; Marrakech; (The Joint Video Exploration Team of ISO/IEC JTC1/SC29/WG11 and ITU-T S… [cited by applicant]
Ding et al., “Improved intra mode coding by multiple mode candidates,” Joint Collaborative Team on Video Coding (JCT-VC) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, 4th Meeting: Daegu, KR, Jan. 20-28, 2011, Docum… [cited by applicant]
Extended European Search Report in EP20783806.1, mailed Dec. 8, 2022, 20 pages. [cited by applicant]
Han et al., “EE1: Improvements for intra prediction mode coding,” Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, 8th Meeting: Macao, CN, Oct. 18-25, 2017, Document: JVET-H0024, 5 page… [cited by applicant]
Helle et al., “CE3-related: Non-linear weighted intra prediction (cross-check report in JVET-K0262),” Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, 11th Meeting: Ljubljana, SI, Jul. … [cited by applicant]
Helle et al., “CE3-related: Non-linear weighted intra prediction (tests 2.2.1 and 2.2.2),” Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, 12th Meeting: Macao, CN, Oct. 3-12, 2018, Doc… [cited by applicant]
High Efficiency Video Coding (HEVC), Rec. ITU-T H.265, International Telecommunication Union, Apr. 2015. (634 pages). [cited by applicant]
Hsiang et al., “Non-SCCE3: Palette index coding using a universal entropy coding scheme,” Joint Collaborative Team on Video Coding (JCT-VC) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, 18th Meeting: Sapporo, JP, J… [cited by applicant]
J-Y Huo et al: “Non-CE3: Removal of MIP mapping table” , 15. JVET Meeting; Jul. 3, 2019-Jul. 12, 2019; Gothenburg; (The Joint Video Exploration Team of ISO/IEC JTC1/SC29/WG11 and ITU-T SG. 16 ), No. JVET-00321 ; m48433,… [cited by applicant]
Japanese Office Action in 2021535036, mailed Jul. 19, 2022, 39 pages. [cited by applicant]
Kim et al., “Non-CE3: Simplification of Mip Mpm Derivation,” Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, 15th Meeting: Gothenburg, SE, Jul. 3-12, 2019, Document: JVET-O0469_v4, 11 … [cited by applicant]
Office Action in KR1020217015079, mailed Feb. 22, 2023, 15 pages. [cited by applicant]
Pfaff et al., “CE3: Affine linear weighted intra prediction (CE3-4.1, CE3-4.2)”, Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11 14th Meeting: Geneva, CH, JVET-N0217, Mar. 2019, 17 page… [cited by applicant]
Proposed Working Draft Text Modifications for JCTVC-H0435, Joint Video Experts Team on Video Coding (JCT-VC) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, Jan. 30, 2012, 6 pages. [cited by applicant]
Richardson, I., “H.264/MPEG4 Part 10,” Chapter 6, Oct. 2003, pp. 159-223. [cited by applicant]
Xu et al., “Fixed MPM set in intra mode coding for screen contents,” Joint Collaborative Team on Video Coding (JCT-VC) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, 15th Meeting: Geneva, CH, Oct. 23-Nov. 1, 2013, D… [cited by applicant]
Yoon et al., “Non-CE3: MIP Modifications,” Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, 15th Meeting: Gothenburg, SE, Jul. 3-12, 2019, Document: JVET-O0202, 4 pages. [cited by applicant]
Zhang et al., “Intra mode coding with fixed length binarization,” Joint Collaborative Team on Video Coding (JCT-VC) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, 8th Meeting: San Jose, USA, Nov. 21-30, 2011, Docume… [cited by applicant]
Zhang et al., “Non-CE6: Intra mode coding with fixed length binarization,” Joint Collaborative Team on Video Coding (JCT-VC) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, 8th Meeting: San Jose, USA, Feb. 1-10, 2012… [cited by applicant]
Zhao et al., “Non-CE3: Simplifications for MIP,” Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, 15th Meeting: Gothenburg, SE, Jul. 3-12, 2019, Document: JVET-O0171, 3 pages. [cited by applicant]