IP Library Granted Patent US 12,401,782
Granted Patent B2
US 12,401,782 · App. 17/781,901 · Granted Aug 26, 2025

Intra sub partitions for video encoding and decoding combined with multiple transform selection, matrix weighted intra prediction or multi-reference-line intra prediction

Inventors: Fabrice Leleannec (Betton, FR); Karam Naser (Mouazé, FR); Philippe Bordes (Laille, FR); Tangi Poirier (Thorigné-Fouillard, FR); Franck Galpin (Thorigne-Fouillard, FR); Gagan Rath (Rennes, FR); Antoine Robert (Mézières sur Couesnon, FR)
Assignee: InterDigital CE Patent Holdings, SAS
H04N19/105H04N19/132H04N19/176
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,401,782
App. No.
17/781,901
Filed
Jun 2, 2022
Granted
Aug 26, 2025
Kind
B2
Examiner
DANG, PHILIP
Art Unit
2488
USPC
375/240.02
Abstract

In an encoding apparatus or a decoding apparatus, an encoding method or decoding method combines various coding tools with intra sub partitioning mode in which a coding unit is split in multiple sub partitions. At least one embodiment particularly aims at the selection of primary transforms among a set of multiple transforms for video encoding or decoding of intra sub block partitions. At least one embodiment particularly aims at intra coding using Matrix-Based Intra Prediction mode combined with Intra Sub Partition mode. At least one embodiment particularly aims at intra coding using Multi-Reference-Line intra prediction mode combined with Intra Sub Partition mode.

Claims (46)

1. A method comprising:

obtaining information representative of a block of a video, wherein the block is coded using an intra-sub partition mode and the block is partitioned into sub partitions;

obtaining a syntax element representative of a reference line index, wherein the syntax element is signaled at the block level;

partitioning the block into sub partitions;

selecting a single reference line based on the reference line index;

for each of the sub partitions, predicting samples of the sub partitions based on applying a 2D matrix and 1D vector to a vector based on averaged samples of the single reference line;

applying an inverse transform to the sub partitions; and

decoding the block;

wherein the single reference line is selected from among multiple reference lines adjacent to a top line of the block or to a left column of the block and is used to predict all the sub partitions of the block.

2. A method comprising, for a block of a video coded using an intra-sub partition mode:

partitioning the block into sub partitions;

selecting a single reference line from among multiple reference lines adjacent to a top line of the block or to a left column of the block;

for each of the sub partitions, predicting samples of the sub partitions based on applying a 2D matrix and 1D vector to a vector based on averaged samples of the single reference line;

applying a transform to the sub partitions; and

encoding the block and signaling information, wherein the block is coded in intra-sub partition mode and the signaling information comprises a syntax element representative of a reference line index used for the predicting, wherein the syntax element is signaled at the block level;

wherein the single reference line is used to predict all the sub partitions of the block.

3. A video encoding apparatus comprising a processor configured to, for a block of a video coded using an intra-sub partition mode:

partition the block into sub partitions;

select a single reference line from among multiple reference lines adjacent to a top line of the block or to a left column of the block;

for each of the sub partitions, predict samples of the sub partitions based on applying a 2D matrix and 1D vector to a vector based on averaged samples of the single reference line;

apply a transform to the sub partitions; and

encode the block and signaling information, wherein the block is coded in intra-sub partition mode and the signaling information comprises a syntax element representative of a reference line index used for the predicting, wherein the syntax element is signaled at the block level;

wherein the single reference line is used to predict all the sub partitions of the block.

4. A video decoding apparatus comprising a processor configured to:

obtain information representative of a block of a video, wherein the block is coded using an intra-sub partition mode and the block is partitioned into sub partitions;

obtain a syntax element representative of a reference line index, wherein the syntax element is signaled at the block level;

partition the block into sub partitions;

select a single reference line based on the reference line index;

for each of the sub partitions, predict samples of the sub partitions based on applying a 2D matrix and 1D vector to a vector based on averaged samples of the single reference line;

apply an inverse transform to the sub partitions; and

decode the block;

wherein the single reference line is selected from among multiple reference lines adjacent to a top line of the block or to a left column of the block and is used to predict all the sub partitions of the block.

5. A non-transitory computer readable medium comprising program code instructions executable by a processor for implementing the method according to claim 1 .

6. A non-transitory computer readable medium comprising program code instructions executable by a processor for implementing the method according to claim 2 .

7. The method of claim 1 , wherein the type of partitioning is horizontal or vertical according to the value of the reference line index.

8. The method of claim 1 , wherein the type of partitioning is horizontal when the reference line index is equal to 1 and vertical when the reference line index is equal to 3.

9. The method of claim 1 , wherein the type of partitioning is horizontal when the reference line index is equal to 3 and vertical when the reference line index is equal to 1.

10. The method of claim 2 , wherein the type of partitioning is horizontal or vertical according to the value of the reference line index.

11. The method of claim 2 , wherein the type of partitioning is horizontal when the reference line index is equal to 1 and vertical when the reference line index is equal to 3.

12. The method of claim 2 , wherein the type of partitioning is horizontal when the reference line index is equal to 3 and vertical when the reference line index is equal to 1.

13. The apparatus of claim 3 , wherein the type of partitioning is horizontal or vertical according to the value of the reference line index.

14. The apparatus of claim 3 , wherein the type of partitioning is horizontal when the reference line index is equal to 1 and vertical when the reference line index is equal to 3.

15. The apparatus of claim 3 , wherein the type of partitioning is horizontal when the reference line index is equal to 3 and vertical when the reference line index is equal to 1.

16. The apparatus of claim 4 , wherein the type of partitioning is horizontal or vertical according to the value of the reference line index.

17. The apparatus of claim 4 , wherein the type of partitioning is horizontal when the reference line index is equal to 1 and vertical when the reference line index is equal to 3.

18. The apparatus of claim 4 , wherein the type of partitioning is horizontal when the reference line index is equal to 3 and vertical when the reference line index is equal to 1.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 1, 2023
From: INTERDIGITAL VC HOLDINGS FRANCE, SAS
To: INTERDIGITAL CE PATENT HOLDINGS, SAS
Reel/Frame 064460/0921 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 2, 2022
From: LELEANNEC, FABRICE; NASER, KARAM; BORDES, PHILIPPE; POIRIER, TANGI; GALPIN, FRANCK; RATH, GAGAN; ROBERT, ANTOINE
To: INTERDIGITAL VC HOLDINGS FRANCE, SAS
Reel/Frame 060086/0556 →
Priority Claims (3)
EP 19306575 · Dec 5, 2019 · regional
EP 19306576 · Dec 5, 2019 · regional
EP 19306577 · Dec 5, 2019 · regional
Continuity (1)
Related Publication 20230024223A1 · Jan 26, 2023
References Cited (78)
US 8902978B2 · Lim · 2014 [cited by examiner]
US 9100621B2 · Jeon · 2015 [cited by examiner]
US 9100649B2 · Park · 2015 [cited by examiner]
US 9154796B2 · Seregin · 2015 [cited by examiner]
US 9467692B2 · Rapaka · 2016 [cited by examiner]
US 9532058B2 · Chien · 2016 [cited by examiner]
US 9544597B1 · Han et al. · 2017 [cited by applicant]
US 9736454B2 · Hannuksela · 2017 [cited by examiner]
US 9749651B2 · Merkle · 2017 [cited by examiner]
US 9756330B2 · Merkle · 2017 [cited by examiner]
US 10003810B2 · Chuang · 2018 [cited by examiner]
US 10070128B2 · Ugur · 2018 [cited by examiner]
US 10136140B2 · Li · 2018 [cited by examiner]
US 10142627B2 · Zhao · 2018 [cited by examiner]
US 10171819B2 · Ramamurthy · 2019 [cited by examiner]
US 10244256B2 · Ikai · 2019 [cited by examiner]
US 10313668B2 · Gisquet · 2019 [cited by examiner]
US 10390044B2 · Karczewicz · 2019 [cited by examiner]
US 10531084B2 · Yoo · 2020 [cited by examiner]
US 10542264B2 · Panusopone · 2020 [cited by examiner]
US 10574982B2 · Merkle · 2020 [cited by examiner]
US 10587873B2 · Koo · 2020 [cited by examiner]
US 10681354B2 · Heo · 2020 [cited by examiner]
US 10757406B2 · Lee · 2020 [cited by examiner]
US 10764576B2 · Li · 2020 [cited by examiner]
US 10819977B2 · Zhao · 2020 [cited by examiner]
US 10841593B2 · Zhao · 2020 [cited by examiner]
US 10904567B2 · Kang · 2021 [cited by examiner]
US 10917660B2 · Vanam · 2021 [cited by examiner]
US 11051011B2 · Lee · 2021 [cited by examiner]
US 11102509B2 · Ko · 2021 [cited by examiner]
US 11128862B2 · Cho · 2021 [cited by examiner]
US 11184639B2 · Lee · 2021 [cited by examiner]
US 11202063B2 · Lee · 2021 [cited by examiner]
US 11218704B2 · Lim · 2022 [cited by examiner]
US 11228755B2 · Lee · 2022 [cited by examiner]
US 11233990B2 · Kim · 2022 [cited by examiner]
US 11259047B2 · Lee · 2022 [cited by examiner]
US 11350107B2 · Jun · 2022 [cited by examiner]
US 11368682B2 · Sim · 2022 [cited by examiner]
US 11375185B2 · Lee · 2022 [cited by examiner]
US 11405620B2 · Jun · 2022 [cited by examiner]
US 11438582B2 · Lee · 2022 [cited by examiner]
US 11463689B2 · Zhao · 2022 [cited by examiner]
US 11616987B2 · Jeong · 2023 [cited by examiner]
US 11743456B2 · Lee · 2023 [cited by examiner]
US 11831910B2 · Ko · 2023 [cited by examiner]
US 11909961B2 · Ko · 2024 [cited by examiner]
US 20130287093A1 · Hannuksela · 2013 [cited by examiner]
US 20140092978A1 · Bugdayci · 2014 [cited by examiner]
US 20150103906A1 · Zhao · 2015 [cited by examiner]
US 20150271515A1 · Pang · 2015 [cited by examiner]
US 20160373742A1 · Zhao · 2016 [cited by examiner]
US 20160373770A1 · Zhao · 2016 [cited by examiner]
US 20160373782A1 · Zhao · 2016 [cited by examiner]
US 20170094274A1 · Chien · 2017 [cited by examiner]
US 20170347102A1 · Panusopone et al. · 2017 [cited by applicant]
US 20180160113A1 · Jeong · 2018 [cited by examiner]
US 20190166375A1 · Jun et al. · 2019 [cited by applicant]
US 20190306494A1 · Chang et al. · 2019 [cited by applicant]
US 20200296417A1 · Ko · 2020 [cited by examiner]
US 20210076028A1 · Jin et al. · 2021 [cited by applicant]
US 20210160487A1 · Kim · 2021 [cited by examiner]
US 20230024223A1 · Le Leannec · 2023 [cited by examiner]
CN 110235444A · 2019 [cited by applicant]
CN 110312126A · 2019 [cited by applicant]
CN 109565593A · 2023 [cited by applicant]
WO 2018205950A1 · 2018 [cited by applicant]
WO 2019190181A1 · 2019 [cited by applicant]
JVET—Test Model 7 of Versatile Video Coding (VTM 7) (Year: 2019). [cited by examiner]
Anonymous, “High Efficiency Video Coding”, Series H: Audiovisual and Multimedia Systems, Infrastructure of Audiovisual Services—Coding of Moving Video, Recommendation ITU-T H.265 Standard, Telecommunication Standardizat… [cited by applicant]
Bross et al., “Versatile Video Coding (Draft 7)”, Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/ IEC JTC 1/SC 29/WG 11, Document: JVET-P2001-vE, 16th Meeting, Geneva, Switzerland, Oct. 1, 2019, 492 pages. [cited by applicant]
Anonymous, “Advanced video coding for generic audiovisual services”, International Telecommunication Union, ITU-T Telecommunication Standardization Sector of ITU, Series H: Audiovisual and Multimedia Systems, Infrastruc… [cited by applicant]
Naser, et al., “Non-CE6: Shape Adaptive Transform Selection for ISP, SBT and MTS”, Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, Document: JVET-N0388-v3; 14th Meeting: Geneva, Switze… [cited by applicant]
Naser et al., “Non-CE6: Simplified Transform Selection for ISP”, Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, Document: JVET-O0528, 15th Meeting: Gothenburg, Sweden, Jul. 3, 2019, 4… [cited by applicant]
Chen et al., Test Model 5 of Versatile Video Coding (VTM 5); International Organization for Standardization, ISO/IEC JTC1/SC29/WG11, Coding of Moving Pictures and Audio, Document: N18371, Geneva, Switzerland, Mar. 2019,… [cited by applicant]
Le Leannec, et al., “Non-CE3: simplified MRL and ISP mode coding”, Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, Document JVET-O0467, 15th Meeting: Gothenburg, SE, Jul. 3-12, 2019, 5… [cited by applicant]
Hongbin, et al., “Non-CE3: Cleanup for ISP flag and MRL index signalling”, Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, JVET-O0197, 15th Meeting: Gothenburg, SE, Jul. 3-12, 2019, 6 … [cited by applicant]