IP Library › Granted Patent US 12,526,455
Granted Patent B2
US 12,526,455 · App. 18/818,310 · Granted Jan 13, 2026

Decoder, encoder and methods comprising a coding for intra subpartitions

Inventors: Santiago De Luxán Hernández (Berlin, DE); Valeri George (Berlin, DE); Gayathri Venugopal (Berlin, DE); Jens Brandenburg (Berlin, DE); Benjamin Bross (Berlin, DE); Heiko Schwarz (Berlin, DE); Detlev Marpe (Berlin, DE); Thomas Wiegand (Berlin, DE)
Assignee: Fraunhofer-Gesellschaft Zur Foerderung der angewandten Forschung e.V.
H04N19/61H04N19/159H04N19/176H04N19/46H04N19/625H04N19/70
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,526,455
App. No.
18/818,310
Granted
Jan 13, 2026
Kind
B2
Abstract

Decoder for decoding a picture, wherein blocks into which the picture is subdivided are assigned to a set of prediction types, which include intra prediction and inter prediction. For each of predetermined intra-predicted blocks, the decoder is configured to derive, from the data stream, an information on a partitioning of the respective predetermined intra-predicted block into partitions. The decoder is configured to derive, from the data stream, for each partition of the respective predetermined intra-predicted block, a partition-specific prediction residual signal related to a spatial domain prediction residual signal of the respective partition of the respective predetermined intra-predicted block via a predetermined transform. The predetermined transform can be identified out of a set of transforms including a first transform and a second transform, which equals a concatenation of a primary transform and a secondary transform applied onto a subset of coefficients of the primary transform.

Claims (50)

1 . A video decoder, the video decoder configured to:

decode, from a data stream, an intra-prediction mode for an intra-predicted block of a picture;

decode, from the data stream, information on a partitioning of the intra-predicted block into partitions;

determine a partition-specific intra-prediction for each partition of the intra-predicted block using the intra-prediction mode;

decode, from the data stream, for each partition of the intra-predicted block, a partition-specific transform domain residual;

determine whether, for each partition of the intra-predicted block, no non-zero transform coefficient lies outside a respective area;

responsive to a determination that, for each partition of the intra-predicted block, no non-zero transform coefficient lies outside the respective area, decode a secondary transform index for the intra-predicted block from the data stream, wherein the secondary transform index indicates one of: 1) not using an inverse secondary transform, 2) using a first inverse secondary transform or 3) using a second inverse secondary transform;

determine a partition-specific spatial domain residual from the partition-specific transform domain residual for each partition of the intra-predicted block; and

reconstruct each partition of the intra-predicted block using the partition-specific spatial domain residual and the partition-specific intra-prediction.

2 . The video decoder of claim 1 , wherein the partition-specific spatial domain residual is computed based on the secondary transform index.

3 . The video decoder of claim 1 , configured to:

responsive to a determination that for at least one partition of the intra-predicted block there is a non-zero transform coefficient outside the respective area, not decode the secondary transform index from the data stream and infer that no secondary transform is used for the intra-predicted block.

4 . The video decoder of claim 1 , wherein:

the first inverse secondary transform or the second inverse secondary transform is further indicated by the intra-prediction mode.

5 . A method of video decoding, the method comprising:

decoding, from a data stream, an intra-prediction mode for an intra-predicted block of a picture;

decoding, from the data stream, information on a partitioning of the intra-predicted block into partitions;

determining a partition-specific intra-prediction for each partition of the intra-predicted block using the intra-prediction mode;

decoding, from the data stream, for each partition of the intra-predicted block, a partition-specific transform domain residual;

determining whether, for each partition of the intra-predicted block, no non-zero transform coefficient lies outside a respective area;

responsive to a determination that, for each partition of the intra-predicted block, no non-zero transform coefficient lies outside the respective area, decoding a secondary transform index for the intra-predicted block from the data stream, wherein the secondary transform index indicates one of: 1) not using an inverse secondary transform, 2) using a first inverse secondary transform or 3) using a second inverse secondary transform;

determining a partition-specific spatial domain residual from the partition-specific transform domain residual for each partition of the intra-predicted block; and

reconstructing each partition of the intra-predicted block using the partition-specific spatial domain residual and the partition-specific intra-prediction.

6 . The method of claim 5 , wherein the partition-specific spatial domain residual is determined based on the secondary transform index.

7 . The method of claim 5 , comprising:

responsive to a determination that for at least one partition of the intra-predicted block there is a non-zero transform coefficient outside the respective area, not decoding the secondary transform index from the data stream and inferring that no secondary transform is used for the intra-predicted block.

8 . The method of claim 5 , wherein:

the first inverse secondary transform or the second inverse secondary transform is further indicated by the intra-prediction mode.

9 . A video encoder, the video encoder configured to:

encode, into a data stream, an intra-prediction mode for an intra-predicted block of a picture;

encode, into the data stream, information on a partitioning of the intra-predicted block into partitions;

determine a partition-specific intra-prediction for each partition of the intra-predicted block using the intra-prediction mode;

encode, into the data stream, a partition-specific transform domain residual for each partition of the intra-predicted block;

determine whether, for each partition of the intra-predicted block, no non-zero transform coefficient lies outside a respective area; and

responsive to a determination that, for each partition of the intra-predicted block, no non-zero transform coefficient lies outside the respective area, encode a secondary transform index for the intra-predicted block into the data stream, wherein the secondary transform index indicates one of: 1) not using an inverse secondary transform, 2) using a first inverse secondary transform or 3) using a second inverse secondary transform.

10 . The video encoder of claim 9 , configured to:

responsive to a determination that for at least one partition of the intra-predicted block there is a non-zero transform coefficient outside the respective area, not encode the secondary transform index and infer that no secondary transform is used for the intra-predicted block.

11 . The video encoder of claim 9 , wherein:

the first inverse secondary transform or the second inverse secondary transform is further indicated by the intra-prediction mode.

12 . A method of video encoding, the method comprising:

encoding, into a data stream, an intra-prediction mode for an intra-predicted block of a picture;

encoding, into the data stream, information on a partitioning of the intra-predicted block into partitions;

determining a partition-specific intra-prediction for each partition of the intra-predicted block using the intra-prediction mode;

encoding, into the data stream, a partition-specific transform domain residual for each partition of the intra-predicted block;

determining whether, for each partition of the intra-predicted block, no non-zero transform coefficient lies outside a respective area; and

responsive to a determination that, for each partition of the intra-predicted block, no non-zero transform coefficient lies outside the respective area, encoding a secondary transform index for the intra-predicted block into the data stream, wherein the secondary transform index indicates one of: 1) not using an inverse secondary transform, 2) using a first inverse secondary transform or 3) using a second inverse secondary transform.

13 . The method of claim 12 , comprising:

responsive to a determination that for at least one partition of the intra-predicted block there is a non-zero transform coefficient outside the respective area, not encoding the secondary transform index and inferring that no secondary transform is used for the intra-predicted block.

14 . The method of claim 12 , wherein:

the first inverse secondary transform or the second inverse secondary transform is further indicated by the intra-prediction mode.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 26, 2025
From: DE LUXÁN HERNÁNDEZ, SANTIAGO; GEORGE, VALERI; VENUGOPAL, GAYATHRI; BRANDENBURG, JENS; BROSS, BENJAMIN; SCHWARZ, HEIKO; MARPE, DETLEV; WIEGAND, THOMAS
To: FRAUNHOFER-GESELLSCHAFT ZUR FOERDERUNG DER ANGEWANDTEN FORSCHUNG E.V.
Reel/Frame 071532/0620 →
Priority Claims (3)
EP 19182425 · Jun 25, 2019 · regional
EP 19191601 · Aug 13, 2019 · regional
EP 19199382 · Sep 24, 2019 · regional
Continuity (3)
Continuation 17554429 · Dec 17, 2021
Continuation PCTEP2020067549 · Jun 23, 2020
Related Publication 20240422356A1 · Dec 19, 2024
References Cited (18)
US 11582486B2 · Koo · 2023 [cited by examiner]
US 12063384B2 · Lee · 2024 [cited by examiner]
US 12219130B2 · Heo · 2025 [cited by examiner]
US 20060176962A1 · Arimura · 2006 [cited by examiner]
US 20170264914A1 · Agyo · 2017 [cited by applicant]
US 20180192070A1 · Dupuis · 2018 [cited by applicant]
US 20190110049A1 · Gordon · 2019 [cited by examiner]
US 20190268594A1 · Lim · 2019 [cited by applicant]
US 20200105022A1 · Mora · 2020 [cited by applicant]
US 20240015328A1 · Zhang · 2024 [cited by examiner]
WO 2018037737A1 · 2019 [cited by applicant]
WO 2020206254A1 · 2020 [cited by applicant]
Jang, Hyeongmun, et al., “Adaptive NSST Kernel Size Selection”, Jang H. et al., 5. JVET Meeting; Jan. 12, 2017-Jan. 20, 2017; Geneva; (The Joint Video Exploration Team of ISO/IEC JTC1 /SC29/WG11 and ITU-T SG.16), 6 pp. [cited by applicant]
Koo, Moonmo, et al., “Reduced Secondary Transform (RST) Algorithm Description (JVET-N0193)”, Koo (LGE) M et al., “CE6: Reduced Secondary Transform (RST) (CE6-3.1)”, No. JVET-N0193, (Mar. 27, 2019), 14. JVET Meeting; Mar… [cited by applicant]
Pfaff, Jonathan, et al., “Intra prediction modes based on neural networks”, Pfaff J. et al., 10. JVET Meeting; Apr. 10, 2018-Apr. 20, 2018; San Diego; (The Joint Video Exploration Team of ISO/IEC JTC1/SC29/ WG11 and ITU… [cited by applicant]
Zhao, X., et al.; “TU-level Non-separable Secondary Transform”; JVET-B00059; Feb. 20-26, 2016; 5 pages. [cited by applicant]
Bross, Benjamin; “Versatile Video Coding (daft 4)”; JVET-M1001-v7; Jan. 9-18, 2019; 12 pages. [cited by applicant]
Koo et al: “CE6: Reduced Secondary Transform (RST) (CE6-3.1)”, JVET Meeting Mar. 19, 2019-Mar. 27, 2019 Geneva No. JVET-N0193-v5. [cited by applicant]