IP Library Granted Patent US 12,634,441
Granted Patent B2
US 12,634,441 · App. 18/881,155 · Granted May 19, 2026

Apparatus, a method and a computer program for video coding and decoding

Inventors: Pekka Astola (Tampere, FI); Jani Lainema (Tampere, FI); Ramin Ghaznavi Youvalari (Tampere, FI)
Assignee: Nokia Technologies Oy
H04N19/105H04N19/117H04N19/176H04N19/186
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,634,441
App. No.
18/881,155
Granted
May 19, 2026
Kind
B2
Abstract

A method comprising: receiving an image block unit of a frame, the image block unit comprising samples in color channels comprising at least one chrominance channel and one luminance channel ( 1100 ); reconstructing samples of said luminance channels of the image block unit ( 1102 ); determining a reference area for predicting target samples of at least one color channel of the image block unit, wherein said reference area comprises one or more of reference samples in a neighboring block in current color channel/frame, in the neighboring of a co-located block in reference color channel/frame; and/or inside the co-located block in reference color channel/frame ( 1104 ); determining filter coefficients of a filter for said predicting based the reference samples and a shape of the filter ( 1106 ); reconstructing the target samples of at least one color channel of the image block unit using said prediction based on the samples of said reference area and the filter coefficients ( 1108 ); computing an autocorrelation matrix for the reconstructed target samples of the image block unit ( 1110 ); computing autocorrelation matrices for a plurality of neighboring image blocks units of said image block unit ( 1112 ); mixing the autocorrelation matrices of each of the plurality of neighboring image blocks units separately with the autocorrelation matrix of said image block unit ( 1114 ); and storing the mixed autocorrelation matrices for said image block unit ( 1116 ).

Claims (50)

1 . An apparatus comprising a processor, a memory, and a computer program code residing in the memory, wherein the computer program code when executed by the processor, is configured to cause the apparatus to perform:

receiving an image block unit of a frame, the image block unit comprising samples in one or more color channels comprising at least one chrominance channel and a luminance channel;

reconstructing samples of said luminance channel of the image block unit to generate reconstructed samples;

determining a reference area for predicting target samples of at least one color channel of the image block unit, wherein said reference area comprises one or more of reference samples in a neighboring block in a current color channel or the frame, in the neighboring of a co-located block in a reference color channel or the frame, and/or inside the co-located block in the reference color channel or the frame;

determining filter coefficients of a filter for said predicting based on the one or more reference samples and a shape of the filter;

reconstructing the target samples of at least one color channel of the image block unit using said predicting based on the samples of said reference area and the filter coefficients to generate reconstructed target samples;

computing an autocorrelation matrix for the reconstructed target samples of the image block unit;

computing autocorrelation matrices for each plurality of neighboring image blocks units of said image block unit;

mixing the autocorrelation matrices of the each of the plurality of neighboring image blocks units separately with the autocorrelation matrix of said image block unit to generate mixed autocorrelation matrices; and

storing the mixed autocorrelation matrices for said image block unit.

2 . The apparatus according to claim 1 , wherein said plurality of neighboring image blocks units comprise at least a left, a left-above, an above and a right-above neighboring image block of said image block unit.

3 . The apparatus according to claim 1 , wherein the apparatus upon execution is further caused to perform:

applying weights for the autocorrelation matrices of the plurality of neighboring image blocks units upon mixing with the autocorrelation matrix of said image block unit.

4 . The apparatus according to claim 3 , wherein the apparatus upon execution is further caused to perform:

inferring the weights from properties of said image block unit.

5 . The apparatus according to claim 3 , wherein the apparatus upon execution is further caused to perform:

receiving the weights from an encoder.

6 . The apparatus according claim 1 , wherein the apparatus upon execution is further caused to perform:

converting the stored autocorrelation matrices into prediction coefficients.

7 . The apparatus according to claim 6 , wherein the apparatus upon execution is further caused to perform:

using one or more of the plurality of neighboring image blocks units as a directional predictor.

8 . The apparatus according to claim 1 , wherein to determining the filter coefficients, the apparatus upon execution further is caused to perform:

determining recursively the filter coefficients for a successive filter orders of the filter for said predicting based on the one or more reference samples and the shape of the filter.

9 . The apparatus according to claim 1 , wherein to compute the autocorrelation matrix, the apparatus upon execution is further caused to perform:

computing the autocorrelation matrix for the reconstructed samples of the image block unit using sub-sampling determined based on a size and a shape of the image block unit.

10 . A method comprising

receiving an image block unit of a frame, the image block unit comprising samples in one or more color channels comprising at least one chrominance channel and a luminance channel;

reconstructing samples of said luminance channel of the image block unit to generate reconstructed samples;

determining a reference area for predicting target samples of at least one color channel of the image block unit, wherein said reference area comprises one or more of reference samples in a neighboring block in current color channel or the frame, in the neighboring of a co-located block in a reference color channel or the frame; and/or inside the co-located block in the reference color channel or the frame;

determining filter coefficients of a filter for said predicting based on the one or more reference samples and a shape of the filter;

reconstructing the target samples of at least one color channel of the image block unit using said predicting based on the samples of said reference area and the filter coefficients to generate reconstructed target samples;

computing an autocorrelation matrix for the reconstructed target samples of the image block unit;

computing autocorrelation matrices for each plurality of neighboring image blocks units of said image block unit;

mixing the autocorrelation matrices of the each of the plurality of neighboring image blocks units separately with the autocorrelation matrix of said image block unit to generate mixed autocorrelation matrices; and

storing the mixed autocorrelation matrices for said image block unit.

11 . The method according to claim 10 , wherein said plurality of neighboring image blocks units comprise at least a left, a left-above, an above and a right-above neighboring image block of said image block unit.

12 . The method according to claim 10 further comprising:

applying weights for the autocorrelation matrices of the plurality of neighboring image blocks units upon mixing with the autocorrelation matrix of said image block unit.

13 . The method according to claim 10 , comprising:

inferring the weights from properties of said image block unit.

14 . The method according to claim 10 , comprising:

receiving the weights from an encoder.

15 . The method according to claim 10 comprising

converting the stored autocorrelation matrices into prediction coefficients.

16 . The method according to claim 10 , comprising:

using one or more of the plurality of neighboring image blocks units as a directional predictor.

17 . The method according to claim 10 , comprising

determining recursively the filter coefficients for successive filter orders of the filter for said predicting based on the one more reference samples and the shape of the filter.

18 . The method according to claim 10 , comprising

computing the autocorrelation matrix for the reconstructed samples of the image block unit using sub-sampling determined based on the size and the shape of the said image block unit.

Assignments (2)
CORRECTIVE ASSIGNMENT TO CORRECT THE RECEIVING PARTY STREET ADDRESS TO KARAKAARI 7 PREVIOUSLY RECORDED ON REEL 71830 FRAME 46. ASSIGNOR(S) HEREBY CONFIRMS THE ASSIGNMENT. Recorded Sep 30, 2025
From: ASTOLA, PEKKA; LAINEMA, JANI; YOUVALARI, RAMIN GHAZNAVI
To: NOKIA TECHNOLOGIES OY
Reel/Frame 073778/0907 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 25, 2025
From: ASTOLA, PEKKA; LAINEMA, JANI; GHAZNAVI YOUVALARI, RAMIN
To: NOKIA TECHNOLOGIES OY
Reel/Frame 071830/0046 →
Priority Claims (1)
FI 20225630 · Jul 5, 2022 · national
Continuity (1)
Related Publication 20260019561A1 · Jan 15, 2026
References Cited (17)
US 20120218432A1 · Liu et al. · 2012 [cited by applicant]
US 20210218962A1 · Lim · 2021 [cited by examiner]
US 20220038722A1 · Chen et al. · 2022 [cited by applicant]
US 20220295058A1 · Lim · 2022 [cited by examiner]
WO 2021244935A1 · 2021 [cited by applicant]
“Video coding for low bit rate communication”, Series H: Audiovisual and Multimedia Systems, Infrastructure of audiovisual services—Coding of moving video, Infrastructure of audiovisual services—Coding of moving video, … [cited by applicant]
“Advanced video coding for generic audiovisual services”, Series H: Audiovisual and Multimedia Systems, Infrastructure of audiovisual services—Coding of moving video, ITU-T Recommendation H.264, Aug. 2021, 844 pages. [cited by applicant]
“Information technology—Generic coding of moving pictures and associated audio information: Systems”, Series H: Audiovisual and Multimedia Systems, Infrastructure of audiovisual services—Transmission multiplexing and sy… [cited by applicant]
“Information technology—Coding of audiovisual objects—Part 12: ISO base media file format”, ISO/IEC 14496-12, Fifth edition, Dec. 15, 2015, 248 pages. [cited by applicant]
“Information technology—Coding of audio-visual objects—Part 15: Carriage of network abstraction layer (NAL) unit structured video in the ISO base media file format”, ISO/IEC 14496-15, 2021, 282 pages. [cited by applicant]
“High efficiency video coding”, Series H: Audiovisual and Multimedia Systems, Infrastructure of audiovisual services—Coding of moving video, Recommendation ITU-T H.265, Aug. 2021, 716 pages. [cited by applicant]
“Versatile video coding”, Series H: Audiovisual and Multimedia Systems, Infrastructure of audiovisual services—Coding of moving video, ITU-T Recommendation H.266, Apr. 2022, 536 pages. [cited by applicant]
“IEEE 802.11”, Wikipedia, Retrieved on Apr. 15, 2025, Webpage available at : https://en.wikipedia.org/wiki/IEEE_802.11. [cited by applicant]
Office action received for corresponding Finnish Patent Application No. 20225630, dated Jan. 27, 2023, 9 pages. [cited by applicant]
Astola et al., “AHG12: Convolutional cross-component model (CCCM) for intra prediction”, Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29, JVET-Z0064-v1, 26th Meeting, Apr. 20-29, 2022, pp. 1-… [cited by applicant]
International Search Report and Written Opinion received for corresponding Patent Cooperation Treaty Application No. PCT/FI2023/050218, dated Aug. 25, 2023, 18 pages. [cited by applicant]
Bross et al., “Versatile Video Coding Editorial Refinements on Draft 10”, Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29, JVET-T2001-v2, 20th Meeting, Oct. 7-16, 2020, pp. 1-511. [cited by applicant]