IP Library › Granted Patent US 12,457,324
Granted Patent B2
US 12,457,324 · App. 18/150,603 · Granted Oct 28, 2025

Video compression using boundary based template refinement

Inventors: Alexey Konstantinovich Filippov (Khimki, RU); Vasily Alexeevich Rufitskiy (Vladimir, RU); Damian Ruiz Coll (Reston, VA)
Assignee: Comcast Cable Communications, LLC
H04N19/105H04N19/132H04N19/159H04N19/176
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,457,324
App. No.
18/150,603
Granted
Oct 28, 2025
Kind
B2
Abstract

Encoding and/or decoding a block of a video frame may be based on a template associated with the block. The length of the template may be determined based on at least one of: a position of the block relative to a boundary, available reference samples above the boundary, and/or the length of a second template of one or more other template derivation algorithms. The length may be adjusted to improve prediction efficiencies and accuracies of template-based predictions.

Claims (32)

1 . A method comprising:

determining, by a computing device and based on a quantity of lines of reference samples above a current block of a video, a vertical length of a template above the current block and a reference line for prediction of the template;

determining, based on the reference line determined for prediction of the template, a plurality of predictions of the template respectively associated with a plurality of intra prediction modes;

determining, based on the plurality of predictions of the template, at least one selected intra prediction mode of the plurality of intra prediction modes; and

generating, based on the at least one selected intra prediction mode of the plurality of intra prediction modes, a signal indicating the at least one selected intra prediction mode for an intra prediction associated with the current block.

2 . The method of claim 1 , wherein:

the determining the vertical length of the template and the reference line determined for prediction of the template is for a first intra mode derivation and is further based on at least one of:

a position of the current block relative to a boundary between two coding tree units (CTUs); or

a length of a second template associated with a second intra mode derivation;

a first coding tree unit (CTU), of the two CTUs, comprising the current block; and

the boundary being a top boundary of the first CTU and being a bottom boundary of a second CTU of the two CTUs.

3 . The method of claim 1 , wherein the quantity of line of reference samples above a current block corresponds to a quantity of lines of reconstructed reference samples above the current block that are available for coding the current block, and

wherein at least a portion of the lines of reconstructed reference samples is above a top boundary of a coding tree unit that comprises the current block.

4 . The method of claim 1 , further comprising:

sending, via a bitstream and based on the plurality of predictions of the template, an indication of the at least one selected intra prediction mode of the plurality of intra prediction modes.

5 . The method of claim 1 , further comprising:

encoding or decoding, based on the at least one selected intra prediction mode of the plurality of intra prediction modes and based on reference samples associated with the template, the current block.

6 . The method of claim 1 , wherein the quantity of lines of reference samples above the current block is determined based on a quantity of hardware line buffers configured to store reference lines from an upper coding tree unit (CTU), and wherein a lower CTU comprises the current block and is positioned below the upper CTU.

7 . A method comprising: determining, by a computing device and based on a position of a current block relative to a boundary between two coding tree units (CTUs), a length of a template comprising reconstructed samples above the current block; determining, based on a reference line associated with the template, a plurality of predictions of the template respectively associated with a plurality of intra prediction modes; and sending, via a bitstream and based on the plurality of predictions of the template, an indication of at least one selected intra prediction mode of the plurality of intra prediction modes.

8 . The method of claim 7 , wherein: a first CTU of the two CTUs comprises the current block; and the boundary is a top boundary of the first CTU and is a bottom boundary of a second CTU of the two CTUs.

9 . The method of claim 7 , wherein the determining the length of the template is based on: a top row of the current block being adjacent to the boundary; and a quantity of lines of reconstructed reference samples above the current block that are available for coding the current block.

10 . The method of claim 9 , wherein the length of the template corresponds to: the quantity of lines of reconstructed reference samples above the current block that are available for coding the current block; or one less than the quantity of lines of reconstructed reference samples above the current block that are available for coding the current block.

11 . The method of claim 7 , wherein the determining the length of the template comprises determining, based on a top row of the current block being adjacent to the boundary, a vertical length of the template to be equal to two or zero.

12 . The method of claim 7 , wherein the determining the length of the template comprises determining, based on a top row of the current block being adjacent to the boundary, the length of the template to be equal to a minimum of: one less than a quantity of lines of reconstructed reference samples above the current block that are available for coding the current block; and a value determined based on a length of a left side of the current block.

13 . The method of claim 9 , wherein the quantity of lines of reconstructed reference samples above the current block that are available for coding the current block is determined based on a quantity of line buffers configured to handle data dependencies between the two CTUs in a vertical direction.

14 . The method of claim 7 , wherein the determining the length of the template is based on a top row of the current block not being adjacent to the boundary; and a size of the current block.

15 . A method comprising: determining, by a computing device and based on a position of a current block relative to a boundary between two coding tree units (CTUs), a length of a template comprising reconstructed samples above the current block; determining, based on a reference line associated with the template, a plurality of predictions of the template respectively associated with a plurality of intra prediction modes determining, based on the plurality of predictions of the template, at least one intra prediction mode of the plurality of intra prediction modes; and generating, based on the at least one intra prediction mode, a prediction of the current block.

16 . The method of claim 15 , wherein a first CTU of the two CTUs comprises the current block; and the boundary is a top boundary of the first CTU and is a bottom boundary of a second CTU of the two CTUs.

17 . The method of claim 15 , wherein the determining the length of the template is based on: a top row of the current block being adjacent to the boundary; and a quantity of lines of reconstructed reference samples above the current block that are available for coding the current block.

18 . The method of claim 17 , wherein the length of the template corresponds to: the quantity of lines of reconstructed reference samples above the current block that are available for coding the current block; or one less than the quantity of lines of reconstructed reference samples above the current block that are available for coding the current block.

19 . The method of claim 15 , wherein the determining the length of the template comprises determining, based on a top row of the current block being adjacent to the boundary, a vertical length of the template to be equal to two or zero.

20 . The method of claim 15 , wherein the determining the length of the template comprises determining, based on a top row of the current block being adjacent to the boundary, the length of the template to be equal to a minimum of: one less than a quantity of lines of reconstructed reference samples above the current block that are available for coding the current block; and a value determined based on a length of a left side of the current block.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Feb 27, 2023
From: FILIPPOV, ALEXEY KONSTANTINOVICH; RUFITSKIY, VASILY ALEXEEVICH; RUIZ COLL, DAMIAN
To: COMCAST CABLE COMMUNICATIONS, LLC
Reel/Frame 062812/0156 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Feb 27, 2023
From: FILIPPOV, ALEXEY KONSTANTINOVICH; RUFITSKIY, VASILY ALEXEEVICH; RUIZ COLL, DAMIAN
To: COMCAST CABLE COMMUNICATIONS, LLC
Reel/Frame 062812/0198 →
Continuity (2)
Provisional Application 63296815 · Jan 5, 2022
Related Publication 20230217016A1 · Jul 6, 2023
References Cited (24)
US 10904561B2 · Lee et al. · 2021 [cited by applicant]
US 11595687B2 · Zhang · 2023 [cited by examiner]
US 20170353730A1 · Liu · 2017 [cited by examiner]
US 20190174145A1 · Zhang · 2019 [cited by examiner]
US 20210297656A1 · Ma · 2021 [cited by examiner]
US 20210297677A1 · Jang · 2021 [cited by examiner]
US 20210368165A1 · Choi et al. · 2021 [cited by applicant]
US 20210400298A1 · Zhao et al. · 2021 [cited by applicant]
US 20220094973A1 · Chujoh et al. · 2022 [cited by applicant]
US 20220329826A1 · Wang · 2022 [cited by examiner]
US 20230085006A1 · Bae · 2023 [cited by examiner]
US 20240214580A1 · Jhu · 2024 [cited by examiner]
US 20240223757A1 · Wang · 2024 [cited by examiner]
EP 3905674A1 · 2021 [cited by applicant]
EP 3965419A1 · 2022 [cited by applicant]
WO 2019007490A1 · 2019 [cited by applicant]
WO 2019201232A1 · 2019 [cited by applicant]
WO 2020069667A1 · 2020 [cited by applicant]
May 11, 2023—European Search Report—EP App. No. 23150490.3. [cited by applicant]
Pfaff, Jonathan et al., “Intra Prediction and Mode Coding in VVC”, IEEE Transactions on Circuits and Systems for Video Technology, vol. 31, No. 10, Oct. 2021. [cited by applicant]
Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29, 22nd Meeting, by teleconference, Apr. 20-28, 2021, Source: Bytedance Inc., Title: EE2-related: Template-based intra mode derivation using MPMs… [cited by applicant]
Yang Wang, Li Zhang, Kai Zhang, Zhipin Deng, Na Zhang Bytedance Inc., JVET-V0098 EE2-related: Template-based intra mode derivation using MPMs PowerPoint. [cited by applicant]
Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29 25th Meeting, by teleconference, Jan. 12-21, 2022, Source: Ofinno, LLC, Title: EE2-related: On the LCU boundary processing by intra-prediction … [cited by applicant]
Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29 23rd Meeting, by teleconference, Jul. 7-16, 2021, Source: Editors, Title: Algorithm description of Enhanced Compression Model 4 (ECM 4), Docume… [cited by applicant]
Cited By (1)
US 12,750,521