IP Library Granted Patent US 12,445,595
Granted Patent B2
US 12,445,595 · App. 18/405,290 · Granted Oct 14, 2025

Composed prediction and restricted merge

Inventors: Thomas Wiegand (Berlin, DE); Detlev Marpe (Berlin, DE); Heiko Schwarz (Berlin, DE); Martin Winken (Berlin, DE); Christian Bartnik (Berlin, DE); Jonathan Pfaff (Berlin, DE); Philipp Helle (Berlin, DE); Mischa Siekmann (Berlin, DE)
Assignee: Fraunhofer-Gesellschaft zur Förderung der angewandten Forschung e.V.
H04N19/103H04N19/107H04N19/109H04N19/11H04N19/159H04N19/176
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,445,595
App. No.
18/405,290
Granted
Oct 14, 2025
Kind
B2
Abstract

A video decoder for decoding a video from a data stream using block-based predictive decoding is arranged to derive, using inter prediction, a first prediction, p 1 , for a current block, derive, using intra prediction, a second prediction, p 2 , for the current block determine a scalar weighting parameter, α, based at least in part on a look up table using prediction parameter information of blocks neighboring the current block, determine a prediction signal, q, for the current block as a weighted sum, of the first prediction, p 1 , and the second prediction, p 2 , using, at least in part, the scalar weighting parameter, α, and decode the current block using the prediction signal, q.

Claims (67)

1. A video decoder for decoding a video from a data stream using block-based predictive decoding, the video decoder comprising a processor configured to:

derive, using a first inter prediction mode, a first prediction, p 1 , for a current block;

set a first intermediate prediction signal, q 1 to the first prediction, p 1 ;

derive, using a first intra prediction mode, a second prediction, p 2 , for the current block;

derive, using a second prediction mode, a third prediction, p 3 , for the current block, the second prediction mode is either an intra prediction mode or an inter prediction mode;

determine multiple scalar weighting parameters, α n , based at least in part on a look up table using prediction parameter information of blocks neighboring the current block;

determine a second intermediate prediction signal, q 2 , for the current block as a weighted sum, of the first intermediate prediction signal, q 1 , and the second prediction, p 2 , using, at least in part, the scalar weighting parameter, α n ;

determine a composed prediction signal, q, for the current block as a weighted sum, of the second intermediate prediction signal, q 2 , and the third prediction, p 3 , using, at least in part, the scalar weighting parameter, α n ; and

decode the current block using the composed prediction signal, q.

2. The video decoder of claim 1 , wherein the weighted sum is equal to.

3. The video decoder of claim 1 , wherein the prediction parameter information of blocks which neighbor the current block is prediction modes of blocks which neighbor the current block.

4. A video encoder for encoding a video into a data stream using block-based predictive encoding, the video encoder comprising a processor configured to:

derive, using a first inter prediction mode, a first prediction, p 1 , for a current block;

set a first intermediate prediction signal, q 1 to the first prediction, p 1 ;

derive, using a first intra prediction mode, a second prediction, p 2 , for the current block;

derive, using a second prediction mode, a third prediction, p 3 , for the current block, the second prediction mode is either an intra prediction mode or an inter prediction mode;

determine multiple scalar weighting parameters, α n , based at least in part on a look up table using prediction parameter information of blocks neighboring the current block;

determine a second intermediate prediction signal, q 2 , for the current block as a weighted sum, of the first intermediate prediction signal, q 1 , and the second prediction, p 2 , using, at least in part, the scalar weighting parameter, α n ;

determine a composed prediction signal, q, for the current block as a weighted sum, of the second intermediate prediction signal, q 2 , and the third prediction, p 3 , using, at least in part, the scalar weighting parameter, α n ; and

encode the current block using the composed prediction signal, q.

5. The video encoder of claim 4 , wherein the weighted sum is equal to:

α n ·p n+1 +(1−α n )·q n .

6. The video encoder of claim 4 , wherein the prediction parameter information of blocks which neighbor the current block is prediction modes of blocks which neighbor the current block.

7. A method of decoding a video from a data stream using block-based predictive decoding, the method comprising:

deriving, using a first inter prediction mode, a first prediction, p 1 , for a current block;

set a first intermediate prediction signal, q 1 to the first prediction, p 1 ;

deriving, using a first intra prediction mode, a second prediction, p 2 , for the current block;

derive, using a second prediction mode, a third prediction, p 3 , for the current block, the second prediction mode is either an intra prediction mode or an inter prediction mode;

determining multiple scalar weighting parameters, α n , based at least in part on a look up table using prediction parameter information of blocks neighboring the current block;

determining a second intermediate prediction signal, q 2 , for the current block as a weighted sum, of the first intermediate prediction signal, q 1 , and the second prediction, p 2 , using, at least in part, the multiple scalar weighting parameters, α n ;

determining a composed prediction signal, q, for the current block as a weighted sum, of the second intermediate prediction signal, q 2 , and the third prediction, p 3 , using, at least in part, the multiple scalar weighting parameters, α n ; and

decoding the current block using the composed prediction signal, q.

8. The method of claim 7 , wherein the weighted sum is equal.

9. The method of claim 7 , wherein the prediction parameter information of blocks which neighbor the current block is prediction modes of blocks which neighbor the current block.

10. A method of encoding a video into a data stream using block-based predictive encoding, the method comprising:

deriving, using a first inter prediction mode, a first prediction, p 1 , for a current block;

set a first intermediate prediction signal, q 1 to the first prediction, p 1 ;

deriving, using a first intra prediction mode, a second prediction, p 2 , for the current block;

derive, using a second prediction mode, a third prediction, p 3 , for the current block, the second prediction mode is either an intra prediction mode or an inter prediction mode;

determining multiple scalar weighting parameters, α n , based at least in part on a look up table using prediction parameter information of blocks neighboring the current block;

determining a second intermediate prediction signal, q 2 , for the current block as a weighted sum, of the first intermediate prediction signal, q 1 , and the second prediction, p 2 , using, at least in part, the scalar weighting parameter, α n ;

determine a composed prediction signal, q, for the current block as a weighted sum, of the second intermediate prediction signal, q 2 , and the third prediction, p 3 , using, at least in part, the scalar weighting parameter, α n ; and

encoding the current block using the composed prediction signal, q.

11. The method of claim 10 , wherein the weighted sum is equal to.

12. The method of claim 10 , wherein the prediction parameter information of blocks which neighbor the current block is prediction modes of blocks which neighbor the current block.

13. A non-transitory digital storage medium having a computer program stored thereon to perform, when the computer program is run by a computer, a method of video decoding, the method comprising:

deriving, using a first inter prediction mode, a first prediction, p 1 , for a current block;

setting a first intermediate prediction signal, q 1 to the first prediction, p 1 ;

deriving, using a first intra prediction mode, a second prediction, p 2 , for the current block;

deriving, using a second prediction mode, a third prediction, p 3 , for the current block, the second prediction mode is either an intra prediction mode or an inter prediction mode;

determining multiple scalar weighting parameters, α n , based at least in part on a look up table using prediction parameter information of blocks neighboring the current block;

determining a second intermediate prediction signal, q 2 , for the current block as a weighted sum, of the first intermediate prediction signal, q 1 , and the second prediction, p 2 , using, at least in part, the scalar weighting parameter, α n ;

determining a composed prediction signal, q, for the current block as a weighted sum, of the second intermediate prediction signal, q 2 , and the third prediction, p 3 , using, at least in part, the scalar weighting parameter, α n ; and

decoding the current block using the composed prediction signal, q.

14. The non-transitory digital storage medium of claim 13 , wherein the weighted sum is equal to.

15. The non-transitory digital storage medium of claim 13 , wherein the prediction parameter information of blocks which neighbor the current block is prediction modes of blocks which neighbor the current block.

16. A non-transitory digital storage medium having a computer program stored thereon to perform, when the computer program is run by a computer, a method of video encoding, the method comprising:

deriving, using a first inter prediction mode, a first prediction, p 1 , for a current block;

setting a first intermediate prediction signal, q 1 to the first prediction, p 1 ;

deriving, using a first intra prediction mode, a second prediction, p 2 , for the current block;

derive, using a second prediction mode, a third prediction, p 3 , for the current block, the second prediction mode is either an intra prediction mode or an inter prediction mode;

determining multiple scalar weighting parameters, α n , based at least in part on a look up table using prediction parameter information of blocks neighboring the current block;

determining a second intermediate prediction signal, q 2 , for the current block as a weighted sum, of the first intermediate prediction signal, q 1 , and the second prediction, p 2 , using, at least in part, the scalar weighting parameter, α n ;

determining a composed prediction signal, q, for the current block as a weighted sum, of the second intermediate prediction signal, q 2 , and the third prediction, p 3 , using, at least in part, the scalar weighting parameter, α n ; and

encoding the current block using the composed prediction signal, q.

17. The non-transitory digital storage medium of claim 16 , wherein the weighted sum is equal to.

18. The non-transitory digital storage medium of claim 16 , wherein the prediction parameter information of blocks which neighbor the current block is prediction modes of blocks which neighbor the current block.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 13, 2024
From: WIEGAND, THOMAS; MARPE, DETLEV; SCHWARZ, HEIKO; WINKEN, MARTIN; BARTNIK, CHRISTIAN; PFAFF, JONATHAN; HELLE, PHILIPP; SIEKMANN, MISCHA
To: FRAUNHOFER-GESELLSCHAFT ZUR FÖRDERUNG DER ANGEWANDTEN FORSCHUNG E.V.
Reel/Frame 068264/0555 →
Priority Claims (1)
EP 18159304 · Feb 28, 2018 · regional
Continuity (4)
Continuation 17700360 · Mar 21, 2022
Continuation 17002578 · Aug 25, 2020
Continuation PCTEP2019054896 · Feb 27, 2019
Related Publication 20240205385A1 · Jun 20, 2024
References Cited (34)
US 8085845B2 · Tourapis · 2011 [cited by examiner]
US 8737824B1 · Bultje · 2014 [cited by examiner]
US 9531990B1 · Wilkins · 2016 [cited by examiner]
US 9813700B1 · Bultje · 2017 [cited by examiner]
US 10362332B2 · Mukherjee · 2019 [cited by examiner]
US 11032550B2 · Ye · 2021 [cited by examiner]
US 20070047648A1 · Tourapis · 2007 [cited by examiner]
US 20070053443A1 · Song · 2007 [cited by applicant]
US 20090257492A1 · Andersson · 2009 [cited by examiner]
US 20100098156A1 · Karczewicz · 2010 [cited by applicant]
US 20120063514A1 · Lin · 2012 [cited by examiner]
US 20120250769A1 · Bross · 2012 [cited by examiner]
US 20130044812A1 · Ye · 2013 [cited by applicant]
US 20130051467A1 · Zhou · 2013 [cited by examiner]
US 20150131724A1 · Lin · 2015 [cited by examiner]
US 20160014416A1 · Hinz · 2016 [cited by applicant]
US 20160165248A1 · Lainema · 2016 [cited by applicant]
US 20160191920A1 · Kim · 2016 [cited by applicant]
US 20170251213A1 · Ye · 2017 [cited by examiner]
US 20180063531A1 · Hu · 2018 [cited by applicant]
US 20180270502A1 · Mukherjee · 2018 [cited by examiner]
US 20180288410A1 · Park · 2018 [cited by applicant]
US 20180376149A1 · Zhang · 2018 [cited by examiner]
JP 2007503775A · 2007 [cited by applicant]
KR 20170084055A · 2017 [cited by applicant]
WO 2005022919A1 · 2005 [cited by applicant]
Chen, J, et al., “Scalable Video Coding Extension for HEVC”, Qualcomm Technology Inc. 5775 Morehouse Drive, San Diego, CA. [cited by applicant]
Cha, Run, et al., “Improved Combined Inter-Intra Prediction Using Spatial-Variant Weighted Coefficient”, Run Cha, et al., Improved Combined Inter-Intra Prediction Using Spatial-Variant Weighted Coefficient, 2011 IEEE In… [cited by applicant]
Audiovisional and Multimedia Systems/Infrastructure of audiovisual services—coding of moving video, ITU-T Series H, Telecommunication Standardization Sector of ITU H264, Apr. 2017. [cited by applicant]
High efficiency video coding, ITU-T Series H, Telecommunication Standardization Sector of Itu Audiovisual and Mul Ti Media Systems H.265, Dec. 2016. [cited by applicant]
Albrecht, M, et al., “Description of SDR, HDR and 360 video coding technology proposal by Fraunhofer HHI”, 10. JVET Meeting; Oct. 4, 2018-Apr. 20, 2018; San Diego; (The Joint Video Exploration Team of ISO/IEC JTC1/ SC29… [cited by applicant]
Chen, J, et al., “Description of scalable video coding technology proposal by Qualcomm (configuration 2)”, 11.JCT-VC Meeting; 102. MPEG Meeting; Oct. 10, 2012-Oct. 19, 2012; Shanghai; (Joint Collaborative Team On Video … [cited by applicant]
Chen, J, et al., “Algorithm description of Joint Exploration Test Model 3 (JEM3)”, 3. JVET Meeting; May 26, 2016—˜- Jun. 2016; Geneva; (The Joint Video Exploration Team of ISO/IEC JTC1/SC29/WG11 and ITU-T SG-16); URL: h… [cited by applicant]
Chen, J, et al., “High efficiency video coding (HEVC) scalable extension Draft 6”, 3. JCT-VG Meeting; Mar. 27, 2014-Jan. 4, 2014; Valencia; (Joint Collaborative Team on Video Coding (JCT-VG) of ITU-T SG 16 WP 3 and ISO/… [cited by applicant]