IP Library Granted Patent US 12,647,590
Granted Patent B2
US 12,647,590 · App. 18/909,348 · Granted Jun 2, 2026

Inter-component prediction

Inventors: Tung Nguyen (Berlin, DE); Ali Atef Ibrahim Khairat Abdelhamid (Berlin, DE); Detlev Marpe (Berlin, DE)
Assignee: Dolby Video Compression, LLC
H04N19/44H04N19/119H04N19/176H04N19/186H04N19/50H04N19/503H04N19/593H04N19/597H04N19/82H04N19/96
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,647,590
App. No.
18/909,348
Granted
Jun 2, 2026
Kind
B2
Abstract

Reconstructing a second component signal relating to a second component of a multi-component picture from a spatially corresponding portion of a reconstructed first component signal and a correction signal derived from data stream for the second component promises increased coding efficiency over a broader range of multi-component picture content. By including the spatially corresponding portion of the reconstructed first component signal into the reconstruction of the second component signal, any remaining inter-component redundancies/correlations present such as still present despite a possibly a priori performed component space transformation, or present because of having been introduced by such a priori performed component space information, for example, may readily be removed by way of the inter-component redundancy/correlation reduction of the second component signal.

Claims (65)

1 . A decoder configured to decode a multi-component picture, the decoder comprising a processor configured for:

determining, based on information extracted from an encoded data stream, a first residual signal relating to a first component of the multi-component picture;

extracting, from the encoded data stream, a first signaling syntax element that indicates whether or not an inter-component prediction is enabled for the multicomponent picture;

extracting, from the encoded data stream, a second signaling syntax element that indicates a scaling factor based on which the first residual signal is to be added to a second residual signal of a second component of the multi-component picture to generate a new residual signal for replacing the second residual signal;

extracting, from the encoded data stream, a third signaling syntax element associated with the second signaling syntax element;

deriving a portion of the second residual signal based on a portion of the first residual signal scaled using the scaling factor and the third signaling syntax element; and

reconstructing the multi-component picture based on the first residual signal and the second residual signal.

2 . The decoder according to claim 1 , wherein the scaling factor is decoded based on truncated unary binarization and context-adaptive binary arithmetic coding.

3 . The decoder according to claim 1 , wherein the third signaling syntax element indicates a sign value of the scaling factor when the scaling factor is not equal to zero.

4 . The decoder according to claim 3 , wherein the sign value is decoded based on context-adaptive binary arithmetic coding.

5 . The decoder according to claim 1 , wherein the portion of the second residual signal is derived based on scaling the portion of the first residual signal using the scaling factor, a bit depth value of the first component, and a bit depth value of the second component.

6 . The decoder according to claim 1 , wherein the processor is further configured for:

extracting, from the encoded data stream, a fourth signaling syntax element that indicates a second scaling factor based on which the first residual signal is to be added to a third residual signal of a third component of the multi-component picture to generate a new residual signal for replacing the third residual signal;

extracting, from the encoded data stream, a fifth signaling syntax element associated with the fourth signaling syntax element;

deriving a portion of the third residual signal based on a portion of the first residual signal scaled using the second scaling factor and the fifth signaling syntax element; and

reconstructing the multi-component picture based on the first residual signal, the second residual signal and the third residual signal.

7 . The decoder according to claim 6 , wherein the first, second and third components are three color components of the multi-component picture.

8 . The decoder according to claim 1 , wherein the processor is configured for:

sub-dividing the multi-component picture into prediction blocks and residual blocks;

sub-dividing the residual blocks into transform blocks;

selecting prediction modes based on first information from the encoded data stream;

determining prediction parameters for the prediction blocks based on second information from the encoded data stream;

deriving a prediction signal using the prediction modes and the prediction parameters;

deriving a residual signal within each residual block by performing inverse transformations within the transform blocks; and

reconstructing the multi-component picture by combining the prediction signal and the residual signal.

9 . A method for decoding a multi-component picture, comprising:

determining, based on information extracted from an encoded data stream, a first residual signal relating to a first component of the multi-component picture;

extracting, from the encoded data stream, a first signaling syntax element that indicates whether or not an inter-component prediction is enabled for the multicomponent picture;

extracting, from the encoded data stream, a second signaling syntax element that indicates a scaling factor based on which the first residual signal is to be added to a second residual signal of a second component of the multi-component picture to generate a new residual signal for replacing the second residual signal;

extracting, from the encoded data stream, a third signaling syntax element associated with the second signaling syntax element;

deriving a portion of the second residual signal based on a portion of the first residual signal scaled using the scaling factor and the third signaling syntax element; and

reconstructing the multi-component picture based on the first residual signal and the second residual signal.

10 . The method according to claim 9 , wherein:

the scaling factor is decoded based on truncated unary binarization and context-adaptive binary arithmetic coding.

11 . The method according to claim 9 , wherein:

the third signaling syntax element indicates a sign value of the scaling factor when the scaling factor is not equal to zero.

12 . The method according to claim 11 , wherein:

the sign value is decoded based on context-adaptive binary arithmetic coding.

13 . The method according to claim 9 , wherein the portion of the second residual signal is derived based on scaling the portion of the first residual signal using the scaling factor, a bit depth value of the first component, and a bit depth value of the second component.

14 . The method according to claim 9 , further comprising:

extracting, from the encoded data stream, a fourth signaling syntax element that indicates a second scaling factor based on which the first residual signal is to be added to a third residual signal of a third component of the multi-component picture to generate a new residual signal for replacing the third residual signal;

extracting, from the encoded data stream, a fifth signaling syntax element associated with the fourth signaling syntax element;

deriving a portion of the third residual signal based on a portion of the first residual signal scaled using the second scaling factor and the fifth signaling syntax element; and

reconstructing the multi-component picture based on the first residual signal, the second residual signal and the third residual signal.

15 . The method according to claim 14 , wherein the first, second and third components are three color components of the multi-component picture.

16 . The method according to claim 9 , further comprising:

sub-dividing the multi-component picture into prediction blocks and residual blocks;

sub-dividing the residual blocks into transform blocks;

selecting prediction modes based on first information from the encoded data stream;

determining prediction parameters for the prediction blocks based on second information from the encoded data stream;

deriving a prediction signal using the prediction modes and the prediction parameters;

deriving a residual signal within each residual block by performing inverse transformations within the transform blocks; and

reconstructing the multi-component picture by combining the prediction signal and the residual signal.

17 . A method for encoding a multi-component picture, comprising:

obtaining a first residual signal relating to a first component of the multicomponent picture;

encoding, into a data stream, the first residual signal;

encoding, into the data stream, a first signaling syntax element that indicates whether or not an inter-component prediction is enabled for the multi-component picture;

encoding, into the data stream, a second signaling syntax element that indicates a scaling factor based on which the first residual signal is to be added to a second residual signal of a second component of the multi-component picture to generate a new residual signal for replacing the second residual signal; and

encoding, into the data stream, a third signaling syntax element associated with the second signaling syntax element, wherein a portion of the second residual signal is derived based on a portion of the first residual signal scaled using the scaling factor and the third signaling syntax element.

18 . The method according to claim 17 , wherein:

the scaling factor is encoded based on truncated unary binarization and context-adaptive binary arithmetic coding.

19 . The method according to claim 17 , wherein:

the third signaling syntax element indicates a sign value of the scaling factor when the scaling factor is not equal to zero.

20 . The method according to claim 19 , wherein:

the sign value is encoded based on context-adaptive binary arithmetic coding.

Assignments (1)
CHANGE OF NAME Recorded Nov 26, 2024
From: GE VIDEO COMPRESSION, LLC
To: DOLBY VIDEO COMPRESSION, LLC
Reel/Frame 069451/0262 →
Continuity (8)
Continuation 18169248 · Feb 15, 2023
Continuation 16988271 · Aug 7, 2020
Continuation 16256064 · Jan 24, 2019
Continuation 14875743 · Oct 6, 2015
Continuation PCTEP2014057090 · Apr 8, 2014
Provisional Application 61846450 · Jul 15, 2013
Provisional Application 61809608 · Apr 8, 2013
Related Publication 20250106422A1 · Mar 27, 2025
References Cited (72)
US 6556624B1 · Orchard · 2003 [cited by applicant]
US 9661340B2 · Sullivan · 2017 [cited by examiner]
US 9781447B1 · Bultje · 2017 [cited by examiner]
US 9979960B2 · Zhu · 2018 [cited by examiner]
US 11595674B2 · Nguyen · 2023 [cited by examiner]
US 12155850B2 · Nguyen · 2024 [cited by examiner]
US 20050013363A1 · Cho et al. · 2005 [cited by applicant]
US 20050063471A1 · Regunathan et al. · 2005 [cited by applicant]
US 20060233251A1 · Kim et al. · 2006 [cited by applicant]
US 20080008238A1 · Song · 2008 [cited by applicant]
US 20080019597A1 · Song · 2008 [cited by applicant]
US 20090041120A1 · Yu · 2009 [cited by applicant]
US 20100020866A1 · Marpe et al. · 2010 [cited by applicant]
US 20100158110A1 · Pandit · 2010 [cited by applicant]
US 20110142358A1 · Katou et al. · 2011 [cited by applicant]
US 20120195367A1 · Kossentini et al. · 2012 [cited by applicant]
US 20120229602A1 · Chen et al. · 2012 [cited by applicant]
US 20120250769A1 · Bross et al. · 2012 [cited by applicant]
US 20120307897A1 · Yang et al. · 2012 [cited by applicant]
US 20120307898A1 · Chono et al. · 2012 [cited by applicant]
US 20130051467A1 · Zhou et al. · 2013 [cited by applicant]
US 20130113884A1 · Leontaris · 2013 [cited by examiner]
US 20130121415A1 · Wahadaniah · 2013 [cited by examiner]
US 20150063438A1 · Kim · 2015 [cited by examiner]
US 20150078447A1 · Gamei · 2015 [cited by examiner]
US 20160029035A1 · Nguyen · 2016 [cited by examiner]
US 20160227210A1 · Nguyen · 2016 [cited by examiner]
BE 1007211A5 · 1995 [cited by applicant]
CN 1574970A · 2005 [cited by applicant]
CN 101160970A · 2008 [cited by applicant]
CN 101411196A · 2009 [cited by applicant]
CN 101416521A · 2009 [cited by applicant]
CN 101616329A · 2009 [cited by applicant]
CN 101828405A · 2010 [cited by applicant]
CN 102726043A · 2012 [cited by applicant]
CN 102939756A · 2013 [cited by applicant]
CN 113259681A · 2021 [cited by applicant]
CN 113259683A · 2021 [cited by applicant]
CN 113259684A · 2021 [cited by applicant]
EP 2237558A1 · 2010 [cited by applicant]
EP 2725794A2 · 2014 [cited by applicant]
JP 2009278495A · 2009 [cited by applicant]
JP 2011124846A · 2011 [cited by applicant]
JP 2012129650A · 2012 [cited by applicant]
JP 2012213175A · 2012 [cited by applicant]
JP 2013021557A · 2013 [cited by applicant]
KR 1020110063860A · 2011 [cited by applicant]
KR 1020130006690A · 2013 [cited by applicant]
WO 2005098756A1 · 2005 [cited by applicant]
WO 2011054879A2 · 2011 [cited by applicant]
WO 2011127963A1 · 2011 [cited by applicant]
WO 2011127964A2 · 2011 [cited by applicant]
WO 2011128269A1 · 2011 [cited by applicant]
WO 2013002589A2 · 2013 [cited by applicant]
Office Action issued in corresponding Chinese Patent Application 2021105051071 dated Oct. 25, 2023. [cited by applicant]
Francois Pasteau et al., Adaptive color decorrelation for predictive image codecs. 2011 19th European Signal Processing Conference, Sep. 2, 2011. [cited by applicant]
Office Action issued in corresponding Chinese Patent Application 2021105047837 dated Oct. 26, 2023. [cited by applicant]
Office Action issued in corresponding Japanese Patent Application 2021-165187 dated Oct. 17, 2023. [cited by applicant]
Office Action issued in corresponding Chinese Patent Application 2021105048401 dated Nov. 20, 2023. [cited by applicant]
Office Action issued in corresponding Chinese Patent Application 2021105052657 dated Nov. 9, 2023. [cited by applicant]
Kei Kawamura et al., “AHG7: Inter-place intra coding for residual signals”, Joint Collaborative Team on Video Coding (JCT-VC) of ITU-T SG16 WP3 and ISO/IEC JTC1/SC29/WG11 JCTVC-K0191_r2, ITU-T, Oct. 10-19, 2012, p. 1-4. [cited by applicant]
Kei Kawamura et al., “Inter-channel prediction coding in CTB structure”, Study Report of the Institute of Electronics, Information and Communication Engineers, The Institute of Electronics, Information and Communication… [cited by applicant]
Kei Kawamura et al., “Inter-channel prediction coding of intra-prediction residual signal in CTB structure”, Collected papers of Lectures at General meeting 2011 of the Institute of Electronics, Information and Communic… [cited by applicant]
Detlev Marpe et al., “CE5: Color transform issues and related results”, Joint Video Team (VT) of ISO/IEC MPEG & ITU-T VCEG (ISO/IEC JTC1/SC29/WG11 and ITU-T SG16 Q.6) JVT-S073, ITU-T, Apr. 7, 2006, p. 1-6. [cited by applicant]
Nguyen et al., “RCE1/RCE2/AHG5/AHG8: Adaptive Inter-Plane Prediction for RGB Content”, Joint Collaborative Team on Video Coding (JCT-VC) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, JCTVC-M0230, Apr. 18-26, 2013, … [cited by applicant]
Pasteau et al., “Adaptive Color Decorrelation for Predictive Image Codecs”, European Signal Processing Conference, EUSIPCO, Jan. 1, 2011, 5 pages. [cited by applicant]
Merkle et al., “Efficient Prediction Structures for Multiview Video Coding”, IEEE Transactions on Circuits and Systems for Video Technology, vol. 17, No. 11, Nov. 2007, pp. 1461-1473. [cited by applicant]
Schwarz et al., “3D Video Coding Using Advanced Prediction, Depth Modeling, and Encoder Control Methods”, 2012 Picture Coding Symposium, May 9, 2012, pp. 1-4. [cited by applicant]
Pu, Wei et al., Non RCE1: Inter Color Component Residual Prediction, Joint Collaborative Team on Video Coding (JCT-VC) of ITU-T SG16 WP3 and ISO/IEC JTC1/SC29/WG11, 14th Meeting: Vienna, AT, Jul. 25-Aug. 2, 2013, [JCTVC… [cited by applicant]
Kawamura Kei et al., Estimate of Inter-channel Prediction Coding of Intra-Prediction Residual Signal in CTB Structure, FIT 2011 10th Forum on Information Technology, Japan, Information Processing Society of Japan The In… [cited by applicant]
Kawamura, Kei et al., AHG7: Inter-plane intra coding for residual signals, Joint Collaborative Team on Video Coding (JCT-VC) of ITU-T SG16 WP3 and ISO/IEC JTC1/SC29/WG11, 11th Meeting: Shanghai, CN, Oct. 10-19, 2012, [J… [cited by applicant]
Kawamura, Kei et al., Non-RCE1: Inter colour-component residual coefficients prediction, Joint Collaborative Team on Video Coding (JCT-VC) of ITU-T SG16 WP3 and ISO/IEC JTC1/SC29/WG11, 15th Meeting: Geneva, CH, Oct. 23-… [cited by applicant]