IP Library › Granted Patent US 12,219,156
Granted Patent B2
US 12,219,156 · App. 17/726,463 · Granted Feb 4, 2025

Methods and systems for chroma residual data prediction

Inventors: Ajit Deepak Gupte (Bengaluru, IN); Ranga Ramanujam Srinivasan (Villupuram, IN)
Assignee: TEXAS INSTRUMENTS INCORPORATED
H04N19/186H04N19/107H04N19/147H04N19/176
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,219,156
App. No.
17/726,463
Granted
Feb 4, 2025
Kind
B2
Abstract

Several methods and systems for chroma residual data prediction for encoding blocks corresponding to video data are disclosed. In an embodiment, at least one coefficient correlating reconstructed luma residual samples and corresponding reconstructed chroma residual samples is computed for one or more encoded blocks of video data. Predicted chroma residual samples are generated for encoding a block of video data based on corresponding reconstructed luma residual samples and the at least one coefficient.

Claims (55)

1. A method, comprising:

obtaining, by a processor, a correlation between a reconstructed luma residual sample and each of a C b component and a C r component corresponding to a reconstructed chroma residual sample;

determining, by the processor, a coefficient correlating the reconstructed luma residual sample and the reconstructed chroma residual sample for an encoded block of video data based on the correlation;

determining, by the processor, a predicted chroma residual sample for inter-prediction encoding a block of the video data based on a corresponding reconstructed luma residual sample and the coefficient; and

selecting, by the processor, a chroma residual prediction encoding mode or a chroma prediction encoding mode based on a cost associated with chroma residual samples in the encoded block.

2. The method of claim 1 , wherein:

the encoded block of the video data corresponds to a neighboring encoded block of a currently encoded block of the video data associated with the encoded block of the video data.

3. The method of claim 1 , wherein:

the encoded block of the video data corresponds to one of a top neighboring block and a left neighboring block neighboring a currently encoded block of the video data associated with the encoded block of the video data.

4. The method of claim 1 , wherein:

determining the coefficient is based on a least mean square error approximation corresponding to a linear model.

5. The method of claim 1 , wherein:

the obtaining of the correlation between the reconstructed luma residual sample and each of the C b component and the C r component corresponding to the reconstructed chroma residual sample includes:

determining a first and second coefficient for the C b component based on least mean square error approximations; and

determining a third and fourth coefficient for the C r component based on least mean square error approximations.

6. The method of claim 1 , further comprising determining a weighted sum of the reconstructed luma residual sample and the reconstructed chroma residual sample.

7. The method of claim 1 , wherein:

determining the coefficient is based on a presence of at least one block of the video data encoded based on an inter-prediction coding scheme neighboring the block of the video data and comprising motion vectors in correlation with motion vectors corresponding to the block of the video data.

8. The method of claim 1 , further comprising determining a subsampling of the reconstructed luma residual sample corresponding to the encoded block of video data prior to determining the coefficient in response to a number of reconstructed luma residual samples being greater than a number of reconstructed chroma residual samples.

9. The method of claim 8 , wherein:

determining the subsampling is performed based on a chroma subsampling metric.

10. A system, comprising:

a processor configured to:

obtain a correlation between a reconstructed luma residual sample and each of a C b component and a C r component corresponding to a reconstructed chroma residual sample;

determine a coefficient correlating the reconstructed luma residual sample and the reconstructed chroma residual sample for an encoded block of video data based on the correlation;

determine a predicted chroma residual sample for inter-prediction encoding a block of the video data based on a corresponding reconstructed luma residual sample and the coefficient; and

select a chroma residual prediction encoding mode or a chroma prediction encoding mode based on a cost associated with chroma residual samples in the encoded block; and

an encoding unit configured to inter-prediction encode the block of the video data based on the selection.

11. The system of claim 10 , wherein:

the encoded block of the video data corresponds to a neighboring encoded block of a currently encoded block of the video data associated with the encoded block of the video data.

12. The system of claim 10 , wherein:

the encoded block of the video data corresponds to one of a top neighboring block and a left neighboring block neighboring a currently encoded block of the video data associated with the encoded block of the video data.

13. The system of claim 10 , wherein:

the processor is configured to determine the coefficient based on a least mean square error approximation corresponding to a linear model.

14. The system of claim 10 , wherein:

obtaining the correlation between the reconstructed luma residual sample and each of the C b component and the C r component corresponding to the reconstructed chroma residual sample includes:

determining a first and second coefficient for the C b component based on least mean square error approximations; and

determining a third and fourth coefficient for the C r component based on least mean square error approximations.

15. The system of claim 10 , wherein:

the processor is configured to determine a weighted sum of the reconstructed luma residual sample and the reconstructed chroma residual sample.

16. The system of claim 10 , wherein:

the processor is configured to determine the coefficient based on a presence of at least one block of the video data encoded based on an inter-prediction coding scheme neighboring the block of the video data and comprising motion vectors in correlation with motion vectors corresponding to the block of the video data.

17. The system of claim 10 , wherein:

the processor is configured to determine a subsampling of the reconstructed luma residual sample corresponding to the encoded block of video data prior to determining the coefficient in response to a number of reconstructed luma residual samples being greater than a number of reconstructed chroma residual samples.

18. The system of claim 17 , wherein:

the processor is configured to perform the subsampling based on a chroma subsampling metric.

19. A system, comprising:

a processor configured to:

determine a coefficient correlating a reconstructed luma residual sample and a reconstructed chroma residual sample for an encoded block of video data; and

determine a predicted chroma residual sample for inter-prediction encoding a block of the video data based on the corresponding reconstructed luma residual sample and the coefficient; and

select a chroma residual prediction encoding mode or a chroma prediction encoding mode based on a cost associated with chroma residual samples in the encoded block; and

an encoding unit configured to inter-prediction encode the block of the video data based on the selection.

20. The system of claim 19 ,

wherein to determine the coefficient, the processor is configured to determine a first coefficient and a second coefficient for a C b component based on least mean square error approximations, and

wherein the processor is configured to determine the predicted chroma residual sample for inter-prediction encoding the block of the video data based on the corresponding reconstructed luma residual sample, further based on the first coefficient, and further based on the second coefficient.

Priority Claims (1)
IN 2504/CHE/2011 · Jul 21, 2011 · national
Continuity (4)
Continuation 17020960 · Sep 15, 2020
Continuation 15954139 · Apr 16, 2018
Continuation 13553873 · Jul 20, 2012
Related Publication 20220248037A1 · Aug 4, 2022
References Cited (70)
US 7551701B1 · Ariyavisitakul · 2009 [cited by applicant]
US 8000390B2 · Zhao · 2011 [cited by examiner]
US 8265152B2 · Anisimov · 2012 [cited by applicant]
US 8660345B1 · Fang · 2014 [cited by examiner]
US 8767828B2 · Ma · 2014 [cited by examiner]
US 9008174B2 · Zheng et al. · 2015 [cited by applicant]
US 9049444B2 · Zheng · 2015 [cited by examiner]
US 9161057B2 · Karczewicz · 2015 [cited by examiner]
US 9363525B2 · Sasai · 2016 [cited by examiner]
US 9462282B2 · Sasai · 2016 [cited by examiner]
US 9854275B2 · Joshi · 2017 [cited by examiner]
US 10015512B2 · Song · 2018 [cited by examiner]
US 10536710B2 · Xu · 2020 [cited by examiner]
US 20010017887A1 · Furukawa · 2001 [cited by applicant]
US 20020176498A1 · Frojdh et al. · 2002 [cited by applicant]
US 20040095511A1 · Amara et al. · 2004 [cited by applicant]
US 20050008240A1 · Banerji et al. · 2005 [cited by applicant]
US 20050053136A1 · Yu · 2005 [cited by applicant]
US 20050281334A1 · Walker · 2005 [cited by applicant]
US 20060227871A1 · Budagavi · 2006 [cited by applicant]
US 20060233251A1 · Kim · 2006 [cited by examiner]
US 20070014349A1 · Bao · 2007 [cited by applicant]
US 20070083578A1 · Chen · 2007 [cited by applicant]
US 20070092001A1 · Arakawa · 2007 [cited by applicant]
US 20070154087A1 · Cho et al. · 2007 [cited by applicant]
US 20070183491A1 · Pearson et al. · 2007 [cited by applicant]
US 20070253484A1 · Zhao · 2007 [cited by examiner]
US 20080144723A1 · Chen et al. · 2008 [cited by applicant]
US 20080175495A1 · Segall · 2008 [cited by applicant]
US 20080247641A1 · Rasmusson · 2008 [cited by applicant]
US 20080253457A1 · Moore · 2008 [cited by applicant]
US 20090022219A1 · Goel · 2009 [cited by applicant]
US 20090129465A1 · Lai et al. · 2009 [cited by applicant]
US 20090152000A1 · Kaushik · 2009 [cited by applicant]
US 20090161759A1 · Seo et al. · 2009 [cited by applicant]
US 20090175334A1 · Ye et al. · 2009 [cited by applicant]
US 20090219993A1 · Bronstein et al. · 2009 [cited by applicant]
US 20100020866A1 · Marpe · 2010 [cited by applicant]
US 20100054329A1 · Bronstein et al. · 2010 [cited by applicant]
US 20100091860A1 · Anisimov · 2010 [cited by applicant]
US 20100177585A1 · Rubinstein · 2010 [cited by applicant]
US 20100177828A1 · Rubinstein · 2010 [cited by applicant]
US 20100188571A1 · Wei Yin · 2010 [cited by applicant]
US 20100220215A1 · Rubinstein · 2010 [cited by applicant]
US 20100260260A1 · Wiegand · 2010 [cited by applicant]
US 20100260265A1 · Jeon et al. · 2010 [cited by applicant]
US 20100329342A1 · Joshi et al. · 2010 [cited by applicant]
US 20110007801A1 · Andersson · 2011 [cited by applicant]
US 20110222723A1 · He · 2011 [cited by applicant]
US 20110249721A1 · Karczewicz et al. · 2011 [cited by applicant]
US 20110255591A1 · Kim et al. · 2011 [cited by applicant]
US 20110274170A1 · Paz · 2011 [cited by applicant]
US 20110292994A1 · Lim et al. · 2011 [cited by applicant]
US 20120027083A1 · Narroschke et al. · 2012 [cited by applicant]
US 20120051440A1 · Parfenov et al. · 2012 [cited by applicant]
US 20120106642A1 · Letunovskiy et al. · 2012 [cited by applicant]
US 20130004092A1 · Sasai · 2013 [cited by examiner]
US 20130016782A1 · Sasai · 2013 [cited by examiner]
US 20130113880A1 · Zhao et al. · 2013 [cited by applicant]
US 20130129326A1 · Wang et al. · 2013 [cited by applicant]
US 20130136174A1 · Xu et al. · 2013 [cited by applicant]
US 20130336591A1 · Jeon · 2013 [cited by examiner]
US 20140072033A1 · Chuang · 2014 [cited by examiner]
US 20140105290A1 · Kwon · 2014 [cited by examiner]
US 20150063438A1 · Kim · 2015 [cited by applicant]
US 20150124875A1 · Xu · 2015 [cited by examiner]
US 20190075295A1 · Sasai et al. · 2019 [cited by applicant]
Kim et al., “New Intra Chroma Prediction Using Inter-Channel Correlation”, JCTVC-B021, 2nd Meeting: Geneva, CH, Jul. 21-28, 2010 (9 pages). [cited by applicant]
Chen et al., “CE6.a: Chroma Intra Prediction by Reconstructed Luma Samples,”, JCTVC-D350, 4th Meeting: Daegu, KR, Jan. 20-28, 2011 (7 pages). [cited by applicant]
Lucas et al., “Intra-Prediction for Color Image Coding Using YUV Correlation”, International Conference on Image Processing, Hong Kong, Sep. 26-29, 2010 (4 pages). [cited by applicant]