IP Library › Granted Patent US 12,445,618
Granted Patent B2
US 12,445,618 · App. 17/844,462 · Granted Oct 14, 2025

Method and device for predictive picture encoding and decoding

Inventors: Edouard Francois (Bourg des Comptes, FR); Christophe Chevance (Brece, FR); Franck Hiron (Chateaubourg, FR)
Assignee: INTERDIGITAL VC HOLDINGS, INC.
H04N19/132H04N19/136H04N19/176H04N19/186
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,445,618
App. No.
17/844,462
Granted
Oct 14, 2025
Kind
B2
Abstract

A method for encoding a block of a picture comprising, for at least one sample of the block and for one current component: obtaining a prediction value; determining a mapped residual value from a source value of the sample and from the prediction value responsive to a mapping function; and encoding the mapped residual value into a bitstream; wherein the mapping function is derived to obtain at least one of a reduction of a bit cost of the bitstream for a given quality of reconstruction or an increase of quality of reconstruction for a given bit cost of the bitstream.

Claims (96)

1. A method of encoding comprising:

obtaining a chroma prediction value of a chroma source value of a sample of a block of a picture;

obtaining a value representative of a luma prediction value of a luma source value of the sample;

determining a mapped chroma residual value from the chroma source value and from the value representative of the luma prediction value using a mapping function; and

encoding the mapped chroma residual value into a bitstream;

wherein determining the mapped chroma residual value comprises:

determining a chroma residual value as a difference between the chroma source value and the chroma prediction value; and

mapping the chroma residual value with the mapping function to obtain a mapped chroma residual value, wherein the mapping comprises multiplying the chroma residual value by a scaling factor depending on the value representative of the luma prediction value.

2. The method of claim 1 , further comprising:

obtaining the luma prediction value;

determining a mapped luma residual value from the luma source value and from the luma prediction value using a mapping function; and

encoding the mapped luma residual value into a bitstream;

wherein determining the mapped luma residual value comprises:

mapping the luma prediction value with the mapping function to obtain a mapped luma prediction value;

mapping the luma source value with the mapping function to obtain a mapped luma source value; and

determining the mapped luma residual value as a subtraction of the mapped luma prediction value and the mapped luma source value.

3. A method of decoding comprising:

obtaining a chroma prediction value of a chroma source value of a sample of a block of a picture;

obtaining a value representative of a luma prediction value of a luma source value of the sample;

decoding a chroma residual value for the sample; and

determining a reconstructed chroma value for the sample from the decoded chroma residual value and from the chroma prediction value using a mapping function;

wherein determining the reconstructed chroma value comprises:

mapping the chroma residual value to obtain a mapped chroma residual value, wherein the mapping comprises multiplying the chroma residual value by a scaling factor depending on the value representative of the luma prediction value; and

obtaining the reconstructed chroma value by adding the mapped chroma residual value to the chroma prediction value.

4. The method of claim 3 , further comprising:

obtaining the luma prediction value;

decoding a luma residual value for the sample; and

determining a reconstructed luma value for the sample from the decoded luma residual value and from the luma prediction value using both a mapping function and an inverse mapping function that is the inverse of the mapping function;

wherein determining the reconstructed luma value comprises:

mapping the luma prediction value with the mapping function to obtain a mapped luma prediction value;

obtaining an intermediate value representative of a sum of the mapped luma prediction value and the luma residual value; and

obtaining the reconstructed luma value by mapping the intermediate value with the inverse mapping function.

5. An encoding device comprising at least one processor configured to perform:

obtaining a chroma prediction value of a chroma source value of a sample of a block of a picture;

obtaining a value representative of a luma prediction value of a luma source value of the sample;

determining a mapped chroma residual value from the chroma source value and from the value representative of the luma prediction value using a mapping function; and

encoding the mapped chroma residual value into a bitstream;

wherein determining the mapped chroma residual value comprises:

determining a chroma residual value as a difference between the chroma source value and the chroma prediction value; and

mapping the chroma residual value with the mapping function to obtain a mapped chroma residual value, wherein the mapping comprises multiplying the chroma residual value by a scaling factor depending on the value representative of the luma prediction value.

6. The encoding device of claim 5 , wherein the at least one processor is further configured to perform:

obtaining the luma prediction value;

determining a mapped luma residual value from the luma source value and from the luma prediction value using a mapping function; and

encoding the mapped luma residual value into a bitstream;

wherein determining the mapped luma residual value comprises:

mapping the luma prediction value with the mapping function to obtain a mapped luma prediction value;

mapping the luma source value with the mapping function to obtain a mapped luma source value; and

determining the mapped luma residual value as a subtraction of the mapped luma prediction value and the mapped luma source value.

7. A decoding device comprising at least one processor configured to perform:

obtaining a chroma prediction value of a chroma source value of a sample of a block of a picture;

obtaining a value representative of a luma prediction value of a luma source value of the sample;

decoding a chroma residual value for the sample; and

determining a reconstructed chroma value for the sample from the decoded chroma residual value and from the chroma prediction value using a mapping function;

wherein determining the reconstructed chroma value comprises:

mapping the chroma residual value to obtain a mapped chroma residual value, wherein the mapping comprises multiplying the chroma residual value by a scaling factor depending on the value representative of the luma prediction value; and

obtaining the reconstructed chroma value by adding the mapped chroma residual value to the chroma prediction value.

8. The decoding device of claim 7 , wherein the at least one processor is further configured to perform:

obtaining the luma prediction value;

decoding a luma residual value for the sample; and

determining a reconstructed luma value for the sample from the decoded luma residual value and from the luma prediction value using both a mapping function and an inverse mapping function that is the inverse of the mapping function;

wherein determining the reconstructed luma value comprises:

mapping the luma prediction value with the mapping function to obtain a mapped luma prediction value;

obtaining an intermediate value representative of a sum of the mapped luma prediction value and the luma residual value; and

obtaining the reconstructed luma value by mapping the intermediate value with the inverse mapping function.

9. A non-transitory computer readable storage medium having stored instructions that, when executed by a processor, cause the processor to perform a method of encoding comprising:

obtaining a chroma prediction value of a chroma source value of a sample of a block of a picture;

obtaining a value representative of a luma prediction value of a luma source value of the sample;

determining a mapped chroma residual value from the chroma source value and from the value representative of the luma prediction value using a mapping function; and

encoding the mapped chroma residual value into a bitstream;

wherein determining the mapped chroma residual value comprises:

determining a chroma residual value as a difference between the chroma source value and the chroma prediction value; and

mapping the chroma residual value with the mapping function to obtain a mapped chroma residual value, wherein the mapping comprises multiplying the chroma residual value by a scaling factor depending on the value representative of the luma prediction value.

10. The non-transitory computer readable storage medium of claim 9 , wherein the method of encoding further comprises:

obtaining the luma prediction value;

determining a mapped luma residual value from the luma source value and from the luma prediction value using a mapping function; and

encoding the mapped luma residual value into a bitstream;

wherein determining the mapped luma residual value comprises:

mapping the luma prediction value with the mapping function to obtain a mapped luma prediction value;

mapping the luma source value with the mapping function to obtain a mapped luma source value; and

determining the mapped luma residual value as a subtraction of the mapped luma prediction value and the mapped luma source value.

11. A non-transitory computer readable storage medium having stored instructions that, when executed by a processor, cause the processor to perform a method of decoding comprising:

obtaining a chroma prediction value of a chroma source value of a sample of a block of a picture;

obtaining a value representative of a luma prediction value of a luma source value of the sample;

decoding a chroma residual value for the sample; and

determining a reconstructed chroma value for the sample from the decoded chroma residual value and from the chroma prediction value using a mapping function;

wherein determining the reconstructed chroma value comprises:

mapping the chroma residual value to obtain a mapped chroma residual value, wherein the mapping comprises multiplying the chroma residual value by a scaling factor depending on the value representative of the luma prediction value; and

obtaining the reconstructed chroma value by adding the mapped chroma residual value to the chroma prediction value.

12. The non-transitory computer readable storage medium of claim 11 , wherein the method of decoding further comprises:

obtaining the luma prediction value;

decoding a luma residual value for the sample; and

determining a reconstructed luma value for the sample from the decoded luma residual value and from the luma prediction value using both a mapping function and an inverse mapping function that is the inverse of the mapping function;

wherein determining the reconstructed luma value comprises:

mapping the luma prediction value with the mapping function to obtain a mapped luma prediction value;

obtaining an intermediate value representative of a sum of the mapped luma prediction value and the luma residual value; and

obtaining the reconstructed luma value by mapping the intermediate value with the inverse mapping function.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 28, 2022
From: FRANCOIS, EDOUARD; CHEVANCE, CHRISTOPHE; HIRON, FRANCK
To: THOMSON LICENSING
Reel/Frame 060336/0473 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 28, 2022
From: THOMSON LICENSING SAS
To: INTERDIGITAL VC HOLDINGS, INC.
Reel/Frame 060447/0615 →
Priority Claims (1)
EP 17305411 · Apr 7, 2017 · regional
Continuity (2)
Continuation 16603568
Related Publication 20220385913A1 · Dec 1, 2022
References Cited (55)
US 6108449A · Sekiguchi · 2000 [cited by applicant]
US 6154572A · Chaddha · 2000 [cited by applicant]
US 9066070B2 · Su · 2015 [cited by applicant]
US 9100661B2 · Alshina · 2015 [cited by applicant]
US 9544610B2 · Efremov · 2017 [cited by applicant]
US 9832464B2 · Lee · 2017 [cited by examiner]
US 20060103861A1 · Klassen · 2006 [cited by applicant]
US 20130108183A1 · Bruls · 2013 [cited by applicant]
US 20130114696A1 · Liu · 2013 [cited by examiner]
US 20130188696A1 · Liu · 2013 [cited by examiner]
US 20130188703A1 · Liu · 2013 [cited by examiner]
US 20130188705A1 · Liu · 2013 [cited by examiner]
US 20130272396A1 · Liu · 2013 [cited by examiner]
US 20130294689A1 · Jia · 2013 [cited by examiner]
US 20140023139A1 · Xu · 2014 [cited by examiner]
US 20140153642A1 · Hattori · 2014 [cited by examiner]
US 20140247869A1 · Su · 2014 [cited by applicant]
US 20150016512A1 · Pu · 2015 [cited by examiner]
US 20150124865A1 · Kim · 2015 [cited by examiner]
US 20150172661A1 · Dong · 2015 [cited by applicant]
US 20150373349A1 · Zhang · 2015 [cited by examiner]
US 20160219283A1 · Chen · 2016 [cited by examiner]
US 20160277762A1 · Zhang · 2016 [cited by examiner]
US 20160323556A1 · Luginbuhl · 2016 [cited by applicant]
US 20160360235A1 · Ramasubramonian · 2016 [cited by applicant]
US 20160366423A1 · Laserre · 2016 [cited by applicant]
US 20170085896A1 · Ramasubramonian · 2017 [cited by applicant]
US 20170127085A1 · Sun · 2017 [cited by applicant]
US 20170272749A1 · Pettersson · 2017 [cited by examiner]
US 20170332098A1 · Rusanovskyy · 2017 [cited by applicant]
US 20170345187A1 · Sato · 2017 [cited by examiner]
US 20170359595A1 · Zhang · 2017 [cited by examiner]
US 20170366818A1 · Zhang · 2017 [cited by examiner]
US 20180176594A1 · Zhang · 2018 [cited by examiner]
US 20200288126A1 · Hu · 2020 [cited by examiner]
US 20200396458A1 · Francois · 2020 [cited by applicant]
US 20210266604A1 · Du · 2021 [cited by applicant]
CN 102084653A · 2011 [cited by applicant]
CN 102132563A · 2011 [cited by applicant]
EP 0624036A1 · 1994 [cited by applicant]
FR 2618623A1 · 1989 [cited by applicant]
FR 2767623A1 · 1999 [cited by applicant]
WO 2015177126A1 · 2015 [cited by applicant]
WO 2015196119A1 · 2015 [cited by applicant]
WO 2016066028A1 · 2016 [cited by applicant]
WO 2016164235A1 · 2016 [cited by applicant]
WO WO2020156532A1 · 2020 [cited by examiner]
Spaulding, K., et al. “Using A Residual Image To Extend The Color Gamut And Dynamic Range Of An sRGB Image.” In IS and TS Pics Conference, Society for Imaging Science & Technology, 2003, pp. 307-314 (8 pages). [cited by applicant]
Kawamura, K., et al. “Chroma intra prediction based on residual luma samples.” In Joint Collaborative Team on Video Coding (JCT-VC) of ITU-T SG16 WP3 and ISO/IEC JTC1/SC29/WG11, 7th Meeting: Geneva, CH, Nov. 2011 (3 pag… [cited by applicant]
Salih et al. / Salih et al., “Tone Mapping of HDR Images: A Review”, 2012 4th International Conference on Intelligent and Advanced Systems (ICIAS 2012), Kuala Lumpur, Malaysia, Jun. 12, 2012, pp. 368-373 (6 pages). [cited by applicant]
Spaulding et al. / Spaulding et al., “Extending the Color Gamut and Dynamic Range of an sRGB Image Using a Residual Image”, Color Research & Application, vol. 28, No. 4, Aug. 2003, pp. 251-266 (16 pages). [cited by applicant]
Mantiuk / Mantiuk, R., “Multidimensional Retargeting: Tone Mapping”, 4th ACM SIGGRAPH Conference and Exhibition on Computer Graphics and Interactive Techniques in Asia (SIGGRAPH Asia 2011), Hong Kong, Dec. 12, 2011 (75 … [cited by applicant]
Mir et al. / Mir et al., “Adaptive Residual Mapping for an Efficient Extension Layer Coding in Two-Layer HDR Video Coding”, 2016 IEEE International Conference on Image Processing (ICIP), Phoenix, Arizona, USA, Sep. 25, … [cited by applicant]
Marpe et al. / Marpe et al., “Macroblock-Adaptive Residual Color Space Transforms For 4:4:4 Video Coding”, 2006 International Conference on Image Processing, Atlanta, Georgia, USA, Oct. 8, 2006, pp. 3157-3160 (4 pages). [cited by applicant]
Chen, J., et al. “CE6.a: Chroma intra prediction by reconstructed luma samples” In Joint Collaborative Team on Video Coding (JCT-VC) of ITU-T SG16 WP3 and ISO/IEC JTC1/SC29/WG11, JCTVC-E266, 5th Meeting: Geneva, CH, Mar… [cited by applicant]