IP Library Granted Patent US 12,395,637
Granted Patent B2
US 12,395,637 · App. 18/285,939 · Granted Aug 19, 2025

Spatial illumination compensation on large areas

Inventors: Fabrice Le Leannec (Betton, FR); Ya Chen (Rennes, FR); Gaëlle Martin-Cocher (Toronto, CA)
Assignee: InterDigital Madison Patent Holdings, SAS
H04N19/136H04N19/11H04N19/119H04N19/167H04N19/172H04N19/503H04N19/593
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,395,637
App. No.
18/285,939
Granted
Aug 19, 2025
Kind
B2
Abstract

A reconstruction method comprising: obtaining ( 811 ) a region predictor for a current region of a picture based on a spatial prediction; obtaining ( 812 ) an information representative of a partitioning of the current region into sub-regions; reconstructing ( 813 ) at least one residual sub-region based on an intra prediction residual and an intra prediction mode and obtaining a reconstructed residual region from the at least one reconstructed residual sub-region, wherein all reference samples external to the current region used for reconstructing the at least one sub-region are set to zero before reconstructing the at least one residual sub-region; and, reconstructing ( 814 ) the current region based on the reconstructed residual region and on the region predictor by adding a final predictor obtained from the region predictor and the reconstructed residual region.

Claims (46)

1. A method for decoding comprising:

obtaining a region predictor for a current region of a picture based on a spatial prediction;

obtaining an information representative of a partitioning of the current region into a plurality of sub-regions of samples;

for at least one sub-region of samples of the plurality, reconstructing a sub-region of residual values based on an intra prediction residual and an intra prediction mode signaled in video data for the sub-region of residual values, wherein values of reference samples external to the current region used for reconstructing a sub-region of residual values are modified before reconstructing the sub-region of residual values, and each intra predicted sub-region of residual values of the plurality is associated to an intra prediction mode independent of intra prediction modes associated to other intra predicted sub-regions of residual values of the plurality;

obtaining a reconstructed residual region from the at least one reconstructed sub-region of residual values; and

reconstructing the current region based on the reconstructed residual region and on the region predictor by combining a final predictor based on the region predictor and the reconstructed residual region.

2. The method according to claim 1 wherein obtaining the region predictor comprises obtaining the region predictor from a plurality of linear predictions, each linear prediction being based on parameters representative of illumination variations in the picture obtained from at least one region of the picture spatially neighboring the current region.

3. The method according to claim 1 wherein obtaining the region predictor comprises obtaining the region predictor based on a combination of a horizontal linear prediction and a vertical linear prediction, each linear prediction using samples of reconstructed regions neighboring the current region and at least one sample belonging to a non-reconstructed region.

4. The method according to claim 3 wherein the sample belonging to a non-reconstructed region is a bottom right sample of the current region in the current region or out of the current region.

5. The method according to claim 1 comprising obtaining a temporal predictor for the current region and wherein the final predictor is a weighted average of the region predictor and the temporal predictor.

6. The method according to claim 1 wherein the reconstructed residual region undergoes an inverse reshaping process before being used for reconstructing the current region.

7. The method according to claim 1 wherein values of all reference samples external to the current region used for reconstructing a sub-region of residual values are set to zero before reconstructing the at least one residual sub-region of residual values.

8. Non-transitory information storage medium storing program code instructions for implementing the method according to claim 1 .

9. A method for encoding comprising:

obtaining a region predictor for a current region of a picture based on a spatial prediction;

obtaining a residual region for the current region by subtracting a final predictor obtained from the region predictor from the current region;

partitioning the residual region into a plurality of sub-regions of residual values; and

for at least one sub-region of residual values of the plurality, intra predicting the sub-region of residual values, the intra predicting comprising:

determining an intra prediction mode for the sub-region of residual values;

determining an intra predictor for the sub-region of residual values based on the determined intra prediction mode; and

determining an intra residual for the sub-region of residual values as the difference between the sub-region of residual values and the intra predictor; and signaling the intra prediction mode and the intra residual in video data,

wherein values of reference samples external to the current region used for intra predicting at least one sub-region of residual values of the plurality are modified before intra predicting the sub-region of residual values and, each intra predicted sub-region of residual values of the plurality is associated to an intra prediction mode independent of intra prediction modes associated to other intra predicted sub-regions of residual values of the plurality.

10. The method according to claim 9 wherein obtaining the region predictor comprises obtaining the region predictor from a plurality of linear predictions, each linear prediction being based on parameters representative of illumination variations in the picture obtained from at least one region of the picture spatially neighboring the current region.

11. The method according to claim 9 wherein obtaining the region predictor comprises obtaining the region predictor based on a combination of a horizontal linear prediction and a vertical linear prediction, each linear prediction using samples of reconstructed regions neighboring the current region and at least one sample belonging to a non-reconstructed region.

12. The method according to claim 11 wherein the sample belonging to a non-reconstructed region is a bottom right sample of the current region in the current region or out of the current region.

13. The method according to claim 9 comprising obtaining a temporal predictor for the current region and wherein the final predictor is a weighted average of the region predictor and the temporal predictor.

14. The method according to claim 9 wherein the residual region undergoes a reshaping process before intra prediction of a sub-region of residual values.

15. The method according to claim 9 wherein values of all reference samples external to the current region used for intra predicting at least one sample of the residual region are set to zero before intra predicting a residual sub-region of residual values.

16. Non-transitory information storage medium storing program code instructions for implementing the method according to claim 9 .

17. A device comprising electronic circuitry configured for:

obtaining a region predictor for a current region of a picture based on a spatial prediction;

obtaining an information representative of a partitioning of the current region into a plurality of sub-regions of samples;

for at least one sub-region of samples of the plurality, reconstructing ( 813 ) a sub-region of residual values based on an intra prediction residual and an intra prediction mode signaled in video data for the sub-region of residual values, wherein values of reference samples external to the current region used for reconstructing a sub-region of residual values are modified before reconstructing the sub-region of residual values and, each intra predicted sub-region of residual values of the plurality is associated to an intra prediction mode independent of intra prediction modes associated to other intra predicted sub-regions of residual values of the plurality;

obtaining a reconstructed residual region from the at least one reconstructed sub-region of residual values; and

reconstructing the current region based on the reconstructed residual region and on the region predictor by combining a final predictor based on the region predictor and the reconstructed residual region.

18. The device according to claim 17 wherein the electronic circuitry being configured for obtaining the region predictor comprises the electronic circuitry being configured for obtaining the region predictor from a plurality of linear predictions, each linear prediction being based on parameters representative of illumination variations in the picture obtained from at least one region of the picture spatially neighboring the current region.

19. A device comprising electronic circuitry configured for:

obtaining a region predictor for a current region of a picture based on a spatial prediction;

obtaining a residual region for the current region by subtracting a final predictor obtained from the region predictor from the current region;

partitioning the residual region into a plurality of sub-regions of residual values; and

for at least one sub-region of residual values of the plurality, intra predicting the sub-region of residual values, the intra predicting comprising:

determining an intra prediction mode for the sub-region of residual values;

determining an intra predictor for the sub-region of residual values based on the determined intra prediction mode;

determining an intra residual for the sub-region of residual values as the difference between the sub-region of residual values and the intra predictor; and signaling the intra prediction mode and the intra residual in video data,

wherein values of reference samples external to the current region used for intra predicting at least one sub-region of residual values of the plurality are modified before intra predicting the sub-region of residual values and, each intra predicted sub-region of residual values of the plurality is associated to an intra prediction mode independent of intra prediction modes associated to other intra predicted sub-regions of residual values of the plurality.

20. The device according to claim 19 wherein the electronic circuitry being configured for obtaining the region predictor comprises the electronic circuitry being configured for obtaining the region predictor from a plurality of linear predictions, each linear prediction being based on parameters representative of illumination variations in the picture obtained from at least one region of the picture spatially neighboring the current region.

Assignments (3)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Oct 16, 2024
From: INTERDIGITAL CE PATENT HOLDINGS, SAS
To: INTERDIGITAL MADISON PATENT HOLDINGS, SAS
Reel/Frame 068916/0562 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Oct 6, 2023
From: LE LEANNEC, FABRICE; CHEN, YA; MARTIN-COCHER, GAËLLE
To: INTERDIGITAL VC HOLDINGS FRANCE, SAS
Reel/Frame 065150/0667 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Oct 6, 2023
From: INTERDIGITAL VC HOLDINGS FRANCE, SAS
To: INTERDIGITAL CE PATENT HOLDINGS, SAS
Reel/Frame 065178/0245 →
Priority Claims (1)
EP 21305474 · Apr 9, 2021 · regional
Continuity (1)
Related Publication 20240205412A1 · Jun 20, 2024
References Cited (16)
US 20110170606A1 · Zhang et al. · 2011 [cited by applicant]
US 20120243608A1 · Yu et al. · 2012 [cited by applicant]
US 20190268599A1 · Hannuksela · 2019 [cited by examiner]
US 20200162728A1 · Van der Auwera · 2020 [cited by examiner]
US 20210266581A1 · Jung · 2021 [cited by examiner]
US 20220014741A1 · Xiu · 2022 [cited by examiner]
US 20230061216A1 · Zhao · 2023 [cited by examiner]
US 20240205412A1 · Le Leannec · 2024 [cited by examiner]
US 20240406375A1 · Lim · 2024 [cited by examiner]
Andersson, Kenneth, “Combined Intra Inter Prediction Coding Mode”, International Telecommunication Union (ITU), Telecommunications Standardization Sector, Video Coding Experts Group (VCEG), Document: VCEG-AD11, 30th Mee… [cited by applicant]
“Test Model 11 for Versatile Video Coding (VTM 11)”, International Organization for Standardization (ISO) and International Electrotechnical Commission (IEC), MPEG Joint Video Coding Team(s) with ITU-T SG 16, ISO/IEC JT… [cited by applicant]
Chen et al., “Scalable Video Coding Extension for HEVC”, Institute of Electrical and Electronics Engineers (IEEE), 2013 Data Compression Conference, Snowbird, Utah, USA, Mar. 20, 2013, 10 pages. [cited by applicant]
Bross et al., “Versatile video coding (draft 9)”, Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC ITC 1/SC 29/WG 11, Document: JVET-R2001-vA, 18th Meeting, by teleconference, Apr. 15, 2020, 524 pages. [cited by applicant]
Lou, Chung-Cheng, “Low complexity and high efficiency prediction techniques for video coding”, University of Southern California, Faculty of the USC Graduate School, Dissertation Paper, Dec. 2011, 124 pages. [cited by applicant]
Jin et al., “Combined Inter-Intra Prediction for High Definition Video Coding”, Picture Coding Symposium 2007, Lisboa, Portugal, Nov. 7, 2007, 4 pages. [cited by applicant]
Hinz et al., “An HEVC Extension for Spatial and Quality Scalable Video Coding”, The International Society for Optics and Photonics (SPIE), IS&T/SPIE Electronic Imaging, Proceedings vol. 8666, Visual Information Processi… [cited by applicant]