IP Library › Granted Patent US 11,689,727
Granted Patent B2
US 11,689,727 · App. 17/277,386 · Granted Jun 27, 2023

Local illumination compensation for video encoding and decoding using stored parameters

Inventors: Fabrice Leleannec (Mouaze, FR); Tangi Poirier (Thorigne-Fouillard, FR); Ya Chen (Rennes, FR); Philippe Bordes (Laille, FR)
Assignee: InterDigital VC Holdings, Inc.
H04N19/152H04N19/102H04N19/149H04N19/176
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,689,727
App. No.
17/277,386
Granted
Jun 27, 2023
Kind
B2
Abstract

A Local illumination compensation system for video encoding and decoding uses memory for storing illumination compensation parameters and does not require access to reconstructed pixels of neighboring blocks. A set of illumination compensation parameters is stored in a dedicated buffer, which is of limited size, and which is decoupled from the coding unit level storage of information. The buffer contains a set of illumination compensation parameters, which may be, for example, computed (or determined in some other manner) on the fly or determined beforehand (for example for example obtained from the video signal or from a device).

Claims (65)

1. A method for video decoding, the method comprising:

determining to perform local illumination compensation (LIC) on a current block using LIC parameters;

obtaining a local illumination compensation parameter candidate list;

obtaining, for the current block, an LIC parameter index associated with the LIC parameter candidate list for performing LIC on the current block;

selecting an LIC parameter set from the LIC parameter candidate list based on the LIC parameter index; and

decoding the current block based on the LIC parameter set.

2. The method of claim 1 , wherein the LIC parameter set is a first LIC parameter set, and the method further comprises:

determining a second LIC parameter set based on a right-hand vertical sub-block of the current block; and

adding the second LIC parameter set to the LIC parameter candidate list, wherein the second LIC parameter set is indexed in the LIC parameter candidate list as a function of a vertical position associated with the sub-block of the current block.

3. The method of claim 1 , wherein the LIC parameter set is a first LIC parameter set, and the method further comprises:

determining a second LIC parameter set based on a lower horizontal sub-block of the current block; and

adding the second LIC parameter set to the LIC parameter candidate list, wherein the second LIC parameter set is indexed in the LIC parameter candidate list as a function of a horizontal position associated with the sub-block of the current block.

4. The method of claim 1 , wherein the LIC parameter set is a first LIC parameter set, and the method further comprises:

determining a second LIC parameter set that comprises a LIC parameter set and a horizontal LIC parameter candidate set, wherein the vertical LIC parameter candidate set is obtained based on a right-hand vertical sub-block of the current block, and wherein the horizontal LIC parameter candidate set is obtained based on a lower-horizontal sub-block associated with the current block; and

adding the second LIC parameter set to the LIC parameter candidate list, wherein the vertical LIC parameter candidate set is indexed in the LIC parameter candidate list as a function of a vertical position of the sub-block associated with the sub-block of the current block, and wherein the horizontal LIC parameter candidate set is indexed in the LIC parameter candidate list as a function of the horizontal position associated with the sub-block of the current block.

5. The method of claim 1 , wherein the LIC parameter set is a first LIC parameter set, and the method further comprises:

determining a second LIC parameter set based on the current block and a first order linear model using a scaling factor and an offset.

6. A method for video encoding, the method comprising:

obtaining a local illumination compensation (LIC) parameter candidate list;

selecting an LIC parameter set for a current block from the LIC parameter candidate list;

encoding the current block based on the selected LIC parameter set; and

Including an indication of an index of the selected LIC parameter set for the current block in video data.

7. The method of claim 6 , wherein the selected LIC parameter set is a first LIC parameter set, wherein the method further comprises:

reconstructing the current block;

determining a second LIC parameter set that comprises a vertical LIC parameter candidate set and a horizontal parameter candidate set, wherein the vertical LIC parameter candidate set is obtained based on a right-hand vertical sub-block of the current block, and wherein the horizontal LIC parameter candidate set is obtained based on a lower horizontal sub-block of the current block; and

adding the second LIC parameter set to the LIC parameter candidate list, wherein the vertical LIC parameter candidate set is indexed as a function of the vertical position associated with the sub-block of the current block, and wherein the horizontal LIC parameter candidate set is indexed as a function of the horizontal position associated with the sub-block of the current block.

8. The method of claim 6 , wherein the LIC parameter set is a first LIC parameter set and the method further comprises:

Determining a second LIC parameter set based on the current block and a first order linear model using a scaling factor and an offset.

9. An apparatus for video decoding, the device comprising at least one processor configured to:

determine to perform local illumination compensation (LIC) on a current block using LIC parameters;

obtain a local illumination compensation parameter candidate list;

obtain, for the current block, an LIC parameter index associated with the LIC parameter candidate list for performing LIC on the current block;

selecting an LIC parameter set from the LIC parameter candidate list based on the LIC parameter index; and

decode the current block block based on the LIC parameter set.

10. The apparatus of claim 9 , wherein the LIC parameter set is a first LIC parameter set, and the at least one processor is further configured to:

determine a second LIC parameter set based on a right-hand vertical sub-block of the current block; and

add the second LIC parameter set to the LIC parameter candidate list, wherein the second LIC parameter set is are stored in the local illumination compensation buffer indexed in the LIC parameter candidate list as a function of a vertical position associated with the sub-block of the current block.

11. The apparatus of claim 9 , wherein the LIC parameter set is a first LIC parameter set, and the at least one processor is further configured to:

determine a second LIC parameter set based on a lower horizontal sub-block of the current block; and

add the second LIC parameter set to the LIC parameter candidate list, wherein the second LIC parameter set is indexed in the LIC parameter candidate list as a function of a horizontal position associated with the sub-block of the current block.

12. The apparatus of claim 9 , wherein the LIC parameter set is a first LIC parameter set, and the at least one processor is further configured to:

determine a second LIC parameter set that comprises a vertical LIC parameter set and a horizontal LIC parameter candidate set, wherein the vertical LIC parameter candidate set is obtained based on a right-hand vertical sub-block of the current block, and wherein the horizontal LIC parameter candidate set is obtained based on a lower-horizontal sub-block associated with the current block; and

add the second LIC parameter set to the LIC parameter candidate list, wherein the vertical LIC parameter candidate set is indexed in the LIC parameter candidate list as a function of a vertical position of the sub-block associated with the sub-block of the current block, and wherein the horizontal LIC parameter candidate set is indexed in the LIC parameter candidate list as a function of the horizontal position associated with the sub-block of the current block.

13. The apparatus of claim 9 , wherein the LIC parameter set is a first LIC parameter set, and the at least one processor is further configured to:

determine a second LIC parameter set based on the current block using a first order linear model using a scaling factor and an offset.

14. The method of claim 1 , wherein the LIC parameter set is a first LIC parameter set, and the method further comprises:

determining a second LIC parameter set based on a sub-block of reconstructed samples of the decoded current block; and

adding the second LIC parameter set to the LIC parameter candidate list.

15. The method of claim 1 , wherein the LIC parameter candidate list comprises a set of LIC parameter candidates associated with previously reconstructed blocks.

16. The apparatus of claim 9 , wherein the LIC parameter set is a first LIC parameter set, and the at least one processor is further configured to:

determine a second LIC parameter set based on a sub-block of reconstructed samples of the decoded current block; and

add the second LIC parameter set to the LIC parameter candidate list.

17. The apparatus of claim 9 , wherein the LIC parameter candidate list comprises a set of LIC parameter candidates associated with previously reconstructed blocks.

18. The method of claim 6 , wherein the selected LIC parameter set is a first LIC parameter set, wherein the method further comprises:

reconstructing the current block;

determining a second LIC parameter set based on a sub-block of reconstructed samples of the decoded current block; and

adding the second LIC parameter set to the LIC parameter candidate list.

19. The method of claim 6 , wherein the selected LIC parameter set is a first LIC parameter set, wherein the method further comprises:

reconstructing the current block;

determining a second LIC parameter set based on a right-hand vertical sub-block of the current block; and

adding the second LIC parameter set to the LIC parameter candidate list, wherein the second LIC parameter set is indexed in the LIC parameter candidate list as a function of a vertical position associated with the sub-block of the current block.

20. The method of claim 6 , wherein the selected LIC parameter set is a first LIC parameter set, wherein the method further comprises:

reconstructing the current block;

determining a second LIC parameter set based on a lower horizontal sub-block of the current block; and

adding the second LIC parameter set to the LIC parameter candidate list, wherein the second LIC parameter set is indexed in the LIC parameter candidate list as a function of a horizontal position associated with the sub-block of the current block.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 19, 2021
From: LELEANNEC, FABRICE; POIRIER, TANGI; CHEN, YA; BORDES, PHILIPPE
To: INTERDIGITAL VC HOLDINGS, INC.
Reel/Frame 055649/0919 →
Priority Claims (2)
EP 19306215 · Sep 19, 2018 · regional
EP 18306261 · Sep 26, 2018 · regional
Continuity (1)
Related Publication 20220038711A1 · Feb 3, 2022
Cited By (1)
US 12,641,272