IP Library Granted Patent US 11,659,162
Granted Patent B2
US 11,659,162 · App. 17/230,048 · Granted May 23, 2023

Video processing using local illumination compensation

Inventors: Hongbin Liu (Beijing, CN); Li Zhang (San Diego, CA); Kai Zhang (San Diego, CA); Yue Wang (Beijing, CN)
Assignees: BEIJING BYTEDANCE NETWORK TECHNOLOGY CO., LTD; BYTEDANCE INC.
H04N19/105H04N19/119H04N19/176H04N19/186H04N19/436H04N19/52H04N19/55H04N19/70H04N19/96
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,659,162
App. No.
17/230,048
Granted
May 23, 2023
Kind
B2
Abstract

A video processing method is provided to include: determining, based on a position rule, whether a local illumination compensation (LIC) tool is enabled for a conversion between a current block in a video region of a video and a coded representation of the video, and performing the conversion based on the position rule. The position rule specifies that the LIC tool is enabled for blocks on boundaries of the video region and disabled for blocks inside the video region and the LIC tool includes using a linear model of illumination changes in the current block during the conversion.

Claims (40)

1. A video processing method, comprising:

inheriting local illumination compensation (LIC) parameters associated with another video block for a current block in a video region of a video; and

performing a conversion between the current block in the video region of the video and a bitstream of the video, wherein the video is represented as video frames comprising video blocks, and an LIC tool is enabled for video blocks that use a geometric prediction structure including a triangular prediction mode,

wherein the LIC tool includes using a linear model of illumination changes in the current block during the conversion, and

wherein the linear model generates a final predictor of the current block using the LIC parameters including a scaling factor and an offset.

2. The method of claim 1 , wherein, for the current block for which the LIC is enabled, all prediction units share a same value of a LIC flag.

3. The method of claim 1 , wherein, for the current block that is partitioned from a top-right corner to a bottom-left corner of the video region, a single set of LIC parameters is used for both prediction units.

4. The method of claim 1 , wherein, for the current block that is partitioned from a top-left corner to a bottom-right corner of the video region, a single set of LIC parameters is used for each of the prediction units.

5. The method of claim 1 , wherein, for prediction units coded in a merge mode, a LIC flag is inherited from merge candidates without a signaling.

6. The method of claim 1 , wherein, for prediction units respectively coded in an AMVP mode and a merge mode, a signaled LIC flag is applied to the prediction unit coded in the AMVP mode and one or both of LIC flag and LIC parameters are inherited for the prediction unit coded in the merge mode.

7. The method of claim 1 , wherein, for prediction units coded in an AMVP mode, a LIC flag is signaled for each of the prediction units.

8. The method of claim 1 , further comprising:

deriving LIC parameters according to decoded information.

9. The method of claim 1 , further comprising:

deriving LIC parameters using a linear model for blocks on a boundary of the video region and inherit the LIC parameters for blocks inside the video region.

10. The method of claim 1 , wherein the video region is a coding tree unit (CTU) in which the current block is positioned.

11. The method of claim 1 , wherein the inheriting includes:

maintaining a number of look-up tables (LUTs) of LIC parameters previously used for other blocks; and

deriving the LIC parameters for the current block based on one or more LIC parameters from the look-up table.

12. The method of claim 11 , wherein a LUT is maintained for each reference picture.

13. The method of claim 11 , wherein a LUT is emptied and rebuilt for each CTU or a row of CTU or a slice or a tile or a tile group or a picture of the current block.

14. The method of claim 11 , wherein multiple LUTs are used for a CTU.

15. The method of claim 11 , wherein the performing conversion uses parameters from the LUTs generated by a previously processed coding tree unit.

16. The method of claim 11 , wherein at least one LUT is maintained for each reference picture or for each reference picture list used in the conversion of the current block.

17. The method of claim 1 , wherein the inheriting includes configuring the bitstream with one or more difference values and computing LIC flag or LIC parameters based on the one or more difference values and one or both of a neighboring block's LIC flag and LIC parameters.

18. An apparatus in a video system comprising a processor and a non-transitory memory with instructions thereon, wherein the instructions upon execution by the processor, cause the processor to:

inheriting local illumination compensation (LIC) parameters associated with another video block for a current block in a video region of a video; and

performing a conversion between the current block in the video region of the video and a bitstream of the video, wherein the video is represented as video frames comprising video blocks, and an LIC tool is enabled for video blocks that use a geometric prediction structure including a triangular prediction mode,

wherein the LIC tool includes using a linear model of illumination changes in the current block during the conversion, and

wherein the linear model generates a final predictor of the current block using the LIC parameters including a scaling factor and an offset.

19. A non-transitory computer-readable storage medium storing instructions that cause a processor to:

inheriting local illumination compensation (LIC) parameters associated with another video block for a current block in a video region of a video; and

performing a conversion between the current block in the video region of the video and a bitstream of the video, wherein the video is represented as video frames comprising video blocks, and an LIC tool is enabled for video blocks that use a geometric prediction structure including a triangular prediction mode,

wherein the LIC tool includes using a linear model of illumination changes in the current block during the conversion, and

wherein the linear model generates a final predictor of the current block using the LIC parameters including a scaling factor and an offset.

20. A non-transitory computer-readable recording medium storing a bitstream of a video which is generated by a method performed by a video processing apparatus, wherein the method comprises:

Inheriting local illumination compensation (LIC) parameters associated with another video block for a current block in a video region of a video; and

performing a conversion between the current block in the video region of the video, wherein the video is represented as video frames comprising video blocks, and an LIC tool is enabled for video blocks that use a geometric prediction structure including a triangular prediction mode,

wherein the LIC tool includes using a linear model of illumination changes in the current block during the conversion, and

wherein the linear model generates a final predictor of the current block using the LIC parameters including a scaling factor and an offset.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 14, 2021
From: ZHANG, LI; ZHANG, KAI
To: BYTEDANCE INC.
Reel/Frame 055918/0018 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 14, 2021
From: LIU, HONGBIN; WANG, YUE
To: BEIJING BYTEDANCE NETWORK TECHNOLOGY CO., LTD.
Reel/Frame 055918/0066 →
Priority Claims (3)
WO PCT/CN2018/111436 · Oct 23, 2018 · international
WO PCT/CN2019/071759 · Jan 15, 2019 · international
WO PCT/CN2019/072154 · Jan 17, 2019 · international
Continuity (2)
Continuation PCTIB2019059042 · Oct 23, 2019
Related Publication 20210235109A1 · Jul 29, 2021
Cited By (1)
US 12,621,432