IP Library › Granted Patent US 10,349,083
Granted Patent B2
US 10,349,083 · App. 15/121,142 · Granted Jul 9, 2019

Method for low-latency illumination compensation process and Depth Lookup Table based coding

Inventors: Yi-Wen Chen (Taichung, TW); Kai Zhang (Beijing, CN); Jian-Liang Lin (Su'ao Township, Yilan County, TW); Yu-Wen Huang (Taipei, TW)
Assignee: HFI INNOVATION INC.
H04N19/597H04N19/105H04N19/136H04N19/174H04N19/176H04N19/46
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,349,083
App. No.
15/121,142
Granted
Jul 9, 2019
Kind
B2
Abstract

A method and apparatus for low-latency illumination compensation in a three-dimensional (3D) and multi-view coding system are disclosed. According to the present invention, the encoder determines whether to enable or disable the illumination compensation for the current picture or slice based on a condition related to statistic associated with a selected reference picture or slice respectively, or related to high-level coding information associated with the current picture or slice respectively. The high-level coding information associated with the current picture or slice excludes any information related to pixel values of the current picture or slice respectively. The illumination compensation is them applied according to the decision made by the encoder. A similar low-latency method is also applied for depth lookup table (DLT) based coding.

Claims (32)

1. A method of illumination compensation in a three-dimensional (3D) and multi-view coding system, the method comprising:

receiving plural pictures or slices in a dependent view;

determining whether to enable or disable the illumination compensation for a first or second current picture or slice of the plural pictures or slices based on a condition related to high-level coding information associated with the first or second current picture or slice respectively, wherein the high-level coding information associated with the first or second current picture or slice excludes any information related to pixel values of the first or second current picture or slice respectively, wherein the condition related to the high-level coding information associated with the first or second current picture or slice corresponds to whether a smallest POC distance between the first or second current picture or slice and a temporal reference picture or slice respectively is larger than a threshold;

for the first current picture or slice where the illumination compensation is enabled, applying the illumination compensation to the first current picture or slice respectively; and

for the second picture or slice where the illumination compensation is disabled, skipping the illumination compensation for the second current picture or slice respectively.

2. The method of claim 1 , wherein the selected reference picture or slice corresponds to a latest reconstructed picture or slice with a first temporal ID smaller than a second temporal ID of the first or second current picture or slice respectively.

3. The method of claim 2 , wherein the determining is further based on a condition related to statistic associated with a selected reference picture or slice respectively, wherein the statistic of the selected reference picture corresponds to a coding unit (CU) level enabling ratio of the latest reconstructed picture and the condition corresponds to whether the CU level enabling ratio is larger than a threshold, wherein the CU level enabling ratio corresponds to a ratio of a first number of coding units (CUs) of the latest reconstructed picture or slice with the illumination compensation enabled and a second number of CUs of the latest reconstructed picture or slice with an IC flag to indicate whether the illumination compensation is enabled or disabled.

4. The method of claim 3 , wherein if the condition is asserted, the illumination compensation for the first or second current picture or slice is enabled, and if the condition is not asserted, the illumination compensation for the first or second current picture or slice is disabled.

5. The method of claim 1 , wherein the selected reference picture or slice corresponds to a latest reconstructed picture or slice with a first quantization parameter (QP) smaller than a second QP of the first or second current picture or slice respectively.

6. The method of claim 1 , wherein the determining is further based on a condition related to statistic associated with a selected reference picture or slice respectively, wherein the statistic of the selected reference picture corresponds to a coding unit (CU) level enabling ratio of the selected reference picture and the condition corresponds to whether the CU level enabling ratio is larger than a threshold, wherein the CU level enabling ratio corresponds to a ratio of a first number of coding units (CUs) of the selected reference picture or slice with the illumination compensation enabled and a second number of CUs of the selected reference picture or slice with an IC flag to indicate whether the illumination compensation is enabled or disabled.

7. The method of claim 1 , wherein the determining is further based on a condition related to statistic associated with a selected reference picture or slice respectively, wherein the statistic of the selected reference picture corresponds to an average pixel difference between the selected reference picture and an inter-view reference picture corresponding to the selected reference picture, and the condition corresponds to whether the average pixel difference is greater than a threshold.

8. The method of claim 1 , wherein the condition related to the high-level coding information associated with the first or second current picture or slice corresponds to whether there is any inter-view reference picture in a reference list of the first or second current picture or slice respectively.

9. The method of claim 1 , wherein the condition related to the high-level coding information associated with the first or second current picture or slice corresponds to whether there is no temporal reference picture in a reference list of the first or second current picture or slice respectively.

10. The method of claim 1 , wherein if the condition is asserted, the illumination compensation for the first or second current picture or slice is enabled, and if the condition is not asserted, the illumination compensation for the first or second current picture or slice is disabled.

11. An apparatus for illumination compensation in a three-dimensional (3D) and multi-view coding system, the apparatus comprising one or more electronic circuits configured to:

receive plural pictures or slices in a dependent view;

determine whether to enable or disable the illumination compensation for a first or second current picture or slice based on a condition related to high-level coding information associated with the first or second current picture or slice respectively, wherein the high-level coding information associated with the first or second current picture or slice excludes any information related to depth values of the first or second current picture or slice respectively, wherein the condition related to the high-level coding information associated with the first or second current picture or slice corresponds to whether a smallest POC distance between the first or second current picture or slice and a temporal reference picture or slice respectively is larger than a threshold;

for the first current picture or slice where the illumination compensation is enabled, apply the illumination compensation to the first current picture or slice respectively; and

for the second picture or slice where the illumination compensation is disabled, skip the illumination compensation for the second current picture or slice respectively.

12. The apparatus of claim 11 , wherein the selected reference picture or slice corresponds to a latest reconstructed picture or slice with a first temporal ID smaller than a second temporal ID of the first or second current picture or slice respectively.

13. The apparatus of claim 12 , wherein the one or more electronic circuits are configured to determine further based on a condition related to statistic associated with a selected reference picture or slice respectively, wherein the statistic of the selected reference picture corresponds to a coding unit (CU) level enabling ratio of the latest reconstructed picture and the condition corresponds to whether the CU level enabling ratio is larger than a threshold, wherein the CU level enabling ratio corresponds to a ratio of a first number of coding units (CUs) of the latest reconstructed picture or slice with the illumination compensation enabled and a second number of CUs of the latest reconstructed picture or slice with an IC flag to indicate whether the illumination compensation is enabled or disabled.

14. The apparatus of claim 13 , wherein if the condition is asserted, the illumination compensation for the first or second current picture or slice is enabled, and if the condition is not asserted, the illumination compensation for the first or second current picture or slice is disabled.

15. The apparatus of claim 11 , wherein the selected reference picture or slice corresponds to a latest reconstructed picture or slice with a first quantization parameter (QP) smaller than a second QP of the first or second current picture or slice respectively.

16. The apparatus of claim 11 , wherein the one or more electronic circuits are configured to determine further based on a condition related to statistic associated with a selected reference picture or slice respectively, wherein the statistic of the selected reference picture corresponds to a coding unit (CU) level enabling ratio of the selected reference picture and the condition corresponds to whether the CU level enabling ratio is larger than a threshold, wherein the CU level enabling ratio corresponds to a ratio of a first number of coding units (CUs) of the selected reference picture or slice with the illumination compensation enabled and a second number of CUs of the selected reference picture or slice with an IC flag to indicate whether the illumination compensation is enabled or disabled.

17. The apparatus of claim 11 , wherein the one or more electronic circuits are configured to determine further based on a condition related to statistic associated with a selected reference picture or slice respectively, wherein the statistic of the selected reference picture corresponds to an average pixel difference between the selected reference picture and an inter-view reference picture corresponding to the selected reference picture, and the condition corresponds to whether the average pixel difference is greater than a threshold.

18. The apparatus of claim 11 , wherein the condition related to the high-level coding information associated with the first or second current picture or slice corresponds to whether there is any inter-view reference picture in a reference list of the first or second current picture or slice respectively.

19. The apparatus of claim 11 , wherein the condition related to the high-level coding information associated with the first or second current picture or slice corresponds to whether there is no temporal reference picture in a reference list of the first or second current picture or slice respectively.

20. A non-transitory machine-readable medium comprising machine-readable software code that, when executed by one or more processors, causes the one or more processors to execute the following method:

receiving plural pictures or slices in a dependent view;

determining whether to enable or disable the illumination compensation for a first or second current picture or slice of the plural pictures or slices based on a condition related to high-level coding information associated with the first or second current picture or slice respectively, wherein the high-level coding information associated with the first or second current picture or slice excludes any information related to pixel values of the first or second current picture or slice respectively, wherein the condition related to the high-level coding information associated with the first or second current picture or slice corresponds to whether a smallest POC distance between the first or second current picture or slice and a temporal reference picture or slice respectively is larger than a threshold;

for the first current picture or slice where the illumination compensation is enabled, applying the illumination compensation to the first current picture or slice respectively; and

for the second picture or slice where the illumination compensation is disabled, skipping the illumination compensation for the second current picture or slice respectively.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 30, 2016
From: MEDIATEK INC.
To: HFI INNOVATION INC.
Reel/Frame 039573/0468 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 24, 2016
From: CHEN, YI-WEN; ZHANG, KAI; LIN, JIAN-LIANG; HUANG, YU-WEN
To: MEDIATEK INC.
Reel/Frame 039522/0472 →
Priority Claims (1)
WO PCT/CN2014/073555 · Mar 17, 2014 · international
Continuity (1)
Related Publication 20170013276A1 · Jan 12, 2017
Cited By (8)
US 12,212,769 US 12,212,771 US 12,368,880 US 12,401,820 US 12,549,756 US 12,556,738 US 12,604,029 US 12,641,216