Granted Patent B2

US 8,135,235 · App. 12/381,920 · Granted Mar 13, 2012

Abstract

Claims (50)

1. A method of pre-processing in wide dynamic range (WDR) image processing, the method comprising:

(a) receiving luminance and chrominance signals having different exposure times, analyzing, utilizing a processor, the correlation between a luminance signal having a first exposure time and a luminance signal having a second exposure time that is longer than the first exposure time;

(b) based on the result of the analysis, dividing each of the luminance signal having the first exposure time and the luminance signal having the second exposure time into at least one of a bright region, a transition region, and a dark region; and

(c) normalizing the regions of the luminance signal having the first exposure time to respectively correspond to the regions of the luminance signal having the second exposure time.

2. The method of claim 1 , wherein the analysis of the correlation is conducted using a 2D histogram expressing luminance components in the same pixel of the luminance signal having the first exposure time and the luminance signal having the second exposure time.

3. The method of claim 1 , wherein (b) comprises:

(b1) determining a boundary between the bright region and the transition region using a distance between a portion of the luminance signal having the second exposure time in which the brightness of the luminance signal is abruptly changed, and a maximum luminance component of the luminance signal having the second exposure time; and

(b2) determining a boundary between the transition region and the dark region based on the boundary between the luminance region and the transition region, depending on the received luminance and chrominance signals.

4. The method of claim 3 , wherein the boundary between the bright region and the transition region is determined based on a point where the distance is the smallest.

5. The method of claim 4 , wherein the boundary between the transition region and the dark region is fixed to a multiple of a fractional number between 0 and 1 of the point where the distance is the smallest depending on the condition of the obtained image signals.

6. The method of claim 1 , wherein (c) comprises:

(c1) calculating a gain and an offset with respect to each of the regions; and

(c2) calculating and normalizing the regions of the luminance signal having the first exposure time so as to respectively correspond to the maximums of the regions of the luminance signal having the second exposure time using the calculated gain and the calculated offset.

7. A method of wide dynamic range (WDR) image processing, the method comprising:

(a) receiving luminance and chrominance signals having different exposure times and normalizing a luminance signal having a first exposure time so as to correspond to a luminance signal having a second exposure time that is longer than the first exposure time;

(b) adding up, utilizing a processor, the luminance signal having the second exposure time and the normalized luminance signal having the first exposure time using a first weight;

(c) adding up a chrominance signal having the first exposure time and a chrominance signal having the second exposure time using a second weight to which the result of the adding in (b) is reflected; and

(d) converting the added luminance signal and the added chrominance signal into a RGB signal to be output as a WDR resultant image signal.

8. The method of claim 7 , wherein (a) comprises:

(a1) analyzing the correlation between the luminance signal having the first exposure time and the luminance signal having the second exposure time, and dividing each of the luminance signal having the first exposure time and the luminance signal having the second exposure signal into at least one of a bright region, a transition region, and a dark region, based on the result of the analysis; and

(a2) normalizing the regions of the luminance signal having the first exposure time so as to respectively correspond to the regions of the luminance signal having the second exposure time.

9. The method of claim 8 , wherein (b) comprises:

(b1) calculating a first weight using the luminance signal having the second exposure time and the result of division of the regions; and

(b2) adding up the luminance signal having the second exposure time and the luminance signal having the first exposure time using the calculated first weight.

10. The method of claim 9 , wherein the first weight is calculated by using the result of division of the regions.

11. The method of claim 9 , wherein (b) further comprises performing a contrast ratio enhancing process on the result of the addition.

12. A non-transitory computer readable storage medium having embodied thereon a computer program for executing a method of pre-processing in wide dynamic range (WDR) image processing, the method comprising:

(a) receiving luminance and chrominance signals having different exposure times, analyzing the correlation between a luminance signal having a first exposure time and a luminance signal having a second exposure time that is longer than the first exposure time;

(b) based on the result of the analysis, dividing each of the luminance signal having the first exposure time and the luminance signal having the second exposure time into at least one of a bright region, a transition region, and a dark region; and

(c) normalizing the regions of the luminance signal having the first exposure time to respectively correspond to the regions of the luminance signal having the second exposure time.

13. A pre-processing apparatus in a wide dynamic range (WDR) image processing, comprising:

a region determining unit for receiving luminance and chrominance signals having different exposure times and among the different exposure times, analyzing the correlation between a luminance signal having a first exposure time and a luminance signal having a second exposure time that is longer than the first exposure time, and dividing each of the luminance signal having the first exposure time and the luminance signal having the second exposure signal into at least one of a bright region, a transition region, and a dark region, based on the result of the analysis; and

a normalizing unit for normalizing the regions of the luminance signal having the first exposure time so as to respectively correspond to the regions of the luminance signal having the second exposure time.

14. The apparatus of claim 13 , wherein the analysis of the correlation is conducted using a 2D histogram expressing luminance components in the same pixel of the luminance signal having the first exposure time and the luminance signal having the second exposure time.

15. A wide dynamic range (WDR) image processing apparatus, comprising:

a luminance/chrominance converting unit for converting image signals obtained at different exposure times into luminance and chrominance signals;

a pre-processing unit for normalizing a luminance signal having a first exposure time among the different exposure times to correspond to a luminance signal having a second exposure time that is longer than the first exposure time;

a luminance fusing unit for adding up the luminance signal having the second exposure time and the normalized luminance signal having the first exposure time using a first weight;

a chrominance fusing unit for adding up a chrominance signal having the first exposure time and a chrominance signal having the second exposure time using a second weight to which the result of the addition of the luminance fusing unit is reflected; and

an RGB converting unit for converting the fused luminance signal output from the luminance fusing unit and the fused chrominance signal output from the chrominance fusing unit into an RGB signal to be output as a WDR resultant image signal.

16. The WDR image processing apparatus of claim 15 , wherein the pre-processing unit comprises:

a region determining unit for analyzing the correlation between the luminance signal having the first exposure time and the luminance signal having the second exposure time, and dividing each of the luminance signal having the first exposure time and the luminance signal having the second exposure time into at least one of a bright region, a transition region, and a dark region, based on the result of the analysis; and

a normalizing unit for normalizing the regions of the luminance signal having the first exposure time so as to respectively correspond to the regions of the luminance signal having the second exposure time.

17. The WDR image processing unit of claim 15 , wherein the luminance fusing unit comprises:

a weight calculation unit for calculating a first weight using the luminance signal having the second exposure time and the result of division of the regions; and

a weight adding unit for adding up the luminance signal having the second exposure time and the normalized luminance signal having the first exposure time using the calculated first weight.

18. The WDR image processing apparatus of claim 17 , wherein the luminance fusing unit further comprises a post-processing unit for performing a contrast ratio enhancing process on the result of the addition of the weight adding unit.

19. The WDR image processing apparatus of claim 15 , wherein the chrominance fusing unit comprises:

a weight calculation unit for calculating the second weight using the luminance signal having the first exposure time, the luminance signal having the second exposure time, and the result of addition of the luminance fusing unit; and

a weight adding unit adding the chrominance signal having the first exposure time and the chrominance signal having the second exposure time using the calculated second weight.

Assignments (7)