IP Library Granted Patent US 7,409,104
Granted Patent B2
US 7,409,104 · App. 10/622,355 · Granted Aug 5, 2008

Enhanced wide dynamic range in imaging

View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 7,409,104
App. No.
10/622,355
Granted
Aug 5, 2008
Kind
B2
Abstract

A method for enhancing wide dynamic range in images. The method comprises: acquiring at least two images of a scene to be imaged, the images acquired using different exposure times; constructing for a first image an illumination mask comprising a set of two weight values distinctively identifying respective areas of pixels of high or low illumination, over-exposed or underexposed with respect to a predetermined threshold illumination value, assigning one of the values to each pixels in them, whereas the other value is assigned to other pixels of the other images; using a low-pass filter to smooth border zones between pixels of one value and pixels of the other value, thus assigning weight values in a range between the two weight values; constructing a combined image using image data of pixels of the first image and image data of pixels of the other images proportional to the weight values assigned to each pixel using the illumination mask.

Claims (81)

1. A method for enhancing wide dynamic range in images, the method comprising:

acquiring at least two images of a scene to be imaged, the images acquired using different exposure times, wherein the acquired images are in JPEG format, the JPEG format including a DCT transform domain;

constructing for a first image of said at least two images an illumination mask comprising a set of weight values distinctively identifying respective areas of pixels of high or low illumination, over-exposed or underexposed with respect to a predetermined threshold illumination value,

assigning one of the weight values to each pixel, whereas other weight values are assigned to other pixels of the other of said at least two images;

using a spatial low-pass filter to smooth border zones between pixels of one weight value and pixels of other weight values, thus assigning pixels in the border zones new weight values in a range between the weight values; and

constructing a combined image in the DCT transform domain using image data of pixels assigned with one weight value of the first image and image data of pixels assigned with other weight values of the other of said at least two images and in pixels corresponding to the border zones using image data from said at least two images proportional to the new weight values, wherein the following relation is used in the constructing the combined image:

I p,q DCT WDR =α( I DC Long ))* I p,q DCT Long +(1−α( I DC Long ))* I p,q DCT Short ·Ratio,

where I DC Long is the DC coefficient of the DCT transform of the relatively longer exposure image, α is a weight representing the illumination mask, Ratio is a measure that defines the relationship between the images of different exposures, p, q are DCT coefficients, and*represents convolution.

2. The method of claim 1 , wherein only first few DCT coefficients are used in calculating the relationship.

3. The method of claim 2 , wherein p=1 and q=1.

4. A method for enhancing wide dynamic range in images, the method comprising:

acquiring at least two images of a scene to be imaged, the images acquired using different exposure times;

detecting pixels in said at least two images indicative of motion by comparing corresponding image data from said at least two images;

constructing for a first image of said at least two images an illumination mask comprising a set of weight values distinctively identifying respective areas of pixels of high or low illumination, over-exposed or underexposed with respect to a predetermined threshold illumination value,

assigning one of the weight values to each pixel, whereas other weight values are assigned to other pixels of the other of said at least two images;

using a spatial low-pass filter to smooth border zones between pixels of one weight value and pixels of other weight values, thus assigning pixels in the border zones new weight values in a range between the weight values;

evaluating image data value for pixels identified as indicative of motion using image data from one of said at least two images, using the image data value in constructing the combined image;

constructing a combined image using image data of pixels assigned with one weight value of the first image and image data of pixels assigned with other weight values of the other of said at least two images and in pixels corresponding to the border zones using image data from said at least two images proportional to the new weight values,

wherein the step of detecting pixels indicative of motion comprises looking for pixels for which the ratio I Long/Î Long is beyond a predetermined threshold, I Long is image data from one of said at least two images which was acquired with longest exposure time, and

I

^

Long

=

{

I

Short

·

Ratio

where

I

Short

·

Ratio

<

255

255

else

,

wherein Ratio is a measure that defines the relationship between the images of different exposures.

5. A method for enhancing wide dynamic range in images, the method comprising:

acquiring at least two images of a scene to be imaged, the images acquired using different exposure times;

constructing for a first image of said at least two images an illumination mask comprising a set of weight values distinctively identifying respective areas of pixels of high or low illumination, over-exposed or underexposed with respect to a predetermined threshold illumination value,

assigning one of the weight values to each pixel, whereas other weight values are assigned to other pixels of the other of said at least two images;

using a low-pass filter to smooth border zones between pixels of one weight value and pixels of other weight values, thus assigning pixels in the border zones new weight values in a range between the weight values; and

constructing a combined image using image data of pixels assigned with one weight value of the first image and image data of pixels assigned with other weight values of the other of said at least two images and in pixels corresponding to the border zones using image data from said at least two images proportional to the new weight values,

wherein the acquired images are in JPEG format, the JPEG format including a DCT transform domain, wherein the step of constructing the combined image is carried out in the DCT transform domain, and wherein the following relationship is used in the constructing the combined image:

I p,q DCT WDR =α( I DC Long ))* I p,q DCT Long +(1−α( I DC Long ))* I p,q DCT Short ·Ratio,

where I p,q Long is the DC coefficient of the DCT transform of the relatively longer exposure image, α is a weight representing the illumination mask, Ratio is a measure that defines the relationship between the images of different exposure exposures, p, q are DCT coefficients, and*represents convolution.

6. The method of claim 5 , wherein only first few DCT coefficients are used in calculating the relation.

7. The method of claim 6 , wherein p=1 and q=1.

8. The method of claim 5 , further comprising:

detecting pixels in said at least two images indicative of motion by comparing corresponding image data from said at least two images; and

evaluating image data value for pixels identified as indicative of motion using image data from one of said at least two images and using the image data value in constructing the combined image.

9. The method of claim 8 , wherein the step of detecting pixels indicative of motion comprises looking for pixels for which the ratio I Long /Î Long is beyond a predetermined threshold, I Long is image data from one of said at least two images which was acquired with longest exposure time, and

I

^

Long

=

{

I

Short

·

Ratio

where

I

Short

·

Ratio

<

255

255

else

,

wherein Ratio is a measure that defines the relationship between the images of different exposures.

10. The method of claim 8 , wherein the step of constructing a combined image includes using for pixels identified as indicative of motion only image data from one of said at least two images.

11. The method of claim 10 , wherein the image data from one of said at least two images is reconstructed to simulate corresponding pixels in the other of said at least two images.

12. The method of claim 11 , wherein image data from one of said at least two images which was acquired with longest exposure time is incorporated in two illumination masks.

Assignments (5)
TERMINATION AND RELEASE OF SECURITY INTEREST IN PATENTS Recorded Feb 3, 2017
From: BANK OF AMERICA, N.A., AS COLLATERAL AGENT
To: BROADCOM CORPORATION
Reel/Frame 041712/0001 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Feb 1, 2017
From: BROADCOM CORPORATION
To: AVAGO TECHNOLOGIES GENERAL IP (SINGAPORE) PTE. LTD.
Reel/Frame 041706/0001 →
PATENT SECURITY AGREEMENT Recorded Feb 11, 2016
From: BROADCOM CORPORATION
To: BANK OF AMERICA, N.A., AS COLLATERAL AGENT
Reel/Frame 037806/0001 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 31, 2011
From: SIGHTIC VISTA, LTD.
To: BROADCOM CORPORATION
Reel/Frame 026836/0013 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 10, 2008
From: VITSNUDEL, ILIA; SOREK, NOAM
To: SIGHTIC VISTA LTD.
Reel/Frame 020349/0038 →