IP Library Granted Patent US 7,684,645
Granted Patent B2
US 7,684,645 · App. 12/146,053 · Granted Mar 23, 2010

Enhanced wide dynamic range in imaging

View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 7,684,645
App. No.
12/146,053
Granted
Mar 23, 2010
Kind
B2
Abstract

A method for enhancing wide dynamic range in images is disclosed. The method comprises acquiring at least two images of a scene to be imaged, the images acquired using different exposure times. For a first image an illumination mask is constructed corresponding to the illumination in the scene, comprising a set of continuous weight values distinctively identifying respective areas of pixels of high or low illumination, over-exposed or underexposed with respect to a predetermined threshold illumination value, assigning one of the weight values to each pixels, whereas other weight value is assigned to other pixels of the other images. A spatial low-pass filter is used to smooth border zones on the illumination mask, thus assigning pixels in the border zones new continuous weight values in a range between the weight values. A combined image is constructed using combined weight values with image data of pixels assigned with one weight value of the first image and image data of pixels assigned with other weight value of the other images and in pixels corresponding to the border zones using image data from the images proportional to the new weight values.

Claims (21)

1. A method for enhancing wide dynamic range in images, the method comprising:

using an imaging device acquiring at least two images of a scene to be imaged, the images acquired using different exposure times; and

using a processor performing the following steps:

constructing for a first image of said at least two images an illumination mask corresponding to the illumination in the scene, comprising a set of continuous weight values distinctively identifying respective areas of pixels of high or low illumination, over-exposed or underexposed with respect to a predetermined threshold illumination value, assigning one of the weight values to each pixels, whereas other weight value is assigned to other pixels of the other of said at least two images;

using a spatial low-pass filter that for a given pixel position takes into account information from pixels that are a plurality of pixels away from the given pixel position in different spatial directions to smooth border zones on the illumination mask, thus assigning pixels in the border zones new continuous weight values in a range between the weight values; and

constructing a combined image in the DCT transform domain using combined weight values with image data of pixels assigned with one weight value of the first image and image data of pixels assigned with other weight value of the other of said at least two images and in pixels corresponding to the border zones using image data from said at least two images proportional to the new weight values.

2. The method of claim 1 , wherein the weight values are binary values.

3. The method of claim 1 , wherein the acquired images are in JPEG format, the JPEG format including a DCT transform domain.

4. The method of claim 1 , applied for color imaging, wherein the steps of claim 1 are carried our separately for each color plane.

5. The method of claim 1 , further comprising:

detecting pixels in said at least two images indicative of motion by comparing corresponding image data from said at least two images; and

evaluating image data value for pixels identified as indicative of motion using image data from one of said at least two images and using the image data value in constructing the combined image.

6. The method of claim 5 , wherein the step of constructing a combined image includes using for pixels identified as indicative of motion only image data from one of said at least two images.

7. The method of claim 6 , wherein the image data from one of said at least two images is reconstructed to simulate corresponding pixels in the other of said at least two images.

8. The method of claim 7 , wherein using image data from one of said at least two images which was acquired with longest exposure time incorporated in two illumination masks.

9. The method as claimed in claim 1 , further comprising companding the constructed image.

10. The method as claimed in claim 9 , wherein the step of companding comprises using the illumination mask.

11. The method as claimed in claim 10 , wherein the step of companding comprises applying the formula for each pixel:

I Res =Ī γ +α( Ī )·( I WDR −Ī )

where I Res is the result illumination value, I γ is the illumination value after gamma correction, α is constant, I WDR is the wide dynamic range illumination value and I is original illumination value.

12. The method as claimed in claim 1 , wherein the step of using a spatial low-pass filter to smooth border zones on the illumination mask, includes using a spatial low-pass filter that for a given pixel position takes into account information from pixels that are at least 8 pixels away from the given pixel position in different spatial directions.

Assignments (8)
CORRECTIVE ASSIGNMENT TO CORRECT THE PROPERTY NUMBERS PREVIOUSLY RECORDED AT REEL: 47630 FRAME: 344. ASSIGNOR(S) HEREBY CONFIRMS THE ASSIGNMENT. Recorded Mar 21, 2019
From: AVAGO TECHNOLOGIES GENERAL IP (SINGAPORE) PTE. LTD.
To: AVAGO TECHNOLOGIES INTERNATIONAL SALES PTE. LIMITED
Reel/Frame 048883/0267 →
CORRECTIVE ASSIGNMENT TO CORRECT THE EFFECTIVE DATE OF MERGER TO 9/5/2018 PREVIOUSLY RECORDED AT REEL: 047196 FRAME: 0687. ASSIGNOR(S) HEREBY CONFIRMS THE MERGER. Recorded Oct 29, 2018
From: AVAGO TECHNOLOGIES GENERAL IP (SINGAPORE) PTE. LTD.
To: AVAGO TECHNOLOGIES INTERNATIONAL SALES PTE. LIMITED
Reel/Frame 047630/0344 →
MERGER Recorded Oct 4, 2018
From: AVAGO TECHNOLOGIES GENERAL IP (SINGAPORE) PTE. LTD.
To: AVAGO TECHNOLOGIES INTERNATIONAL SALES PTE. LIMITED
Reel/Frame 047196/0687 →
TERMINATION AND RELEASE OF SECURITY INTEREST IN PATENTS Recorded Feb 3, 2017
From: BANK OF AMERICA, N.A., AS COLLATERAL AGENT
To: BROADCOM CORPORATION
Reel/Frame 041712/0001 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Feb 1, 2017
From: BROADCOM CORPORATION
To: AVAGO TECHNOLOGIES GENERAL IP (SINGAPORE) PTE. LTD.
Reel/Frame 041706/0001 →
PATENT SECURITY AGREEMENT Recorded Feb 11, 2016
From: BROADCOM CORPORATION
To: BANK OF AMERICA, N.A., AS COLLATERAL AGENT
Reel/Frame 037806/0001 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 31, 2011
From: SIGHTIC VISTA, LTD.
To: BROADCOM CORPORATION
Reel/Frame 026836/0013 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Feb 2, 2010
From: VITSNUDEL, ILIA; SOREK, NOAM
To: SIGHTIC VISTA LTD.
Reel/Frame 023881/0086 →