IP Library Granted Patent US 8,339,474
Granted Patent B2
US 8,339,474 · App. 12/194,697 · Granted Dec 25, 2012

Gain controlled threshold in denoising filter for image signal processing

View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 8,339,474
App. No.
12/194,697
Granted
Dec 25, 2012
Kind
B2
Abstract

An image processing system is disclosed which uses gain information from an input image to determine a threshold value used to filter the input image. The gain information is indicative of the amount of illumination of the input image and thus the noise level. The image processing system includes an image processor, a converter and a filter. The image processor receives and processes first image information into second image information and extracts the gain information from the first image information. The converter converts the gain information into a filter threshold, which is used by the filter to filter the second image information to provide filtered image information. The converter may include a lookup table storing noise characteristic estimates or the threshold values. The threshold values may further be based on subband size. The filter may be a wavelet-based transform denoising filter.

Claims (62)

1. An image processing system, comprising:

an image processor which receives first image information amplified using first gain information, which processes said first image information into second image information, which extracts second gain information from said first image information, and which updates said first gain information using said second gain information to provide updated gain information;

a converter which converts said updated gain information into a filter threshold; and

a filter which filters said second image information using said filter threshold to provide filtered image information.

2. The image processing system of claim 1 , wherein said updated gain information comprises analog and digital gain information.

3. The image processing system of claim 1 , wherein said image processor comprises:

a statistics circuit which determines color component statistics from said first image information;

a color processing circuit which determines luminance information from said first image information;

a luminance circuit which determines light intensity information from said luminance information; and

a white balance and exposure control circuit which uses said color component statistics and said light intensity information to update said first gain information.

4. The image processing system of claim 1 , further comprising:

said converter further providing a select value based on said updated gain information;

select logic which selects between said second image information and said filtered image information based on said select value; and

wherein said select value causes said select logic to select said filtered image information when said gain information indicates an illumination level below an illumination threshold.

5. The image processing system of claim 1 , wherein said converter comprises a lookup table storing a plurality of filter threshold values based on said updated gain information.

6. The image processing system of claim 1 , wherein said converter comprises:

a lookup table storing a plurality of noise characteristic estimates based on said updated gain information; and

a threshold circuit which multiplies a selected one of said plurality of noise characteristic estimates provided from said lookup table by a multiple based on a subband size to provide said filter threshold.

7. The image processing system of claim 1 , wherein said converter comprises an arithmetic calculation circuit which converts said updated gain information into a total gain, and which converts said total gain into a noise characteristic estimate.

8. The image processing system of claim 1 , wherein said filter comprises a wavelet-based denoising filter.

9. The image processing system of claim 1 , wherein said filter comprises:

a forward discrete wavelet transform filter having an input receiving said second image information and an output providing wavelet values;

a threshold circuit having a first input receiving said wavelet values, a second input receiving said filter threshold, and an output providing adjusted wavelet values; and

an inverse discrete wavelet transform filter having an input receiving said adjusted wavelet values and an output providing said filtered image information.

10. The image processing system of claim 9 , wherein said threshold circuit replaces each wavelet value that is less than said filter threshold with a zero value coefficient.

11. A method of processing image information, comprising:

processing first image information amplified using first gain information into second image information;

during said processing, determining second gain information from the first image information;

updating the first gain information using the second gain information and providing updated gain information;

converting the updated gain information into a filter threshold; and

filtering the second image information using the filter threshold to provide filtered image information.

12. The method of claim 11 , wherein said determining second gain information comprises determining analog gain information and digital gain information.

13. The method of claim 11 , wherein said determining second gain information comprises:

determining color component statistics from the first image information;

determining luminance information from the first image information;

determining light intensity information from the luminance information; and

determining the second gain information from the color component statistics and the light intensity information.

14. The method of claim 11 , further comprising:

selecting the filtered image information when the updated gain information indicates an illumination level below a predetermined illumination threshold; and

selecting the second image information when the updated gain information indicates an illumination level above the predetermined threshold.

15. The method of claim 11 , wherein said converting comprises providing the updated gain information to a lookup table storing a plurality of filter thresholds.

16. The method of claim 11 , wherein said converting comprises:

providing the updated gain information to a lookup table storing a plurality of gamma values; and

determining the filter threshold based on a selected gamma value and a subband size.

17. The method of claim 11 , wherein said converting the updated gain information comprises determining a total gain value from the updated gain information and converting the total gain value into a gamma value.

18. The method of claim 11 , wherein said filtering comprises:

transforming the second image information into wavelet values;

replacing wavelet values that are less than the filter threshold with a zero value and otherwise passing the wavelet values to provide adjusted wavelet values; and

transforming the adjusted wavelet values into the filtered image information.

19. An image processing system, comprising:

an image sensor providing raw image information;

gain circuitry which amplifies and digitizes said raw image information to provide gain adjusted image information using first gain information;

an image processor which processes said gain adjusted image information into processed image information, and which extracts second gain information from said gain adjusted image information, and which updates said first am information using said second gain information and provides updated gain information;

a converter which converts said updated gain information into a filter threshold; and

a denoising filter which filters said processed image information using said filter threshold to provide filtered image information.

20. A method of processing image information, comprising:

processing first image information into second image information;

during said processing, determining gain information from the first image information;

converting the gain information into a filter threshold;

filtering the second image information using the filter threshold to provide filtered image information;

selecting the filtered image information when the gain information indicates an illumination level below a predetermined illumination threshold; and

selecting the second image information when the gain information indicates an illumination level above the predetermined threshold.

Assignments (27)
CORRECTIVE ASSIGNMENT TO CORRECT THE REMOVE APPLICATION 11759915 AND REPLACE IT WITH APPLICATION 11759935 PREVIOUSLY RECORDED ON REEL 040925 FRAME 0001. ASSIGNOR(S) HEREBY CONFIRMS THE RELEASE OF SECURITY INTEREST. Recorded Feb 17, 2020
From: MORGAN STANLEY SENIOR FUNDING, INC.
To: NXP, B.V. F/K/A FREESCALE SEMICONDUCTOR, INC.
Reel/Frame 052917/0001 →
CORRECTIVE ASSIGNMENT TO CORRECT THE REMOVE APPLICATION 11759915 AND REPLACE IT WITH APPLICATION 11759935 PREVIOUSLY RECORDED ON REEL 040928 FRAME 0001. ASSIGNOR(S) HEREBY CONFIRMS THE RELEASE OF SECURITY INTEREST. Recorded Jan 17, 2020
From: MORGAN STANLEY SENIOR FUNDING, INC.
To: NXP B.V.
Reel/Frame 052915/0001 →
CORRECTIVE ASSIGNMENT TO CORRECT THE REMOVE APPLICATION 11759915 AND REPLACE IT WITH APPLICATION 11759935 PREVIOUSLY RECORDED ON REEL 037486 FRAME 0517. ASSIGNOR(S) HEREBY CONFIRMS THE ASSIGNMENT AND ASSUMPTION OF SECURITY INTEREST IN PATENTS. Recorded Dec 10, 2019
From: CITIBANK, N.A.
To: MORGAN STANLEY SENIOR FUNDING, INC.
Reel/Frame 053547/0421 →
CORRECTIVE ASSIGNMENT TO CORRECT THE REMOVE APPLICATION 12298143 PREVIOUSLY RECORDED ON REEL 038017 FRAME 0058. ASSIGNOR(S) HEREBY CONFIRMS THE SECURITY AGREEMENT SUPPLEMENT. Recorded Oct 22, 2019
From: NXP B.V.
To: MORGAN STANLEY SENIOR FUNDING, INC.
Reel/Frame 051030/0001 →
CORRECTIVE ASSIGNMENT TO CORRECT THE REMOVE APPLICATION 12298143 PREVIOUSLY RECORDED ON REEL 039361 FRAME 0212. ASSIGNOR(S) HEREBY CONFIRMS THE SECURITY AGREEMENT SUPPLEMENT. Recorded Oct 22, 2019
From: NXP B.V.
To: MORGAN STANLEY SENIOR FUNDING, INC.
Reel/Frame 051029/0387 →
CORRECTIVE ASSIGNMENT TO CORRECT THE REMOVE APPLICATION 12298143 PREVIOUSLY RECORDED ON REEL 042985 FRAME 0001. ASSIGNOR(S) HEREBY CONFIRMS THE SECURITY AGREEMENT SUPPLEMENT. Recorded Oct 22, 2019
From: NXP B.V.
To: MORGAN STANLEY SENIOR FUNDING, INC.
Reel/Frame 051029/0001 →
CORRECTIVE ASSIGNMENT TO CORRECT THE REMOVE APPLICATION 12298143 PREVIOUSLY RECORDED ON REEL 042762 FRAME 0145. ASSIGNOR(S) HEREBY CONFIRMS THE SECURITY AGREEMENT SUPPLEMENT. Recorded Oct 22, 2019
From: NXP B.V.
To: MORGAN STANLEY SENIOR FUNDING, INC.
Reel/Frame 051145/0184 →
RELEASE OF SECURITY INTEREST Recorded Sep 10, 2019
From: MORGAN STANLEY SENIOR FUNDING, INC.
To: NXP B.V.
Reel/Frame 050745/0001 →
CORRECTIVE ASSIGNMENT TO CORRECT THE TO CORRECT THE APPLICATION NO. FROM 13,883,290 TO 13,833,290 PREVIOUSLY RECORDED ON REEL 041703 FRAME 0536. ASSIGNOR(S) HEREBY CONFIRMS THE THE ASSIGNMENT AND ASSUMPTION OF SECURITY INTEREST IN PATENTS.. Recorded Feb 20, 2019
From: MORGAN STANLEY SENIOR FUNDING, INC.
To: SHENZHEN XINGUODU TECHNOLOGY CO., LTD.
Reel/Frame 048734/0001 →
CORRECTIVE ASSIGNMENT TO CORRECT THE REMOVE APPLICATION 12681366 PREVIOUSLY RECORDED ON REEL 038017 FRAME 0058. ASSIGNOR(S) HEREBY CONFIRMS THE SECURITY AGREEMENT SUPPLEMENT. Recorded May 9, 2017
From: NXP B.V.
To: MORGAN STANLEY SENIOR FUNDING, INC.
Reel/Frame 042985/0001 →
CORRECTIVE ASSIGNMENT TO CORRECT THE REMOVE APPLICATION 12681366 PREVIOUSLY RECORDED ON REEL 039361 FRAME 0212. ASSIGNOR(S) HEREBY CONFIRMS THE SECURITY AGREEMENT SUPPLEMENT. Recorded May 9, 2017
From: NXP B.V.
To: MORGAN STANLEY SENIOR FUNDING, INC.
Reel/Frame 042762/0145 →
CORRECTIVE ASSIGNMENT TO CORRECT THE REMOVE PATENTS 8108266 AND 8062324 AND REPLACE THEM WITH 6108266 AND 8060324 PREVIOUSLY RECORDED ON REEL 037518 FRAME 0292. ASSIGNOR(S) HEREBY CONFIRMS THE ASSIGNMENT AND ASSUMPTION OF SECURITY INTEREST IN PATENTS. Recorded Feb 1, 2017
From: CITIBANK, N.A.
To: MORGAN STANLEY SENIOR FUNDING, INC.
Reel/Frame 041703/0536 →
RELEASE OF SECURITY INTEREST Recorded Nov 7, 2016
From: MORGAN STANLEY SENIOR FUNDING, INC.
To: NXP B.V.
Reel/Frame 040928/0001 →
RELEASE OF SECURITY INTEREST Recorded Sep 21, 2016
From: MORGAN STANLEY SENIOR FUNDING, INC.
To: NXP, B.V., F/K/A FREESCALE SEMICONDUCTOR, INC.
Reel/Frame 040925/0001 →
PATENT RELEASE Recorded Aug 17, 2016
From: MORGAN STANLEY SENIOR FUNDING, INC.
To: NXP B.V.
Reel/Frame 039707/0471 →
CORRECTIVE ASSIGNMENT TO CORRECT THE REMOVE APPLICATION 12092129 PREVIOUSLY RECORDED ON REEL 038017 FRAME 0058. ASSIGNOR(S) HEREBY CONFIRMS THE SECURITY AGREEMENT SUPPLEMENT. Recorded Jul 14, 2016
From: NXP B.V.
To: MORGAN STANLEY SENIOR FUNDING, INC.
Reel/Frame 039361/0212 →
SECURITY AGREEMENT SUPPLEMENT Recorded Mar 7, 2016
From: NXP B.V.
To: MORGAN STANLEY SENIOR FUNDING, INC.
Reel/Frame 038017/0058 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Feb 4, 2016
From: FREESCALE SEMICONDUCTOR, INC.
To: NORTH STAR INNOVATIONS INC.
Reel/Frame 037694/0264 →
ASSIGNMENT AND ASSUMPTION OF SECURITY INTEREST IN PATENTS Recorded Jan 13, 2016
From: CITIBANK, N.A.
To: MORGAN STANLEY SENIOR FUNDING, INC.
Reel/Frame 037518/0292 →
ASSIGNMENT AND ASSUMPTION OF SECURITY INTEREST IN PATENTS Recorded Jan 12, 2016
From: CITIBANK, N.A.
To: MORGAN STANLEY SENIOR FUNDING, INC.
Reel/Frame 037486/0517 →
PATENT RELEASE Recorded Dec 21, 2015
From: CITIBANK, N.A., AS COLLATERAL AGENT
To: FREESCALE SEMICONDUCTOR, INC.
Reel/Frame 037354/0757 →
PATENT RELEASE Recorded Dec 21, 2015
From: CITIBANK, N.A., AS COLLATERAL AGENT
To: FREESCALE SEMICONDUCTOR, INC.
Reel/Frame 037356/0553 →
SECURITY AGREEMENT Recorded Nov 6, 2013
From: FREESCALE SEMICONDUCTOR, INC.
To: CITIBANK, N.A., AS NOTES COLLATERAL AGENT
Reel/Frame 031591/0266 →
SECURITY AGREEMENT Recorded Jun 18, 2013
From: FREESCALE SEMICONDUCTOR, INC.
To: CITIBANK, N.A., AS NOTES COLLATERAL AGENT
Reel/Frame 030633/0424 →
SECURITY AGREEMENT Recorded May 13, 2010
From: FREESCALE SEMICONDUCTOR, INC.
To: CITIBANK, N.A., AS COLLATERAL AGENT
Reel/Frame 024397/0001 →
SECURITY AGREEMENT Recorded Dec 9, 2008
From: FREESCALE SEMICONDUCTOR, INC.
To: CITIBANK, N.A.
Reel/Frame 021936/0772 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 20, 2008
From: PRIETO, YOLANDA; SAKAUYE, MILES A.; YAN, YONG; YANOF, ARNOLD W.
To: FREESCALE SEMICONDUCTOR, INC.
Reel/Frame 021415/0634 →