IP Library Granted Patent US 7,236,190
Granted Patent B2
US 7,236,190 · App. 10/284,661 · Granted Jun 26, 2007

Digital image processing using white balance and gamma correction

View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 7,236,190
App. No.
10/284,661
Granted
Jun 26, 2007
Kind
B2
Abstract

A method and system for digital cameras provides improved automatic exposure control, improved automatic white balance, improved color interpolation, improved automatic gamma correction, and improved progressive edge enhancement. These improvements are preferably implemented in CMOS semiconductor technology for faster speed.

Claims (80)

1. A method for processing a digital image, comprising the steps of:

performing an automatic gain control on a photo-sensor output to generate a first image output;

performing an automatic white balance correction to said first image output to generate a second image output;

applying white balance to said second image output to generate a third image output;

performing a color interpolation to said third image output to generate a fourth image output, wherein said color interpolation comprises:

detecting a diagonal edge where there is a difference in color intensity in both a row and a column of a pixel array, and

calculating a median color value for a pixel at said diagonal edge;

performing a low-pass spatial filtration of said fourth image output to generate a fifth image output;

performing a gamma correction on said fifth image output to generate a sixth image output, wherein said gamma correction comprises using a luminance conversion factor measured from an RGB to adjust said RGB;

performing a color space conversion of said sixth image output to generate a seventh image output;

performing a YCC color correction on said seventh image output to generate an eighth image output; and

performing a progressive edge enhancement on said eighth image and storing said image to a storage device.

2. The method of claim 1 , wherein said progressive edge enhancement comprises the steps of:

applying a high pass filter to said eighth image output;

utilizing a look-up table; and

modifying said eighth image output through said lookup table.

3. The method of claim 2 , wherein said automatic white balance is comprised of the steps of:

calculating a mean color value; and

applying a sector based weighting to an adjustment to a white balance coefficient.

4. The method of claim 1 , further comprising the step of acquiring a Bayer pattern image with a photo-sensor array.

5. The method of claim 4 , further comprising the step of regulating the operation of said photo-sensor array with an iterative automatic exposure control algorithm.

6. A method for processing a digital image, comprising the steps of:

providing a first image output from a photo-sensor array;

applying a white balance algorithm to said first image output of said photo-sensor array to form a second image output;

performing a color interpolation to said second image output to generate a third image output;

performing a low-pass spatial filtration of said third image output to generate a fourth image output;

performing a gamma correction on said fourth image output to generate a fifth image output, wherein performing said gamma correction comprises using a luminance conversion factor measured from an RGB to adjust said RGB;

performing a color space conversion of said sixth image output to generate a seventh image output;

performing a YCC color correction and progressive edge enhancement on said seventh image output to generate an eighth image output; and

generating an output file from said eighth image output.

7. The method of claim 6 , wherein said color interpolation comprises the steps of:

detecting a diagonal edge where there is a difference in color intensity in both a row and a column of a pixel array; and

calculating a median color value for a pixel at said diagonal edge.

8. The method of claim 6 , further comprising the steps of:

acquiring a Bayer pattern image with said photo-sensor array; and

regulating the operation of said photo-sensor array with an iterative automatic exposure control algorithm.

9. A method for processing a digital image, comprising the steps of:

providing a first image output from a photo-sensor array;

applying a white balance algorithm to said first image output of said photo-sensor array to form a second image output;

performing a color interpolation to said second image output to generate a third image output;

performing a low-pass spatial filtration of said third image output to generate a fourth image output;

performing a gamma correction on said fourth image output to generate a fifth image output;

performing a color space conversion of said sixth image output to generate a seventh image output;

performing a YCC color correction on said seventh image output to generate an eighth image output; and

generating an output file from said eighth image output, said method further comprising the step of providing a progressive edge enhancement.

10. The method of claim 9 wherein said progressive edge enhancement comprises the steps of:

applying a high pass filter to said eighth image output;

utilizing a look-up table; and

modifying said eighth image output through said look-up table.

11. A method for processing a digital image, comprising the steps of:

providing a first image output from a photo-sensor array;

applying a white balance algorithm to said first image output of said photo-sensor array to form a second image output, wherein said white balance algorithm comprises:

calculating a median color value; and

applying a sector based weighting to an adjustment to a white balance coefficient;

performing a color interpolation to said second image output to generate a third image output;

performing a low-pass spatial filtration of said third image output to generate a fourth image output;

performing a gamma correction on said fourth image output to generate a fifth image output;

performing a color space conversion of said sixth image output to generate a seventh image output;

performing a YCC color correction on said seventh image output to generate an eighth image output; and

generating an output file from said eighth image output.

12. A digital image processing system comprised of:

a photo-sensor array;

an automatic gain control system to boost an output of said photo-sensor array;

an automatic white balance system coupled to said automatic gain control;

a color interpolation system to improve the resolution of said digital image coupled to said automatic white balance;

a low-pass spatial filter coupled to said color interpolation system;

a gamma correction system coupled to said low-pass filter, wherein said gamma correction system uses a luminance conversion factor measured from an RGB to adjust said RGB;

a color space conversion system coupled to said gamma correction system;

a YCC color correction system coupled to said space conversion system; and

a progressive edge enhancement system coupled to said YCC color correction system.

13. The system of claim 12 , wherein said color interpolation system is comprised of means to detect a diagonal edge where there is a difference in color intensity in both a row and a column of a pixel array; and

means to calculate a median color value for a pixel at said diagonal edge.

14. The system of claim 12 , wherein said progressive edge enhancement system is comprised of:

means to apply a high pass filter to an output of said YCC color correction system;

means to utilize a look-up table; and

means to modify said output of said YCC color correction system.

15. The system of claim 14 , wherein said automatic white balance system is comprised of:

means to calculate a mean color value; and

means to apply a sector based weighting to an adjustment to a white balance coefficient.

16. The system of claim 12 , further comprising an automatic exposure control coupled to said photo-sensor array.

Assignments (25)
CORRECTIVE ASSIGNMENT TO CORRECT THE REMOVE APPLICATION 11759915 AND REPLACE IT WITH APPLICATION 11759935 PREVIOUSLY RECORDED ON REEL 040925 FRAME 0001. ASSIGNOR(S) HEREBY CONFIRMS THE RELEASE OF SECURITY INTEREST. Recorded Feb 17, 2020
From: MORGAN STANLEY SENIOR FUNDING, INC.
To: NXP, B.V. F/K/A FREESCALE SEMICONDUCTOR, INC.
Reel/Frame 052917/0001 →
CORRECTIVE ASSIGNMENT TO CORRECT THE REMOVE APPLICATION 11759915 AND REPLACE IT WITH APPLICATION 11759935 PREVIOUSLY RECORDED ON REEL 040928 FRAME 0001. ASSIGNOR(S) HEREBY CONFIRMS THE RELEASE OF SECURITY INTEREST. Recorded Jan 17, 2020
From: MORGAN STANLEY SENIOR FUNDING, INC.
To: NXP B.V.
Reel/Frame 052915/0001 →
CORRECTIVE ASSIGNMENT TO CORRECT THE REMOVE APPLICATION 11759915 AND REPLACE IT WITH APPLICATION 11759935 PREVIOUSLY RECORDED ON REEL 037486 FRAME 0517. ASSIGNOR(S) HEREBY CONFIRMS THE ASSIGNMENT AND ASSUMPTION OF SECURITY INTEREST IN PATENTS. Recorded Dec 10, 2019
From: CITIBANK, N.A.
To: MORGAN STANLEY SENIOR FUNDING, INC.
Reel/Frame 053547/0421 →
RELEASE OF SECURITY INTEREST Recorded Sep 10, 2019
From: MORGAN STANLEY SENIOR FUNDING, INC.
To: NXP B.V.
Reel/Frame 050744/0097 →
CORRECTIVE ASSIGNMENT TO CORRECT THE TO CORRECT THE APPLICATION NO. FROM 13,883,290 TO 13,833,290 PREVIOUSLY RECORDED ON REEL 041703 FRAME 0536. ASSIGNOR(S) HEREBY CONFIRMS THE THE ASSIGNMENT AND ASSUMPTION OF SECURITY INTEREST IN PATENTS.. Recorded Feb 20, 2019
From: MORGAN STANLEY SENIOR FUNDING, INC.
To: SHENZHEN XINGUODU TECHNOLOGY CO., LTD.
Reel/Frame 048734/0001 →
CORRECTIVE ASSIGNMENT TO CORRECT THE REMOVE PATENTS 8108266 AND 8062324 AND REPLACE THEM WITH 6108266 AND 8060324 PREVIOUSLY RECORDED ON REEL 037518 FRAME 0292. ASSIGNOR(S) HEREBY CONFIRMS THE ASSIGNMENT AND ASSUMPTION OF SECURITY INTEREST IN PATENTS. Recorded Feb 1, 2017
From: CITIBANK, N.A.
To: MORGAN STANLEY SENIOR FUNDING, INC.
Reel/Frame 041703/0536 →
CORRECTIVE ASSIGNMENT TO CORRECT THE NATURE OF CONVEYANCE LISTED CHANGE OF NAME SHOULD BE MERGER AND CHANGE PREVIOUSLY RECORDED AT REEL: 040652 FRAME: 0180. ASSIGNOR(S) HEREBY CONFIRMS THE MERGER AND CHANGE OF NAME. Recorded Jan 12, 2017
From: FREESCALE SEMICONDUCTOR INC.
To: NXP USA, INC.
Reel/Frame 041354/0148 →
CHANGE OF NAME Recorded Nov 8, 2016
From: FREESCALE SEMICONDUCTOR INC.
To: NXP USA, INC.
Reel/Frame 040652/0180 →
RELEASE OF SECURITY INTEREST Recorded Nov 7, 2016
From: MORGAN STANLEY SENIOR FUNDING, INC.
To: NXP B.V.
Reel/Frame 040928/0001 →
RELEASE OF SECURITY INTEREST Recorded Sep 21, 2016
From: MORGAN STANLEY SENIOR FUNDING, INC.
To: NXP, B.V., F/K/A FREESCALE SEMICONDUCTOR, INC.
Reel/Frame 040925/0001 →
SUPPLEMENT TO THE SECURITY AGREEMENT Recorded Jun 16, 2016
From: FREESCALE SEMICONDUCTOR, INC.
To: MORGAN STANLEY SENIOR FUNDING, INC.
Reel/Frame 039138/0001 →
ASSIGNMENT AND ASSUMPTION OF SECURITY INTEREST IN PATENTS Recorded Jan 13, 2016
From: CITIBANK, N.A.
To: MORGAN STANLEY SENIOR FUNDING, INC.
Reel/Frame 037518/0292 →
ASSIGNMENT AND ASSUMPTION OF SECURITY INTEREST IN PATENTS Recorded Jan 12, 2016
From: CITIBANK, N.A.
To: MORGAN STANLEY SENIOR FUNDING, INC.
Reel/Frame 037486/0517 →
PATENT RELEASE Recorded Dec 21, 2015
From: CITIBANK, N.A., AS COLLATERAL AGENT
To: FREESCALE SEMICONDUCTOR, INC.
Reel/Frame 037356/0553 →
PATENT RELEASE Recorded Dec 21, 2015
From: CITIBANK, N.A., AS COLLATERAL AGENT
To: FREESCALE SEMICONDUCTOR, INC.
Reel/Frame 037356/0143 →
PATENT RELEASE Recorded Dec 21, 2015
From: CITIBANK, N.A., AS COLLATERAL AGENT
To: FREESCALE SEMICONDUCTOR, INC.
Reel/Frame 037354/0655 →
PATENT RELEASE Recorded Dec 21, 2015
From: CITIBANK, N.A., AS COLLATERAL AGENT
To: FREESCALE SEMICONDUCTOR, INC.
Reel/Frame 037354/0225 →
SECURITY AGREEMENT Recorded Nov 6, 2013
From: FREESCALE SEMICONDUCTOR, INC.
To: CITIBANK, N.A., AS NOTES COLLATERAL AGENT
Reel/Frame 031591/0266 →
SECURITY AGREEMENT Recorded Jun 18, 2013
From: FREESCALE SEMICONDUCTOR, INC.
To: CITIBANK, N.A., AS NOTES COLLATERAL AGENT
Reel/Frame 030633/0424 →
SECURITY AGREEMENT Recorded May 13, 2010
From: FREESCALE SEMICONDUCTOR, INC.
To: CITIBANK, N.A., AS COLLATERAL AGENT
Reel/Frame 024397/0001 →
SECURITY AGREEMENT Recorded Nov 1, 2007
From: FREESCALE SEMICONDUCTOR, INC.
To: CITIBANK, N.A., AS COLLATERAL AGENT
Reel/Frame 020045/0448 →
SECURITY AGREEMENT Recorded Feb 2, 2007
From: FREESCALE SEMICONDUCTOR, INC.; FREESCALE ACQUISITION CORPORATION; FREESCALE ACQUISITION HOLDINGS CORP.; FREESCALE HOLDINGS (BERMUDA) III, LTD.
To: CITIBANK, N.A. AS COLLATERAL AGENT
Reel/Frame 018855/0129 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 16, 2004
From: ABDY, ANOOSH
To: MOTORLA, INC.
Reel/Frame 015063/0036 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 7, 2004
From: MOTOROLA, INC
To: FREESCALE SEMICONDUCTOR, INC.
Reel/Frame 015360/0718 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Oct 31, 2002
From: YANOF, ARNOLD; SKOW, MICHAEL; TRAN, HUNG; ADBY, ANOOSH
To: MOTOROLA, INC.
Reel/Frame 013449/0883 →