IP Library Granted Patent US 7,580,070
Granted Patent B2
US 7,580,070 · App. 11/095,418 · Granted Aug 25, 2009

System and method for roll-off correction in image processing

View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 7,580,070
App. No.
11/095,418
Granted
Aug 25, 2009
Kind
B2
Abstract

A system and method is provided for processing a digital image. The system and method processes image data by correcting for roll-off variability in the digital image. The system and method corrects for roll-off in image data by determining for each pixel a roll-off contour in which the pixel resides and adjusting that pixel based upon its roll-off contour, which in turn, depends upon its location on the image plane.

Claims (55)

1. A method of processing an a digital image, the method comprising the steps of:

receiving image data defining the image, the image data including a plurality of pixels;

defining a plurality of roll-off contours;

determining an offset from an optical axis for each pixel in the plurality of pixels;

determining for each pixel in the plurality of pixels which roll-off contour in the plurality of roll-off contours corresponds to the pixel from the offset for the pixel;

adjusting each pixel based on its corresponding roll-off contour, wherein the adjusting each pixel based on its corresponding roll-off contour comprises adjusting modulation transfer function of each pixel.

2. The method of claim 1 wherein each of the plurality of roll-off contours includes a plurality of linear segments that define the roll-off contour.

3. The method of claim 1 wherein each of the plurality of roll-off contours includes a plurality of linear segments that define an oval-type roll-off contour.

4. The method of claim 1 wherein each of the plurality of roll-off contours includes a plurality of linear segments that define a circle-type roll-off contour.

5. The method of claim 1 wherein the step of adjusting each pixel based on its corresponding roll-off contour comprises adjusting luminance of each pixel.

6. The method of claim 1 wherein the step of adjusting each pixel based on its corresponding roll-off contour comprises adjusting color of each pixel.

7. The method of claim 1 wherein the step of determining an offset from an optical axis for each pixel in the plurality of pixels comprises determining offset variables x and y representing horizontal and vertical offset components of each pixel, and wherein the step of determining for each pixel in the plurality of pixels which roll-off contour in the plurality of roll-off contours corresponds to the pixel comprises comparing x to y.

8. The method of claim 1 wherein the step of determining an offset from an optical axis for each pixel in the plurality of pixels comprises determining offset variables x and y representing horizontal and vertical offset components of each pixel, and wherein the step of determining for each pixel in the plurality of pixels which roll-off contour in the plurality of roll-off contours corresponds to the pixel comprises comparing x to 4y and selecting a roll-off contour defined by 5x/4 if x is greater than 4y, else comparing x to 2y and selecting a roll-off contour defined by x+y if x is greater than 2y, else selecting a roll-off contour defined by x/2+2y.

9. The method of claim 1 wherein the step of determining an offset from an optical axis for each pixel in the plurality of pixels comprises determining offset variables x and y representing horizontal and vertical offset components of each pixel, and wherein the step of determining for each pixel in the plurality of pixels which roll-off contour in the plurality of roll-off contours corresponds to the pixel comprises comparing x to y and selecting a roll-off contour defined by x+y/2 if x is greater than y, else selecting a roll-off contour defined by x/2+y.

10. The method of claim 1 wherein the step of determining an offset from an optical axis for each pixel in the plurality of pixels comprises determining offset variables x and y representing horizontal and vertical offset components of each pixel, and wherein the step of determining for each pixel in the plurality of pixels which roll-off contour in the plurality of roll-off contours corresponds to the pixel comprises comparing x to 6y and selecting a roll-off contour defined by 7x/16 if x is greater than 6y, else comparing x to 5y/2 and selecting a roll-off contour defined by 3(x+y)/8 if x is greater than 5y/2, else selecting a roll-off contour defined by x/8+y.

11. A method of processing an a digital image, the method comprising the steps of:

receiving image data defining the image, the image data including a plurality of pixels;

defining a plurality of roll-off contours;

determining an offset from an optical axis for each pixel in the plurality of pixels, wherein the step of determining an offset from an optical axis for each pixel in the plurality of pixels comprises determining offset variables x and y representing horizontal and vertical offset components of each pixel; and

determining for each pixel in the plurality of pixels which roll-off contour in the plurality of roll-off contours corresponds to the pixel from the offset for the pixel, wherein the step of determining for each pixel in the plurality of pixels which roll-off contour in the plurality of roll-off contours corresponds to the pixel comprises comparing x to 4y and comparing x to 2y; and

adjusting each pixel based on its corresponding roll-off contour.

12. A method of processing an a digital image, the method comprising the steps of:

receiving image data defining the image, the image data including a plurality of pixels;

defining a plurality of roll-off contours;

determining an offset from an optical axis for each pixel in the plurality of pixels, wherein the step of determining an offset from an optical axis for each pixel in the plurality of pixels comprises determining offset variables x and y representing horizontal and vertical offset components of each pixel; and

determining for each pixel in the plurality of pixels which roll-off contour in the plurality of roll-off contours corresponds to the pixel from the offset for the pixel, wherein the step of determining for each pixel in the plurality of pixels which roll-off contour in the plurality of roll-off contours corresponds to the pixel comprises comparing x to 6y and comparing x to 5y/2; and

adjusting each pixel based on its corresponding roll-off contour.

13. A method of processing a digital image, the method comprising the steps of:

receiving image data defining the image, the image data including a plurality of pixels;

defining a first plurality of roll-off contours, each of the first plurality of roll-off contours including a first plurality of linear segments that define the roll-off contour;

determining for each pixel in the plurality of pixels which roll-off contour in the first plurality of roll-off contours corresponds to the pixel;

adjusting luminance of each pixel based on its corresponding roll-off contour in the first plurality of roll-off contours;

defining a second plurality of roll-off contours, each of the second plurality of roll-off contours including a second plurality of linear segments that define the roll-off contour;

determining for each pixel in the plurality of pixels which roll-off contour in the second plurality of roll-off contours corresponds to the pixel; adjusting color of each pixel based on its corresponding roll-off contour in the second plurality of roll-off contours;

defining a third plurality of roll-off contours, each of the third plurality of roll-off contours including a third plurality of linear segments that define the roll-off contour;

determining for each pixel in the third plurality of pixels which roll-off contour in the third plurality of roll-off contours corresponds to the pixel; and

adjusting modulation transform function of each pixel based on its corresponding roll-off contour in the third plurality of roll-off contours.

14. The method of claim 13 wherein the step of determining for each pixel in the plurality of pixels which roll-off contour in the first plurality of roll-off contours corresponds to the pixel comprises determining an offset from an optical axis for each pixel in the plurality of pixels, and wherein the step of determining for each pixel in the plurality of pixels which roll-off contour in the second plurality of roll-off contours corresponds to the pixel comprises determining an offset from the optical axis for each pixel in the plurality of pixels; and wherein the step of determining for each pixel in the plurality of pixels which roll-off contour in the third plurality of roll-off contours corresponds to the pixel comprises determining an offset from an optical axis for each pixel in the plurality of pixels.

15. The method of claim 13 wherein the step of determining for each pixel in the plurality of pixels which roll-off contour in the first plurality of roll-off contours corresponds to the pixel comprises determining offset variables x and y representing horizontal and vertical offset components of each pixel and comparing x to 4y and selecting a roll-off contour defined by 5x/4 if x is greater than 4y, else comparing x to 2y and selecting a roll-off contour defined by x+y if x is greater than 2y, else selecting a roll-off contour defined by x/2+2y.

16. The method of claim 13 wherein the step of determining for each pixel in the plurality of pixels which roll-off contour in the first plurality of roll-off contours corresponds to the pixel comprises determining offset variables x and y representing horizontal and vertical offset components of each pixel and comparing x to y and selecting a roll-off contour defined by x+y/2 if x is greater than y, else selecting a roll-off contour defined by x/2+y.

17. A method of processing a digital image, the method comprising the steps of:

receiving image data defining the image, the image data including a plurality of pixels;

determining for each pixel if the pixel is likely corrupt by comparing each pixel to a plurality of neighboring pixels;

replacing each pixel determined to be likely corrupt with a statistical function of a plurality of nearby pixels;

converting the plurality of pixels to a format that includes a luminance component, a first color component and a second color component;

defining a first plurality of luminance roll-off contours, each of the first plurality of luminance roll-off contours including a first plurality of linear segments that define the luminance roll-off contour;

determining for each pixel in the plurality of pixels which luminance roll-off contour in the first plurality of luminance roll-off contours corresponds to the pixel;

adjusting luminance component of each pixel based on its corresponding roll-off contour in the first plurality of roll-off contours; defining a second plurality of color roll-off contours, each of the second plurality of color roll-off contours including a second plurality of linear segments that define the color roll-off contour;

determining for each pixel in the plurality of pixels which color roll-off contour in the second plurality of roll-off contours corresponds to the pixel; adjusting first and second color components of each pixel based on its corresponding color roll-off contour in the second plurality of roll-off contours;

defining a third plurality of MTF roll-off contours, each of the third plurality of MTF roll-off contours including a third plurality of linear segments that define the roll-off contour; determining for each pixel in the third plurality of pixels which MTF roll-off contour in the third plurality of roll-off contours corresponds to the pixel; and

adjusting MTF of luminance components of each pixel based on its corresponding MTF roll-off contour in the third plurality of roll-off contours.

18. A processor, tangibly embodying a program of instructions to perform method steps for digital image processing, comprising the machine executed steps of:

receiving image data defining the image, the image data including a plurality of pixels; defining a plurality of roll-off contours;

determining an offset from an optical axis for each pixel in the plurality of pixels; determining for each pixel in the plurality of pixels which roll-off contour in the plurality of roll-off contours corresponds to the pixel from the offset for the pixel;

adjusting each pixel based on its corresponding roll-off contour, wherein the adjusting each pixel based on its corresponding roll-off contour comprises adjusting modulation transfer function of each pixel.

Assignments (18)
CORRECTIVE ASSIGNMENT TO CORRECT THE REMOVE APPLICATION 11759915 AND REPLACE IT WITH APPLICATION 11759935 PREVIOUSLY RECORDED ON REEL 040925 FRAME 0001. ASSIGNOR(S) HEREBY CONFIRMS THE RELEASE OF SECURITY INTEREST. Recorded Feb 17, 2020
From: MORGAN STANLEY SENIOR FUNDING, INC.
To: NXP, B.V. F/K/A FREESCALE SEMICONDUCTOR, INC.
Reel/Frame 052917/0001 →
CORRECTIVE ASSIGNMENT TO CORRECT THE REMOVE APPLICATION 11759915 AND REPLACE IT WITH APPLICATION 11759935 PREVIOUSLY RECORDED ON REEL 040928 FRAME 0001. ASSIGNOR(S) HEREBY CONFIRMS THE RELEASE OF SECURITY INTEREST. Recorded Jan 17, 2020
From: MORGAN STANLEY SENIOR FUNDING, INC.
To: NXP B.V.
Reel/Frame 052915/0001 →
CORRECTIVE ASSIGNMENT TO CORRECT THE REMOVE APPLICATION 11759915 AND REPLACE IT WITH APPLICATION 11759935 PREVIOUSLY RECORDED ON REEL 037486 FRAME 0517. ASSIGNOR(S) HEREBY CONFIRMS THE ASSIGNMENT AND ASSUMPTION OF SECURITY INTEREST IN PATENTS. Recorded Dec 10, 2019
From: CITIBANK, N.A.
To: MORGAN STANLEY SENIOR FUNDING, INC.
Reel/Frame 053547/0421 →
RELEASE OF SECURITY INTEREST Recorded Sep 10, 2019
From: MORGAN STANLEY SENIOR FUNDING, INC.
To: NXP B.V.
Reel/Frame 050744/0097 →
CORRECTIVE ASSIGNMENT TO CORRECT THE TO CORRECT THE APPLICATION NO. FROM 13,883,290 TO 13,833,290 PREVIOUSLY RECORDED ON REEL 041703 FRAME 0536. ASSIGNOR(S) HEREBY CONFIRMS THE THE ASSIGNMENT AND ASSUMPTION OF SECURITY INTEREST IN PATENTS.. Recorded Feb 20, 2019
From: MORGAN STANLEY SENIOR FUNDING, INC.
To: SHENZHEN XINGUODU TECHNOLOGY CO., LTD.
Reel/Frame 048734/0001 →
CORRECTIVE ASSIGNMENT TO CORRECT THE REMOVE PATENTS 8108266 AND 8062324 AND REPLACE THEM WITH 6108266 AND 8060324 PREVIOUSLY RECORDED ON REEL 037518 FRAME 0292. ASSIGNOR(S) HEREBY CONFIRMS THE ASSIGNMENT AND ASSUMPTION OF SECURITY INTEREST IN PATENTS. Recorded Feb 1, 2017
From: CITIBANK, N.A.
To: MORGAN STANLEY SENIOR FUNDING, INC.
Reel/Frame 041703/0536 →
CORRECTIVE ASSIGNMENT TO CORRECT THE NATURE OF CONVEYANCE LISTED CHANGE OF NAME SHOULD BE MERGER AND CHANGE PREVIOUSLY RECORDED AT REEL: 040652 FRAME: 0180. ASSIGNOR(S) HEREBY CONFIRMS THE MERGER AND CHANGE OF NAME. Recorded Jan 12, 2017
From: FREESCALE SEMICONDUCTOR INC.
To: NXP USA, INC.
Reel/Frame 041354/0148 →
CHANGE OF NAME Recorded Nov 8, 2016
From: FREESCALE SEMICONDUCTOR INC.
To: NXP USA, INC.
Reel/Frame 040652/0180 →
RELEASE OF SECURITY INTEREST Recorded Nov 7, 2016
From: MORGAN STANLEY SENIOR FUNDING, INC.
To: NXP B.V.
Reel/Frame 040928/0001 →
RELEASE OF SECURITY INTEREST Recorded Sep 21, 2016
From: MORGAN STANLEY SENIOR FUNDING, INC.
To: NXP, B.V., F/K/A FREESCALE SEMICONDUCTOR, INC.
Reel/Frame 040925/0001 →
SUPPLEMENT TO THE SECURITY AGREEMENT Recorded Jun 16, 2016
From: FREESCALE SEMICONDUCTOR, INC.
To: MORGAN STANLEY SENIOR FUNDING, INC.
Reel/Frame 039138/0001 →
ASSIGNMENT AND ASSUMPTION OF SECURITY INTEREST IN PATENTS Recorded Jan 13, 2016
From: CITIBANK, N.A.
To: MORGAN STANLEY SENIOR FUNDING, INC.
Reel/Frame 037518/0292 →
ASSIGNMENT AND ASSUMPTION OF SECURITY INTEREST IN PATENTS Recorded Jan 12, 2016
From: CITIBANK, N.A.
To: MORGAN STANLEY SENIOR FUNDING, INC.
Reel/Frame 037486/0517 →
PATENT RELEASE Recorded Dec 21, 2015
From: CITIBANK, N.A., AS COLLATERAL AGENT
To: FREESCALE SEMICONDUCTOR, INC.
Reel/Frame 037356/0143 →
PATENT RELEASE Recorded Dec 21, 2015
From: CITIBANK, N.A., AS COLLATERAL AGENT
To: FREESCALE SEMICONDUCTOR, INC.
Reel/Frame 037354/0225 →
PATENT RELEASE Recorded Dec 21, 2015
From: CITIBANK, N.A., AS COLLATERAL AGENT
To: FREESCALE SEMICONDUCTOR, INC.
Reel/Frame 037354/0854 →
PATENT RELEASE Recorded Dec 21, 2015
From: CITIBANK, N.A., AS COLLATERAL AGENT
To: FREESCALE SEMICONDUCTOR, INC.
Reel/Frame 037356/0553 →
SECURITY AGREEMENT Recorded Nov 6, 2013
From: FREESCALE SEMICONDUCTOR, INC.
To: CITIBANK, N.A., AS NOTES COLLATERAL AGENT
Reel/Frame 031591/0266 →