IP Library Granted Patent US 9,191,556
Granted Patent B2
US 9,191,556 · App. 13/550,436 · Granted Nov 17, 2015

Imaging array having photodiodes with different light sensitivities and associated image restoration methods

Inventors: Rastislav Lukac (San Jose, CA); Shri Ramaswami (San Jose, CA); Sanghoon Bae (Cupertino, CA)
Assignee: Foveon, Inc.
H04N5/2173H01L27/14623H01L27/14627H04N5/35563H04N9/045
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,191,556
App. No.
13/550,436
Granted
Nov 17, 2015
Kind
B2
Abstract

A pixel sensor array includes a plurality of pixel sensors having a first gain and a plurality of pixel sensors having a second gain less than the first gain.

Claims (39)

1. A pixel sensor array comprising:

a first plurality of single-photodiode pixel sensors having a first light-sensitivity; and

a second plurality of single-photodiode pixel sensors having a second light-sensitivity less than the first light-sensitivity, the number of second plurality of single-photodiode pixel sensors in the array being fewer than the number of first plurality of pixel sensors in the array, no two of the second plurality of pixel sensors being immediate neighbors to one another in both a row direction and a column direction in the array.

2. The pixel sensor array of claim 1 wherein the second plurality of single-photodiode pixel sensors is dispersed evenly in the array.

3. The pixel sensor array of claim 1 wherein the first plurality of single-photodiode pixel sensors each have a light-admitting aperture of a first area and the second plurality of single-photodiode pixel sensors each have a light-admitting aperture of a second area smaller in size than the first area.

4. The pixel sensor array of claim 2 wherein placement of the second plurality of pixel sensors in the array is between every 2 to every 100 pixels on each row and column of the array.

5. In an image captured by an image sensor array having a first plurality of pixel sensors having a first light-sensitivity and a second plurality of pixel sensors separate from the first plurality of pixel sensors and having a second light-sensitivity less than the first light-sensitivity, the number of second plurality of single-photodiode pixel sensors in the array being fewer than the number of first plurality of pixel sensors in the array, and no two of the second plurality of pixel sensors being immediate neighbors to one another in both a row direction and a column direction in the array, a method for correcting saturated pixel data captured by the first pixel sensors comprising:

a) applying pixel gains to pixel values from the second plurality of pixel sensors;

b) selecting a pixel with at least one saturated color component in the first plurality of pixel sensors;

c) identifying at least one of the second plurality of pixel sensors in a local neighborhood of the selected first pixel sensor;

d) replacing the saturated color component of the selected pixel data by combining corresponding nonsaturated color components of pixels identified in the second plurality of pixel sensors; and

e) repeating b) through d) until pixel data from all saturated pixel sensors have been processed.

6. The method of claim 5 wherein identifying at least one of the second plurality of pixel sensors in a local neighborhood of the selected first pixel sensor comprises identifying more than one of the second plurality of pixel sensors in a local neighborhood of the selected first pixel sensor.

7. In an image captured by an image sensor array having a first plurality of pixel sensors having a first light-sensitivity and a second plurality of pixel sensors having a second light-sensitivity less than the first light-sensitivity, a method for correcting saturated pixel data captured by the first pixel sensors comprising:

a) applying pixel gains to pixel values of the second plurality of pixel sensors;

b) selecting a pixel with at least one saturated color component in the first plurality of pixel sensors;

c) identifying at least one of the second plurality of pixel sensors in a local neighborhood of the selected first pixel sensor;

d) replacing the saturated color component of the selected pixel in the first plurality of pixel sensors with the sum of the nonsaturated color component of the selected pixel in the first plurality of pixel sensors and the corresponding average or weighted average difference between pixel data from a nonsaturated color channel and a saturated color channel of the locally available pixels identified in the second plurality of pixel sensors; and

e) repeating b) through d) until pixel data from all pixel sensors having at least one saturated color channel have been processed.

8. The method of claim 7 wherein identifying at least one of the second plurality of pixel sensors in a local neighborhood of the selected first pixel sensor comprises identifying more than one of the second plurality of pixel sensors in a local neighborhood of the selected first pixel sensor.

9. In an image captured by an image sensor array having a first plurality of pixel sensors having a first light-sensitivity and a second plurality of pixel sensors having a second light-sensitivity less than the first light-sensitivity, a method for correcting saturated pixel data captured by the first pixel sensors comprising:

a) applying pixel gains to pixel values of the second plurality of pixel sensors;

b) selecting a pixel with at least one saturated color component in the first plurality of pixel sensors;

c) identifying at least one of the second plurality of pixel sensors in a local neighborhood of the selected first pixel sensor;

d) replacing the saturated color component of the selected pixel in the first plurality of pixel sensors with the product of the nonsaturated color component of the selected pixel in the first plurality of pixel sensors and the corresponding average or weighted average ratio between pixel data from a nonsaturated color channel and a saturated color channel of the locally available pixels identified in the second plurality of pixel sensors; and

e) repeating b) through d) until pixel data from all pixel sensors having at least one saturated color channel have been processed.

10. The method of claim 9 wherein identifying at least one of the second plurality of pixel sensors in a local neighborhood of the selected first pixel sensor comprises identifying more than one of the second plurality of pixel sensors in a local neighborhood of the selected first pixel sensor.

11. In an image captured by an image sensor array having a first plurality of pixel sensors having a first light-sensitivity and a second plurality of pixel sensors having a second light-sensitivity less than the first light-sensitivity, a method for correcting saturated pixel data captured by the first pixel sensors comprising:

a) selecting a color channel;

b) analyzing the entire image to identify nonsaturated pixels;

c) for each identified pixel data, building a correction table by calculating as a function of one or more color channels, an index into the table of correction factors, and a correction factor;

d) filling in any gaps in the correction table by interpolating existing entries in the correction table

e) selecting a pixel in the first plurality of pixel sensors;

f) determining whether all color channels in the pixel data are saturated;

g) only if all of the color channels in pixel data from the selected pixel are not saturated:

calculating the index value for the pixel;

addressing the correction table using the calculated index value to obtain the correction factor

applying the obtained correction factor to the pixel data to produce corrected pixel data value;

h) repeating e) through g) until pixel data from all pixel sensors having at least one saturated color channel have been processed.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 4, 2024
From: FOVEON, INC.
To: SIGMA CORPORATION
Reel/Frame 069483/0391 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Oct 3, 2012
From: LUKAC, RASTISLAV; RAMASWAMI, SHRI; BAE, SANGHOON
To: FOVEON, INC.
Reel/Frame 029068/0886 →
Continuity (2)
Provisional Application 61511611 · Jul 26, 2011
Related Publication 20130027591A1 · Jan 31, 2013