Interpolation of panchromatic and color pixels
A method for forming a final digital color image, includes: capturing an image using an image sensor having panchromatic pixels and color pixels corresponding to at least two color photoresponses; providing from the captured image a digital high resolution panchromatic image and a digital high resolution color differences image; and using the digital high resolution panchromatic image and the digital high resolution color differences image to produce the final digital high resolution full color image.
1. A method for forming a final digital color image, comprising:
(a) capturing an image using an image sensor having panchromatic pixels (P) and color pixels, red (R), green (G), and blue (B), in the following arrangement:
R
G
P
P
P
P
G
B
P
P
P
P;
(b) providing from the captured image a digital high resolution panchromatic image, a low resolution panchromatic image, and a low resolution RGB CFA image;
(c) using the low resolution panchromatic image and the low resolution RGB CFA image to produce a low resolution color differences image;
(d) using the low resolution color difference image to produce a digital interpolated low resolution color differences image;
(e) using the digital interpolated low resolution color differences image to produce a digital high resolution color differences image; and
(f) using the digital high resolution panchromatic image and the digital high resolution color differences image to produce the final digital high resolution full color image.
2. The method of claim 1 , wherein step (b) includes using pixel neighborhood predictor values responsive to pixel neighborhood classifier values to produce the digital high resolution panchromatic image.
3. The method of claim 1 , wherein step (b) further includes averaging and subsampling the digital high resolution panchromatic image to produce the low resolution panchromatic image.
4. The method of claim 1 , wherein step (b) further includes summing or averaging and subsampling a digital RGBP CFA image to produce the low resolution RGB CFA image.
5. A method for forming a final digital color image, comprising:
(a) capturing an image using an image sensor having panchromatic pixels (P) and color pixels, red (R), green (G), and blue (B), in the following arrangement:
R
R
R
G
G
G
P
P
P
P
P
P
P
P
P
P
P
P
G
G
G
B
B
B
P
P
P
P
P
P
P
P
P
P
P
P;
(b) providing from the captured image a digital high resolution panchromatic image, a low resolution panchromatic image, and a low resolution RGB CFA image;
(c) using the low resolution panchromatic image and the low resolution RGB CFA image to produce a low resolution color differences image;
(d) using the low resolution color difference image to produce a digital interpolated low resolution color differences image;
(e) using the digital interpolated low resolution color differences image to produce a digital high resolution color differences image; and
(f) using the digital high resolution panchromatic image and the digital high resolution color differences image to produce the final digital high resolution full color image.
6. The method of claim 5 , wherein step (b) includes using pixel neighborhood predictor values responsive to pixel neighborhood classifier values to produce the digital high resolution panchromatic image.
7. The method of claim 5 , wherein step (b) further includes averaging and subsampling the digital high resolution panchromatic image to produce the low resolution panchromatic image.
8. The method of claim 5 , wherein step (b) further includes summing or averaging and subsampling a digital RGBP CFA image to produce the low resolution RGB CFA image.
9. A method for forming a final digital color image, comprising:
(a) capturing an image using an image sensor having panchromatic pixels (P) and color pixels, red (R), green (G), and blue (B), in the following arrangement:
R
R
R
R
G
G
G
G
P
P
P
P
P
P
P
P
R
R
R
R
G
G
G
G
P
P
P
P
P
P
P
P
G
G
G
G
B
B
B
B
P
P
P
P
P
P
P
P
G
G
G
G
B
B
B
B
P
P
P
P
P
P
P
P;
(b) providing from the captured image a digital high resolution panchromatic image, a low resolution panchromatic image, and a low resolution RGB CFA image;
(c) using the low resolution panchromatic image and the low resolution RGB CFA image to produce a low resolution color differences image;
(d) using the low resolution color difference image to produce a digital interpolated low resolution color differences image;
(e) using the digital interpolated low resolution color differences image to produce a digital high resolution color differences image; and
(f) using the digital high resolution panchromatic image and the digital high resolution color differences image to produce the final digital high resolution full color image.
10. The method of claim 9 , wherein step (b) includes using pixel neighborhood predictor values responsive to pixel neighborhood classifier values to produce the digital high resolution panchromatic image.
11. The method of claim 9 , wherein step (b) further includes averaging and subsampling the digital high resolution panchromatic image to produce the low resolution panchromatic image.
12. The method of claim 9 , wherein step (b) further includes summing or averaging and subsampling a digital RGBP CFA image to produce the low resolution RGB CFA image.
13. A method for forming a final digital color image, comprising:
(a) capturing an image using an image sensor having panchromatic pixels (P) and color pixels, red (R), green (G), and blue (B), in the following arrangement:
R
P
R
P
G
P
G
P
P
P
P
P
P
P
P
P
R
P
R
P
G
P
G
P
P
P
P
P
P
P
P
P
G
P
G
P
B
P
B
P
P
P
P
P
P
P
P
P
G
P
G
P
B
P
B
P
P
P
P
P
P
P
P
P;
(b) providing from the captured image a digital high resolution panchromatic image, a low resolution panchromatic image, and a low resolution RGB CFA image;
(c) using the low resolution panchromatic image and the low resolution RGB CFA image to produce a low resolution color differences image;
(d) using the low resolution color difference image to produce a digital interpolated low resolution color differences image;
(e) using the digital interpolated low resolution color differences image to produce a digital high resolution color differences image; and
(f) using the digital high resolution panchromatic image and the digital high resolution color differences image to produce the final digital high resolution full color image.
14. The method of claim 13 , wherein step (b) includes using pixel neighborhood predictor values responsive to pixel neighborhood classifier values to produce the digital high resolution panchromatic image.
15. The method of claim 13 , wherein step (b) further includes averaging and subsampling the digital high resolution panchromatic image to produce the low resolution panchromatic image.
16. The method of claim 13 , wherein step (b) further includes summing or averaging and subsampling a digital RGBP CFA image to produce the low resolution RGB CFA image.