Imaging systems with clear filter pixels
View Patent ↗An image sensor may have an array of image sensor pixels arranged in color filter unit cells each having one red image pixel that generates red image signals, one blue image pixel that generate blue image signals, and two clear image sensor pixels that generate white image signals. The image sensor may be coupled to processing circuitry that performs filtering operations on the red, blue, and white image signals to increase noise correlations in the image signals that reduce noise amplification when applying a color correction matrix to the image signals. The processing circuitry may extract a green image signal from the white image signal. The processing circuitry may compute a scaling value that includes a linear combination of the red, blue, white and green image signals. The scaling value may be applied to the red, blue, and green image signals to produce corrected image signals having improved image quality.
1. An imaging system, comprising:
an array of image sensor pixels, wherein the array of image sensor pixels includes first image sensor pixels configured to generate first image signals in response to a first frequency range of light, second image sensor pixels configured to generate second image signals in response to a second frequency range of light, and third image sensor pixels configured to generate third image signals in response to a third frequency range of light; and
processing circuitry, wherein the processing circuitry is configured to perform filtering operations on the first, second, and third image signals by: generating a first difference value based on the first and third image signals, generating a second difference value based on the second and third image signals, applying a filter to the first and second difference values to generate filtered difference values, and adding the third image signals to the filtered difference values.
2. The imaging system defined in claim 1 , wherein the processing circuitry is configured to perform the filtering operations by, for each image sensor pixel of the first image sensor pixels, generating a weighted sum of image signals generated by at least 25 image sensor pixels.
3. The imaging system defined in claim 1 , wherein the processing circuitry is configured to perform white balance operations on the first image signals, the second image signals, and the third image signals prior to generating the first and second difference values.
4. The imaging system defined in claim 3 , wherein the processing circuitry is configured to apply a color correction matrix to the third image signals after generating the filtered difference values, wherein the color correction matrix extracts a fourth image signal of a fourth frequency range from the third image signals.
5. The imaging system defined in claim 1 , wherein the third frequency range is broader than the first frequency range and the third frequency range is broader than the second frequency range.
6. The imaging system defined in claim 5 , wherein the filtering operations increase noise correlations between the first, second, and third image signals.
7. The imaging system defined in claim 6 , wherein the filtering operations increase and decrease noise fluctuations in the first, second, and third image signals together in a correlated manner.
8. The imaging system defined in claim 5 , wherein the second frequency range is broader than the first frequency range.
9. An imaging system comprising:
first image sensor pixels that gather first image signals of a first range of frequencies;
second image sensor pixels that gather second image signals of a second range of frequencies;
third image sensor pixels that gather third image signals of a third range of frequencies; and
processing circuitry, wherein the processing circuitry is configured to generate fourth image signals of a fourth range of frequencies using the third image signals, the processing circuitry is configured to combine the first image signals, the second image signals, and the fourth image signals to generate a first luminance value, the processing circuitry is configured to compute a second luminance value based on the first image signals, the second image signals, and the third image signals, and the processing circuitry is configured to modify the first image signals, the second image signals, and the fourth image signals using the first and second luminance values.
10. The imaging system defined in claim 9 , wherein the processing circuitry is configured to compute a scaling value based on the first and second luminance values, and wherein the processing circuitry is configured to modify the first image signals, the second image signals, and the fourth image signals by multiplying the first image signals, the second image signals, and the fourth image signals by the scaling value.
11. The imaging system defined in claim 9 , wherein the third range of frequencies is broader than the first range of frequencies and the third range of frequencies is broader than the second range of frequencies.
12. The imaging system defined in claim 11 , wherein the third range of frequencies is broader than the fourth range of frequencies.
13. The imaging system defined in claim 11 , wherein the second range of frequencies is broader than the first range of frequencies.
14. An imaging system comprising:
first image sensor pixels that gather first image signals of a first range of frequencies;
second image sensor pixels that gather second image signals of a second range of frequencies;
third image sensor pixels that gather third image signals of a third range of frequencies that is broader than the first range of frequencies and that is broader than the second range of frequencies; and
processing circuitry, wherein the processing circuitry is configured to generate a luminance signal by performing a weighted sum of the first, second, and third image signals.
15. The imaging system defined in claim 14 , wherein the processing circuitry is configured to weight the third image signals more heavily in the weighted sum than the first and second image signals.
16. The imaging system defined in claim 14 , wherein the processing circuitry is configured to generate a scaling value by dividing the third image signals by the luminance value.
17. The imaging system defined in claim 16 , wherein the processing circuitry is configured to generate corrected image signals by multiplying at least the first and second image signals by the scaling value.
18. The imaging system defined in claim 17 , wherein the processing circuitry is configured to generate fourth image signals of a fourth range of frequencies using the third image signals and wherein the third range of frequencies is broader than the fourth range of frequencies.
19. The imaging system defined in claim 14 , wherein the processing circuitry is configured to perform filtering operations on the first, second, and third image signals that increase noise correlations between the first, second, and third image signals.
20. The imaging system defined in claim 19 , wherein the filtering operations increase and decrease noise fluctuations in the first, second, and third image signals together in a correlated manner.