Systems and methods for calibrating image sensors
View Patent ↗Systems and methods are provided for calibrating image sensors. In some embodiments, a processing module of an image system can automatically perform a self-calibration process after a production unit of an image sensor has been integrated into an end product system. For example, the processing module can calibrate a production unit based on one or more reference pixels of the production unit, where the one or more reference pixels have minimal color filtration. In some embodiments, the processing module may perform local calibrations by correcting specifically for spatial variations in a color filter array (“CFA”). In some embodiments, the processing module can perform global calibrations by correcting for optical density variations in the CFA. In some embodiments, a processing module can determine whether the cause of production variations is related to production variations of a CFA or production variations of an infrared (“IR”) cutoff filter.
1. A method for calibrating a production unit of an image sensor, comprising:
generating data based at least in part on one or more reference pixels of a pixel array of the production unit, wherein the reference pixels have minimal color filtration; and
adjusting for production variations of a color filter array associated with one or more color pixels of the pixel array of the production unit using the data,
wherein the generating data comprises generating a set of color ratios based at least in part on the one or more color pixels and calculating a gain map representative of variations of the color filter array, wherein the gain map includes a set of production color ratios relating the one or more color pixels to the reference pixels, said color ratios of the gain map of the form:
[ X 1prod/ C prod, X 2prod/ C prod, . . . XN prod/ C prod]
where X1prod, X2prod . . . XNprod, and Cprod correspond to production sensor responses of the one or more color pixels of the production unit of the image sensor, and the reference pixel, respectively.
2. The method of claim 1 , wherein the one or more reference pixels corresponds to one or more clear pixels that have a clear coating material in corresponding portions of the color filter array.
3. The method of claim 1 , wherein the one or more reference pixels corresponds to one or more neutral density pixels that have a neutral density coating material in corresponding portions of the color filter array, wherein the neutral density coating material attenuates light.
4. The method of claim 1 , wherein the one or more reference pixels are one or more imaging pixels embedded in a pixel array of the production unit.
5. The method of claim 1 , wherein the gain map includes a color ratio for each color pixel of the one or more color pixels of the pixel array.
6. The method of claim 1 , wherein the one or more reference pixels is associated with a reference integration time that is different from a color integration time that is associated with the one or more color pixels.
7. The method of claim 1 , wherein the data comprises a set of target color ratios based at least in part on sensor responses of a target unit of the Image sensor.
8. The method of claim 1 , wherein
calculating the gain map includes calculating the gain map that varies over one or more areas of an image; and
wherein the adjusting includes adjusting for spatial variations of the color filter array of the production unit using the gain map.
9. The method of claim 8 , wherein the gain map comprises one or more planes, wherein each plane of the one or more planes corresponds to a particular color channel.
10. The method of claim 8 , further comprising storing the gain map in memory.
11. The method of claim 1 , wherein calculating the gain map also includes the form:
[ R prod/ C prod, G prod/ C prod, B prod/ C prod],
where Rprod, Gprod, Bprod correspond to production sensor responses of the production unit of the image sensor for red, green and blue channels, respectively and Cprod corresponds to production sensor responses of the reference channel.
12. The method of claim 11 , wherein Rprod, Gprod, Bprod and Cprod, correspond to unique responses of the red, green, blue and reference pixels in a pixel array of the production unit of the image sensor.
13. The method of claim 1 further including configuring an image system to perform the steps of claim 1 including the generating data step and the adjusting step.
14. A method for calibrating a production unit of an image sensor, comprising:
generating data based at least in part on one or more reference pixels of a pixel array of the production unit, wherein the reference pixels have minimal color filtration and
adjusting for production variations of a color filter array associated with one or more color pixels of the pixel array of the production unit using the data,
wherein the generating data comprises generating a set of color ratios based on the one or more color pixels and the one or more reference pixels and generating the set of color ratios, including target color ratios, for a pre-determined memory color, wherein the set of target color ratios is based on:
[ X 1target/ C target, X 2target/ C target, . . . XN target/ C target],
where X1target, X2target, . . . XNtarget and Ctarget correspond to target sensor responses for the one or more color pixels, and the reference pixel, respectively.
15. The method of claim 14 , wherein generating the data includes generating the data wherein the one or more reference pixels corresponds to one or more clear pixels that have a clear coating material in corresponding portions of the color filter array.
16. The method of claim 14 , wherein generating the data includes generating the data wherein the one or more reference pixels corresponds to one or more neutral density pixels that have a neutral density coating material in corresponding portions of the color filter array, wherein the neutral density coating material attenuates light.
17. The method of claim 14 , wherein generating the data includes generating the data wherein the one or more reference pixels are one or more imaging pixels embedded in a pixel array of the production unit.
18. The method of claim 14 , wherein generating the data includes generating the data wherein the one or more reference pixels are one or more calibration pixels embedded in the production unit.
19. The method of claim 14 , wherein generating the data includes generating the data wherein the one or more reference pixels is associated with a reference integration time that is different from a color integration time that is associated with the one or more color pixels.
20. The method of claim 14 , wherein generating the data includes generating the data wherein the data comprises a set of target color ratios based at least in part on sensor responses of a target unit of the image sensor.
21. The method of claim 14 , wherein the adjusting comprises: calculating a gain map, wherein the gain map varies over one or more areas of an image; and adjusting for spatial variations of the production unit using the gain map.
22. The method of claim 21 , wherein the gain map comprises one or more planes, wherein each plane of the one or more planes corresponds to a particular color channel.
23. The method of claim 14 , wherein generating the color ratios includes the set of target color ratios based on:
[ R target/ C target, B target/ C target, G target/ C target],
where Rtarget, Gtarget, Btarget and Ctarget correspond to target sensor responses for red, green and blue, channels, respectively, and Ctarget corresponds to target sensor responses for the reference channel.
24. The method of claim 23 , wherein Rtarget, Gtarget, Btarget and Ctarget correspond to average pixel values for the red, green, blue and reference channels, respectively.
25. The method of claim 14 further including configuring an image system to perform the steps of claim 14 including the generating data step and the adjusting step.