Image sensors with dynamic pixel defect detection and correction
Defect detection and correction circuitry for image sensors. Example circuitry includes dynamic defect detection circuitry configured to determine an average of a subset of a plurality of pixel output values, the subset excluding maximum and minimum values from among the plurality of pixel output values, determine one or more thresholds based on the average and a difference between a second highest pixel output value and a second lowest pixel output value from among the plurality of pixel output values, and based on an original output value of a pixel-under-correction (PUC) transgressing one of the thresholds, indicate that the PUC has a dynamic defect. The circuitry further includes defect correction circuitry configured to apply a defect correction process based the PUC having either a dynamic defect or a mapped defect, and to produce a corrected output value for the PUC based on the defect correction process.
1. Defect detection and correction circuitry comprising:
dynamic defect detection circuitry configured to
receive an input signal specifying a plurality of pixel output values and an original output value of a pixel under correction (PUC),
determine an average value based on a subset of the plurality of pixel output values, wherein the subset excludes a maximum pixel output value from among the plurality of pixel output values and a minimum pixel output value from among the plurality of pixel output values,
determine one or more thresholds based on the average value and a difference between a second highest pixel output value from the plurality of pixel output values and a second lowest pixel output value from the plurality of pixel output values, and
based on the original output value of the PUC transgressing a threshold of the one or more thresholds, to provide a first output signal indicating that the PUC has a dynamic defect; and
defect correction circuitry coupled to the dynamic defect detection circuitry and configured to apply a defect correction process based on one of the first output signal or a defect signal indicating that the PUC has a mapped defect, and to produce, based on the defect correction process, a second output signal indicating a corrected output value for the PUC.
2. The defect detection and correction circuitry of claim 1 , wherein the subset further excludes the second highest pixel output value and the second lowest pixel output value.
3. The defect detection and correction circuitry of claim 2 , wherein the one or more thresholds include a first threshold and a second threshold, and wherein the dynamic defect detection circuitry is configured to provide the first output signal based on the original output value of the PUC being between the first and second thresholds.
4. The defect detection and correction circuitry of claim 1 , wherein the defect correction circuitry is configured to determine a plurality of directional gradients based on the plurality of pixel output values; and
wherein the defection correction circuitry is configured to select, from among the plurality of pixel output values, one or more selected pixel output values based on a directional gradient having a smallest value among the plurality of directional gradients, and to produce the corrected output value for the PUC based on the one or more selected pixel output values.
5. The defect detection and correction circuitry of claim 1 , wherein individual pixel output values of the plurality of pixel output values correspond to respective pixels of a pixel array; and
wherein the defect correction circuitry is configured to apply the defect correction process based on a number of the respective pixels having a mapped defect.
6. The defect detection and correction circuitry of claim 5 , wherein the number of the pixel having a mapped defect is two or more; and
wherein to apply the defect correction process, the defect correction circuitry is configured to:
exclude the pixel output values corresponding to the respective pixels having the mapped defect to produce, from the plurality of pixel output values, a set of one or more remaining pixel output values; and
determine the corrected output value of the PUC based on a median of the set of one or more remaining pixel output values.
7. The defect detection and correction circuitry of claim 5 , wherein the dynamic defect detection circuitry is configured to provide the number of the pixels having a mapped defect in the first output signal.
8. An image sensor comprising:
a pixel array including a plurality of pixels arranged in rows and columns, the plurality of pixels including a pixel under correction (PUC) and a plurality of surrounding pixels physically positioned around the PUC in the pixel array, the PUC configured to produce a PUC output signal having an original PUC value, and the plurality of surrounding pixels configured to produce a corresponding plurality of pixel output signals having respective pixel output values;
dynamic defect detection circuitry coupled to the pixel array and configured to
determine an average value based on a subset of the respective pixel output values, wherein the subset excludes a maximum pixel output value and a minimum pixel output value from among the pixel output values,
determine one or more thresholds based on the average value and a difference between a second highest pixel output value of pixel output values and a second lowest pixel output value of the pixel output values, and
determine, based on the original PUC value and the one or more thresholds, whether the PUC has a dynamic defect; and
defect correction circuitry coupled to the dynamic defect detection circuitry and configured to apply, based on one of an output signal from the dynamic defect detection circuitry indicating that the PUC has a dynamic defect or a defect signal indicating that the PUC has a mapped defect, a defect correction process to produce a corrected output value for the PUC.
9. The image sensor of claim 8 wherein the subset further excludes the second highest pixel output value and the second lowest pixel output value.
10. The image sensor of claim 9 , wherein the one or more thresholds include a first threshold and a second threshold, and wherein the dynamic defect detection circuitry is configured to provide the output signal based on the original PUC value being between the first and second thresholds.
11. The image sensor of claim 10 , wherein the second threshold is based on the average value, the difference, and a detection factor, the detection factor being based on one or more parameters of the image sensor.
12. The image sensor of claim 11 , wherein the one or more parameters include any one or more of an integration time for the image sensor to acquire an image using the pixel array, an analog gain of the image sensor, a digital gain of the image sensor, or a temperature of the pixel array.
13. The image sensor of claim 10 , wherein the defect correction circuitry is configured to:
determine a plurality of directional gradients based on the pixel output values;
determine a directional gradient having a smallest value among the plurality of directional gradients;
select, from among the pixel output values, one or more selected pixel output values based on the directional gradient; and
produce the corrected output value for the PUC based on the one or more selected pixel output values.
14. The image sensor of claim 8 ; the plurality of surrounding pixels includes a number of defective pixels, a defective pixel having a mapped defect; and
wherein the defect correction circuitry is configured to apply the defect correction process based on the number of defective pixels.
15. The image sensor of claim 14 , wherein the number of the defective pixels is two or more; and
wherein to apply the defect correction process, the defect correction circuitry is configured to:
exclude the pixel output values corresponding to the defective pixels to produce a set of one or more remaining pixel output values; and
to determine the corrected output value of the PUC based on a median of the set of one or more remaining pixel output values.
16. The image sensor of claim 14 , wherein the dynamic defect detection circuitry is configured to information to the defect correction circuitry, the information including the number of defective pixels.
17. The image sensor of claim 8 , wherein the pixel array is a color filter array, and wherein the plurality of surrounding pixels have a same color filter type as the PUC.
18. A computer program product comprising one or more non-transitory computer readable media storing instructions that, when executed by at least one processor, cause a process for defect detection and correction in an image sensor to be carried out, the image sensor including a pixel array, and the process comprising:
receiving a signal specifying a plurality of pixel output values and an original output value of a pixel under correction (PUC);
determining an average value based on a subset of the plurality of pixel output values, wherein the subset excludes a maximum pixel output value from among the plurality of pixel values and a minimum pixel output value from among the plurality of pixel output values;
determining one or more thresholds based on the average value and a difference between a second highest pixel output value from the plurality of pixel output values and a second lowest pixel output value from the plurality of pixel output values;
determining, based on the original output value of the PUC and the one or more thresholds, whether the PUC has a dynamic defect; and
based on the PUC having the dynamic defect or a mapped defect, applying a defect correction process to produce a corrected output value for the PUC.
19. The computer program product of claim 18 , wherein the process further comprises:
determining a detection factor based on one or more parameters of the image sensor, the parameters including an integration time for the image sensor to acquire an image using the pixel array, an analog gain of the image sensor, a digital gain of the image sensor, or a temperature of the pixel array; and
determining at least one of the one or more thresholds based on the average value, the difference, and the detection factor.
20. The computer program product of claim 18 , wherein applying the defect correction process comprises:
determining a median value of a set including at least some of plurality of pixel output values; and
producing the corrected output value for the PUC based on the median value.