IP Library Granted Patent US 10,652,490
Granted Patent B2
US 10,652,490 · App. 15/739,660 · Granted May 12, 2020

Detection of bad pixels in an infrared image-capturing apparatus

Inventor: Amaury Saragaglia (Eybens, FR)
Assignee: ULIS
H04N5/3675H04N5/33H04N5/3651
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,652,490
App. No.
15/739,660
Granted
May 12, 2020
Kind
B2
Abstract

The invention relates to a method for detecting bad pixels from a pixel array of a device, for capturing an image, that is sensitive to infrared radiation. The method includes: receiving an input image captured by the pixel system, and calculating a score for a plurality of target pixels including at least some of the pixels from the input image. The score for each target pixel is generated on the basis of k pixels of the input image that are selected in a window of H by H pixels around the target pixel. H is an odd integer greater than or equal to 3, and k is an integer between 2 and 5. Each pixel, from the set formed of the k pixels and the target pixel, share at least one border or corner with another pixel from said set, and the values of the k pixels are at respective distances from the value of the target pixel, the k pixels being selected on the basis of the k distances. The method also includes detecting that at least one of the target pixels is a bad pixel on the basis of the calculated scores.

Claims (67)

1. A method of detecting spurious pixels of a pixel array of an imaging device sensitive to infrared radiation, the method comprising:

receiving, by a processing device of the imaging device, an input image captured by the pixel array;

calculating a score for a plurality of target pixels comprising at least some of the pixels of the input image, the score for each target pixel being generated based on k pixels of the input image selected within a window of H by H pixels around the target pixel, H being an odd integer of 3 or more, and k being an integer of between 2 and 5, each of the pixels of the set formed by the k pixels and the target pixel sharing at least one border or a corner with another pixel of said set, and the values of the k pixels pixels being at respective distances from the value of the target pixel, the k pixels being selected based on the distances of the k pixels and the score for each target pixel being calculated based on the distances of the k selected pixels; and

detecting that at least one of the target pixels is a spurious pixel based on the calculated scores,

wherein the selection of the k pixels comprises the successive steps of:

forming, around the target pixel, a first group consisting of all of the pixels sharing at least one border or a corner with the target pixel, excluding the target pixel, and selecting within this first group a first pixel having a value that is closest to that of the target pixel;

forming a second group consisting of the first group, excluding the first selected pixel, and of all the pixels sharing at least one border or a corner with the first selected pixel, and selecting within this second group a second pixel having a value that is closest to that of the target pixel; and

repeating operations of forming a new group consisting of a latest group to be formed, excluding a previously selected pixel of the latest group, and of all pixels sharing at least one border or a corner with a selected pixel of the latest group and then of selecting, within this new group, a subsequent pixel having a value closest to that of the target pixel, until k pixels have been selected.

2. The method of claim 1 , wherein H is an odd integer equal to 5 or more.

3. The method of claim 1 , wherein the k pixels are selected in order to minimize the sum of the k distances.

4. The method of claim 1 , wherein the score is equal to the sum of the k distances.

5. The method of claim 1 , wherein detecting the at least one spurious pixel comprises comparing at least some of the scores with a threshold value.

6. The method of claim 1 , further comprising, prior to calculating said scores, correcting the input image by applying gain and offset values to at least some of the pixel values of the input image.

7. A non-transistory computer-readable storage medium storing instructions for implementing the method of claim 1 when executed by a processing device.

8. A method of detecting spurious pixels of a pixel array of an imaging device sensitive to infrared radiation, the method comprising:

receiving, by a processing device of the imaging device, an input image captured by the pixel array;

calculating a score for a plurality of target pixels comprising at least some of the pixels of the input image, the score for each target pixel being generated based on k pixels of the input image selected within a window of H by H pixels around the target pixel, H being an odd integer of 3 or more, and k being an integer of between 2 and 5, each of the pixels of the set formed by the k pixels and the target pixel sharing at least one border or a corner with another pixel of said set, and the values of the k pixels being at respective distances from the value of the target pixel, the k pixels being selected based on the distances of the k pixels and the score for each target pixel being calculated based on the distances of the k selected pixels; and

detecting that at least one of the target pixels is a spurious pixel based on the calculated scores, comprising comparing a subset of the scores with a threshold value thr SPUR , the subset comprising a plurality of the highest scores of the calculated scores of the plurality of target pixels, and wherein the threshold value thr SPUR is calculated based on the following equation:

thr SPUR =Q 3+ x EI ×( Q 3− Q 1)

where x EI is a parameter equal to at least 1.0 and Q1 and Q3 are the first and third quartiles respectively of the subset.

9. The method of claim 8 , further comprising, prior to calculating said scores, correcting the input image by applying gain and offset values to at least some of the pixel values of the input image.

10. A non-transistory computer-readable storage medium storing instructions for implementing the method of claim 8 when executed by a processing device.

11. A method of detecting spurious pixels of a pixel array of an imaging device sensitive to infrared radiation, the method comprising:

receiving, by a processing device of the imaging device, an input image captured by the pixel array;

calculating a score for a plurality of target pixels comprising at least some of the pixels of the input image, the score for each target pixel being generated based on k pixels of the input image selected within a window of H by H pixels around the target pixel, H being an odd integer of 3 or more, and k being an integer of between 2 and 5, each of the pixels of the set formed by the k pixels and the target pixel sharing at least one border or a corner with another pixel of said set, and the values of the k pixels being at respective distances from the value of the target pixel, the k pixels being selected based on the distances of the k pixels and the score for each target pixel being calculated based on the distances of the k selected pixels; and

detecting that at least one of the target pixels is a spurious pixel based on the calculated scores, comprising comparing at least some of the calculated scores with a threshold value thr SPUR , and selecting at least some of the calculated scores by applying a further threshold to the calculated scores, wherein said further threshold is calculated based on an assumption that the pixel values in the image have a probability distribution based on a Laplace distribution.

12. The method of claim 11 , further comprising, prior to calculating said scores, correcting the input image by applying gain and offset values to at least some of the pixel values of the input image.

13. A non-transistory computer-readable storage medium storing instructions for implementing the method of claim 11 when executed by a processing device.

14. A method of detecting spurious pixels of a pixel array of an imaging device sensitive to infrared radiation, the method comprising:

receiving, by a processing device of the imaging device, an input image captured by the pixel array;

calculating a score for a plurality of target pixels comprising at least some of the pixels of the input image, the score for each target pixel being generated based on k pixels of the input image selected within a window of H by H pixels around the target pixel, H being an odd integer of 3 or more, and k being an integer of between 2 and 5, each of the pixels of the set formed by the k pixels and the target pixel sharing at least one border or a corner with another pixel of said set, and the values of the k pixels being at respective distances from the value of the target pixel, the k pixels being selected based on the distances of the k pixels and the score for each target pixel being calculated based on the distances of the k selected pixels; and

detecting that at least one of the target pixels is a spurious pixel based on the calculated scores, comprising comparing at least some of the calculated scores with a threshold value thr SPUR , and selecting at least some of the calculated scores by applying a further threshold to the calculated scores, wherein said further threshold is calculated based on the following equation:

thr

outlier

=

ln

(

4

)

λ

^

+

1.5

×

ln

(

3

)

λ

^

where {circumflex over (λ)} is an estimation of the parameter {circumflex over (λ)} of the exponential distribution f(x)=λe −λx of the absolute values of the calculated scores.

15. The method of claim 14 , further comprising, prior to calculating said scores, correcting the input image by applying gain and offset values to at least some of the pixel values of the input image.

16. A non-transistory computer-readable storage medium storing instructions for implementing the method of claim 14 when executed by a processing device.

17. An image processing device comprising:

a processing device adapted to receive an input image captured by a pixel array of an imaging device sensitive to infrared radiation; and

a memory storing the input image;

wherein the processing device is further adapted to:

calculate a score for a plurality of target pixels comprising at least some of the pixels of the input image, the score for each target pixel being generated based on k pixels of the input image selected within a window of H by H pixels around the target pixel, H being an odd integer of 3 or more, and k being an integer of between 2 and 5, each of the pixels of the set formed by the k pixels and the target pixel sharing at least one border or a corner with another pixel of said set, and the values of the k pixels being at respective distances from the value of the target pixel, the k pixels being selected based on the distances of the k pixels and the score for each target pixel being calculated based on the distances of the k selected pixels; and

detect that at least one of the target pixels is a spurious pixel based on the calculated scores,

wherein the processing device is adapted to select the k pixels by the successive steps of:

forming, around the target pixel, a first group consisting of all of the pixels sharing at least one border or a corner with the target pixel, excluding the target pixel, and selecting within this first group a first pixel having a value that is closest to that of the target pixel;

forming a second group consisting of the first group, excluding the first selected pixel, and of all the pixels sharing at least one border or a corner with the first selected pixel, and selecting within this second group a second pixel having a value that is closest to that of the target pixel; and

repeating operations of forming a new group consisting of a latest group to be formed, excluding a previously selected pixel of the latest group, and of all pixels sharing at least one border or a corner with a selected pixel of the latest group and then of selecting, within this new group, a subsequent pixel having a value closest to that of the target pixel, until k pixels have been selected.

18. The image processing device of claim 17 , wherein the k pixels are selected in order to minimize the sum of the k distances.

19. The image processing device of claim 17 , wherein the score is equal to the sum of the k distances.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 14, 2021
From: ULIS
To: LYNRED
Reel/Frame 055916/0093 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Feb 9, 2018
From: SARAGAGLIA, AMAURY
To: ULIS
Reel/Frame 044879/0430 →
Priority Claims (1)
FR 15 55964 · Jun 26, 2015 · national
Continuity (1)
Related Publication 20180316882A1 · Nov 1, 2018