IP Library › Granted Patent US 11,039,096
Granted Patent B2
US 11,039,096 · App. 16/607,600 · Granted Jun 15, 2021

Image processing device, image processing method and storage medium

Inventor: Chenhui Huang (Tokyo, JP)
Assignee: NEC CORPORATION
H04N5/367H04N5/361
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,039,096
App. No.
16/607,600
Granted
Jun 15, 2021
Kind
B2
Abstract

In an aspect, an image processing device includes: first specification means for specifying an abnormal pixel from a plurality of pixels according to a first method; and second specification means for specifying an abnormal pixel, from the plurality of pixels excluding the abnormal pixel specified by the first specification means, according to a second method different from the first method.

Claims (60)

1. An image processing device comprising:

at least one memory storing a set of instructions; and

at least one processor configured to execute the set of instructions to:

specify an abnormal pixel from a plurality of pixels according to a first method; and

specify an abnormal pixel, from the plurality of pixels excluding the abnormal pixel specified by the first method, according to a second method different from the first method, wherein

the first method specifies the abnormal pixel, based on a frequency distribution in which a characteristic of the plurality of pixels is represented by using a first variate,

the second method specifies the abnormal pixel, based on a frequency distribution in which a characteristic of the plurality of pixels excluding the abnormal pixel specified by the first method is represented by using a second variate different from the first variate,

the frequency distribution in which the characteristic of the plurality of pixels is represented by using the first variate and the frequency distribution in which the characteristic of the plurality of pixels is represented by using the second variate have a plurality of peaks of frequency, and

the frequency distribution in which the characteristic of the plurality of pixels is represented by using the first variate has a smaller overlapping region of distributions in comparison with the frequency distribution in which the characteristic of the plurality of pixels is represented by using the second variate.

2. The image processing device according to claim 1 , wherein

the first method specifies the abnormal pixel by using a ratio based on an output signal and a noise of the plurality of pixels, and

the second method specifies the abnormal pixel by using an output signal of the plurality of pixels.

3. The image processing device according to claim 1 , wherein

the first method specifies the abnormal pixel by using a difference between an output signal in a case where a plurality of sensor elements associated with the plurality of pixels are irradiated with incident light at a first intensity and an output signal in a case where the plurality of sensor elements are irradiated with incident light at a second intensity, and

the second method specifies the abnormal pixel by using an output signal of the plurality of pixels.

4. The image processing device according to claim 1 , wherein

the first method specifies the abnormal pixel by using a ratio based on an output signal and a noise of the plurality of pixels, and

the second method specifies the abnormal pixel by using a difference between an output signal in a case where a plurality of sensor elements associated with the plurality of pixels are irradiated with incident light at a first intensity and an output signal in a case where the plurality of sensor elements are irradiated with incident light at a second intensity.

5. The image processing device according to claim 1 , wherein

the at least one processor is configured to execute the set of instructions to:

correct an output signal of the abnormal pixel specified by the first method or the second method, based on an output signal of a pixel in a vicinity of the abnormal pixel, the pixel not being an abnormal pixel.

6. The image processing device according to claim 5 , wherein

the at least one memory stores a position of the abnormal pixel specified by the first method or the second method, and

the at least one processor is configured to execute the set of instructions to specify, based on the position stored in the memory, the pixel that is not an abnormal pixel.

7. The image processing device according to claim 1 , wherein

the at least one processor is configured to execute the set of instructions to:

specify an abnormal pixel, from the plurality of pixels excluding the abnormal pixel specified by the first method or the second method, according to a third method different from both of the first method and the second method.

8. The image processing device according to claim 7 , wherein

the first method specifies the abnormal pixel by using a ratio based on an output signal and a noise of the plurality of pixels,

the second method specifies the abnormal pixel by using a difference between an output signal in a case where a plurality of sensor elements associated with the plurality of pixels are irradiated with incident light at a first intensity and an output signal in a case where the plurality of sensor elements are irradiated with incident light at a second intensity, and

the third method specifies an abnormal pixel by using an output signal of the plurality of pixels.

9. An image processing method comprising:

specifying an abnormal pixel from a plurality of pixels according to a first method; and

specifying an abnormal pixel, from the plurality of pixels excluding the specified abnormal pixel, according to a second method different from the first method, wherein

the first method specifies the abnormal pixel, based on a frequency distribution in which a characteristic of the plurality of pixels is represented by using a first variate, and

the second method specifies the abnormal pixel, based on a frequency distribution in which a characteristic of the plurality of pixels excluding the abnormal pixel specified by the first specification method is represented by using a second variate different from the first variate,

the frequency distribution in which the characteristic of the plurality of pixels is represented by using the first variate and the frequency distribution in which the characteristic of the plurality of pixels is represented by using the second variate have a plurality of peaks of frequency, and

the frequency distribution in which the characteristic of the plurality of pixels is represented by using the first variate has a smaller overlapping region of distributions in comparison with the frequency distribution in which the characteristic of the plurality of pixels is represented by using the second variate.

10. The image processing method according to claim 9 , wherein

the first method specifies the abnormal pixel by using a ratio based on an output signal and a noise of the plurality of pixels, and

the second method specifies the abnormal pixel by using an output signal of the plurality of pixels.

11. The image processing method according to claim 9 , wherein

the first method specifies the abnormal pixel by using a difference between an output signal in a case where a plurality of sensor elements associated with the plurality of pixels are irradiated with incident light at a first intensity and an output signal in a case where the plurality of sensor elements are irradiated with incident light at a second intensity, and

the second method specifies the abnormal pixel by using an output signal of the plurality of pixels.

12. The image processing method according to claim 9 , wherein

the first method specifies the abnormal pixel by using a ratio based on an output signal and a noise of the plurality of pixels, and

the second method specifies the abnormal pixel by using a difference between an output signal in a case where a plurality of sensor elements associated with the plurality of pixels are irradiated with incident light at a first intensity and an output signal in a case where the plurality of sensor elements are irradiated with incident light at a second intensity.

13. The image processing method according to claim 9 , further comprising correcting an output signal of the specified abnormal pixel, based on an output signal of a pixel in a vicinity of the abnormal pixel, the pixel not being an abnormal pixel.

14. The image processing method according to claim 9 , further comprising specifying an abnormal pixel, from the plurality of pixels excluding the specified abnormal pixel, according to a third method different from both of the first method and the second method.

15. The image processing method according to claim 14 , wherein

the first method specifies the abnormal pixel by using a ratio based on an output signal and a noise of the plurality of pixels,

the second method specifies the abnormal pixel by using a difference between an output signal in a case where a plurality of sensor elements associated with the plurality of pixels are irradiated with incident light at a first intensity and an output signal in a case where the plurality of sensor elements are irradiated with incident light at a second intensity, and

the third method specifies an abnormal pixel by using an output signal of the plurality of pixels.

16. A non-transitory computer readable storage medium storing a program causing a computer to execute:

first specification processing of specifying an abnormal pixel from a plurality of pixels according to a first method; and

second specification processing of specifying an abnormal pixel, from the plurality of pixels excluding the abnormal pixel specified by the first specification processing, according to a second method different from the first method, wherein

the first method specifies the abnormal pixel, based on a frequency distribution in which a characteristic of the plurality of pixels is represented by using a first variate, and

the second method specifies the abnormal pixel, based on a frequency distribution in which a characteristic of the plurality of pixels excluding the abnormal pixel specified by the first specification method is represented by using a second variate different from the first variate,

the frequency distribution in which the characteristic of the plurality of pixels is represented by using the first variate and the frequency distribution in which the characteristic of the plurality of pixels is represented by using the second variate have a plurality of peaks of frequency, and

the frequency distribution in which the characteristic of the plurality of pixels is represented by using the first variate has a smaller overlapping region of distributions in comparison with the frequency distribution in which the characteristic of the plurality of pixels is represented by using the second variate.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Oct 23, 2019
From: HUANG, CHENHUI
To: NEC CORPORATION
Reel/Frame 050805/0821 →
Priority Claims (1)
JP JP2017-084927 · Apr 24, 2017 · national
Continuity (1)
Related Publication 20200304739A1 · Sep 24, 2020