IP Library › Granted Patent US 10,567,712
Granted Patent B2
US 10,567,712 · App. 16/180,675 · Granted Feb 18, 2020

Imaging device and imaging system

Inventor: Shingo Hikosaka (Kawasaki, JP)
Assignee: CANON KABUSHIKI KAISHA
H04N9/04515G06T3/4015H04N9/04555H04N9/646B60W30/09B60W30/0956B60W2420/42B60W2550/10B60W2550/308B60W2710/18B60W2710/30B60W2720/10
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,567,712
App. No.
16/180,675
Granted
Feb 18, 2020
Kind
B2
Abstract

A disclosed imaging device includes an imaging element that includes a plurality of pixels including a plurality of first pixels each of which outputs a signal including color information and a plurality of second pixels each of which has higher sensitivity than the first pixels, and a signal processing unit that processes a signal output from the imaging element. The signal processing unit includes a luminance signal processing unit that generates luminance values of the first pixels based on signals output from the second pixels and a false color determination unit that determines a presence or absence of false color based on a result of comparison between the luminance values of the first pixels generated by the luminance signal processing unit and a predetermined threshold value.

Claims (40)

1. An imaging device comprising:

an imaging element that includes a plurality of pixels including a plurality of first pixels each of which outputs a signal including color information and a plurality of second pixels each of which has higher sensitivity than the first pixels; and

a signal processing unit that processes a signal output from the imaging element,

wherein the signal processing unit includes

a luminance signal processing unit that generates luminance values of the first pixels based on signals output from the second pixels, and

a false color determination unit that determines a presence or absence of false color based on a result of comparison between the luminance values of the first pixels generated by the luminance signal processing unit and a predetermined threshold value.

2. The imaging device according to claim 1 , wherein the luminance signal processing unit generates the luminance values of the first pixels by performing an interpolation process by using signals output from the plurality of the second pixels.

3. The imaging device according to claim 1 ,

wherein the plurality of first pixels include plural types of the first pixels that output color information on different colors, and

wherein the signal processing unit further includes a color-iW interpolation unit that performs an interpolation process by using plural types of color information output from the plural types of the first pixels and luminance information on the plurality of first pixels generated by the luminance signal processing unit to generate plural color information and plural luminance information that correspond to the plural types of colors for each of the plurality of pixels.

4. The imaging device according to claim 3 ,

wherein the plural luminance information corresponding to the plural types of colors include a maximum value, an intermediate value, and a minimum value, and

wherein the false color determination unit outputs information indicating that there is an occurrence of false color when a difference between the intermediate value and the minimum value is larger than the threshold value.

5. The imaging device according to claim 4 , wherein the false color determination unit outputs information indicating that a color corresponding to the minimum value causes false color when a difference between the intermediate value and the minimum value is larger than the threshold value.

6. The imaging device according to claim 3 ,

wherein the plural luminance information corresponding to the plural types of colors include a maximum value, an intermediate value, and a minimum value, and

wherein the false color determination unit outputs information indicating that there is an occurrence of false color when a difference between the intermediate value and the minimum value is smaller than a first threshold value and a difference between the maximum value and the intermediate value is larger than a second threshold value.

7. The imaging device according to claim 6 , wherein the false color determination unit outputs information indicating that colors corresponding to the minimum value and the intermediate value cause false color when a difference between the intermediate value and the minimum value is smaller than the first threshold value and a difference between the maximum value and the intermediate value is larger than the second threshold value.

8. The imaging device according to claim 3 , wherein the signal processing unit further includes a false color correction unit that corrects information output by the color-iW interpolation unit when there is an occurrence of false color.

9. The imaging device according to claim 8 , wherein the false color correction unit searches for a pixel which has a value close to color information on colors other than a color causing false color out of the plural color information of a pixel in which false color occurs and, based on color information on the searched pixel, corrects color information on the color causing false color of the pixel in which false color occurs.

10. The imaging device according to claim 8 , wherein based on color information on a color other than a color causing false color out of the plural color information of a pixel in which false color occurs, the false color correction unit corrects color information on the color causing false color of the pixel in which false color occurs.

11. The imaging device according to claim 8 , wherein the signal processing unit further includes a signal synthesizing unit that synthesizes an output of the luminance signal processing unit and an output of the false color correction unit to calculate an RGB value of the plurality of pixels.

12. The imaging device according to claim 1 , wherein each of the plurality of the first pixels is surrounded by the second pixels.

13. The imaging device according to claim 1 , wherein the plurality of pixels include the second pixels such that the number of the second pixels is twice or more than the number of the first pixels.

14. The imaging device according to claim 1 , wherein the plurality of the first pixels includes R pixels, G pixels, and B pixels.

15. The imaging device according to claim 1 , wherein the plurality of the first pixels includes C pixels, M pixels, Y pixels.

16. The imaging device according to claim 1 , wherein the plurality of the second pixels are W pixels.

17. A signal processing device that processes a signal output from an imaging element that includes a plurality of pixels including a plurality of first pixels each of which outputs a signal including color information and a plurality of second pixels each of which has higher sensitivity than the first pixels, the signal processing device comprising:

a luminance signal processing unit that generates luminance values of the first pixels based on luminance information output from the second pixels; and

a false color determination unit that determines false color by comparing the luminance values of the first pixels generated by the luminance signal processing unit to a predetermined threshold value.

18. An imaging system comprising:

an imaging device including an imaging element that includes a plurality of pixels including a plurality of first pixels each of which outputs a signal including color information and a plurality of second pixels each of which has higher sensitivity than the first pixels; and

a signal processing unit that processes a signal output from the imaging device,

wherein the signal processing unit includes

a luminance signal processing unit that generates luminance values of the first pixels based on luminance information output from the second pixels, and

a false color determination unit that determines false color by comparing the luminance values of the first pixels generated by the luminance signal processing unit to a predetermined threshold value.

19. A movable object comprising:

the imaging device according to claim 1 ;

a distance information acquisition unit that acquires distance information on a distance to an object, from a parallax image based on signals output from the pixels of the imaging device; and

a control unit that controls the movable object based on the distance information.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 30, 2019
From: HIKOSAKA, SHINGO
To: CANON KABUSHIKI KAISHA
Reel/Frame 048197/0386 →
Priority Claims (1)
JP 2017-218283 · Nov 13, 2017 · national
Continuity (1)
Related Publication 20190149780A1 · May 16, 2019
Cited By (1)
US 12,586,158