IP Library › Granted Patent US 8,553,089
Granted Patent B2
US 8,553,089 · App. 13/070,243 · Granted Oct 8, 2013

Imaging device and signal processing circuit for the imaging device

View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 8,553,089
App. No.
13/070,243
Granted
Oct 8, 2013
Kind
B2
Abstract

The present invention switches to and from generation of a luminance signal based on a visible light pixel signal and generation of a luminance signal based on a near infrared light pixel signal depending on a result of comparison of signal levels of the visible light pixel signal and the near infrared light pixel signal.

Claims (116)

1. An imaging device configured to switch to and from generation of a luminance signal based on a visible light pixel signal and generation of a luminance signal based on a near infrared light pixel signal depending on a result of comparison of signal levels of the visible light pixel signal and the near infrared light pixel signal, the imaging device comprising:

a luminance signal generation unit, the luminance signal generation unit including:

a first processing configuration for signal generation suitable for the generation of the luminance signal based on the visible light pixel signal obtained during daytime or in a first photographing environment substantially as bright as the daytime; and

a second processing configuration for signal generation suitable for the generation of the luminance signal based on the near infrared light pixel signal obtained in a second photographing environment darker than the first photographing environment, wherein

the luminance signal generation unit switches to and from the first processing configuration for signal generation and the second processing configuration for signal generation depending on the comparison result of the signal levels of the visible light pixel signal and the near infrared light pixel signal.

2. The imaging device as claimed in claim 1 , wherein

the luminance signal generation unit selects the first processing configuration for signal generation when the signal level of the visible light pixel signal is larger than the signal level of the near infrared light pixel signal, and

the luminance signal generation unit selects the second processing configuration for signal generation when the signal level of the visible light pixel signal is equal to or smaller than the signal level of the near infrared light pixel signal.

3. The imaging device as claimed in claim 2 , comprising:

a plurality of first pixels having a sensitivity to a visible light wavelength region and configured to output the visible light pixel signal; and

a plurality of second pixels having a sensitivity to a near infrared light wavelength region and configured to output the near infrared light pixel signal, wherein

the second processing configuration for signal generation includes:

a 2-1 processing configuration for signal generation in which the luminance signal is generated based on the near infrared light pixel signal read per pixel from the second pixels, and a color signal is generated based on the visible light pixel signal read per pixel from the first pixels; and

a 2-2 processing configuration for signal generation in which the luminance signal is generated based on the near infrared light pixel signal read per pixel from the second pixels, and the color signal is generated based on the visible light pixel signal read from a mixing result obtained by mixing a target pixel with a surrounding pixel thereof both selected from the first pixels, and

the luminance signal generation unit selects the 2-1 processing configuration for signal generation when the signal level of the visible light pixel signal is equal to or smaller than the signal level of the near infrared light pixel signal and the signal level of the visible light pixel signal is larger than a given threshold value, and

the luminance signal generation unit selects the 2-2 processing configuration for signal generation when the signal level of the visible light pixel signal is equal to or smaller than the signal level of the near infrared light pixel signal and the signal level of the visible light pixel signal is equal to or smaller than the given threshold value.

4. The imaging device as claimed in claim 3 , wherein

the luminance signal generation unit includes a 2-3 processing configuration for signal generation in place of the 2-2 processing configuration for signal generation, and

the luminance signal is generated based on the near infrared light pixel signal read per pixel from the second pixels, and the color signal is generated based on the visible light pixel signal read from the first pixels after a prolonged exposure to light in the 2-3 processing configuration for signal generation.

5. The imaging device as claimed in claim 3 , wherein

the first pixels include:

a pixel having a sensitivity to a red visible light;

a pixel having a sensitivity to a green visible light; and

a pixel having a sensitivity to a blue visible light.

6. An imaging device comprising:

an imaging element capable of outputting a visible light pixel signal and a near infrared light pixel signal;

a YC processing unit capable of generating a luminance signal and a color signal from the visible light pixel signal and the near infrared light pixel signal; and

a visible light/near infrared light dominance determination unit configured to compare signal levels of the visible light pixel signal and the near infrared light pixel signal and switch to and from generation of the luminance signal based on the visible light pixel signal and generation of the luminance signal based on the near infrared light pixel signal depending on a comparison result thereby obtained,

wherein

the YC processing unit includes:

a first processing configuration for signal generation suitable for the generation of the luminance signal based on the visible light pixel signal outputted from the imaging element during daytime or in a first photographing environment substantially as bright as the daytime; and

a second processing configuration for signal generation suitable for the generation of the luminance signal based on the near infrared light pixel signal outputted from the imaging element in a second photographing environment darker than the first photographing environment, and

the visible light/near infrared light dominance determination unit switches to and from the first processing configuration for signal generation and the second processing configuration for signal generation in the YC processing unit depending on the comparison result of the signal levels of the visible light pixel signal and the near infrared light pixel signal.

7. The imaging device as claimed in claim 6 , wherein

the visible light/near infrared light dominance determination unit selects the first processing configuration for signal generation when the signal level of the visible light pixel signal is larger than the signal level of the near infrared light pixel signal, and

the visible light/near infrared light dominance determination unit selects the second processing configuration for signal generation when the signal level of the visible light pixel signal is equal to or smaller than the signal level of the near infrared light pixel signal.

8. The imaging device as claimed in claim 6 , wherein the imaging element comprises:

a plurality of first pixels having a sensitivity to a visible light wavelength region and configured to output the visible light pixel signal; and

a plurality of second pixels having a sensitivity to a near infrared light wavelength region and configured to output the near infrared light pixel signal, and

the first pixels include:

a pixel having a sensitivity to a red visible light;

a pixel having a sensitivity to a green visible light; and

a pixel having a sensitivity to a blue visible light.

9. The imaging device as claimed in claim 7 , wherein the imaging element comprises:

a plurality of first pixels having a sensitivity to a visible light wavelength region and configured to output the visible light pixel signal; and

a plurality of second pixels having a sensitivity to a near infrared light wavelength region and configured to output the near infrared light pixel signal, and

the second processing configuration for signal generation includes:

a 2-1 processing configuration for signal generation in which the luminance signal is generated based on the near infrared light pixel signal read per pixel from the second pixels, and the color signal is generated based on the visible light pixel signal read per pixel from the first pixels; and

a 2-2 processing configuration for signal generation in which the luminance signal is generated based on the near infrared light pixel signal read per pixel from the second pixels, and the color signal is generated based on the visible light pixel signal read from a mixing result obtained by mixing a target pixel with a surrounding pixel thereof both selected from the first pixels, and

the visible light/near infrared light dominance determination unit requests the YC processing unit to switch to the 2-1 processing configuration for signal generation when the signal level of the visible light pixel signal is equal to or smaller than the signal level of the near infrared light pixel signal and the signal level of the visible light pixel signal is larger than a given threshold value, and

the visible light/near infrared light dominance determination unit requests the YC processing unit to switch to the 2-2 processing configuration for signal generation when the signal level of the visible light pixel signal is equal to or smaller than the signal level of the near infrared light pixel signal and the signal level of the visible light pixel signal is equal to or smaller than the given threshold value.

10. The imaging device as claimed in claim 9 , further comprising

a readout configuration switching unit; and

a visible light threshold determination unit, wherein

the readout switching control unit includes:

a first readout configuration in which the visible light pixel signal and the near infrared light pixel signal are read per pixel from the imaging element; and

a second readout configuration in which the visible light pixel signal and the near infrared light pixel signal are read from a mixing result obtained by mixing a target pixel with a surrounding pixel thereof both selected from the imaging element, and

the readout switching control unit switches to and from the first readout configuration and the second readout configuration, and

the visible light threshold determination unit requests the readout switching control unit to switch to the first readout configuration and requests the YC processing unit to switch to the 2-1 processing configuration for signal generation when the signal level of the visible light pixel signal is equal to or smaller than the signal level of the near infrared light pixel signal and the signal level of the visible light pixel signal is larger than a given threshold value, and

when the signal level of the visible light pixel signal is equal to or smaller than the signal level of the near infrared light pixel signal and the signal level of the visible light pixel signal is equal to or smaller than the given threshold value, the visible light threshold determination unit requests the readout switching control unit to switch to the first readout configuration and requests the YC processing unit to switch to the 2-1 processing configuration for signal generation in order to generate the luminance signal, and the visible light threshold determination unit requests the readout switching control unit to switch to the second readout configuration and requests the YC processing unit to switch to the 2-2 processing configuration for signal generation in order to generate the color signal.

11. The imaging device as claimed in claim 9 , wherein

the YC processing unit includes a 2-3 processing configuration for signal generation in place of the 2-2 processing configuration for signal generation, and

the luminance signal is generated based on the near infrared light pixel signal read per pixel from the second pixels, and the color signal is generated based on the visible light pixel signal read from the first pixels after a prolonged exposure to light in the 2-3 processing configuration for signal generation.

12. The imaging device as claimed in claim 10 , wherein

the readout switching control unit includes a third readout configuration in place of the second readout configuration, and

the visible light pixel signal and the near infrared light pixel signal are read from the imaging element after a prolonged exposure to light in the third readout configuration.

13. A signal processing circuit for an imaging device configured to switch to and from generation of a luminance signal based on a visible light pixel signal and generation of a luminance signal based on a near infrared light pixel signal depending on a result of comparison of signal levels of the visible light pixel signal and the near infrared light pixel signal,

wherein

the luminance signal is generated based on the near infrared light pixel signal read per pixel from an imaging element, and a color signal is generated based on the visible light pixel signal read per pixel from the imaging element when the signal level of the visible light pixel signal is equal to or smaller than the signal level of the near infrared light pixel signal and the signal level of the visible light pixel signal is larger than a given threshold value, and

the luminance signal is generated based on the near infrared light pixel signal read per pixel from the imaging element, and the color signal is generated based on the visible light pixel signal read from a mixing result obtained by mixing a target pixel with a surrounding pixel thereof both selected from the imaging element when the signal level of the visible light pixel signal is equal to or smaller than the signal level of the near infrared light pixel signal and the signal level of the visible light pixel signal is equal to or smaller than the given threshold value.

14. The signal processing circuit for an imaging device as claimed in claim 13 , comprising a luminance signal generation unit, the luminance signal generation unit including:

a first processing configuration for signal generation suitable for the generation of the luminance signal based on the visible light pixel signal obtained during daytime or in a first photographing environment substantially as bright as the daytime; and

a second processing configuration for signal generation suitable for the generation of the luminance signal based on the near infrared light pixel signal obtained in a second photographing environment darker than the first photographing environment, wherein

the luminance signal generation unit switches to and from the first processing configuration for signal generation and the second processing configuration for signal generation depending on the comparison result of the signal levels of the visible light pixel signal and the near infrared light pixel signal.

15. The signal processing circuit for an imaging device as claimed in claim 14 , wherein

the luminance signal generation unit selects the first processing configuration for signal generation when the signal level of the visible light pixel signal is larger than the signal level of the near infrared light pixel signal, and

the luminance signal generation unit selects the second processing configuration for signal generation when the signal level of the visible light pixel signal is equal to or smaller than the signal level of the near infrared light pixel signal.

16. The signal processing circuit for an imaging device as claimed in claim 15 , wherein the second processing configuration for signal generation includes:

a 2-1 processing configuration for signal generation in which the luminance signal is generated based on the near infrared light pixel signal read per pixel from the imaging element, and the color signal is generated based on the visible light pixel signal read per pixel from the imaging element; and

a 2-2 processing configuration for signal generation in which the luminance signal is generated based on the near infrared light pixel signal read per pixel from the imaging element, and the color signal is generated based on the visible light pixel signal read from a mixing result obtained by mixing a target pixel with a surrounding pixel thereof both selected from the imaging element, and

the luminance signal generation unit selects the 2-1 processing configuration for signal generation when the signal level of the visible light pixel signal is equal to or smaller than the signal level of the near infrared light pixel signal and the signal level of the visible light pixel signal is larger than a given threshold value, and

the luminance signal generation unit selects the 2-2 processing configuration for signal generation when the signal level of the visible light pixel signal is equal to or smaller than the signal level of the near infrared light pixel signal and the signal level of the visible light pixel signal is equal to or smaller than the given threshold value.

17. The signal processing circuit for an imaging device as claimed in claim 16 , wherein

the luminance signal generation unit includes a 2-3 processing configuration for signal generation in place of the 2-2 processing configuration for signal generation, and

the luminance signal is generated based on the near infrared light pixel signal read per pixel from second pixels, and the color signal is generated based on the visible light pixel signal read from first pixels after a prolonged exposure to light in the 2-3 processing configuration for signal generation.

18. A signal processing circuit for an imaging device, comprising:

a YC processing unit capable of generating a luminance signal and a color signal from a visible light pixel signal and a near infrared light pixel signal obtained from an imaging element; and

a visible light/near infrared light dominance determination unit configured to compare signal levels of the visible light pixel signal and the near infrared light pixel signal and switch to and from generation of the luminance signal based on the visible light pixel signal and generation of the luminance signal based on the near infrared light pixel signal depending on a comparison result thereby obtained

wherein the YC processing unit includes:

a first processing configuration for signal generation suitable for the generation of the luminance signal based on the visible light pixel signal obtained in the imaging element during daytime or in a first photographing environment substantially as bright as the daytime; and

a second processing configuration for signal generation suitable for the generation of the luminance signal based on the near infrared light pixel signal obtained in the imaging element in a second photographing environment darker than the first photographing environment, and

the visible light/near infrared light dominance determination unit switches to and from the first processing configuration for signal generation and the second processing configuration for signal generation in the YC processing unit depending on the comparison result of the signal levels of the visible light pixel signal and the near infrared light pixel signal.

19. The signal processing circuit for an imaging device as claimed in claim 18 , wherein

the visible light/near infrared light dominance determination unit selects the first processing configuration for signal generation when the signal level of the visible light pixel signal is larger than the signal level of the near infrared light pixel signal, and

the visible light/near infrared light dominance determination unit selects the second processing configuration for signal generation when the signal level of the visible light pixel signal is equal to or smaller than the signal level of the near infrared light pixel signal.

20. The signal processing circuit for an imaging device as claimed in claim 19 , wherein

the second processing configuration for signal generation includes:

a 2-1 processing configuration for signal generation in which the luminance signal is generated based on the near infrared light pixel signal read per pixel from the imaging element, and the color signal is generated based on the visible light pixel signal read per pixel from the imaging element; and

a 2-2 processing configuration for signal generation in which the luminance signal is generated based on the near infrared light pixel signal read per pixel from the imaging element, and the color signal is generated based on the visible light pixel signal read from a mixing result obtained by mixing a target pixel with a surrounding pixel thereof both selected from the imaging element, and

the visible light/near infrared light dominance determination unit requests the YC processing unit to switch to the 2-1 processing configuration for signal generation when the signal level of the visible light pixel signal is equal to or smaller than the signal level of the near infrared light pixel signal and the signal level of the visible light pixel signal is larger than a given threshold value, and

the visible light/near infrared light dominance determination unit requests the YC processing unit to switch to the 2-2 processing configuration for signal generation when the signal level of the visible light pixel signal is equal to or smaller than the signal level of the near infrared light pixel signal and the signal level of the visible light pixel signal is equal to or smaller than the given threshold value.

21. The signal processing circuit for an imaging device as claimed in claim 20 , further comprising:

a readout configuration switching unit; and

a visible light threshold determination unit, wherein

the readout switching control unit includes:

a first readout configuration in which the visible light pixel signal and the near infrared light pixel signal are read per pixel from the imaging element; and

a second readout configuration in which the visible light pixel signal and the near infrared light pixel signal are read from a mixing result obtained by mixing a target pixel with a surrounding pixel thereof both selected from the imaging element, and

the readout switching control unit switches to and from the first readout configuration and the second readout configuration, and

the visible light threshold determination unit requests the readout switching control unit to switch to the first readout configuration and requests the YC processing unit to switch to the 2-1 processing configuration for signal generation when the signal level of the visible light pixel signal is equal to or smaller than the signal level of the near infrared light pixel signal and the signal level of the visible light pixel signal is larger than a given threshold value, and

the visible light threshold determination unit requests the readout switching control unit to switch to the second readout configuration and requests the YC processing unit to switch to the 2-2 processing configuration for signal generation when the signal level of the visible light pixel signal is equal to or smaller than the signal level of the near infrared light pixel signal and the signal level of the visible light pixel signal is equal to or smaller than the given threshold value.

22. The signal processing circuit for an imaging device as claimed in claim 20 , wherein

the YC processing unit includes a 2-3 processing configuration for signal generation in place of the 2-2 processing configuration for signal generation, wherein

the luminance signal is generated based on the near infrared light pixel signal read per pixel from the imaging element, and the color signal is generated based on the visible light pixel signal read from the imaging element after a prolonged exposure to light in the 2-3 processing configuration for signal generation.

23. The signal processing circuit for an imaging device as claimed in claim 21 , wherein

the readout switching control unit includes a third readout configuration in place of the second readout configuration, and

the visible light pixel signal and the near infrared light pixel signal are read from the imaging element after a prolonged exposure to light in the third readout configuration.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 27, 2020
From: PANASONIC CORPORATION
To: PANASONIC SEMICONDUCTOR SOLUTIONS CO., LTD.
Reel/Frame 052755/0917 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 14, 2011
From: NOGUCHI, TOMOYUKI
To: PANASONIC CORPORATION
Reel/Frame 026123/0356 →