IP Library › Granted Patent US 10,694,118
Granted Patent B2
US 10,694,118 · App. 16/074,026 · Granted Jun 23, 2020

Signal processing apparatus, imaging apparatus, and signal processing method

Inventors: Koji Kurata (Tokyo, JP); Naoki Okamoto (Tokyo, JP)
Assignee: SONY CORPORATION
H04N5/265G06K9/2018H04N5/232H04N5/2351H04N5/243H04N5/33H04N9/04H04N9/045G06K9/00228G06T3/4015G06T5/50G06T2207/10024G06T2207/10048G06T2207/20221G06T2207/30192H04N5/332
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,694,118
App. No.
16/074,026
Granted
Jun 23, 2020
Kind
B2
Abstract

In a signal processing apparatus including a mixing region detecting unit, and an image capturing condition updating unit, the mixing region detecting unit detects a region where a non-visible light image signal is to be mixed with a visible light image signal, the non-visible light image signal and the visible light image signal being generated by repeatedly performing imaging on a basis of a predetermined image capturing condition. The image capturing condition updating unit newly generates an image capturing condition in the non-visible light image signal on a basis of the non-visible light image signal in the detected region to update the predetermined image capturing condition. A region including fog, or the like is detected, a visible light image signal is mixed with a non-visible light image signal in the region, and image capturing conditions of the non-visible light image signal in the region are updated.

Claims (55)

1. A signal processing apparatus, comprising:

a mixing region detecting unit configured to detect a first region associated with an image, wherein

the first region is a region where a non-visible light image signal associated with the image is to be mixed with a visible light image signal associated with the image,

the non-visible light image signal and the visible light image signal are generated based on an imaging operation, and

the imaging operation is based on a first image capturing condition;

a mixing ratio generating unit configured to generate a mixing ratio based on a transmittance of fog in the visible light image signal; and

an image capturing condition updating unit configured to:

generate a second image capturing condition associated with the non-visible light image signal, wherein the second image capturing condition is generated based the mixing ratio; and

update the first image capturing condition based on the generated second image capturing condition.

2. The signal processing apparatus according to claim 1 , wherein

the image capturing condition updating unit is further configured to:

generate a third image capturing condition, wherein

in the third image capturing condition, a brightness associated with the non-visible light image signal in the detected first region is substantially equal to a brightness associated with the visible light image signal in the detected first region; and

update the first image capturing condition based on the generated third image capturing condition.

3. The signal processing apparatus according to claim 1 , wherein

the image capturing condition updating unit is further configured to:

generate a fourth image capturing condition, wherein

in the fourth image capturing condition, a brightness associated with the non-visible light image signal in the detected first region is substantially equal to a brightness associated with the visible light image signal in a second region of the image,

the second region is different from the detected first region; and

update the first image capturing condition based on the generated fourth image capturing condition.

4. The signal processing apparatus according to claim 1 ,

wherein the mixing region detecting unit is further configured to detect the first region based on the transmittance of fog in the visible light image signal.

5. The signal processing apparatus according to claim 4 ,

wherein the mixing region detecting unit is further configured to detect the first region based on a value of the transmittance of fog that is less than a threshold value.

6. The signal processing apparatus according to claim 1 , wherein the mixing region detecting unit is further configured to detect, as the first region, a region of a face in the visible light image signal.

7. The signal processing apparatus according to claim 1 , wherein the mixing region detecting unit is further configured to detect, as the first region, a region where the visible light image signal is greater than a threshold value.

8. The signal processing apparatus according to claim 1 , wherein the mixing region detecting unit is further configured to detect, as the first region, a region where the visible light image signal is less than a threshold value.

9. The signal processing apparatus according to claim 1 , further comprising:

the mixing ratio generating unit is further configured to generate the mixing ratio based on the non-visible light image signal in the detected first region, wherein

the image capturing condition updating unit is further configured to:

generate a fifth image capturing condition associated with the non-visible light image signal,

the fifth image capturing condition is generated based on the generated mixing ratio, and

update the first image capturing condition based on the fifth image capturing condition.

10. The signal processing apparatus according to claim 1 , further comprising:

an amplifying unit configured to adjust a level of the non-visible light image signal based on the first image capturing condition.

11. The signal processing apparatus according to claim 1 , wherein the non-visible light image signal is an infrared light image signal corresponding to infrared light.

12. An imaging apparatus, comprising:

an image sensor configured to generate a non-visible light image signal and a visible light image signal based on an imaging operation,

wherein the imaging operation is based on a first image capturing condition;

a mixing region detecting unit configured to detect a region associated with an image, wherein

the non-visible light image signal and the visible light image signal are associated with the image, and

the detected region is a region where the non-visible light image signal is to be mixed with the visible light image signal;

a mixing ratio generating unit configured to generate a mixing ratio based on a transmittance of fog in the visible light image signal; and

an image capturing condition updating unit configured to:

generate a second image capturing condition associated with the non-visible light image signal, wherein the second image capturing condition is generated based on the mixing ratio; and

update the first image capturing condition based on the generated second image capturing condition.

13. A signal processing method, comprising:

detecting a region associated with an image, wherein

the detected region is a region where a non-visible light image signal associated with the image is to be mixed with a visible light image signal associated with the image,

the non-visible light image signal and the visible light image signal are generated based on an imaging operation, and

the imaging operation is based a first image capturing condition;

generating a mixing ratio based on a transmittance of fog in the visible light image signal;

generating a second image capturing condition associated with the non-visible light image signal,

wherein the second image capturing condition is generated based on a basis of the mixing ratio; and

updating update the first image capturing condition based on the generated second image capturing condition.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Oct 29, 2018
From: KURATA, KOJI; OKAMOTO, NAOKI
To: SONY CORPORATION
Reel/Frame 047348/0627 →
Priority Claims (1)
JP 2016-036925 · Feb 29, 2016 · national
Continuity (1)
Related Publication 20190045139A1 · Feb 7, 2019