IP Library Granted Patent US 10,873,732
Granted Patent B2
US 10,873,732 · App. 16/489,235 · Granted Dec 22, 2020

Imaging device, imaging system, and method of controlling imaging device

Inventor: Takayoshi Miyamoto (Tokyo, JP)
Assignee: SONY SEMICONDUCTOR SOLUTIONS CORPORATION
H04N9/735H04N9/0451
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,873,732
App. No.
16/489,235
Granted
Dec 22, 2020
Kind
B2
Abstract

An imaging device includes a plurality of optical systems having different angles of view. A wide-angle-side light detection unit detects a plurality of wide-angle-side color components in each of a plurality of regions in wide-angle image data having an angle of view wider than a predetermined value. A telephoto-side light detection unit detects a plurality of telephoto-side color components in each of a plurality of regions in telephoto image data having an angle of view narrower than the predetermined value. A telephoto-side white balance gain acquisition unit obtains a gain for the telephoto image data on the basis of a wide-angle-side integration ratio that is a ratio of respective integration values of the plurality of wide-angle-side color components and the plurality of telephoto-side color components as a telephoto-side white balance gain. A telephoto-side white balance correction unit corrects the telephoto image data with the telephoto-side white balance gain.

Claims (60)

1. An imaging device, comprising:

circuitry configured to:

detect a plurality of wide-angle-side color components in each of a first plurality of regions in wide-angle image data, wherein the wide-angle image data has a first angle of view wider than a determined value;

detect a plurality of telephoto-side color components in each of a second plurality of regions in telephoto image data, wherein the telephoto image data has a second angle of view narrower than the determined value;

calculate a wide-angle-side integration ratio based on a ratio of respective integration values of the plurality of wide-angle-side color components and the plurality of telephoto-side color components;

obtain a telephoto-side white balance gain for the telephoto image data based on the wide-angle-side integration ratio; and

correct the telephoto image data based on the telephoto-side white balance gain.

2. The imaging device according to claim 1 , wherein the circuitry is further configured to:

set a telephoto-side integration range that includes the wide-angle-side integration ratio; and

calculate the telephoto-side white balance gain based on a telephoto-side integration ratio, wherein the telephoto-side integration ratio is a ratio of respective integration values of the plurality of telephoto-side color components within the telephoto-side integration range.

3. The imaging device according to claim 2 , wherein

the plurality of telephoto-side color components includes a red (R) component, a green (G) component, and a blue (B) component, and

the circuitry is further configured to set the telephoto-side integration range based on a shape centered on the wide-angle-side integration ratio in an orthogonal coordinate system having a ratio of the R component and the G component and a ratio of the B component and the G component as coordinate axes.

4. The imaging device according to claim 3 , wherein the telephoto-side integration range is rectangular.

5. The imaging device according to claim 3 , wherein the telephoto-side integration range is circular.

6. The imaging device according to claim 3 , wherein the telephoto-side integration range is elliptical.

7. The imaging device according to claim 3 ,

wherein the circuitry is further configured to:

calculate the wide-angle-side integration ratio based on a ratio of respective integration values of the plurality of wide-angle-side color components within a wide-angle-side integration range;

acquire a wide-angle-side white balance gain based on the wide-angle-side integration ratio; and

correct the wide-angle image data based on the wide-angle-side white balance gain.

8. The imaging device according to claim 7 , wherein

a side of the telephoto-side integration range is parallel to a side of the wide-angle-side integration range.

9. The imaging device according to claim 2 , wherein

the plurality of telephoto-side color components includes a red (R) component, a green (G) component, and a blue (B) component, and

the circuitry is further configured to set the telephoto-side integration range based on an overlapping range between a range having a shape centered on the wide-angle-side integration ratio and a preset reference integration range in an orthogonal coordinate system having a ratio of the R component and the G component and a ratio of the B component and the G component as coordinate axes.

10. The imaging device according to claim 7 , wherein the circuitry is further configured to:

determine presence or absence of reliability of the plurality of wide-angle-side color components within the wide-angle-side integration range; and

calculate the wide-angle-side integration ratio based on the presence of the reliability.

11. The imaging device according to claim 10 , wherein the circuitry is further configured to:

determine a result based on a determination whether a number of color components of the plurality of wide-angle-side color components that exceeds a threshold value is larger than a threshold number; and

determine the presence or absence of the reliability based on the result.

12. The imaging device according to claim 10 , wherein the circuitry is further configured to:

determine the presence or absence of the reliability of the plurality of telephoto-side color components within the telephoto-side integration range; and

calculate the telephoto-side integration ratio based on the presence of the reliability.

13. The imaging device according to claim 12 , wherein the circuitry is further configured to:

determine a result based on a determination whether a number of color components of the plurality of telephoto-side color components that exceeds a threshold is larger than a threshold number; and

determine the presence or absence of the reliability based on the result.

14. An imaging system, comprising:

circuitry configured to:

detect a plurality of wide-angle-side color components in each of a first plurality of regions in wide-angle image data, wherein the wide-angle image data has a first angle of view wider than a value;

detect a plurality of telephoto-side color components in each of a second plurality of regions in telephoto image data, wherein the telephoto image data has a second angle of view narrower than the value;

calculate a wide-angle-side integration ratio based on a ratio of respective integration values of the plurality of wide-angle-side color components and the plurality of telephoto-side color components;

obtain a telephoto-side white balance gain for the telephoto image data based on the wide-angle-side integration ratio; and

correct the telephoto image data based on the telephoto-side white balance gain; and

a recording unit configured to record the corrected telephoto image data.

15. A method of controlling an imaging device, comprising:

detecting a plurality of wide-angle-side color components in each of a first plurality of regions in wide-angle image data, wherein the wide-angle image data has a first angle of view wider than a value;

detecting a plurality of telephoto-side color components in each of a second plurality of regions in a telephoto image data, wherein the telephoto image data has a second angle of view narrower than the value;

calculating a wide-angle-side integration ratio based on a ratio of respective integration values of the plurality of wide-angle-side color components and the plurality of telephoto-side color components;

obtaining a telephoto-side white balance gain for the telephoto image data based on the wide-angle-side integration ratio; and

correcting the telephoto image data based on the telephoto-side white balance gain.

16. An imaging device, comprising:

circuitry configured to:

detect a plurality of wide-angle-side color components in each of a first plurality of regions in wide-angle image data, wherein the wide-angle image data has a first angle of view wider than a value;

detect a plurality of telephoto-side color components in each of a second plurality of regions in telephoto image data, wherein the telephoto image data has a second angle of view narrower than the value;

obtain a telephoto-side white balance gain for the telephoto image data based on a wide-angle-side integration ratio, wherein the wide-angle-side integration ratio is a ratio of respective integration values of the plurality of wide-angle-side color components and the plurality of telephoto-side color components;

set a telephoto-side integration range that includes the wide-angle-side integration ratio;

calculate the telephoto-side white balance gain based on a telephoto-side integration ratio, wherein the telephoto-side integration ratio is a ratio of respective integration values of the plurality of telephoto-side color components within the telephoto-side integration range; and

correct the telephoto image data based on the telephoto-side white balance gain.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 27, 2019
From: MIYAMOTO, TAKAYOSHI
To: SONY SEMICONDUCTOR SOLUTIONS CORPORATION
Reel/Frame 050193/0420 →
Priority Claims (1)
JP 2017-067104 · Mar 30, 2017 · national
Continuity (1)
Related Publication 20200014899A1 · Jan 9, 2020