IP Library Granted Patent US 10,897,578
Granted Patent B2
US 10,897,578 · App. 16/225,410 · Granted Jan 19, 2021

Exposure ratio control

Inventors: Maxim Novikov (Loughborough, GB); Alexey Kornienko (Loughborough, GB); Alexis Leonardo Lluis Gomez (Castle Donnington, GB)
Assignee: Apical Limited
H04N5/2353G06K9/4642H04N5/2351H04N5/2355H04N5/2356H04N5/357H04N5/361
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,897,578
App. No.
16/225,410
Granted
Jan 19, 2021
Kind
B2
Abstract

A method of determining an exposure ratio for use with a multi-exposure image capture system operable to capture a first image of a scene with a first exposure and a second image of the scene with a second exposure shorter than the first exposure. The exposure ratio is a ratio of the first exposure to the second exposure. The method comprises obtaining image data representative of an image captured using an image sensor of the image capture system and setting the exposure ratio in dependence on a distribution of counts relating to values of a characteristic of respective pixels of the image and a weighting function which varies with the values of the characteristic.

Claims (48)

1. A method of determining an exposure ratio for use with a multi-exposure image capture system operable to capture a first image of a scene with a first exposure and a second image of the scene with a second exposure shorter than the first exposure, the exposure ratio being a ratio of the first exposure to the second exposure, the method comprising:

obtaining image data representative of an image captured using an image sensor of the image capture system;

inputting distribution data derived from a distribution of counts relating to values of a characteristic of respective pixels of the image to an optimization function, each of a plurality of output values of the optimization function dependent on a respective one of a plurality of input exposure ratios input to the optimization function, wherein the optimization function is based on a weighting function which varies with the values of the characteristic; and

setting the exposure ratio by selecting the exposure ratio from the plurality of input exposure ratios based on the plurality of output values of the optimization function.

2. The method according to claim 1 , wherein the weighting function corresponds to a noise profile of the image sensor.

3. The method according to claim 1 , wherein the weighting function is approximately proportional to a square root of the value of the characteristic.

4. The method according to claim 1 , comprising selecting the exposure ratio from the plurality of plurality of input exposure ratios that corresponds to an optimum output value of the plurality of output values.

5. The method according to claim 1 , wherein the optimization function comprises a weighted signal to noise ratio (WSNR) function.

6. The method according to claim 5 , wherein the WSNR function comprises a logarithmic function.

7. The method according to claim 5 , comprising:

calculating a WSNR value for the image using the WSNR function; and

processing the WSNR value with an exposure ratio factor dependent on the input exposure ratio to obtain the output value of the optimization function.

8. The method according to claim 5 , comprising:

dividing the distribution of counts into a plurality of regions, each of the plurality of regions associated with a different respective range of values of the characteristic;

calculating a plurality of regional WSNR values of the WSNR function, each one of the plurality of regional WSNR values corresponding to a respective region of the plurality of regions and based on the distribution data for pixels within the respective region; and

combining the plurality of regional WSNR values to obtain the output value.

9. The method according to claim 8 , wherein at least one of the plurality of regional WSNR values depends on the input exposure ratio.

10. The method according to claim 5 , comprising:

calculating a WSNR value for the image using the WSNR function;

dividing the distribution of counts into a plurality of regions, each of the plurality of regions associated with a respective regional factor and a different respective range of values of the characteristic;

obtaining a plurality of regional WSNR values each corresponding to the WSNR value processed with a respective one of the regional factors; and

combining the plurality of regional WSNR values to obtain the output value of the optimization function.

11. The method according to claim 1 , wherein:

the exposure ratio is a first exposure ratio;

the multi-exposure image capture system is operable to capture a third image of a scene with a third exposure longer than the second exposure and shorter than the first exposure; and

the method comprises setting a second exposure ratio of the third exposure to the second exposure in dependence on the first exposure ratio.

12. The method according to claim 11 , comprising setting the second exposure ratio to a value proportional to a square root of the first exposure ratio.

13. The method according to claim 1 , wherein the characteristic is a pixel intensity of the respective pixels of the image.

14. The method according to claim 1 , wherein the image is captured using the image sensor with the second exposure.

15. An exposure controller for controlling an exposure ratio for use with a multi-exposure image capture system operable to capture a first image of a scene with a first exposure and a second image of the scene with a second exposure shorter than the first exposure, the exposure ratio being a ratio of the first exposure to the second exposure, the exposure controller operable to:

obtain image data representative of an image captured using an image sensor of the image capture system;

input distribution data derived from the distribution of counts relating to values of a characteristic of respective pixels of the image to an optimization function, an output value of the optimization function dependent on an input exposure ratio input to the optimization function, wherein the optimization function is based on a weighting function which varies with the values of the characteristic and the optimization function comprises a weighted signal to noise ratio (WSNR) function; and

set the exposure ratio in dependence on the output value.

16. The exposure controller according to claim 15 , wherein the weighting function corresponds to a noise profile of the image sensor.

17. The exposure controller according to claim 15 , wherein the exposure controller is configured to:

calculate a WSNR value for the image using the WSNR function; and

process the WSNR value with an exposure ratio factor dependent on the input exposure ratio to obtain the output value of the optimization function.

18. The exposure controller according to claim 15 , wherein the exposure controller is configured to:

divide the distribution of counts into a plurality of regions, each of the plurality of regions associated with a different respective range of values of the characteristic;

calculate a plurality of regional WSNR values of the WSNR function, each one of the plurality of regional WSNR values corresponding to a respective region of the plurality of regions and based on the distribution data for pixels within the respective region; and

combine the plurality of regional WSNR values to obtain the output value.

19. A method of determining an exposure ratio for use with a multi-exposure image capture system operable to capture a first image of a scene with a first exposure and a second image of the scene with a second exposure shorter than the first exposure, the exposure ratio being a ratio of the first exposure to the second exposure, the method comprising:

obtaining image data representative of an image captured using an image sensor of the image capture system; and

setting the exposure ratio in dependence on a distribution of counts relating to values of a characteristic of respective pixels of the image and a weighting function which varies with the values of the characteristic, wherein:

the exposure ratio is a first exposure ratio;

the multi-exposure image capture system is operable to capture a third image of a scene with a third exposure longer than the second exposure and shorter than the first exposure; and

the method comprises setting a second exposure ratio of the third exposure to the second exposure in dependence on the first exposure ratio.

20. The method according to claim 19 , comprising setting the second exposure ratio to a value proportional to a square root of the first exposure ratio.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 23, 2022
From: APICAL LIMITED
To: ARM LIMITED
Reel/Frame 061300/0471 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 19, 2018
From: NOVIKOV, MAXIM; KORNIENKO, ALEXEY; GOMEZ, ALEXIS LEONARDO LLUIS
To: APICAL LTD
Reel/Frame 047817/0536 →
Priority Claims (1)
GB 1721498.2 · Dec 20, 2017 · national
Continuity (1)
Related Publication 20190191068A1 · Jun 20, 2019