IP Library Granted Patent US 10,511,786
Granted Patent B2
US 10,511,786 · App. 16/102,510 · Granted Dec 17, 2019

Image acquisition method and apparatus

Inventors: Ruxandra Vranceanu (Bucharest, RO); Razvan G. Condorovici (Bucharest, RO)
Assignee: FotoNation Limited
H04N5/2355G06T5/20G06T5/40H04N5/2351H04N5/2354G06T2207/10016G06T2207/20208
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,511,786
App. No.
16/102,510
Granted
Dec 17, 2019
Kind
B2
Abstract

An image acquisition method operates in a hand held image acquisition device with a camera. A first image of a scene is obtained with the camera at a nominal exposure level. A number of relatively bright pixels and a number of relatively dark pixels within the first image are determined. Based on the number of relatively bright pixels, a negative exposure adjustment is determined and based on the number of relatively dark pixels, a positive exposure adjustment is determined. Respective images are acquired at the nominal exposure level; with the negative exposure adjustment; and with the positive exposure adjustment as component images for high dynamic range (HDR) image of the scene.

Claims (91)

1. A system comprising:

one or more processors;

an image sensor;

memory comprising computer executable instructions that, when executed by the one or more processors, cause the system to perform operations comprising:

obtaining a first image via the image sensor based at least in part on a first exposure level;

identifying a first set of pixels of the first image based at least in part on a light thresholding curve and first intensities associated with the first set of pixels;

identifying a second set of pixels of the first image based at least in part on a dark threshold curve and second intensities associated with the second set of pixels;

determining an underexposure adjustment level based at least in part on the first set of pixels;

determining an overexposure adjustment level based at least in part on the second set of pixels;

obtaining, via the image sensor, a second image based at least in part on the underexposure adjustment level; and

obtaining, via the image sensor, a third image based at least in part on the overexposure adjustment level.

2. The system of claim 1 , wherein obtaining the first image comprises:

obtaining an image via the image sensor; and

sub-sampling the image to obtain the first image.

3. The system of claim 1 , wherein determining the underexposure adjustment level comprises:

obtaining a fourth image via the image sensor based at least in part on the first exposure level and the underexposure adjustment level;

sub-sampling the fourth image; and

modifying, based at least in part on the first set of pixels, the underexposure adjustment level.

4. The system of claim 1 , wherein determining the overexposure adjustment level comprises:

obtaining a fourth image via the image sensor based at least in part on the first exposure level and the overexposure adjustment level;

sub-sampling the fourth image; and

modifying, based at least in part on the second set of pixels, the overexposure adjustment level.

5. The system of claim 1 , wherein:

determining the underexposure adjustment level comprises:

filtering a histogram associated with the first image based at least in part on the light thresholding curve to obtain a first filtered histogram,

and integrating the first filtered histogram;

determining the overexposure adjustment level comprises:

filtering the histogram associated with the first image based at least in part on the dark thresholding curve to obtain a second filtered histogram, and

integrating the second filtered histogram; and

the histogram comprises luminance values associated with pixels of the first image.

6. The system of claim 1 , wherein the operations further comprise generating a high dynamic range (HDR) image based at least in part on the second image and the third image.

7. The system of claim 1 , wherein the light thresholding curve is based at least in part on a high pass filter and the dark thresholding curve comprises is based at least in part on a low pass filter.

8. The system of claim 7 , wherein:

a first corner frequency of the low pass filter is less than twenty percent of a maximum intensity indicatable by an intensity value associated with a pixel; and

a second corner frequency of the high pass filter is more than seventy-eight percent of the maximum intensity.

9. A method comprising:

obtaining a first image via an image sensor based at least in part on a first exposure level;

identifying a first set of pixels of the first image based at least in part on a high pass filter and first intensities associated with the first set of pixels;

identifying a second set of pixels of the first image based at least in part on a low pass filter and second intensities associated with the second set of pixels;

determining an underexposure adjustment level based at least in part on the first set of pixels;

determining an overexposure adjustment level based at least in part on the second set of pixels;

obtaining, via the image sensor, a second image based at least in part on the underexposure adjustment level; and

obtaining, via the image sensor, a third image based at least in part on the overexposure adjustment level.

10. The method of claim 9 , wherein determining the underexposure adjustment level comprises:

obtaining a fourth image via the image sensor based at least in part on the first exposure level and the underexposure adjustment level;

sub-sampling the fourth image; and

modifying, based at least in part on the first set of pixels, the underexposure adjustment level.

11. The method of claim 9 , wherein determining the overexposure adjustment level comprises:

obtaining a fourth image via the image sensor based at least in part on the first exposure level and the overexposure adjustment level;

sub-sampling the fourth image; and

modifying, based at least in part on the second set of pixels, the overexposure adjustment level.

12. The method of claim 9 , wherein:

determining the underexposure adjustment level comprises:

filtering a histogram associated with the first image based at least in part on the light thresholding curve to obtain a first filtered histogram, and

integrating the first filtered histogram;

determining the overexposure adjustment level comprises:

filtering the histogram associated with the first image based at least in part on the dark thresholding curve to obtain a second filtered histogram, and

integrating the second filtered histogram; and

the histogram comprises luminance values associated with pixels of the first image.

13. The method of claim 9 , further comprising generating a high dynamic range (HDR) image based at least in part on the second image and the third image.

14. The method of claim 9 , wherein:

a first corner frequency of the low pass filter is less than twenty percent of a maximum intensity indicatable by an intensity value associated with a pixel; and

a second corner frequency of the high pass filter is more than seventy-eight percent of the maximum intensity.

15. A non-transitory computer-readable medium comprising processor-executable instructions that, when executed by one or more processors, cause the one or more processors to perform operations comprising:

obtaining a first image via an image sensor based at least in part on a first exposure level;

identifying a first set of pixels of the first image based at least in part on a high pass filter and first intensities associated with the first set of pixels;

identifying a second set of pixels of the first image based at least in part on a low pass filter and second intensities associated with the second set of pixels;

determining an underexposure adjustment level based at least in part on the first set of pixels;

determining an overexposure adjustment level based at least in part on the second set of pixels;

obtaining, via the image sensor, a second image based at least in part on the underexposure adjustment level; and

obtaining, via the image sensor, a third image based at least in part on the overexposure adjustment level.

16. The non-transitory computer-readable medium of claim 15 , wherein determining the underexposure adjustment level comprises:

obtaining a fourth image via the image sensor based at least in part on the first exposure level and the underexposure adjustment level;

sub-sampling the fourth image; and

modifying, based at least in part on the first set of pixels, the underexposure adjustment level.

17. The non-transitory computer-readable medium of claim 15 , wherein determining the overexposure adjustment level comprises:

obtaining a fourth image via the image sensor based at least in part on the first exposure level and the overexposure adjustment level;

sub-sampling the fourth image; and

modifying, based at least in part on the second set of pixels, the overexposure adjustment level.

18. The non-transitory computer-readable medium of claim 15 , wherein:

determining the underexposure adjustment level comprises:

filtering a histogram associated with the first image based at least in part on the light thresholding curve to obtain a first filtered histogram, and

integrating the first filtered histogram;

determining the overexposure adjustment level comprises:

filtering the histogram associated with the first image based at least in part on the dark thresholding curve to obtain a second filtered histogram, and

integrating the second filtered histogram; and

the histogram comprises luminance values associated with pixels of the first image.

19. The non-transitory computer-readable medium of claim 15 , further comprising generating a high dynamic range (HDR) image based at least in part on the second image and the third image.

20. The non-transitory computer-readable medium of claim 15 , wherein:

a first corner frequency of the low pass filter is less than twenty percent of a maximum intensity indicatable by an intensity value associated with a pixel; and

a second corner frequency of the high pass filter is more than seventy-eight percent of the maximum intensity.

Assignments (3)
SECURITY INTEREST Recorded May 28, 2025
From: ADEIA INC. (F/K/A XPERI HOLDING CORPORATION); ADEIA HOLDINGS INC.; ADEIA MEDIA HOLDINGS INC.; ADEIA IMAGING LLC; ADEIA MEDIA LLC; ADEIA MEDIA SOLUTIONS INC.; ADEIA SEMICONDUCTOR BONDING TECHNOLOGIES INC.; ADEIA TECHNOLOGIES INC.; ADEIA GUIDES INC.; ADEIA SOLUTIONS LLC; ADEIA SEMICONDUCTOR ADVANCED TECHNOLOGIES INC.; ADEIA SEMICONDUCTOR SOLUTIONS LLC; ADEIA SEMICONDUCTOR INTELLECTUAL PROPERTY LLC; ADEIA SEMICONDUCTOR TECHNOLOGIES LLC; ADEIA PUBLISHING INC.
To: BANK OF AMERICA, N.A., AS COLLATERAL AGENT
Reel/Frame 071454/0343 →
CHANGE OF NAME Recorded Mar 31, 2025
From: FOTONATION LIMITED
To: TOBII TECHNOLOGIES LIMITED
Reel/Frame 070682/0207 →
CHANGE OF NAME Recorded Feb 17, 2025
From: FOTONATION LIMITED
To: TOBII TECHNOLOGY LIMITED
Reel/Frame 070238/0774 →
Priority Claims (1)
WO PCT/EP2016/057317 · Apr 4, 2016 · international
Continuity (3)
Continuation 15099057 · Apr 14, 2016
Provisional Application 62147464 · Apr 14, 2015
Related Publication 20190045105A1 · Feb 7, 2019