IP Library Granted Patent US 10,999,526
Granted Patent B2
US 10,999,526 · App. 16/708,251 · Granted May 4, 2021

Image acquisition method and apparatus

Inventors: Ruxandra Vranceanu (Bucharest, RO); Razvan G. Condorovici (Bucharest, RO)
Assignee: FotoNation Limited
H04N5/2355G06T5/20G06T5/40H04N5/2351H04N5/2354G06T2207/10016G06T2207/20208
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,999,526
App. No.
16/708,251
Granted
May 4, 2021
Kind
B2
Abstract

A system includes an image sensor, an adjustable aperture, and a memory. THE memory includes computer executable instructions that, when executed by a processor, cause the system to perform operations including obtaining a first image via the image sensor based at least in part on a first aperture stop of the adjustable aperture, identifying a first pixel of the first image, identifying a second pixel of the first image, determining a second aperture stop of the adjustable aperture based at least in part on the first pixel, determining a third aperture stop of the adjustable aperture based at least in part on the second pixel, obtaining a second image via the image sensor based at least in part on the second aperture stop, and obtaining a third image via the image sensor based at least in part on the third aperture stop.

Claims (74)

1. A system comprising:

an image sensor;

an adjustable aperture;

memory comprising computer executable instructions that, when executed by a processor, cause the system to perform operations comprising:

obtaining a first image via the image sensor based at least in part on a first aperture stop of the adjustable aperture;

determining a second aperture stop of the adjustable aperture based at least in part on a first pixel of the first image and a light thresholding curve;

determining a third aperture stop of the adjustable aperture based at least in part on a second pixel of the first image and a dark thresholding curve;

obtaining a second image via the image sensor based at least in part on the second aperture stop; and

obtaining a third image via the image sensor based at least in part on the third aperture stop.

2. The system of claim 1 , wherein the operations further comprise combining at least two of the first image, the second image, or the third image to generate a high-dynamic-range (HDR) image.

3. The system of claim 1 , wherein:

the light thresholding curve is zero valued below a relatively high corner intensity value (LT) and increases in value towards 1 at an upper threshold; and

the dark thresholding curve is zero valued above a relatively low corner intensity value (DT) and increases in value towards 1 at a lower threshold.

4. The system of claim 3 , wherein:

the light thresholding curve is based at least in part on a high pass filter, and

the dark thresholding curve is based at least in part on a low pass filter.

5. The system of claim 4 , wherein:

a first corner frequency of the low pass filter is less than twenty percent of the upper threshold associated with the first pixel; and

a second corner frequency of the high pass filter is more than seventy-eight percent of the upper threshold.

6. The system of claim 1 , wherein determining the second aperture stop of the adjustable aperture includes:

filtering a histogram associated with the first image based at least in part on the light thresholding curve to obtain a first filtered histogram; and

determining an extent of light areas within the first image.

7. The system of claim 6 , wherein determining the third aperture stop of the adjustable aperture includes:

filtering the histogram associated with the first image based at least in part on the dark thresholding curve to obtain a second filtered histogram; and

determining an extent of dark areas within the first image.

8. The system of claim 7 , wherein the operations further comprise:

multiplying the extent of the dark areas (darkPrc) within the first image by a first weight to generate a scaled darkPrc;

multiplying the extent of light areas (lightPrc) by a second weight to generate a scaled lightPrc; and

storing the scaled darkPrc and the scaled lightPrc in a look-up table in the memory.

9. A method comprising:

obtaining a first image via an image sensor based at least in part on a first aperture stop of an adjustable aperture;

determining a second aperture stop of the adjustable aperture based at least in part on a first pixel of the first image and a light thresholding curve; and

determining a third aperture stop of the adjustable aperture based at least in part on a second pixel of the first image and a dark thresholding curve;

obtaining a second image via the image sensor based at least in part on the second aperture stop;

obtaining a third image via the image sensor based at least in part on the third aperture stop; and

combining at least the second image and the third image to generate a high-dynamic-range (HDR) image.

10. The method of claim 9 , wherein:

the light thresholding curve is based at least in part on a high pass filter,

the dark thresholding curve is based at least in part on a low pass filter,

a first corner frequency of the low pass filter is less than twenty percent of an upper threshold indicatable by an intensity value associated with the first pixel, and

a second corner frequency of the high pass filter is more than seventy-eight percent of the upper threshold.

11. The method of claim 10 , wherein determining the second aperture stop of the adjustable aperture includes:

filtering a histogram associated with the first image based at least in part on the light thresholding curve to obtain a first filtered histogram; and

determining an extent of light areas within the first image.

12. The method of claim 11 , wherein determining the third aperture stop of the adjustable aperture includes:

filtering the histogram associated with the first image based at least in part on the dark thresholding curve to obtain a second filtered histogram; and

determining an extent of dark areas within the first image.

13. The method of claim 12 , further including:

multiplying the extent of the dark areas (darkPrc) within the first image by a first weight to generate a first scaled darkPrc;

multiplying the extent of the light areas (lightPrc) within the first image by a second weight to generate a second scaled lightPrc; and

storing the first scaled darkPrc and the second scaled lightPrc in a look-up table in memory.

14. A non-transitory computer readable medium comprising computer executable instructions, which instructions, when executed by one or more processors, cause the one or more processors to:

obtain a first image based at least in part on a first aperture stop of an adjustable aperture;

determine a second aperture stop of the adjustable aperture based at least in part on a first pixel of the first image and a light thresholding curve;

determine a third aperture stop of the adjustable aperture based at least in part on a second pixel of the first image and a dark thresholding curve;

obtain a second image based at least in part on the second aperture stop; and

obtain a third image based at least in part on the third aperture stop.

15. The non-transitory computer readable medium of claim 14 , wherein the computer executable instructions, when executed by the one or more processors, cause the one or more processors to combine at least the second image and the third image to generate a high-dynamic-range (HDR) image.

16. The non-transitory computer readable medium of claim 15 , wherein:

the light thresholding curve is based at least in part on a high pass filter;

the dark thresholding curve is based at least in part on a low pass filter,

a first corner frequency of the low pass filter is less than twenty percent of a upper threshold indicatable by an intensity value associated with the first pixel, and

a second corner frequency of the high pass filter is more than seventy-eight percent of the upper threshold.

17. The non-transitory computer readable medium of claim 16 , wherein:

determining the second aperture stop of the adjustable aperture includes:

filtering a histogram associated with the first image based at least in part on the light thresholding curve to obtain a first filtered histogram; an

determining an extent of light areas within the first image; and

determining the third aperture stop of the adjustable aperture includes:

filtering the histogram associated with the first image based at least in part on the dark thresholding curve to obtain a second filtered histogram; and

determining an extent of dark areas within the first image.

18. The non-transitory computer readable medium of claim 17 , further including:

multiplying the extent of the dark areas (darkPrc) within the first image by a first weight to generate a scaled darkPrc;

multiplying the extent of the light areas (lightPrc) within the first image by a second weight to generate a scaled lightPrc; and

storing the scaled darkPrc and the scaled lightPrc in a look-up table in memory.

Assignments (6)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 12, 2025
From: TOBII TECHNOLOGIES LTD
To: ADEIA MEDIA HOLDINGS LLC
Reel/Frame 071572/0855 →
CONVERSION Recorded Jun 12, 2025
From: ADEIA MEDIA HOLDINGS LLC
To: ADEIA MEDIA HOLDINGS INC.
Reel/Frame 071577/0875 →
SECURITY INTEREST Recorded May 28, 2025
From: ADEIA INC. (F/K/A XPERI HOLDING CORPORATION); ADEIA HOLDINGS INC.; ADEIA MEDIA HOLDINGS INC.; ADEIA IMAGING LLC; ADEIA MEDIA LLC; ADEIA MEDIA SOLUTIONS INC.; ADEIA SEMICONDUCTOR BONDING TECHNOLOGIES INC.; ADEIA TECHNOLOGIES INC.; ADEIA GUIDES INC.; ADEIA SOLUTIONS LLC; ADEIA SEMICONDUCTOR ADVANCED TECHNOLOGIES INC.; ADEIA SEMICONDUCTOR SOLUTIONS LLC; ADEIA SEMICONDUCTOR INTELLECTUAL PROPERTY LLC; ADEIA SEMICONDUCTOR TECHNOLOGIES LLC; ADEIA PUBLISHING INC.
To: BANK OF AMERICA, N.A., AS COLLATERAL AGENT
Reel/Frame 071454/0343 →
CHANGE OF NAME Recorded Mar 31, 2025
From: FOTONATION LIMITED
To: TOBII TECHNOLOGIES LIMITED
Reel/Frame 070682/0207 →
CHANGE OF NAME Recorded Feb 17, 2025
From: FOTONATION LIMITED
To: TOBII TECHNOLOGY LIMITED
Reel/Frame 070238/0774 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 9, 2019
From: VRANCEANU, RUXANDRA; CONDOROVICI, RAZVAN G.
To: FOTONATION LIMITED
Reel/Frame 051222/0449 →