IP Library Granted Patent US 9,154,708
Granted Patent B1
US 9,154,708 · App. 14/535,274 · Granted Oct 6, 2015

Image sensor apparatus and method for simultaneously capturing flash and ambient illuminated images

View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,154,708
App. No.
14/535,274
Granted
Oct 6, 2015
Kind
B1
Abstract

A system, method, and computer program product are provided for simultaneously capturing flash and ambient illuminated images. In use, an ambient sample is stored based on an electrical signal from a photodiode of an image sensor. Also, a flash sample is stored based on the electrical signal from the photodiode of the image sensor. Further, a first value is output based on the ambient sample, and a second value is output based on the flash sample, for generating at least one image. Finally, at least one of the first value and the second value is amplified utilizing two or more gains.

Claims (66)

1. An apparatus, comprising:

circuitry for:

storing an ambient sample based on an electrical signal from a photodiode of an image sensor, wherein the electrical signal includes a photodiode current received from the photodiode of the image sensor;

storing a flash sample based on the electrical signal from the photodiode of the image sensor;

outputting a first value based on the ambient sample, and a second value based on the flash sample, for generating at least one image, wherein the first value is output in an ambient analog signal, and the second value is output in a flash analog signal; and

amplifying at least one of the first value and the second value utilizing two or more gains, wherein the amplification of the at least one of the first value and the second value utilizing the two or more gains includes amplifying at least one of the ambient analog signal and flash analog signal utilizing the two or more gains;

wherein the apparatus is operable such that the ambient analog signal is amplified utilizing the two or more gains to generate a first amplified ambient analog signal and a second amplified ambient analog signal;

wherein the apparatus is operable such that the first amplified ambient analog signal is converted to a first ambient digital signal with a first light sensitivity, and the second amplified ambient analog signal is converted to a second ambient digital signal with a second light sensitivity;

wherein the apparatus is operable such that:

the first ambient digital signal is blended with the second ambient digital signal, resulting in a blended ambient digital signal with a blended ambient light sensitivity;

the flash analog signal is amplified utilizing at least one gain to generate at least one amplified flash analog signal;

the at least one amplified flash analog signal is converted to at least one flash digital signal; and

the blended ambient digital signal is blended with the at least one flash digital signal, in response to user input.

2. The apparatus of claim 1 , wherein the apparatus is operable such that the first ambient digital signal is blended with the second ambient digital signal, in response to user input.

3. The apparatus of claim 2 , wherein the apparatus is operable such that sliding indicia is displayed and the user input includes manipulation of the sliding indicia.

4. The apparatus of claim 1 , wherein the apparatus is operable such that:

the flash analog signal is amplified utilizing another two or more gains to generate two or more amplified flash analog signals;

the two or more amplified flash analog signals are converted to two or more flash digital signals; and

the two or more flash digital signals are blended to generated a blended flash digital signal with a blended flash light sensitivity; and

the blended flash digital signal is blended with the blended ambient digital signal.

5. The apparatus of claim 1 , wherein the apparatus is operable such that the flash analog signal is amplified utilizing the another two or more gains to generate a first amplified flash analog signal and a second amplified flash analog signal.

6. The apparatus of claim 5 , wherein the apparatus is operable such that the first amplified flash analog signal is converted to a first flash digital signal with a first light sensitivity, and the second amplified flash analog signal is converted to a second flash digital signal with a second light sensitivity.

7. The apparatus of claim 6 , wherein the apparatus is operable such that the first flash digital signal is blended with the second flash digital signal, in response to user input.

8. The apparatus of claim 7 , wherein the apparatus is operable such that sliding indicia is displayed and the user input includes manipulation of the sliding indicia.

9. The apparatus of claim 6 , wherein the apparatus is operable such that:

the first flash digital signal is blended with the second flash digital signal, resulting in a blended flash digital signal with a blended flash light sensitivity, and

the blended ambient digital signal is blended with the blended flash digital signal.

10. The apparatus of claim 9 , wherein the two or more gains comprises same gains as the other two or more gains, and each gain of the two or more gains and the other two or more gains is associated with a different light sensitivity value.

11. An apparatus, comprising:

circuitry for:

storing an ambient sample based on an electrical signal from a photodiode of an image sensor, wherein the electrical signal includes a photodiode current received from the photodiode of the image sensor;

storing a flash sample based on the electrical signal from the photodiode of the image sensor;

outputting a first value based on the ambient sample, and a second value based on the flash sample, for generating at least one image, wherein the first value is output in an ambient analog signal, and the second value is output in a flash analog signal; and

amplifying at least one of the first value and the second value utilizing two or more gains, wherein the amplification of the at least one of the first value and the second value utilizing the two or more gains includes amplifying at least one of the ambient analog signal and flash analog signal utilizing the two or more gains;

wherein the apparatus is operable such that the ambient analog signal is amplified utilizing the two or more gains to generate a first amplified ambient analog signal and a second amplified ambient analog signal;

wherein the apparatus is operable such that the first amplified ambient analog signal is converted to a first ambient digital signal with a first light sensitivity, and the second amplified ambient analog signal is converted to a second ambient digital signal with a second light sensitivity;

wherein the apparatus is operable such that:

the first ambient digital signal and the second ambient digital signal are transferred over a network for being combined remotely, resulting in at least a portion of a high dynamic range (HDR) image;

the flash analog signal is amplified utilizing at least one gain to generate at least one amplified flash analog signal;

the at least one amplified flash analog signal is converted to at least one flash digital signal; and

the remotely combined ambient digital signal is blended with the at least one flash digital signal, in response to user input.

12. A computer program product embodied on a non-transitory computer readable medium, comprising:

code for storing an ambient sample based on an electrical signal from a photodiode of an image sensor, wherein the electrical signal includes a photodiode current received from the photodiode of the image sensor;

code for storing a flash sample based on the electrical signal from the photodiode of the image sensor, and

code for outputting a first value based on the ambient sample, and a second value based on the flash sample, for generating at least one image, wherein the first value is output in an ambient analog signal, and the second value is output in a flash analog signal;

code for amplifying at least one of the first value and the second value utilizing two or more gains, wherein the amplification of the at least one of the first value and the second value utilizing the two or more gains includes amplifying at least one of the ambient analog signal and the flash analog signal utilizing the two or more gains;

wherein the computer program product is operable such that the ambient analog signal is amplified utilizing the two or more gains to generate a first amplified ambient analog signal and a second amplified ambient analog signal;

wherein the computer program product is operable such that the first amplified ambient analog signal is converted to a first ambient digital signal with a first light sensitivity, and the second amplified ambient analog signal is converted to a second ambient digital signal with a second light sensitivity;

wherein the computer program product is operable such that:

the first ambient digital signal is blended with the second ambient digital signal, resulting in a blended ambient digital signal with a blended ambient light sensitivity;

the flash analog signal is amplified utilizing at least one gain to generate at least one amplified flash analog signal;

the at least one amplified flash analog signal is converted to at least one flash digital signal; and

the blended ambient digital signal is blended with the at least one flash digital signal, in response to user input.

13. A method, comprising:

storing an ambient sample based on an electrical signal from a photodiode of an image sensor, wherein the electrical signal includes a photodiode current received from the photodiode of the image sensor;

storing a flash sample based on the electrical signal from the photodiode of the image sensor;

outputting a first value based on the ambient sample, and a second value based on the flash sample, for generating at least one image, wherein the first value is output in an ambient analog signal, and the second value is output in a flash analog signal; and

amplifying at least one of the first value and the second value utilizing two or more gains, wherein the amplification of the at least one of the first value and the second value utilizing the two or more gains includes amplifying at least one of the ambient analog signal and the flash analog signal utilizing the two or more gains;

wherein the ambient analog signal is amplified utilizing the two or more gains to generate a first amplified ambient analog signal and a second amplified ambient analog signal;

wherein the first amplified ambient analog signal is converted to a first ambient digital signal with a first light sensitivity, and the second amplified ambient analog signal is converted to a second ambient digital signal with a second light sensitivity;

wherein:

the first ambient digital signal is blended with the second ambient digital signal, resulting in a blended ambient digital signal with a blended ambient light sensitivity;

the flash analog signal is amplified utilizing at least one gain to generate at least one amplified flash analog signal;

the at least one amplified flash analog signal is converted to at least one flash digital signal; and

the blended ambient digital signal is blended with the at least one flash digital signal, in response to user input.

14. The apparatus of claim 1 , wherein the apparatus is operable such that the blended ambient digital signal with a blended ambient light sensitivity is a HDR image.

Assignments (2)
SECURITY INTEREST Recorded Jul 30, 2021
From: DUELIGHT, LLC
To: ZILKA KOTAB, P.C.
Reel/Frame 057043/0301 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 26, 2015
From: RIVARD, WILLIAM; FEDER, ADAM; KINDLE, BRIAN
To: DUELIGHT LLC
Reel/Frame 035715/0071 →