IP Library Granted Patent US 10,652,478
Granted Patent B2
US 10,652,478 · App. 16/519,244 · Granted May 12, 2020

Image sensor apparatus and method for obtaining multiple exposures with zero interframe time

Inventors: William Rivard (Menlo Park, CA); Adam Feder (Mountain View, CA); Brian Kindle (Sunnyvale, CA)
Assignee: DUELIGHT LLC
H04N5/2355G06T5/50H04N5/2352H04N5/23254H04N5/243G06T2207/20208G06T2207/20221
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,652,478
App. No.
16/519,244
Granted
May 12, 2020
Kind
B2
Abstract

A system, method, and computer program product are provided for obtaining multiple exposures with zero interframe time. In use, an analog signal associated with an image associated with an image of an image sensor is received. Amplified analog signals associated with the image are generated by amplifying the analog signal utilizing gains. The amplified analog signals are transmitted to analog-to-digital converter circuits. The amplified analog signals are converted to digital signals utilizing the analog-to-digital converter circuits. The digital signals are combined to create a high dynamic range (HDR) image.

Claims (58)

1. An apparatus, comprising:

circuitry for:

receiving an analog signal associated with an image of an image sensor;

generating a first amplified analog signal associated with the image by amplifying the analog signal utilizing a first gain, wherein the first gain is applied to analog pixel values;

transmitting the first amplified analog signal to a first analog-to-digital converter circuit;

converting the first amplified analog signal to a first digital signal utilizing the first analog-to-digital converter circuit;

generating a second amplified analog signal associated with the image by amplifying the analog signal utilizing a second gain, wherein the second gain is applied to the analog pixel values;

transmitting the second amplified analog signal to a second analog-to-digital converter circuit;

converting the second amplified analog signal to a second digital signal utilizing the second analog-to-digital converter circuit;

generating a third amplified analog signal associated with the image by amplifying the analog signal utilizing a third gain, wherein the third gain is applied to the analog pixel values;

transmitting the third amplified analog signal to a third analog-to-digital converter circuit;

converting the third amplified analog signal to a third digital signal utilizing the third analog-to-digital converter circuit; and

causing the first digital signal, the second digital signal, and the third digital signal to be combined to create a high dynamic range (HDR) image.

2. The apparatus of claim 1 , wherein the apparatus is operable such that the analog signal is amplified utilizing the first gain simultaneously with at least one of the amplification of the analog signal utilizing the second gain or the amplification of the analog signal utilizing the third gain.

3. The apparatus of claim 1 , wherein the apparatus is operable such that the analog signal is amplified utilizing the first gain in serial with at least one of the amplification of the analog signal utilizing the second gain or the amplification of the analog signal utilizing the third gain.

4. The apparatus of claim 1 , wherein the first amplified analog signal is converted to the first digital signal concurrent with the conversion of at least one of the second amplified analog signal to the second digital signal or the third amplified analog signal to the third digital signal.

5. The apparatus of claim 1 , wherein the apparatus is operable such that the first digital signal is associated with a first light sensitivity value, the second digital signal is associated with a second light sensitivity value, and the third digital signal is associated with a third light sensitivity value.

6. The apparatus of claim 1 , wherein the apparatus is operable such that the HDR image is created in response to user input.

7. The apparatus of claim 1 , wherein the apparatus is operable such that sliding indicia is displayed, and the HDR image is created in response to the sliding indicia being manipulated by a user.

8. The apparatus of claim 1 , wherein the apparatus is operable such that at least one of the first digital signal, the second digital signal, or the third digital signal is further combined with at least a portion of another image.

9. The apparatus of claim 8 , wherein the apparatus is operable such that the another image is a second high dynamic range (HDR) image.

10. The apparatus of claim 1 , wherein a first digital value specifies the first gain, a second digital value specifies the second gain, and a third digital value specifies the third gain.

11. The apparatus of claim 10 , wherein at least one of the first digital value, the second digital value, or the third digital value is selected based on a mapping from the at least one of the first digital value, the second digital value, or the third digital value to an ISO value, and the ISO value is selected by at least one of software executing on the apparatus and a user.

12. The apparatus of claim 1 , wherein the first amplified analog signal, the second amplified analog signal, and the third amplified analog signal each include gain-adjusted analog pixel data representative of a common analog value from the analog pixel values of a pixel array of the image sensor.

13. The apparatus of claim 1 , wherein the apparatus is operable for transferring at least one of the first digital signal, the second digital signal, or the third digital signal over a network.

14. The apparatus of claim 1 , wherein the combining occurs remotely.

15. The apparatus of claim 14 , wherein the apparatus is operable for receiving at least a portion of the HDR image resulting from the combining.

16. The apparatus of claim 1 , wherein the second gain is based, at least in part, on the first gain and the second gain is at least one of a half stop, one stop, or two stops away from the first gain.

17. The apparatus of claim 1 , further comprising circuitry for:

generating a fourth amplified analog signal associated with the image by amplifying the analog signal utilizing a fourth gain, wherein the fourth gain is applied to the analog pixel values; and

transmitting the fourth amplified analog signal to a fourth analog-to-digital convert circuit;

converting the fourth amplified analog signal to a fourth digital signal utilizing the fourth analog-to-digital converter circuit;

combining at least a portion of the fourth digital signal and the HDR image.

18. The apparatus of claim 1 , wherein the HDR image is used to create a HDR video.

19. A computer program product comprising computer executable instructions stored on a non-transitory computer readable medium that when executed by a processor instruct the processor to:

receive an analog signal associated with an image of an image sensor;

generate a first amplified analog signal associated with the image by amplifying the analog signal utilizing a first gain, wherein the first gain is applied to analog pixel values;

transmit the first amplified analog signal to a first analog-to-digital converter circuit;

convert the first amplified analog signal to a first digital signal utilizing the first analog-to-digital converter circuit;

generate a second amplified analog signal associated with the image by amplifying the analog signal utilizing a second gain, wherein the second gain is applied to the analog pixel values;

transmit the second amplified analog signal to a second analog-to-digital converter circuit;

convert the second amplified analog signal to a second digital signal utilizing the second analog-to-digital converter circuit;

generate a third amplified analog signal associated with the image by amplifying the analog signal utilizing a third gain, wherein the third gain is applied to the analog pixel values;

transmit the third amplified analog signal to a third analog-to-digital converter circuit;

convert the third amplified analog signal to a third digital signal utilizing the third analog-to-digital converter circuit; and

cause the first digital signal, the second digital signal, and the third digital signal to be combined to create a high dynamic range (HDR) image.

20. A method, comprising:

receiving, using a processor, an analog signal associated with an image of an image sensor;

generating, using the processor, a first amplified analog signal associated with the image by amplifying the analog signal utilizing a first gain, wherein the first gain is applied to analog pixel values;

transmitting, using the processor, the first amplified analog signal to a first analog-to-digital converter circuit;

converting, using the processor, the first amplified analog signal to a first digital signal utilizing the first analog-to-digital converter circuit;

generating, using the processor, a second amplified analog signal associated with the image by amplifying the analog signal utilizing a second gain, wherein the second gain is applied to the analog pixel values;

transmitting, using the processor, the second amplified analog signal to a second analog-to-digital converter circuit;

converting, using the processor, the second amplified analog signal to a second digital signal utilizing the second analog-to-digital converter circuit;

generating, using the processor, a third amplified analog signal associated with the image by amplifying the analog signal utilizing a third gain, wherein the third gain is applied to the analog pixel values;

transmitting, using the processor, the third amplified analog signal to a third analog-to-digital converter circuit;

converting, using the processor, the third amplified analog signal to a third digital signal utilizing the third analog-to-digital converter circuit; and

causing, using the processor, the first digital signal, the second digital signal, and the third digital signal to be combined to create a high dynamic range (HDR) image.

Assignments (2)
SECURITY INTEREST Recorded Jul 30, 2021
From: DUELIGHT, LLC
To: ZILKA KOTAB, P.C.
Reel/Frame 057043/0301 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 24, 2019
From: RIVARD, WILLIAM; FEDER, ADAM; KINDLE, BRIAN
To: DUELIGHT LLC
Reel/Frame 049845/0353 →
Cited By (7)
US 12,316,978 US 12,401,911 US 12,401,912 US 12,418,727 US 12,425,744 US 12,445,736 US 12,666,159