IP Library Granted Patent US 11,089,210
Granted Patent B2
US 11,089,210 · App. 16/436,137 · Granted Aug 10, 2021

Configurable image sensor

Inventors: Andrew Samuel Berkovich (Bellevue, WA); Xinqiao Liu (Medina, WA)
Assignee: Facebook Technologies, LLC
H04N5/23229H04N5/2254H04N5/23254H04N5/23264
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,089,210
App. No.
16/436,137
Granted
Aug 10, 2021
Kind
B2
Abstract

In one example, a method comprises: receiving programming data; determining, based on the programming data, at least one of: an integration period in which a charge storage unit including a floating drain accumulates charge received from a photodiode, or a number of times of sampling the charge; enabling the photodiode to accumulate residual charge, and to transmit overflow charge to the charge storage unit after the photodiode saturates; controlling the charge storage unit to accumulate at least a part of the overflow charge received from the photodiode within the integration period; controlling a quantizer to sample the at least a part of the overflow charge or the residual charge for the number of times to obtain the number of samples; and controlling the quantizer to quantize the number of samples to generate the number of quantization results.

Claims (88)

1. An apparatus comprising:

a photodiode;

a charge storage unit including a floating drain;

a quantizer;

a controller configured to:

receive programming data;

determine, based on the programming data, at least one of: an integration period in which the charge storage unit accumulates charge received from the photodiode, or a number of times of sampling the charge received from the photodiode by the quantizer;

enable the photodiode to accumulate residual charge, and to transmit overflow charge to the charge storage unit after the photodiode saturates;

control the charge storage unit to accumulate at least a part of the overflow charge received from the photodiode within the integration period; and

control the quantizer to:

sample the at least a part of the overflow charge or the residual charge for the number of times to obtain the number of samples, and

quantize the number of samples to generate a number of quantization results.

2. The apparatus of claim 1 , wherein the controller is configured to:

at a first time, enable the photodiode to start accumulating the residual charge;

release the charge storage unit from a reset state starting at a second time after the first time; and

reset the charge storage unit at a third time after the second time and

wherein the controller is configured set the at least one of the second time or the third time based on the programming data.

3. The apparatus of claim 2 , wherein the integration period is a first integration period and starts at the second time; and

wherein a second integration period of the photodiode starts at the first time.

4. The apparatus of claim 3 , further comprising:

a shutter switch coupled between the photodiode and a first charge sink; and

a reset switch coupled between the charge storage unit and a second charge sink.

5. The apparatus of claim 4 ,

wherein the controller is configured to:

at the first time, disable the shutter switch to start the second integration period;

at the second time, disable the reset switch to start the first integration period; and

at the third time, enable the reset switch to stop the first integration period.

6. The apparatus of claim 5 , further comprising a transfer switch coupled between the photodiode and the charge storage unit, the transfer switch comprising a gate and the floating drain of the charge storage unit;

wherein the controller is configured to:

within the first integration period and the second integration period, transmit a first control signal to a gate of the transfer switch to enable the photodiode to store the residual charge; and

within the first integration period, control the quantizer to quantize a first number of samples of the at least a part of the overflow charge accumulated at the charge storage unit.

7. The apparatus of claim 6 , wherein the controller is configured to, after the third time:

disable the reset switch;

transmit a second control signal to the gate of the transfer switch to transfer the residual charge from the photodiode to the charge storage unit;

enable the shutter switch to stop both the first integration period and the second integration period; and

after the first integration period and the second integration period end, control the quantizer to quantize the residual charge accumulated at the charge storage unit.

8. The apparatus of claim 3 , wherein the quantizer comprises a comparator, a counter, and a memory;

wherein the controller is configured to perform a quantization operation comprising:

controlling the counter to start counting from a start count value;

controlling the comparator to compare a voltage at the charge storage unit with one or more thresholds to generate a comparison result; and

based on the comparison result, controlling the memory to store a count value from the counter as a quantization result of a sample of the voltage.

9. The apparatus of claim 8 , wherein the controller is configured to perform the number of the quantization operations based on the programming data to generate the number of the quantization results.

10. The apparatus of claim 9 , wherein the controller is configured to, in each of the number of the quantization operations, control the comparator to compare the voltage with a ramping threshold to determine a quantity of the overflow charge or a quantity of the residual charge stored at the charge storage unit.

11. The apparatus of claim 10 , wherein the controller is configured to generate an output representing an intensity of incident light received by the photodiode based on a rate of change among the number of quantization results.

12. The apparatus of claim 11 , wherein the controller is configured to:

determine a first rate of change among a first subset of the number of quantization results;

determine a second rate of change among a second subset of the number of quantization results; and

based on a relationship between the first rate of change and the second rate of change, generate the output based on the first rate of change.

13. The apparatus of claim 12 , wherein the controller is configured to:

based on the relationship, determine that the charge storage unit is saturated when the samples of the voltage represented by the second subset of the number of quantization results are obtained; and

based on the determination, generate the output based on the first rate of change.

14. The apparatus of claim 10 , wherein the controller is configured to:

in each of the number of quantization operations, reset the charge storage unit; and

generate an output representing an intensity of incident light received by the photodiode based on an average of the number of quantization results.

15. The apparatus of claim 14 , wherein the controller is configured to, in each of the number of quantization operations, control the comparator to compare the voltage with a static threshold; and

wherein each of the number of quantization results represent a time for the charge storage unit to become saturated by the overflow charge.

16. The apparatus of claim 10 , wherein the controller is configured to perform the number of quantization operations within the first integration period to quantize the at least a part of the overflow charge.

17. The apparatus of claim 10 , wherein the controller is configured to perform the number of quantization operations within the second integration period to quantize the residual charge.

18. The apparatus of claim 1 , wherein the integration period is determined based on the number of times of sampling the charge.

19. The apparatus of claim 1 , wherein the number of times of sampling the charge is determined based on the programming data.

20. The apparatus of claim 1 , wherein the integration period is a first integration period;

wherein the controller is configured to:

determine a second integration period based on the programming data; and

enable the photodiode to accumulate the residual charge within the second integration period.

21. The apparatus of claim 20 , wherein the first integration period and the second integration period have different start times.

22. The apparatus of claim 21 , wherein the controller is configured to:

reset the photodiode; and

start the second integration period based on releasing the reset of the photodiode.

23. The apparatus of claim 21 , wherein the controller is configured to:

reset at least one of the quantizer during at least a part of the second integration period; and

start the first integration period based on releasing the reset of the quantizer.

24. A method comprising:

receiving programming data;

determining, based on the programming data, at least one of: an integration period in which a charge storage unit including a floating drain accumulates charge received from a photodiode, or a number of times of sampling the charge;

enabling the photodiode to accumulate residual charge, and to transmit overflow charge to the charge storage unit after the photodiode saturates;

controlling the charge storage unit to accumulate at least a part of the overflow charge received from the photodiode within the integration period;

controlling a quantizer to sample the at least a part of the overflow charge or the residual charge for the number of times to obtain the number of samples; and

controlling the quantizer to quantize the number of samples to generate a number of quantization results.

25. The method of claim 24 , further comprising:

at a first time, enabling the photodiode to start accumulating the overflow charge;

starting at a second time after the first time, releasing the charge storage unit from a reset state; and

resetting the charge storage unit at a third time after the second time,

wherein a duration of the integration period is set based on at least one of the second time or the third time.

26. The method of claim 24 , further comprising:

performing the number of quantization processes, each of the quantization processes comprising:

controlling a counter of quantizer to start counting from a start count value;

controlling a comparator of quantizer to compare a voltage at the charge storage unit with one or more thresholds to generate a comparison result; and

based on the comparison result, controlling a memory to store a count value from the counter as a quantization result of a sample of the voltage.

Assignments (2)
CHANGE OF NAME Recorded Jul 27, 2022
From: FACEBOOK TECHNOLOGIES, LLC
To: META PLATFORMS TECHNOLOGIES, LLC
Reel/Frame 060990/0518 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 3, 2019
From: BERKOVICH, ANDREW SAMUEL; LIU, XINQIAO
To: FACEBOOK TECHNOLOGIES, LLC
Reel/Frame 049662/0882 →
Continuity (2)
Provisional Application 62683563 · Jun 11, 2018
Related Publication 20190379827A1 · Dec 12, 2019