Time-resolving computational image sensor architecture for time-of-flight, high-dynamic-range, and high-speed imaging
A pixel for an image sensor includes a photon sensor, a memory, and an accumulator. The photon sensor element portion outputs a signal to an accumulator, which then may add value stored in memory together and may transfer the result to the memory of another pixel. The pixel may be analog or digital and may be used in a pixel array for compressed sensing imaging. During imaging, a pseudo-random mask may also be used. The data collected during imaging may be used in compressed sensing and may be sent to an offline storage to be processed.
1. A method for processing imaging data from a set of pixels, the method comprising:
storing a first photon information value, from a photon sensor of a first pixel of the set of pixels, in an accumulator;
adding a second photon information value from a memory associated with the first pixel into the accumulator to obtain a third photon information value, the memory being connected between the accumulator and a clock signal; and
resetting the photon sensor to zero.
2. The method of claim 1 , further comprising:
receiving the clock signal at the set of pixels;
collecting the first photon information value from the photon sensor; and
storing the third photon information value.
3. The method of claim 2 , wherein based on receiving the clock signal, the first pixel performs the storing the first photon information value, the adding, the resetting, the collecting, and the storing the third photon information value.
4. The method of claim 2 , wherein the first pixel stores the third photon information value in a first memory associated with the first pixel.
5. The method of claim 2 , wherein the first pixel stores the third photon information value in a second memory associated with a second pixel.
6. The method of claim 1 , further comprising causing the photon sensor to stop sensing, by way of a mask memory connected between a data bus and the photon sensor.
7. The method of claim 1 , wherein the first pixel resets the photon sensor to zero based on storing the third photon information value in the memory.
8. An image-capturing device comprising:
a processor; and
a pixel array, comprising a first pixel,
wherein the processor is configured to cause the first pixel to perform:
storing a first photon information value, from a photon sensor of the first pixel in an accumulator;
adding a second photon information value from a memory associated with the first pixel into the accumulator to obtain a third photon information value, the memory being connected between the accumulator and a clock signal; and
resetting the photon sensor to zero.
9. The image-capturing device of claim 8 , wherein the processor is configured to cause the first pixel to perform:
receiving the clock signal;
collecting the first photon information value from the photon sensor; and
storing the third photon information value.
10. The image-capturing device of claim 9 , wherein the first pixel stores the third photon information value in a first memory associated with the first pixel.
11. The image-capturing device of claim 9 , wherein the first pixel stores the third photon information value in a second memory associated with a second pixel.
12. The image-capturing device of claim 8 , wherein the processor is configured to cause the photon sensor to stop sensing, by way of a mask memory connected between a data bus and the photon sensor.
13. The image-capturing device of claim 8 , wherein the processor is configured to cause the first pixel to reset the photon sensor to zero based on the first pixel storing the third photon information value in the memory.
14. An image-capturing device comprising:
a data bus; and
a first pixel comprising:
a mask memory;
an accumulator;
a memory connected between the accumulator and a clock signal; and
a photon sensor connected to the data bus via the mask memory, the mask memory being configured to cause the photon sensor to stop sensing.
15. The image-capturing device of claim 14 , wherein the first pixel is configured to perform:
storing a first photon information value, from the photon sensor, in the accumulator;
adding a second photon information value from a memory associated with the first pixel into the accumulator to obtain a third photon information value; and
resetting the photon sensor to an initial value.
16. The image-capturing device of claim 15 , wherein the initial value is zero.
17. The image-capturing device of claim 15 , wherein the first pixel is configured to reset the photon sensor to the initial value based on the first pixel storing the third photon information value in the memory.
18. The image-capturing device of claim 15 , wherein the first pixel is configured to perform:
receiving the clock signal;
collecting the first photon information value from the photon sensor; and
storing the third photon information value.
19. The image-capturing device of claim 15 , wherein the first pixel is configured to store the third photon information value in a first memory associated with the first pixel.
20. The image-capturing device of claim 15 , wherein the first pixel is configured to store the third photon information value in a second memory associated with a second pixel.