Pixel sensor having shared readout structure
An apparatus comprises a first photodiode, a second photodiode, a quantizer, a memory, and a controller configured to: set a first exposure period in which the first photodiode generates a first charge; set a second exposure period in which the second photodiode generates a second charge, the second exposure period being set based on the first exposure period and at least one of: a first time associated with a read out operation of the memory to a second apparatus, or a second time associated with a quantization operation by the quantizer; perform, using the quantizer, the first quantization operation of the first charge to generate a first digital output; and perform, using the quantizer, a second quantization operation of the second charge to generate a second digital output.
1. An apparatus comprising:
a first photodiode;
a second photodiode;
a quantizer;
a memory;
a controller configured to:
set a first exposure period in which the first photodiode generates a first charge;
set a second exposure period in which the second photodiode generates a second charge, the second exposure period being set based on:
the first exposure period; and
at least one of:
a first time associated with a read out operation of the memory to a second apparatus, or
a second time associated with a quantization operation by the quantizer;
perform, using the quantizer, a first quantization operation of the first charge to generate a first digital output; and
perform, using the quantizer, a second quantization operation of the second charge to generate a second digital output.
2. The apparatus of claim 1 , wherein the memory includes sufficient capacity to store both the first digital output and the second digital output simultaneously; and
wherein the controller is configured to set an end time of the second exposure period to lag behind an end time of the first exposure period by a delay based on the first time.
3. The apparatus of claim 2 , wherein the controller is configured to set a start time of the second exposure period to lag behind a start time of the first exposure period by a delay based on the first time.
4. The apparatus of claim 2 , wherein the controller is configured to:
set a start time of the second exposure period to lead a start time of the first exposure period by a duration based on the first time; and
set an end time of the second exposure period to lag behind an end time of the first exposure period by a delay based on the first time.
5. The apparatus of claim 1 , wherein the controller is configured to set an end time of the second exposure period to lag behind an end time of the first exposure period by a delay based on the first time.
6. The apparatus of claim 1 , wherein the memory does not sufficient capacity to store both the first digital output and the second digital output simultaneously; and
wherein the controller is configured to set an end time of the second exposure period to lag behind an end time of the first exposure period by a delay based on a sum of the first time and the second time.
7. The apparatus of claim 1 , wherein the controller is configured to set a start time of the second exposure period to lag a start time of the first exposure period by a delay based on the sum of the first time and the second time.
8. The apparatus of claim 1 , wherein:
the first photodiode and the second photodiode are part of a pixel cell;
the first photodiode is configured to detect light of a first wavelength range from a spot of a scene;
the second photodiode is configured to detect light of a second wavelength range from the same spot; and
the first digital output of the first photodiode and the second digital output of the second photodiode from the same pixel of a first image frame and a second image frame, the first image frame being associated with the first wavelength range and the second image frame being associated with the second wavelength range.
9. A system comprising:
a head-mounted display, wherein the head-mounted display comprises:
an image sensor comprising a first photodiode and a second photodiode;
a quantizer;
a memory; and
a controller configured to:
set a first exposure period in which the first photodiode generates a first charge;
set a second exposure period in which the second photodiode generates a second charge, the second exposure period being set based on:
the first exposure period; and
at least one of:
a first time associated with a read out operation of the memory to a second apparatus, or
a second time associated with a quantization operation by the quantizer;
perform, using the quantizer, a first quantization operation of the first charge to generate a first digital output; and
perform, using the quantizer, a second quantization operation of the second charge to generate a second digital output.
10. The system of claim 9 , wherein the memory includes sufficient capacity to store both the first digital output and the second digital output simultaneously; and
wherein the controller is configured to set an end time of the second exposure period to lag behind an end time of the first exposure period by a delay based on the first time.
11. The system of claim 10 , wherein the controller is configured to set a start time of the second exposure period to lag behind a start time of the first exposure period by a delay based on the first time.
12. The system of claim 10 , wherein the controller is configured to:
set a start time of the second exposure period to lead a start time of the first exposure period by a duration based on the first time; and
set an end time of the second exposure period to lag behind an end time of the first exposure period by a delay based on the first time.
13. The system of claim 9 , wherein the controller is configured to set an end time of the second exposure period to lag behind an end time of the first exposure period by a delay based on the first time.
14. The system of claim 9 , wherein the controller is configured to set a start time of the second exposure period to lag a start time of the first exposure period by a delay based on the sum of the first time and the second time.
15. The system of claim 9 , wherein the image sensor further includes a third photodiode and a fourth photodiode; and
wherein the controller is configured to:
set a start time of the first exposure period and the second exposure period at a third time;
set an end time of the second exposure period, the end time of the second exposure period being delayed from end time of the first exposure period by duration based on the second time;
set a start time of a third exposure period in which the third photodiode generates a third charge and a fourth exposure period in which the fourth photodiode generates a fourth charge at a fourth time, the fourth time being delayed from the third time based on a sum of the first time and the second time; and
set an end time of the fourth exposure period, the end time of the fourth exposure period being delayed from end time of the third exposure period by the duration.
16. The system of claim 9 , wherein the image sensor further includes a third photodiode and a fourth photodiode; and
wherein the controller is configured to:
set a start time and end time of the second exposure period to be delayed from, respectively, a start time and an end time of the first exposure period by a duration based on a sum of the first time and the second time;
set a start time and end time of a third exposure period in which the third photodiode generates a third charge to be delayed from, respectively, a start time and an end time of the second exposure period by the duration; and
set a start time and end time of a fourth exposure period in which the fourth photodiode generates a fourth charge to be delayed from, respectively, a start time and an end time of the third exposure period by the duration.
17. The system of claim 9 , wherein:
the first photodiode and the second photodiode are part of a pixel cell;
the first photodiode is configured to detect light of a first wavelength range from a spot of a scene;
the second photodiode is configured to detect light of a second wavelength range from the same spot; and
the first digital output of the first photodiode and the second digital output of the second photodiode from the same pixel of a first image frame and a second image frame, the first image frame being associated with the first wavelength range and the second image frame being associated with the second wavelength range.
18. A non-transitory computer-readable storage medium storing a plurality of instructions executable by one or more processors, the plurality of instructions when executed by the one or more processors cause the one or more processors to:
set a first exposure period in which a first photodiode generates a first charge;
set a second exposure period in which a second photodiode generates a second charge, the second exposure period being set based on:
the first exposure period; and
at least one of:
a first time associated with a read out operation of a memory, or
a second time associated with a quantization operation of a quantizer;
perform, using the quantizer, a first quantization operation of the first charge to generate a first digital output;
store the first digital output in the memory;
perform, using the quantizer, a second quantization operation of the second charge to generate a second digital output; and
store the second digital output in the memory.
19. The non-transitory computer-readable storage medium of claim 18 , wherein the memory includes sufficient capacity to store both the first digital output and the second digital output simultaneously; and
wherein an end time of the second exposure period is set to lag behind an end time of the first exposure period by a duration based on the first time.
20. The non-transitory computer-readable storage medium of claim 19 , wherein a start time of the second exposure period is set to lead a start time of the first exposure period by a duration based on the first time.