Wide dynamic range using monochromatic sensor
The disclosure extends to methods, systems, and computer program products for widening dynamic range within an image in a light deficient environment.
1. An imaging method for use with an image sensor having a pixel array, the pixel array having a first subset of pixels and a second subset of pixels, the imaging method comprising:
illuminating an environment with electromagnetic radiation;
sensing electromagnetic radiation reflected from the environment with the pixel array of the image sensor during a frame capture period, wherein the frame capture period comprises pixel read out of a last optical black row of a first frame, pixel read out of first optical black row of a second frame, and a blanking period between the first frame and the second frame;
commencing a plurality of integration periods within the frame capture period, the plurality of integration periods comprising:
a first integration period for the first subset of pixels, wherein the first subset of pixels is exposed to electromagnetic radiation in the first integration period; and
a second integration period for the second subset of pixels, wherein the second subset of pixels is exposed to electromagnetic radiation in the second integration period;
pulsing electromagnetic radiation during the plurality of integration periods; and
wherein the first integration period is longer than the second integration period such that the first subset of pixels has a longer exposure time to the pulsed electromagnetic radiation than the second subset of pixels.
2. The imaging method of claim 1 , wherein the second integration period overlaps at least a portion of the first integration period.
3. The imaging method of claim 1 , wherein the pulsed electromagnetic radiation comprises a single pulse over the plurality of integration periods.
4. The imaging method of claim 1 , wherein the pulsed electromagnetic radiation comprises a plurality of pulses over the plurality of integration periods; and
wherein a length of the first integration period is such that the first subset of pixels is exposed to both a first pulse and a second pulse of the plurality of pulses of electromagnetic radiation; and
wherein a length of the second integration period is such that the second subset of pixels is exposed to the second pulse of the plurality of pulses of electromagnetic radiation.
5. The imaging method of claim 1 , wherein the first subset of pixels and the second subset of pixels are arranged in a checkerboard pattern in the pixel array.
6. The imaging method of claim 1 , wherein the first subset of pixels comprises one-half of the pixels in the pixel array.
7. The imaging method of claim 6 , wherein the second subset of pixels comprises one-half of the pixels in the pixel array.
8. The imaging method of claim 1 , wherein the imaging sensor is a CMOS sensor.
9. The imaging method of claim 1 , wherein the step of illuminating the environment with electromagnetic radiation comprises emitting monochromatic pulses of electromagnetic radiation during the first integration period and the second integration period.
10. The imaging method of claim 1 , further comprising reading rows of pixels in the pixel array, wherein each row comprises pixels in both the first subset of pixels and the second subset of pixels.
11. The imaging method of claim 1 , wherein the step of illuminating the environment with electromagnetic radiation comprises illuminating the environment with monochromatic light.
12. The imaging method of claim 1 , further comprising:
receiving image data from the first subset of pixels and image data from the second subset of pixels; and
generating a single frame from the image data from the first subset of pixels and image data from the second subset of pixels.
13. A system for digital imaging in a light deficient environment comprising:
an emitter that emits a plurality of pulses of electromagnetic radiation for providing illumination to the light deficient environment;
an image sensor that comprises a pixel array that has a first subset of pixels and a second subset of pixels, wherein the image sensor is sensitive to the plurality of electromagnetic pulses and creates image data therefrom during a frame capture period;
wherein the frame capture period comprises pixel read out of a last optical black row of a first frame, pixel read out of first optical black row of a second frame, and a blanking period between the first frame and the second frame;
a controller that executes a plurality of integration periods during the frame capture period, the plurality of integration periods comprising:
a first integration period for the first subset of pixels, wherein the first subset of pixels is exposed to electromagnetic radiation in the first integration period; and
a second integration period for the second subset of pixels, wherein the second subset of pixels is exposed to electromagnetic radiation in the second integration period;
wherein the electromagnetic radiation is pulsed during the plurality of integration periods; and
wherein the first integration period is longer than the second integration period such that the first subset of pixels has a longer exposure time to the pulsed electromagnetic radiation than the second subset of pixels.
14. The system of claim 13 , wherein the second integration period overlaps at least a portion of the first integration period.
15. The system of claim 13 , wherein the pulsed electromagnetic radiation comprises a single pulse over the plurality of integration periods.
16. The imaging method of claim 13 , wherein the pulsed electromagnetic radiation comprises a plurality of pulses over the plurality of integration periods; and
wherein, a length of the first integration period is such that the first subset of pixels is exposed to both a first pulse and a second pulse of the plurality of pulses of electromagnetic radiation; and
wherein, a length of the second integration period is such that the second subset of pixels is exposed to the second pulse of the plurality of pulses of electromagnetic radiation.
17. The system of claim 13 , wherein the first subset of pixels and the second subset of pixels are arranged in a checkerboard pattern in the pixel array.
18. The system of claim 13 , wherein the first subset of pixels comprises one-half of the pixels in the pixel array.
19. The system of claim 18 , wherein the second subset of pixels comprises one-half of the pixels in the pixel array.
20. The system of claim 13 , wherein the imaging sensor is a CMOS sensor.
21. The system of claim 13 , wherein the emitter emits monochromatic pulses of electromagnetic radiation during the first integration period and the second integration period.
22. The system of claim 13 , wherein the image sensor comprises a plurality of rows, wherein each row comprises pixels in both the first subset of pixels and the second subset of pixels.
23. The system of claim 13 , wherein the emitter illuminates the environment with electromagnetic radiation with monochromatic light.
24. The system of claim 13 , further comprises a single image frame that is generated from image data from the first subset of pixels and image data from the second subset of pixels.