White balance and fixed pattern noise frame calibration using distal cap
The disclosure extends to methods, systems, and computer program products for producing an image in light deficient environments and correction of white balance and/or fixed pattern noise at startup or at any other time during a procedure.
1. A method for adjusting white balance in a digital imaging process for use with an endoscope in ambient light deficient environments comprising:
providing, during a training period, a cap that selectively covers a distal end of a lumen of the endoscope such that the cap is blocking external illumination to each pixel in a pixel array;
illuminating, during the training period, an interior of the cap using a controlled source of electromagnetic radiation;
determining, after the endoscope reaches its operating temperature during the training period, white balance coefficients while the cap is covering the distal end of the lumen and while illuminating the interior of the cap by the controlled source of electromagnetic radiation;
removing the cap from the distal end of the lumen at the operating temperature for the endoscope;
in response to removing the cap from the distal end of the lumen, sensing electromagnetic radiation with the pixel array to create an image frame; and
correcting white balance of the image frame using the white balance coefficients.
2. The method of claim 1 , wherein the method further comprises actuating an emitter to emit a pulse of a wavelength of electromagnetic radiation to cause illumination within the light deficient environment.
3. The method of claim 2 , wherein said pulse is within a wavelength range that comprises a portion of the electromagnetic spectrum.
4. The method of claim 3 , wherein said emitter is a laser emitter and wherein the method further comprises pulsing said laser emitter at a predetermined interval.
5. The method of claim 4 , wherein the method further comprises actuating a pixel array at a sensing interval that corresponds to the pulse interval of said laser emitter.
6. The method of claim 1 , wherein the white balance coefficients are determined by measuring a response of the pixel array while the cap is in place.
7. The method of claim 1 , wherein the white balance coefficients are determined by acquiring a plurality of frames, measuring a plurality of responses of the pixel array, and determining the white balance coefficients based on the plurality of responses of the pixel array while the cap is in place.
8. The method of claim 1 , wherein said white balance coefficients are determined upon startup of a system and stored within memory associated with the system.
9. The method of claim 1 , wherein white balance coefficients are determined before the surgical procedure has begun, the method further comprising;
in response to removing the cap from the lumen, beginning the surgical procedure using the endoscope;
placing the cap on the lumen after beginning the surgical procedure;
in response to placing the cap on the lumen, creating second white balance coefficients for use in adjusting white balance while the cap is in place after the surgical procedure has begun with applied electromagnetic radiation; and
correcting the image frame by performing white balance on an image using the second white balance coefficients.
10. The method of claim 1 , wherein sensing electromagnetic radiation comprises sensing controlled monochromatic radiation to generate the image frame.
11. The method of claim 1 , wherein sensing electromagnetic radiation comprises sensing under a plurality of wavelengths of radiation to generate the image frame.
12. The method of claim 1 , wherein sensing electromagnetic radiation comprises sensing under a continuous spectrum of wavelengths of radiation to generate the image frame.
13. The method of claim 1 , wherein the controlled source of electromagnetic radiation comprises a laser emitter, the method further comprising emitting a pulse of a wavelength of electromagnetic radiation to cause illumination within the light deficient environment, wherein sensing electromagnetic radiation to create the image frame comprises sensing during the emitting the pulse.
14. The method of claim 13 , wherein the method further comprises pulsing said laser emitter at a predetermined interval.
15. The method of claim 14 , wherein the method further comprises sensing electromagnetic radiation using the pixel array at a sensing interval that corresponds to the pulse interval of the laser emitter.
16. A system for digital imaging for use in ambient light deficient environments comprising:
an endoscope comprising a lumen and an image sensor, wherein the image sensor comprises a pixel array that senses electromagnetic radiation;
a cap configured to selectively cover a distal end of the lumen to block external illumination to each pixel in the pixel array;
a camera control unit in electrical communication with the image sensor; and
a controlled source of electromagnetic radiation;
wherein, during a training period, an interior of the cap is illuminated by the controlled source of electromagnetic radiation;
wherein the image sensor determines, after the endoscope reaches its operating temperature during the training period, white balance coefficients while the cap is covering the distal end of the lumen and while illuminating the interior of the cap by the controlled source of electromagnetic radiation, and, in response to removing the cap from the lumen at the operating temperature, senses electromagnetic radiation with the pixel array to create an image frame; and
wherein the camera control unit corrects white balance of the image frame using the white balance coefficients.
17. The system of claim 16 , wherein the white balance coefficients are determined by measuring a response of the pixel array while the cap is in place.
18. The system of claim 16 , wherein the cap is sized and shaped to fit snuggly onto the lumen.
19. The system of claim 16 , wherein the cap is made of a compliant material.
20. The system of claim 16 , wherein the cap is opaque to the controlled source of electromagnetic radiation emitted by an emitter.
21. The system of claim 16 , wherein the endoscope is a reusable endoscopic device.
22. The system of claim 16 , wherein the endoscope is a limited use endoscopic device.
23. The system of claim 16 , wherein the endoscope is a re-posable use endoscopic device.
24. The system of claim 16 , wherein the endoscope is a single-use endoscopic device.
25. The method system of claim 16 , wherein the controlled source of electromagnetic radiation comprises a laser emitter, wherein the laser emitter emits further comprising emitting a pulse of a wavelength of electromagnetic radiation to cause illumination within the light deficient environment, wherein the image sensor senses the pulse of the wavelength of sensing electromagnetic radiation to create the image frame comprises sensing during the emitting the pulse.
26. The method system of claim 25 , wherein the method system further comprises pulsing said laser emitter at a predetermined interval.
27. The method system of claim 26 , wherein the pixel array of the image sensor senses further comprises sensing electromagnetic radiation using the pixel array at a sensing interval that corresponds to the pulse interval of the laser emitter.