YCBCR pulsed illumination scheme in a light deficient environment
The disclosure extends to methods, systems, and computer program products for producing an image in light deficient environments with luminance and chrominance emitted from a controlled light source.
1. A system for digital imaging in an ambient light deficient environment comprising:
an emitter configured to emit a plurality of pulses of electromagnetic radiation;
an imaging sensor comprising an array of pixels for sensing electromagnetic radiation; and
a control unit comprising a processor and wherein the control unit is in electrical communication with the imaging sensor and the emitter;
wherein the control unit is configured to synchronize the emitter and the imaging sensor to produce a plurality of image reference frames;
wherein the imaging sensor generates image data from sensed electromagnetic radiation that produces the plurality of image reference frames comprising:
a first luminance frame comprising first luminance image data;
a second luminance frame comprising second luminance image data;
a first chrominance frame comprising first chrominance data;
a second chrominance frame comprising second chrominance data; and
a third chrominance frame comprising third chrominance data;
wherein the first luminance frame, the first chrominance frame, and the second chrominance frame are combined to form a first color image frame;
wherein the second chrominance frame is reused such that the second chrominance frame is combined with the third chrominance frame and the second luminance frame to form a second color image frame.
2. The system of claim 1 , wherein the plurality of image reference frames comprises a plurality of chrominance frames and a plurality of luminance frames; and
wherein the plurality of chrominance frames in the plurality of image reference frames alternate between blue chrominance frames having blue chrominance data and red chrominance frames having red chrominance data.
3. The system of claim 1 , wherein the first chrominance frame has blue chrominance data, the second chrominance frame has red chrominance data, and the third chrominance frame has blue chrominance data; or
wherein the first chrominance frame has red chrominance data, wherein the second chrominance frame has blue chrominance data, and the third chrominance frame has red chrominance data.
4. The system of claim 1 , wherein the plurality of image reference frames further comprises:
a third luminance frame comprising third luminance image data; and
a fourth chrominance frame comprising fourth chrominance data;
wherein the third chrominance frame is combined with the fourth chrominance frame and a third luminance frame to form a third color image frame.
5. The system of claim 4 , wherein the first chrominance frame has blue chrominance data, the second chrominance frame has red chrominance data, the third chrominance frame has blue chrominance data, and the fourth chrominance frame has red chrominance data; or
wherein the first chrominance frame has red chrominance data, the second chrominance frame has blue chrominance data, the third chrominance frame has red chrominance data, and the fourth chrominance frame has blue chrominance data.
6. The system of claim 2 , wherein luminance frames are represented in the plurality of image reference frames twice as often as red chrominance frames and twice as often as blue chrominance frames.
7. The system of claim 2 , wherein each of the plurality of chrominance frames in the plurality of images is used in at least two color image frames.
8. The system of claim 1 , wherein the plurality of image reference frames produced by the imaging sensor comprises:
a luminance frame of long exposure pixel data and short exposure pixel data;
a red chrominance frame of long exposure pixel data and short exposure pixel data; and
a blue chrominance frame of long exposure pixel data and short exposure pixel data.
9. The system of claim 1 , wherein the emitter produces a pulsing pattern of luminance, chrominance blue, luminance, chrominance red.
10. The system of claim 1 , wherein the emitter produces a pulsing pattern of luminance, chrominance blue combined with chrominance red, luminance, chrominance blue combined with chrominance red.
11. The system of claim 1 , wherein the emitter comprises a plurality of sources that each emit a pulse of a portion of electromagnetic spectrum.
12. The system of claim 11 , wherein the plurality of sources are configured to be actuated simultaneously and wherein the plurality of sources are configured to produce a pulse of a predetermined interval.
13. The system of claim 12 , wherein the pulse of the predetermined interval is adjusted to provide luminance information during generation of luminance frames by matching to color space conversion coefficients.
14. The system of claim 12 , wherein the pulse of the predetermined interval is adjusted to provide chrominance information during generation of chrominance frames by matching to color space conversion coefficients.
15. The system of claim 1 , wherein a luminance coefficient is added to chrominance frames by an image signal processor and wherein the luminance coefficient is an integer that is a multiple of (½) n .
16. The system of claim 1 , wherein the imaging sensor is a monochrome sensor.
17. The system of claim 1 , wherein the plurality of electromagnetic wavelengths are emitted at differing magnitudes, wherein the differing magnitudes correspond to the imaging sensor's sensitivity to differing wavelengths.
18. The system of claim 1 , wherein the system further comprises an endoscope for accessing the ambient light deficient environment comprising a lumen and a hand piece;
wherein the imaging sensor is disposed within one of the lumen and the hand piece.
19. The system of claim 1 , wherein the system produces one color image frame per two captured image reference frames of the plurality of image reference frames.
20. The system of claim 19 , wherein the emitter is pulsed and the plurality of image reference frames are captured at a rate of 120 Hz; and
wherein the plurality of image reference frames are combined to produce a plurality of color image frames;
wherein the plurality of color image frames are combined into a video stream having a frame rate of 60 Hz.