Pulsed illumination in a hyperspectral, fluorescence and laser mapping imaging system

1. An endoscopic system for providing visualization to a light deficient environment comprising:

an emitter for emitting a plurality of emissions of electromagnetic radiation;

an image sensor comprising a pixel array; and

a processor for performing image signal processing, wherein the processor receives a plurality of frames sensed by the image sensor;

wherein the plurality of emissions of electromagnetic radiation comprises a multispectral emission of electromagnetic radiation for eliciting a spectral response from a tissue, a visible emission of electromagnetic radiation, and one or more of:

a laser mapping emission comprising electromagnetic radiation in a laser mapping pattern; or

a fluorescence emission comprising a fluorescence excitation wavelength of electromagnetic radiation; and

wherein the image signal processing performed by the processor comprises generating a luminance-chrominance frame that comprises luminance data and chrominance data.

2. The system of claim 1 , wherein the luminance-chrominance frame is a YCbCr frame, and wherein the luminance-chrominance frame is generated by converting an RGB color image frame to the luminance-chrominance frame.

3. The system of claim 1 , wherein the emitter pulses the laser mapping emission and the image sensor senses a laser mapping frame in response to the pulse of the laser mapping emission, and wherein the laser mapping frame comprises data for calculating one or more of a three-dimensional topography of a scene, a dimension of one or more objects within a scene, or a distance.

4. The system of claim 1 , wherein the multispectral wavelength of electromagnetic radiation comprises one or more of:

electromagnetic radiation comprising a wavelength within a range from about 513 nm to about 545 nm;

electromagnetic radiation comprising a wavelength within a range from about 565 nm to about 585 nm; or

electromagnetic radiation comprising a wavelength within a range from about 900 nm to about 1000 nm.

5. The system of claim 1 , wherein the fluorescence excitation wavelength of electromagnetic radiation comprises one or more of:

electromagnetic radiation comprising a wavelength within a range from about 770 nm to about 795 nm; or

electromagnetic radiation comprising a wavelength within a range from about 790 nm to about 815 nm.

6. The system of claim 1 , wherein the plurality of emissions of electromagnetic radiation further comprising a visible emission comprising a visible wavelength of electromagnetic radiation.

7. The system of claim 1 , wherein the plurality of emissions of electromagnetic radiation comprises a visible emission comprising a visible wavelength of electromagnetic radiation and the laser mapping emission, and further comprises one or more of the multispectral emission or the fluorescence emission.

8. The system of claim 7 , wherein the laser mapping emission comprises one or more of a raster grid of discrete points, an occupancy grid map, a dot array, vertical hashing, or horizontal hashing.

9. The system of claim 8 , wherein:

the multispectral wavelength comprises electromagnetic radiation within a range from about 513 nm to about 545 nm, and/or from about 565 nm to about 585 nm, and/or from about 900 nm to about 1000 nm; and

the fluorescence excitation wavelength comprises electromagnetic radiation within a range from about 770 nm to about 795 nm and/or from about 790 nm to about 815 nm.

10. The system of claim 1 , further comprising a controller in communication with the emitter and the image sensor, wherein the controller synchronizes the emitter and the image sensor such that the image sensor senses a frame in response to the emitter pulsing an emission of electromagnetic radiation.

11. The system of claim 1 , wherein the image sensor senses a plurality of frame-types in response to the emitter emitting the plurality of emissions of electromagnetic radiation, wherein the plurality of frame-types comprises:

a visible frame sensed in response to the emitter emitting a visible emission that comprises a visible wavelength of electromagnetic radiation;

a laser mapping frame sensed in response to the emitter emitting the laser mapping emission;

a multispectral frame sensed in response to the emitter emitting the multispectral emission; and

a fluorescence frame sensed in response to the emitter emitting the fluorescence emission.

12. The system of claim 1 , further comprising a controller configured to execute instructions stored in non-transitory computer readable storage medium, the instructions comprising:

receiving a laser mapping frame sensed by the image sensor, wherein the laser mapping frame is sensed in response to the emitter emitting the laser mapping pattern;

providing the laser mapping frame to a corresponding laser mapping system; and

receiving laser mapping data from the corresponding laser mapping system, wherein the laser mapping data comprises one or more of:

a three-dimensional topographical map of a scene, a dimension of one or more objects within the scene, or a distance.

13. The system of claim 12 , wherein the instructions further comprise:

receiving a multispectral frame sensed by the image sensor, wherein the multispectral frame is sensed in response to the emitter emitting the multispectral emission;

providing the multispectral frame to a corresponding multispectral system; and

receiving multispectral data from the corresponding multispectral system, wherein the multispectral data comprises one or more of:

a predicted identity of a tissue structure within the scene; or

a location of the tissue structure within the scene.

14. The system of claim 12 , wherein the instructions further comprise:

receiving a fluorescence frame sensed by the image sensor, wherein the fluorescence frame is sensed in response to the emitter emitting the fluorescence emission;

providing the fluorescence frame to a corresponding fluorescence system; and

receiving fluorescence data from the corresponding fluorescence system, wherein the fluorescence data comprises one or more of:

a predicted identity of a tissue structure within the scene; or

a location of the tissue structure within the scene.

15. The system of claim 14 , wherein the tissue structure comprises one or more of a nerve, a ureter, a blood vessel, an artery, a blood flow, or a tumor.

16. The system of claim 15 , wherein the instructions further comprise:

receiving a color image frame sensed by the image sensor, wherein the color image frame is sensed in response to the emitter emitting a visible wavelength of electromagnetic radiation;

overlaying at least a portion of the laser mapping data with the color image frame; and

overlaying at least a portion of the fluorescence data with the color image frame.

17. The system of claim 1 , further comprising:

an endoscope comprising a handpiece and a lumen, wherein the image sensor is disposed substantially near a distal end of the lumen of the endoscope; and

a waveguide for carrying the plurality of emissions of electromagnetic radiation from the emitter to the distal end of the lumen of the endoscope;

wherein the emitter is remote from the endoscope.

18. The system of claim 1 , wherein the system is an endoscopic visualization system for performing machine vision of a light-deficient environment, and wherein the emitter is the only source of illumination within the light-deficient environment.

19. The system of claim 1 , wherein the plurality of emissions of electromagnetic radiation further comprises:

a luminance emission comprising a wavelength of electromagnetic radiation that is optimized for sensing luminance data with the image sensor;

a red chrominance emission comprising a wavelength of electromagnetic radiation that is optimized for sensing red-chrominance data with the image sensor; and

a blue chrominance emission comprising a wavelength of electromagnetic radiation that is optimized for sensing blue-chrominance data with the image sensor.

20. The system of claim 1 , wherein the image signal processing further comprises:

receiving a plurality of independent frames sensed by the image sensor;

performing color correction on the plurality of independent frames;

performing edge enhancement on the plurality of independent frames; and

converting the luminance-chrominance frame to an RGB color image frame.