Optical fiber waveguide in an endoscopic system for hyperspectral, fluorescence, and laser mapping imaging
Optical fiber waveguide for communicating electromagnetic radiation pulsed by an emitter in an endoscopic imaging system. A system includes an emitter for emitting pulses of electromagnetic radiation and an endoscope comprising an image sensor for sensing reflected electromagnetic radiation. The system includes a waveguide communicating the pulses of electromagnetic radiation from the emitter to the endoscope. The system is such that at least a portion of the pulses of electromagnetic radiation emitted by the emitter comprises one or more of a hyperspectral emission, a fluorescence emission, and/or a laser mapping pattern.
1 . A system comprising:
an endoscope;
an emitter that emits electromagnetic radiation, wherein the emitter comprises a plurality of electromagnetic sources;
an image sensor;
a waveguide that receives the electromagnetic radiation pulsed by the emitter and carries the electromagnetic radiation to a distal end of the endoscope, wherein the waveguide comprises a plurality of optical fibers; and
a controller in communication with the emitter and the image sensor;
wherein the plurality of electromagnetic sources of the emitter comprises:
a visible source tuned to pulse broadband electromagnetic radiation only within a visible waveband of the electromagnetic spectrum;
a first multispectral source tuned to pulse narrowband visible electromagnetic radiation only within a visible waveband that is 20 nm wide or less without use of a filter;
a second multispectral source tuned to pulse narrowband infrared electromagnetic radiation only within an infrared waveband that is 20 nm wide or less without use of a filter; and
a fluorescence source tuned to pulse a fluorescence excitation wavelength of electromagnetic radiation;
wherein the controller instructs the plurality of electromagnetic sources of the emitter to independently actuate each of the plurality of electromagnetic sources according to a pulse cycle;
wherein the pulse cycle comprises actuating each of the plurality of electromagnetic sources in a repeating pattern, and wherein one of the plurality of electromagnetic sources within the repeating pattern is actuated per frame on a successive frame basis;
wherein electromagnetic radiation emitted by each of the first multispectral source and the second multispectral source elicits a spectral response from a tissue;
wherein each wavelength within the visible waveband of the first multispectral source and the infrared waveband of the second multispectral source elicits a different spectral response;
wherein the image sensor receives the elicited spectral response and reads out spectral data;
wherein the plurality of optical fibers of the waveguide is arranged such that each of the plurality of optical fibers receives substantially an equivalent portion of the electromagnetic radiation emitted by the emitter; and
wherein the emitter provides energy to the plurality of electromagnetic sources such that the substantially equivalent portion of the electromagnetic radiation received by each of the plurality of optical fibers remains below a burnout threshold for the plurality of optical fibers.
2 . The system of claim 1 , wherein the image sensor comprises two independent image sensors; and
wherein an image signal processor outputs three-dimensional imaging data based on data output by the two independent image sensors.
3 . The system of claim 1 , wherein the plurality of electromagnetic sources further comprises a laser mapping source that pulses electromagnetic radiation in a mapping pattern;
wherein the image sensor outputs a laser mapping exposure frame in response to the emitter cycling the laser mapping source on and off; and
wherein the laser mapping exposure frame comprises data for calculating one or more of a three-dimensional topographical map of a scene, a dimension of one or more objects within the scene, or a distance.
4 . The system of claim 1 , wherein the plurality of electromagnetic sources further comprises a laser mapping source that pulses electromagnetic radiation in a mapping pattern comprising one or more of a raster grid of discrete points, an occupancy grid map, a dot array, horizontal hashing, or vertical hashing.
5 . The system of claim 1 , wherein the emitter is located remote from the endoscope, and wherein the waveguide communicates the electromagnetic radiation from the emitter to a distal end of the endoscope for illuminating a light-deficient environment.
6 . The system of claim 1 , further comprising a collection region, wherein each of the plurality of electromagnetic sources of the emitter is aimed at the collection region, and wherein the waveguide communicates the electromagnetic radiation from the collection region to a distal end of the endoscope.
7 . The system of claim 1 , further comprising an intervening optical element disposed between the emitter and the waveguide, wherein the intervening optical element is configured to collect emissions from the plurality of electromagnetic sources prior to the emission being received by the waveguide.
8 . The system of claim 1 , wherein the waveguide comprises one of:
a single optical fiber; or
an optical fiber bundle comprising a plurality of optical fibers.
9 . The system of claim 1 , further comprising a lumen of the endoscope comprising a distal end, and wherein the distal end of the lumen is configured for insertion into a light deficient environment for visualization, and wherein:
the waveguide is an optical fiber bundle comprising a plurality of optical fibers;
the plurality of optical fibers are disposed within the lumen and terminate at the distal end of the lumen; and
the plurality of optical fibers are aimed in at least two different directions at the distal end of the lumen such that a light cone generated by the electromagnetic radiation exiting the plurality of optical fibers has an increased area.
10 . The system of claim 1 , wherein the controller provides instructions to the emitter to independently actuate each of the plurality of electromagnetic sources, and wherein the controller synchronizes timing of the image sensor and the emitter.
11 . The system of claim 1 , wherein the controller causes the image sensor to sense an exposure frame in response to an emission by at least one of the plurality of electromagnetic sources, and wherein the image sensor senses a plurality of exposure frames comprising:
a color exposure frame in response to an emission by the visible source;
a visible multispectral exposure frame in response to an emission by the first multispectral source;
an infrared multispectral exposure frame in response to an emission by the second multispectral source; and
a fluorescence exposure frame in response to an emission by the fluorescence source.
12 . The system of claim 11 , wherein:
the color exposure frame comprises data depicting a scene;
the visible multispectral exposure frame and the infrared multispectral exposure frame each comprise data indicating a spectral response of one or more objects within the scene; and
the fluorescence exposure frame comprises data indicating a fluorescence relaxation wavelength sensed by the image sensor.
13 . The system of claim 1 , wherein the system provides visualization during a robotic surgical procedure, and wherein the controller communicates data sensed by the image sensor to one or more processors configured to execute the robotic surgical procedure.
14 . The system of claim 1 , wherein the controller adjusts the pulse cycle to emphasize or de-emphasize aspects of a scene as requested by a user.
15 . The system of claim 1 , wherein the controller is configured to:
receive multispectral data that is sensed by the image sensor in response to an emission by one or more of the first multispectral source or the second multispectral source; and
provide the multispectral data to a corresponding multispectral system configured to identify one or more of a disease, a tissue condition, a chemical process, or a tissue type based on the multispectral data.
16 . The system of claim 1 , wherein the controller is configured to:
receive fluorescence data that is sensed by the image sensor in response to an emission by the fluorescence source; and
provide the fluorescence data to a corresponding fluorescence system configured to identify one or more of a disease, a tissue condition, a chemical process, or a tissue type based on the fluorescence.
17 . The system of claim 1 , wherein the fluorescence source comprises one or more independent electromagnetic sources that are independently actuatable by a controller, and wherein the independent electromagnetic sources comprise one or more of:
an electromagnetic source that pulses electromagnetic radiation within a waveband from about 770 nm to about 795 nm without use of a filter;
an electromagnetic source that pulses electromagnetic radiation within a waveband from about 790 nm to about 815 nm without use of a filter; or
an electromagnetic source that pulses electromagnetic radiation within a waveband from about 790 nm to about 795 nm without use of a filter.
18 . The system of claim 1 , wherein each of the first multispectral source and the second multispectral source comprises one or more independent electromagnetic sources that are independently actuatable by a controller, and wherein the independent electromagnetic sources comprise one or more of:
an electromagnetic that pulses electromagnetic radiation within a waveband from about 513 nm to about 545 nm without use of a filter;
an electromagnetic that pulses electromagnetic radiation within a waveband from about 565 nm to about 585 nm without use of a filter; or
an electromagnetic that pulses electromagnetic radiation within a waveband from about 900 nm to about 1000 nm without use of a filter.
19 . The system of claim 1 , wherein:
each of the first multispectral source and the second multispectral source is selected by the controller to elicit a spectral response; and
the fluorescence excitation wavelength is selected by the controller to fluorescence one or more of a reagent or the tissue within the scene.
20 . The system of claim 1 , further comprising an image signal processor in communication with the controller, wherein the image signal processor renders the output video stream in accordance with the user input; and
wherein at least a portion of a plurality of frames in the output video stream comprises an overlay.