IP Library › Granted Patent US 12,069,377
Granted Patent B2
US 12,069,377 · App. 17/934,051 · Granted Aug 20, 2024

Speckle removal in a pulsed hyperspectral, fluorescence, and laser mapping imaging system

Inventors: Joshua D. Talbert (Cottonwood Heights, UT); Donald M. Wichern (Ogden, UT)
Assignee: Cilag GmbH International
H04N23/72A61B1/000095A61B1/0655A61B5/0066A61B5/0075A61B5/0084A61B5/7207H04N13/239H04N13/254H04N23/555
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,069,377
App. No.
17/934,051
Filed
Sep 21, 2022
Granted
Aug 20, 2024
Kind
B2
Art Unit
2486
USPC
348/45
Abstract

Speckle removal in a pulsed hyperspectral, fluorescence, and laser mapping imaging system is described. A system includes a coherent light source for emitting pulses of coherent light, a fiber optic bundle connected to the coherent light source, and a vibrating mechanism attached to the fiber optic bundle. The system includes and an image sensor comprising a pixel array for sensing reflected electromagnetic radiation. The system is such that at least a portion of the pulses of coherent light emitted by the coherent light source comprises one or more of a hyperspectral emission, a fluorescence emission, or a laser mapping pattern.

Claims (43)

1. A system comprising:

an image sensor comprising a pixel array that detects electromagnetic radiation;

an emitter that cycles a plurality of electromagnetic sources, wherein the plurality of electromagnetic sources comprises:

a visible source that emits a visible wavelength of electromagnetic radiation; and

one or more spectral sources tuned to emit one or more spectral wavelengths of electromagnetic radiation selected to elicit a spectral response from a tissue; and

a controller in electronic communication with the image sensor and the emitter, wherein the controller synchronizes operations of the image sensor and operations of the emitter;

wherein the image sensor senses reflected electromagnetic radiation emitted by the emitter and outputs data, such that:

the image sensor generates a visible exposure frame in response to detecting the visible wavelength of electromagnetic radiation, and

the image sensor generates a plurality of spectral exposure frames comprising spectral response data based on a plurality of spectral responses in response to detecting pulses of the one or more spectral wavelengths of electromagnetic radiation, and

wherein the spectral exposure frame does not comprise observable speckle pattern;

wherein the controller processes one or more of the plurality of spectral exposure frames to generate a spectral datastore comprising the spectral response data;

wherein the controller provides the spectral datastore to a corresponding system that determines a classification of a malady, a biological process, or a type of tissue based on the spectral datastore;

wherein the system receives the classification from the corresponding system.

2. The system of claim 1 , wherein the one or more spectral sources comprises a plurality of independently actuatable spectral sources that are tuned to emit a plurality of different spectral wavelengths within one or more wavebands of electromagnetic radiation selected for spectral imaging of tissue.

3. The system of claim 2 , wherein the emitter separately cycles the plurality of independently actuatable spectral sources based on user input for spectral visualization of a scene.

4. The system of claim 2 , wherein the plurality of independently actuatable spectral sources comprises one or more of:

a first spectral source tuned to emit electromagnetic radiation within a waveband from about 900 nm to about 1000 nm;

a second spectral source tuned to emit electromagnetic radiation within a waveband from about 513 nm to about 545 nm; or

a third spectral source tuned to emit electromagnetic radiation within a waveband from about 545 nm to about 565 nm.

5. The system of claim 1 , wherein the spectral source comprises a laser; and

wherein the spectral source vibrates at a sufficient rate to reduce coherency such that the spectral frame does not comprise the observable speckle pattern.

6. The system of claim 1 , wherein the controller synchronizes operations of the image sensor and the emitter to generate a video output comprising color image data and spectral image data, and wherein the controller selects one or more spectral wavelengths of electromagnetic radiation for spectral imaging based on user input.

7. The system of claim 6 , wherein the controller instructs the emitter to cycle one or more of the plurality of electromagnetic sources during at least a portion of each blanking period of the image sensor; and

wherein the controller instructs the emitter to discontinue any emission of electromagnetic radiation during at least a portion of each readout period of the image sensor.

8. The system of claim 1 , wherein the image sensor reads out data for generating a plurality of exposure frames, and wherein imaging data for each of the plurality of exposure frames is classified based on a pulsing cycle of the emitter.

9. The system of claim 8 , wherein the controller classifies the imaging data for each of the plurality of exposure frames such that:

a first frame sensed by the pixel array in response to the emitter pulsing a white light is classified as comprising color imaging data; and

a second frame sensed by the pixel array in response to the emitter cycling the spectral source is classified as comprising spectral imaging data.

10. The system of claim 9 , wherein the pixel array comprises a color filter array such that the first frame comprises red, green, and blue imaging data.

11. The system of claim 1 , wherein the visible source is a white light source.

12. The system of claim 1 , wherein the one or more spectral wavelengths can pass through one or more layers of tissue in a foreground of a scene.

13. The system of claim 1 , wherein the one or more spectral wavelengths elicits the spectral response from one or more of nervous tissue, muscle tissue, or cancerous tissue.

14. The system of claim 1 , wherein the one or more spectral wavelengths elicits the spectral response from blood cells.

15. The system of claim 1 , wherein the controller that instructs the emitter to cycle the plurality of electromagnetic sources according to a variable pulse cycle, wherein the variable pulse cycle comprises a white light emission and one or more different spectral emissions.

16. The system of claim 15 , wherein a spectral waveband for each of the one or more different spectral emissions is adjustable in real-time based on user input.

17. The system of claim 16 , wherein the one or more different spectral emissions comprises a first spectral emission comprising electromagnetic radiation within a waveband from about 900 nm to about 1000 nm and further comprises one or more of:

a second spectral emission comprising electromagnetic radiation within a waveband from about 513 nm to about 545 nm; or

a third spectral emission comprising electromagnetic radiation within a waveband from about 545 nm to about 565 nm.

18. The system of claim 1 , wherein the emitter further comprises a fluorescence source tuned to emit a fluorescence excitation wavelength of electromagnetic radiation.

19. The system of claim 18 , wherein the fluorescence source comprises one or more of:

a first fluorescence source that pulses electromagnetic radiation within a waveband from about 770 nm to about 795 nm; and

a second fluorescence source that pulses electromagnetic radiation within a waveband from about 790 nm to about 815 nm.

20. The system of claim 1 , wherein the emitter further comprises a mapping source tuned to emit electromagnetic radiation for generating mapping data for topographical imaging.

Assignments (3)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 21, 2022
From: TALBERT, JOSHUA D.; WICHERN, DONALD M.
To: DEPUY SYNTHES PRODUCTS, INC.
Reel/Frame 061172/0359 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 21, 2022
From: DEPUY SYNTHES PRODUCTS, INC.
To: ETHICON LLC
Reel/Frame 061172/0433 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 21, 2022
From: ETHICON LLC
To: CILAG GMBH INTERNATIONAL
Reel/Frame 061503/0034 →
Continuity (3)
Continuation 16799212 · Feb 24, 2020
Provisional Application 62864242 · Jun 20, 2019
Related Publication 20230028618A1 · Jan 26, 2023