IP Library Granted Patent US 10,694,152
Granted Patent B2
US 10,694,152 · App. 15/343,034 · Granted Jun 23, 2020

Imaging systems and methods for displaying fluorescence and visible images

Inventors: Paul R. Westwick (Vancouver, CA); David Potkins (White Rock, CA); John Fengler (North Vancouver, CA)
Assignee: Novadaq Technologies ULC
H04N7/183A61B1/041A61B1/043A61B1/045A61B1/051A61B1/0638A61B1/0646A61B1/0669A61B1/0676A61B1/0684A61B1/128A61B3/18H04N5/2256H04N9/045H04N2005/2255
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,694,152
App. No.
15/343,034
Granted
Jun 23, 2020
Kind
B2
Abstract

An endoscopic video system and method using a camera with a single color image sensor, for example a CCD color image sensor, for fluorescence and color imaging and for simultaneously displaying the images acquired in these imaging modes at video rates in real time is disclosed. The tissue under investigation is illuminated continuously with fluorescence excitation light and is further illuminated periodically using visible light outside of the fluorescence excitation wavelength range. The illumination sources may be conventional lamps using filters and shutters, or may include light-emitting diodes mounted at the distal tip of the endoscope.

Claims (31)

1. A method of visualizing a tissue of a subject, the method comprising:

illuminating the tissue with white-light and excitation light that excites fluorophors in the tissue, wherein the fluorophors emit fluorescence light to create a fluorescence image;

simultaneously receiving visible white-light image data and corresponding fluorescence image data of the tissue, the visible white-light image data and the fluorescence image data being captured or having been captured by an image capture device;

colorizing the visible white-light image data based on the fluorescence image data to generate a composite colorized image, wherein the composite colorized image comprises a plurality of differentiated color regions, the differentiated color regions corresponding to a change in fluorescence signal from the tissue, and wherein a brightness of the composite colorized image data is based on white-light image data and is independent of the fluorescence image data; and

displaying the composite colorized image.

2. The method of claim 1 , wherein the change in fluorescence signal is indicative of a change in a property of the tissue.

3. The method of claim 2 , wherein the property of the tissue is indicative of tissue health.

4. The method of claim 2 , wherein the property of the tissue comprises a pathological property.

5. The method of claim 2 , wherein the property of the tissue comprises a structural property.

6. The method of claim 1 , wherein colorizing the visible white-light image data based on the fluorescence image data comprises modifying a color attribute of the visible white-light image data.

7. The method of claim 1 , wherein the visible white-light image data comprises desaturated image data.

8. The method of claim 1 , wherein the visible white-light image data comprises grayscale image data.

9. The method of claim 1 , wherein the visible white-light image data comprises luma image data.

10. A system for visualizing a tissue of a subject, the system comprising:

one or more light sources for illuminating the tissue;

one or more image sensors for simultaneously detecting a visible white-light image and a fluorescence image;

one or more processors configured to compute a composite colorized image using the detected visible white-light image and the detected fluorescence image, wherein the composite colorized image comprises a plurality of differentiated color regions, the differentiated color regions corresponding to a change in fluorescence signal from the tissue, and wherein a brightness of the composite colorized image data is based on white-light image data and is independent of the fluorescence image data; and

a display for displaying the composite colorized image.

11. The system of claim 10 , wherein the system is an endoscope system.

12. The system of claim 10 , wherein the one or more image sensors comprise one or more CCD or CMOS image sensors.

13. The system of claim 10 , comprising a single sensor for detecting the white-light image and the fluorescence image.

14. The system of claim 10 , wherein the change in fluorescence signal is indicative of a change in a property of the tissue.

15. The system of claim 14 , wherein the property of the tissue is indicative of tissue health.

16. The system of claim 14 , wherein the property of the tissue comprises a pathological property.

17. The system of claim 14 , wherein the property of the tissue comprises a structural property.

18. The system of claim 10 , wherein the composite colorized image is computed by colorizing visible white-light image data based on fluorescence image data.

19. The system of claim 18 , wherein the visible white-light image data is colorized based on fluorescence image data by modifying a color attribute of the visible white-light image data based on the fluorescence image data.

20. The system of claim 18 , wherein the visible white-light image data comprises desaturated image data.

21. The system of claim 18 , wherein the visible white-light image data comprises luma image data.

22. The system of claim 18 , wherein the visible white-light image data comprises grayscale image data.

23. The method of claim 1 , further comprising administering a fluorescent dye to the subject comprising indocyanine green (ICG).

Assignments (18)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 26, 2023
From: STRYKER EUROPEAN OPERATIONS LIMITED
To: STRYKER CORPORATION
Reel/Frame 066140/0647 →
CORRECTIVE ASSIGNMENT TO CORRECT THE ERRONEOUSLY FILED AGAINST APPLICATION NO. 15/570,072 PREVIOUSLY RECORDED AT REEL: 053823 FRAME: 0445. ASSIGNOR(S) HEREBY CONFIRMS THE NUNC PRO TUNC ASSIGNMENT EFFECTIVE 11/29/2018. Recorded May 3, 2021
From: STRYKER EUROPEAN HOLDINGS III, LLC
To: STRYKER EUROPEAN HOLDINGS LLC
Reel/Frame 056426/0496 →
CORRECTIVE ASSIGNMENT TO CORRECT THE ERRONEOUSLY FILED AGAINST APPLICATION NO. 15/570,072 PREVIOUSLY RECORDED AT REEL: 052873 FRAME: 0548. ASSIGNOR(S) HEREBY CONFIRMS THE NUNC PRO TUNC ASSIGNMENT EFFECTIVE 11/30/2017. Recorded May 3, 2021
From: NOVADAQ TECHNOLOGIES ULC
To: STRYKER EUROPEAN HOLDINGS I, LLC
Reel/Frame 056425/0616 →
CORRECTIVE ASSIGNMENT TO CORRECT THE ERRONEOUSLY FILED AGAINST APPLICATION NO. 15/570,072 PREVIOUSLY RECORDED AT REEL: 052860 FRAME: 0900. ASSIGNOR(S) HEREBY CONFIRMS THE NUNC PRO TUNC ASSIGNMENT EFFECTIVE 12/31/2018. Recorded May 3, 2021
From: STRYKER EUROPEAN HOLDINGS LLC
To: STRYKER EUROPEAN OPERATIONS LIMITED
Reel/Frame 056426/0585 →
CORRECTIVE ASSIGNMENT TO CORRECT THE ERRONEOUSLY FILED AGAINST APPLICATION NO. 15/570,072 PREVIOUSLY RECORDED AT REEL: 044910 FRAME: 0507. ASSIGNOR(S) HEREBY CONFIRMS THE MERGER AND CHANGE OF NAME. Recorded May 3, 2021
From: NOVADAQ TECHNOLOGIES INC.
To: NOVADAQ TECHNOLOGIES ULC
Reel/Frame 056425/0530 →
CORRECTIVE ASSIGNMENT TO CORRECT THE ERRONEOUSLY FILED AGAINST APPLICAITON NO. 15/570,072 PREVIOUSLY RECORDED AT REEL: 053318 FRAME: 0612. ASSIGNOR(S) HEREBY CONFIRMS THE NUNC PRO TUNC ASSIGNMENT EFFECTIVE 09/05/2018. Recorded May 3, 2021
From: STRYKER EUROPEAN HOLDINGS I, LLC
To: STRYKER EUROPEAN HOLDINGS IV, LLC
Reel/Frame 056425/0731 →
CORRECTIVE ASSIGNMENT TO CORRECT THE ERRONEOUSLY FILED AGAINST APPLICATION NO. 15/570,072 PREVIOUSLY RECORDED AT REEL: 052873 FRAME: 0597. ASSIGNOR(S) HEREBY CONFIRMS THE NUNC PRO TUNC ASSIGNMENT EFFECTIVE 09/05/2018. Recorded May 3, 2021
From: STRYKER EUROPEAN HOLDINGS IV, LLC
To: STRYKER EUROPEAN HOLDINGS III, LLC
Reel/Frame 056426/0352 →
NUNC PRO TUNC ASSIGNMENT Recorded Jun 7, 2020
From: STRYKER EUROPEAN HOLDINGS I, LLC
To: STRYKER EUROPEAN HOLDINGS IV, LLC
Reel/Frame 053318/0612 →
NUNC PRO TUNC ASSIGNMENT Recorded Jun 7, 2020
From: STRYKER EUROPEAN HOLDINGS LLC
To: STRYKER EUROPEAN OPERATIONS LIMITED
Reel/Frame 052860/0900 →
NUNC PRO TUNC ASSIGNMENT Recorded Jun 7, 2020
From: NOVADAQ TECHNOLOGIES ULC
To: STRYKER EUROPEAN HOLDINGS I, LLC
Reel/Frame 052873/0548 →
NUNC PRO TUNC ASSIGNMENT Recorded Jun 7, 2020
From: STRYKER EUROPEAN HOLDINGS IV, LLC
To: STRYKER EUROPEAN HOLDINGS III, LLC
Reel/Frame 052873/0597 →
NUNC PRO TUNC ASSIGNMENT Recorded Jun 7, 2020
From: STRYKER EUROPEAN HOLDINGS III, LLC
To: STRYKER EUROPEAN HOLDINGS LLC
Reel/Frame 053823/0445 →
MERGER AND CHANGE OF NAME Recorded Dec 19, 2017
From: NOVADAQ TECHNOLOGIES INC.; STRYKER CANADA OPERATIONS ULC
To: NOVADAQ TECHNOLOGIES ULC
Reel/Frame 044910/0507 →
RELEASE OF SECURITY INTEREST Recorded Sep 8, 2017
From: MIDCAP FINANCIAL TRUST
To: NOVADAQ TECHNOLOGIES INC.; NOVADAQ CORP.
Reel/Frame 043788/0799 →
RELEASE OF SECURITY INTEREST Recorded Sep 8, 2017
From: MIDCAP FUNDING IV TRUST (AS SUCCESSOR AGENT TO MIDCAP FINANCIAL TRUST)
To: NOVADAQ TECHNOLOGIES INC.; NOVADAQ CORP.
Reel/Frame 043786/0344 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 26, 2017
From: WESTWICK, PAUL; POTKINS, DAVID; FENGLER, JOHN
To: NOVADAQ TECHNOLOGIES, INC.
Reel/Frame 042818/0699 →
SECURITY AGREEMENT (TERM) Recorded Jan 9, 2017
From: NOVADAQ TECHNOLOGIES; NOVADAQ CORP.
To: MIDCAP FINANCIAL TRUST, AS AGENT
Reel/Frame 041306/0189 →
SECURITY AGREEMENT (REVOLVING) Recorded Jan 9, 2017
From: NOVADAQ TECHNOLOGIES; NOVADAQ CORP.
To: MIDCAP FINANCIAL TRUST, AS AGENT
Reel/Frame 041306/0172 →
Continuity (6)
Continuation 14860687 · Sep 21, 2015
Continuation 13930225 · Jun 28, 2013
Continuation 11964330 · Dec 26, 2007
Provisional Application 60908373 · Mar 27, 2007
Provisional Application 60876597 · Dec 22, 2006
Related Publication 20170064257A1 · Mar 2, 2017
Cited By (5)
US 12,239,409 US 12,357,162 US 12,464,215 US 12,525,340 US 12,666,156