IP Library Granted Patent US 6,899,675
Granted Patent B2
US 6,899,675 · App. 10/050,601 · Granted May 31, 2005

Fluorescence endoscopy video systems with no moving parts in the camera

View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 6,899,675
App. No.
10/050,601
Granted
May 31, 2005
Kind
B2
Abstract

A fluorescence endoscopy video system includes a multi-mode light source that produces light for white light and fluorescence imaging modes. Light from the light source is transmitted through an endoscope to the tissue under observation. The system also includes a compact camera for white light and fluorescence imaging, which may be located in the insertion portion of the endoscope, or attached to the portion of the endoscope outside the body. The camera can be utilized for both white light imaging and fluorescence imaging, and in its most compact form, contains no moving parts.

Claims (42)

1. A color and fluorescence endoscopy video system including:

an endoscope for directing the light from a multi-mode light source into a patient to illuminate a tissue sample and to collect reflected light or fluorescence light produced by the tissue;

a camera positioned to receive the light collected by the endoscope to produce color or fluorescence images, the camera including:

a low light color image sensor having integrated filters with color output;

one or more filters positioned in front of the low light color image sensor for selectively blocking light with wavelengths below 450 nm and transmitting visible light with wavelengths greater than 470 nm; and

one or more optical imaging components that project images onto the low light color image sensor;

an image processor/controller that receives image signals from the low light color image sensor and combines and interpolates image signals from pixels having filters with the same integrated filter characteristics to fluorescence or reflectance light and then encodes the images as video signals;

a multi-mode light source for producing light for color imaging and/or for fluorescence excitation and/or for fluorescence excitation with reference reflectance, including a filter selectively positioned in the light path of the light source for producing light for color imaging that simultaneously transmits blue light at wavelengths less than 480 nm and amounts of green and red light, wherein the amounts of green and red light transmitted are adjusted to be a fraction of the transmitted blue light, such that, when reflected from a gray surface, the intensity of the green and red light projected onto the low light color image sensor matches the intensity of blue light also projected onto the low light color image sensor in such a way that the resulting color images are white balanced; and

a color video monitor for displaying superimposed video images from the pixels of the low light color image sensor.

2. The system of claim 1 , wherein the camera is attached to the portion of the endoscope that remains outside of the body.

3. The system of claim 1 , wherein the camera is built into the insertion portion of the endoscope.

4. The system of claim 2 or 3 , further comprising a light source filter selectively positioned in the light path of the light source for producing light for fluorescence excitation and reference reflection that simultaneously transmits the fluorescence excitation light at wavelengths less than 450 nm and an amount of reference reflectance light not in a fluorescence detection wavelength band, wherein the amount of reference reflectance light transmitted is a fraction of the fluorescence excitation light, such that the intensity of the reflected reference light projected onto the low light color image sensor approximately matches the intensity of fluorescence light also projected onto the low light color image sensor, the light source filter also blocking light from the light source at wavelengths in the fluorescence detection wavelength band such that the fluorescence light received by the low light color image sensor is substantially composed of light resulting from tissue fluorescence and minimally composed of light originating from the light source.

5. The system of claim 4 , wherein the fluorescence light, transmitted by the one or more filters positioned in front of the low light color image sensor, is green light.

6. The system of claim 5 , wherein the reference reflectance light, not in the detected fluorescence band, transmitted by the light source filter is red light.

7. The system of claim 4 , wherein the fluorescence light, transmitted by the one or more filters positioned in front of the low light color image sensor, is red light.

8. The system of claim 6 , wherein the image processor/controller produces a composite fluorescence/reflectance image comprising an image created from green fluorescence light and an image created from red reflectance light that are superimposed and displayed in different colors on a color video monitor.

9. The system of claim 7 , wherein the reference reflectance light, not in the detected fluorescence band, transmitted by the light source filter is green light.

10. The system of claim 7 , wherein the image processor/controller produces a composite fluorescence/reflectance image comprising an image created from red fluorescence light and an image created from green reflectance light that are superimposed and displayed in different colors on a color video monitor.

11. The system claim 2 or 3 , further comprising a filter positioned in the light path of the light source that transmits fluorescence excitation light at wavelengths less than 450 nm and blocks light at visible wavelengths longer than 450 nm, from reaching the low light color image sensor to the extent that the light received by the low light color image sensor is substantially composed of light resulting from tissue fluorescence and minimally composed of light originating from the light source.

12. The system of claim 11 , wherein the image processor/controller produces a composite fluorescence/reflectance image comprising an image created from green fluorescence light and an image created from red fluorescence light that are superimposed and displayed in different colors on a color video monitor.

13. The system of claim 1 wherein the image processor/controller produces a composite color image comprising red reflectance light, green reflectance light, and blue reflectance light images that are superimposed and displayed respectively on red, green, and blue channels of a color video monitor, when the light source filter for producing light for color imaging is inserted into the light path of the light source.

14. A color and fluorescence endoscopy video system including:

an endoscope for directing the light from a multi-mode light source into a patient to illuminate a tissue sample and to collect reflected light or fluorescence light produced by the tissue;

a camera positioned to receive the light collected by the endoscope to produce color or fluorescence images, the camera including:

a low light color image sensor having integrated filters with color output;

one or more filters positioned in front of the low light color image sensor for selectively blocking light with wavelengths below 450 nm and transmitting visible light with wavelengths greater than 470 nm; and

one or more optical imaging components that project images onto the low light color image sensor;

an image processor/controller that receives image signals from the low light color image sensor and combines and interpolates image signals from pixels having filters with the same integrated filter characteristics to fluorescence or reflectance light and then encodes the images as video signals;

a multi-mode light source for producing light for color imaging and/or for fluorescence excitation and/or for fluorescence excitation with reference reflectance, including a light source filter selectively positioned in the light path of the light source that simultaneously transmits the fluorescence excitation light at wavelengths less than 450 nm and an amount of reference reflectance light not in a fluorescence detection wavelength band, wherein the amount of reference reflectance light transmitted is a fraction of the fluorescence excitation light, such that the intensity of the reflected reference light projected onto the low light color image sensor is approximately matched to the intensity of fluorescence light also projected onto the low light color image sensor, the light source filter also blocking light from the light source at wavelengths in the fluorescence detection wavelength band such that the fluorescence light received by the low light color image sensor is substantially composed of light resulting from tissue fluorescence and minimally composed of light originating from the light source; and

a color video monitor for displaying superimposed video images from the pixels of the low light color image sensor.

15. The system of claim 14 , wherein the camera is attached to the portion of the endoscope that remains outside of the body.

16. The system of claim 14 , wherein the camera is built into the insertion portion of the endoscope.

17. The system of claim 15 or 16 , further comprising a filter selectively positioned in the light path of the light source that transmits fluorescence excitation light at wavelengths less than 450 nm and blocks light at visible wavelengths longer than 450 nm, from reaching the low light color image sensor to the extent that the light received by the low light color image sensor is substantially composed of light resulting from tissue fluorescence and minimally composed of light originating from the light source.

18. The system of claim 17 , wherein the image processor/controller produces a composite fluorescence/reflectance image comprising an image created from green fluorescence light and an image created from red fluorescence light that are superimposed and displayed in different colors on a color video monitor.

19. The system of claim 15 or 16 , further comprising a filter selectively positioned in the light path of the light source for producing light for color imaging that simultaneously transmits blue light at wavelengths less than 480 nm and amounts of green and red light, wherein the amounts of red and green light transmitted are adjusted to be a fraction of the transmitted blue light, such that, when reflected from a gray surface, the intensity of the green and red light projected onto the low light color image sensor matches the intensity of blue light also projected onto the low light color image sensor in such a way that the resulting color images are white balanced.

20. The system of claim 14 , wherein the fluorescence light, transmitted by the one or more filters positioned in front of the low light color image sensor, is green light.

21. The system of claim 20 , wherein the reference reflectance light, not in the detected fluorescence band, transmitted by the light source filter is red light.

22. The system of claim 21 , wherein the image processor/controller produces a composite fluorescence/reflectance image comprising an image created from green fluorescence light and an image created from red reflectance light that are superimposed and displayed in different colors on a color video monitor.

23. The system of claim 14 , wherein the fluorescence light, transmitted by the one or more filters positioned in front of the low light color image sensor, is red light.

24. The system of claim 23 , wherein the reference reflectance light, not in the detected fluorescence band, transmitted by the light source filter is green light.

25. The system of claim 24 , wherein the image processor/controller produces a composite fluorescence/reflectance image comprising an image created from red fluorescence light and an image created from green reflectance light that are superimposed and displayed in different colors on a color video monitor.

26. The system of claim 14 , wherein the image processor/controller produces a composite color image comprising red reflectance light, green reflectance light, and blue reflectance light images that are superimposed and displayed respectively on red, green, and blue channels of a color video monitor.

Assignments (18)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 26, 2023
From: STRYKER EUROPEAN OPERATIONS LIMITED
To: STRYKER CORPORATION
Reel/Frame 066140/0647 →
CORRECTIVE ASSIGNMENT TO CORRECT THE ERRONEOUSLY FILED AGAINST APPLICATION NO. 15/570,072 PREVIOUSLY RECORDED AT REEL: 052873 FRAME: 0597. ASSIGNOR(S) HEREBY CONFIRMS THE NUNC PRO TUNC ASSIGNMENT EFFECTIVE 09/05/2018. Recorded May 3, 2021
From: STRYKER EUROPEAN HOLDINGS IV, LLC
To: STRYKER EUROPEAN HOLDINGS III, LLC
Reel/Frame 056426/0352 →
CORRECTIVE ASSIGNMENT TO CORRECT THE ERRONEOUSLY FILED AGAINST APPLICATION NO. 15/570,072 PREVIOUSLY RECORDED AT REEL: 044910 FRAME: 0507. ASSIGNOR(S) HEREBY CONFIRMS THE MERGER AND CHANGE OF NAME. Recorded May 3, 2021
From: NOVADAQ TECHNOLOGIES INC.
To: NOVADAQ TECHNOLOGIES ULC
Reel/Frame 056425/0530 →
CORRECTIVE ASSIGNMENT TO CORRECT THE ERRONEOUSLY FILED AGAINST APPLICAITON NO. 15/570,072 PREVIOUSLY RECORDED AT REEL: 053318 FRAME: 0612. ASSIGNOR(S) HEREBY CONFIRMS THE NUNC PRO TUNC ASSIGNMENT EFFECTIVE 09/05/2018. Recorded May 3, 2021
From: STRYKER EUROPEAN HOLDINGS I, LLC
To: STRYKER EUROPEAN HOLDINGS IV, LLC
Reel/Frame 056425/0731 →
CORRECTIVE ASSIGNMENT TO CORRECT THE ERRONEOUSLY FILED AGAINST APPLICATION NO. 15/570,072 PREVIOUSLY RECORDED AT REEL: 052860 FRAME: 0900. ASSIGNOR(S) HEREBY CONFIRMS THE NUNC PRO TUNC ASSIGNMENT EFFECTIVE 12/31/2018. Recorded May 3, 2021
From: STRYKER EUROPEAN HOLDINGS LLC
To: STRYKER EUROPEAN OPERATIONS LIMITED
Reel/Frame 056426/0585 →
CORRECTIVE ASSIGNMENT TO CORRECT THE ERRONEOUSLY FILED AGAINST APPLICATION NO. 15/570,072 PREVIOUSLY RECORDED AT REEL: 052873 FRAME: 0548. ASSIGNOR(S) HEREBY CONFIRMS THE NUNC PRO TUNC ASSIGNMENT EFFECTIVE 11/30/2017. Recorded May 3, 2021
From: NOVADAQ TECHNOLOGIES ULC
To: STRYKER EUROPEAN HOLDINGS I, LLC
Reel/Frame 056425/0616 →
CORRECTIVE ASSIGNMENT TO CORRECT THE ERRONEOUSLY FILED AGAINST APPLICATION NO. 15/570,072 PREVIOUSLY RECORDED AT REEL: 053823 FRAME: 0445. ASSIGNOR(S) HEREBY CONFIRMS THE NUNC PRO TUNC ASSIGNMENT EFFECTIVE 11/29/2018. Recorded May 3, 2021
From: STRYKER EUROPEAN HOLDINGS III, LLC
To: STRYKER EUROPEAN HOLDINGS LLC
Reel/Frame 056426/0496 →
NUNC PRO TUNC ASSIGNMENT Recorded Jun 7, 2020
From: STRYKER EUROPEAN HOLDINGS I, LLC
To: STRYKER EUROPEAN HOLDINGS IV, LLC
Reel/Frame 053318/0612 →
NUNC PRO TUNC ASSIGNMENT Recorded Jun 7, 2020
From: STRYKER EUROPEAN HOLDINGS LLC
To: STRYKER EUROPEAN OPERATIONS LIMITED
Reel/Frame 052860/0900 →
NUNC PRO TUNC ASSIGNMENT Recorded Jun 7, 2020
From: NOVADAQ TECHNOLOGIES ULC
To: STRYKER EUROPEAN HOLDINGS I, LLC
Reel/Frame 052873/0548 →
NUNC PRO TUNC ASSIGNMENT Recorded Jun 7, 2020
From: STRYKER EUROPEAN HOLDINGS IV, LLC
To: STRYKER EUROPEAN HOLDINGS III, LLC
Reel/Frame 052873/0597 →
NUNC PRO TUNC ASSIGNMENT Recorded Jun 7, 2020
From: STRYKER EUROPEAN HOLDINGS III, LLC
To: STRYKER EUROPEAN HOLDINGS LLC
Reel/Frame 053823/0445 →
MERGER AND CHANGE OF NAME Recorded Dec 19, 2017
From: NOVADAQ TECHNOLOGIES INC.; STRYKER CANADA OPERATIONS ULC
To: NOVADAQ TECHNOLOGIES ULC
Reel/Frame 044910/0507 →
RELEASE OF SECURITY INTEREST Recorded Sep 8, 2017
From: MIDCAP FUNDING IV TRUST (AS SUCCESSOR AGENT TO MIDCAP FINANCIAL TRUST)
To: NOVADAQ TECHNOLOGIES INC.; NOVADAQ CORP.
Reel/Frame 043786/0344 →
RELEASE OF SECURITY INTEREST Recorded Sep 8, 2017
From: MIDCAP FINANCIAL TRUST
To: NOVADAQ TECHNOLOGIES INC.; NOVADAQ CORP.
Reel/Frame 043788/0799 →
SECURITY AGREEMENT (REVOLVING) Recorded Jan 9, 2017
From: NOVADAQ TECHNOLOGIES; NOVADAQ CORP.
To: MIDCAP FINANCIAL TRUST, AS AGENT
Reel/Frame 041306/0172 →
SECURITY AGREEMENT (TERM) Recorded Jan 9, 2017
From: NOVADAQ TECHNOLOGIES; NOVADAQ CORP.
To: MIDCAP FINANCIAL TRUST, AS AGENT
Reel/Frame 041306/0189 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 16, 2007
From: XILLIX TECHNOLOGIES CORP.
To: NOVADAQ TECHNOLOGIES INC.
Reel/Frame 019297/0691 →