IP Library Granted Patent US 9,642,532
Granted Patent B2
US 9,642,532 · App. 14/873,842 · Granted May 9, 2017

Imaging system for combined full-color reflectance and near-infrared imaging

Inventors: John Fengler (North Vancouver, CA); Paul R. Westwick (Vancouver, CA); Aurther E. Bailey (North Vancouver, CA); Paul Cottle (Vancouver, CA)
Assignee: NOVADAQ TECHNOLOGIES INC.
A61B5/0086A61B1/0005A61B1/00045A61B1/00186A61B1/04A61B1/042A61B1/043A61B1/045A61B1/0638A61B1/0646A61B5/0062A61B5/0071A61B5/418A61B5/7425A61B1/00009A61B1/00043A61B1/00163A61B1/06A61B1/0669A61B5/0075G06T2207/10048H04N5/33H04N5/332
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,642,532
App. No.
14/873,842
Granted
May 9, 2017
Kind
B2
Abstract

An imaging system for acquisition of NIR and full-color images includes a light source providing visible light and NIR light to an area under observation, such as living tissue, a camera having one or more image sensors configured to separately detect blue reflectance light, green reflectance light, and combined red reflectance light/detected NIR light returned from the area under observation. A controller in signal communication with the light source and the camera is configured to control the light source to continuously illuminate area under observation with temporally continuous blue/green illumination light and with red illumination light and NIR excitation light. At least one of the red illumination light and NIR excitation light are switched on and off periodically in synchronism with the acquisition of red and NIR light images in the camera.

Claims (35)

1. An imaging system for acquisition of NIR images and full-color images comprising:

a light source providing visible light and NIR light to an area under observation, the visible light comprising blue illumination light, green illumination light, and red illumination light, the blue illumination light being reflected from the tissue as blue reflectance light, the green illumination light being reflected from the tissue as green reflectance light, and the red illumination light being reflected from the tissue as red reflectance light;

a camera having one or more image sensors;

a controller in signal communication with the light source and the camera for illuminating the area under observation with the blue illumination light continuously and illuminating the area under observation with the red illumination light and the NIR illumination light, wherein at least one of the red illumination light and NIR illumination light is switched on and off periodically according to a predetermined timing scheme, and

simultaneously acquiring a first image signal corresponding to the blue illumination light, a second image signal corresponding to the green illumination light, and a third image signal corresponding to the red illumination light and NIR illumination light; and

determining the red reflectance light and detected NIR light from the third image signal, based on the timing scheme, and

wherein the imaging system is configured to generate the full-color reflectance and NIR images of the area under observation.

2. The imaging system of claim 1 , wherein the area under observation is alternatingly illuminated by the light source with red illumination light and NIR illumination light.

3. The imaging system of claim 1 , wherein the light source comprises

an illuminator emitting a substantially constant intensity of visible light and NIR light over a continuous spectral range, and

a plurality of filters disposed between the illuminator and the area under observation for transmitting temporally continuous blue light and temporally discontinuous red light and discontinuous NIR light.

4. The imaging system of claim 1 , wherein the light source comprises

an illuminator emitting a substantially constant intensity of visible light and NIR light over a continuous spectral range,

first dichroic means for separating the visible light and NIR light into blue and red light and NIR light,

shutter means for transforming the separated red light and NIR light into temporally discontinuous red light and discontinuous NIR light, and

second dichroic means for combining the blue light, the temporally discontinuous red light and the temporally discontinuous NIR light for transmission to the area under observation.

5. The imaging system of claim 1 , wherein the light source comprises

a first illuminator emitting a substantially constant intensity of green and blue light,

a second illuminator producing switched red light,

a third illuminator producing switched NIR light, and

dichroic means for combining the switched red light and the switched NIR light with the green and blue light for transmission to the area under observation.

6. The imaging system of claim 5 , wherein the switched red light and the NIR light are produced by interrupting a continuous intensity light beam of the red light and the NIR light by a shutter or chopper.

7. The imaging system of claim 5 , wherein the switched red light and the NIR light are produced by electrically switching the second illuminator and the third illuminator on and off.

8. The imaging system of claim 1 , wherein the one or more image sensors are configured to employ an interlaced scan.

9. The imaging system of claim 1 , wherein the predetermined timing scheme includes alternating the red illumination light and NIR illumination light.

10. The imaging system of claim 9 , wherein the duration of illumination with the red illumination light is longer than the duration of illumination with the NIR illumination light.

11. The imaging system of claim 1 , where the controller controls the light source such that the green illumination light continuously illuminates the area under observation.

12. The imaging system of claim 1 , wherein the camera comprises a single sensor.

13. The imaging system of claim 12 , wherein the single sensor comprises a three-color RGB sensor.

14. The imaging system of claim 1 , wherein the light source comprises one or more solid state sources.

15. The imaging system of claim 1 , wherein the blue, green, and red illumination light are produced by blue, green, and red LEDs, respectively.

16. The imaging system of claim 1 , wherein the one or more image sensors comprise a single image sensor having pixels, each pixel responsive to one of the blue reflectance light, the green reflectance light, and the red reflectance light and NIR light returned from the area under observation.

17. The imaging system of claim 16 , wherein the single image sensor comprises a mosaic filter array.

18. The imaging system of claim 1 , wherein the imaging system is configured as an endoscope.

19. The imaging system of claim 1 , wherein the NIR light detected by the camera is fluorescent light.

Assignments (18)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 26, 2023
From: STRYKER EUROPEAN OPERATIONS LIMITED
To: STRYKER CORPORATION
Reel/Frame 066140/0647 →
CORRECTIVE ASSIGNMENT TO CORRECT THE ERRONEOUSLY FILED AGAINST APPLICATION NO. 15/570,072 PREVIOUSLY RECORDED AT REEL: 053823 FRAME: 0445. ASSIGNOR(S) HEREBY CONFIRMS THE NUNC PRO TUNC ASSIGNMENT EFFECTIVE 11/29/2018. Recorded May 3, 2021
From: STRYKER EUROPEAN HOLDINGS III, LLC
To: STRYKER EUROPEAN HOLDINGS LLC
Reel/Frame 056426/0496 →
CORRECTIVE ASSIGNMENT TO CORRECT THE ERRONEOUSLY FILED AGAINST APPLICATION NO. 15/570,072 PREVIOUSLY RECORDED AT REEL: 052873 FRAME: 0548. ASSIGNOR(S) HEREBY CONFIRMS THE NUNC PRO TUNC ASSIGNMENT EFFECTIVE 11/30/2017. Recorded May 3, 2021
From: NOVADAQ TECHNOLOGIES ULC
To: STRYKER EUROPEAN HOLDINGS I, LLC
Reel/Frame 056425/0616 →
CORRECTIVE ASSIGNMENT TO CORRECT THE ERRONEOUSLY FILED AGAINST APPLICATION NO. 15/570,072 PREVIOUSLY RECORDED AT REEL: 052860 FRAME: 0900. ASSIGNOR(S) HEREBY CONFIRMS THE NUNC PRO TUNC ASSIGNMENT EFFECTIVE 12/31/2018. Recorded May 3, 2021
From: STRYKER EUROPEAN HOLDINGS LLC
To: STRYKER EUROPEAN OPERATIONS LIMITED
Reel/Frame 056426/0585 →
CORRECTIVE ASSIGNMENT TO CORRECT THE ERRONEOUSLY FILED AGAINST APPLICATION NO. 15/570,072 PREVIOUSLY RECORDED AT REEL: 044910 FRAME: 0507. ASSIGNOR(S) HEREBY CONFIRMS THE MERGER AND CHANGE OF NAME. Recorded May 3, 2021
From: NOVADAQ TECHNOLOGIES INC.
To: NOVADAQ TECHNOLOGIES ULC
Reel/Frame 056425/0530 →
CORRECTIVE ASSIGNMENT TO CORRECT THE ERRONEOUSLY FILED AGAINST APPLICAITON NO. 15/570,072 PREVIOUSLY RECORDED AT REEL: 053318 FRAME: 0612. ASSIGNOR(S) HEREBY CONFIRMS THE NUNC PRO TUNC ASSIGNMENT EFFECTIVE 09/05/2018. Recorded May 3, 2021
From: STRYKER EUROPEAN HOLDINGS I, LLC
To: STRYKER EUROPEAN HOLDINGS IV, LLC
Reel/Frame 056425/0731 →
CORRECTIVE ASSIGNMENT TO CORRECT THE ERRONEOUSLY FILED AGAINST APPLICATION NO. 15/570,072 PREVIOUSLY RECORDED AT REEL: 052873 FRAME: 0597. ASSIGNOR(S) HEREBY CONFIRMS THE NUNC PRO TUNC ASSIGNMENT EFFECTIVE 09/05/2018. Recorded May 3, 2021
From: STRYKER EUROPEAN HOLDINGS IV, LLC
To: STRYKER EUROPEAN HOLDINGS III, LLC
Reel/Frame 056426/0352 →
NUNC PRO TUNC ASSIGNMENT Recorded Jun 7, 2020
From: STRYKER EUROPEAN HOLDINGS I, LLC
To: STRYKER EUROPEAN HOLDINGS IV, LLC
Reel/Frame 053318/0612 →
NUNC PRO TUNC ASSIGNMENT Recorded Jun 7, 2020
From: STRYKER EUROPEAN HOLDINGS LLC
To: STRYKER EUROPEAN OPERATIONS LIMITED
Reel/Frame 052860/0900 →
NUNC PRO TUNC ASSIGNMENT Recorded Jun 7, 2020
From: NOVADAQ TECHNOLOGIES ULC
To: STRYKER EUROPEAN HOLDINGS I, LLC
Reel/Frame 052873/0548 →
NUNC PRO TUNC ASSIGNMENT Recorded Jun 7, 2020
From: STRYKER EUROPEAN HOLDINGS IV, LLC
To: STRYKER EUROPEAN HOLDINGS III, LLC
Reel/Frame 052873/0597 →
NUNC PRO TUNC ASSIGNMENT Recorded Jun 7, 2020
From: STRYKER EUROPEAN HOLDINGS III, LLC
To: STRYKER EUROPEAN HOLDINGS LLC
Reel/Frame 053823/0445 →
MERGER AND CHANGE OF NAME Recorded Dec 19, 2017
From: NOVADAQ TECHNOLOGIES INC.; STRYKER CANADA OPERATIONS ULC
To: NOVADAQ TECHNOLOGIES ULC
Reel/Frame 044910/0507 →
RELEASE OF SECURITY INTEREST Recorded Sep 8, 2017
From: MIDCAP FINANCIAL TRUST
To: NOVADAQ TECHNOLOGIES INC.; NOVADAQ CORP.
Reel/Frame 043788/0799 →
RELEASE OF SECURITY INTEREST Recorded Sep 8, 2017
From: MIDCAP FUNDING IV TRUST (AS SUCCESSOR AGENT TO MIDCAP FINANCIAL TRUST)
To: NOVADAQ TECHNOLOGIES INC.; NOVADAQ CORP.
Reel/Frame 043786/0344 →
SECURITY AGREEMENT (TERM) Recorded Jan 9, 2017
From: NOVADAQ TECHNOLOGIES; NOVADAQ CORP.
To: MIDCAP FINANCIAL TRUST, AS AGENT
Reel/Frame 041306/0189 →
SECURITY AGREEMENT (REVOLVING) Recorded Jan 9, 2017
From: NOVADAQ TECHNOLOGIES; NOVADAQ CORP.
To: MIDCAP FINANCIAL TRUST, AS AGENT
Reel/Frame 041306/0172 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 15, 2016
From: FENGLER, JOHN; WESTWICK, PAUL; BAILEY, ARTHUR E.; COTTLE, PAUL
To: NOVADAQ TECHNOLOGIES INC.
Reel/Frame 039434/0672 →
Continuity (3)
Continuation 12933512
Provisional Application 61037514 · Mar 18, 2008
Related Publication 20160100763A1 · Apr 14, 2016