IP Library Granted Patent US 10,779,734
Granted Patent B2
US 10,779,734 · App. 15/584,405 · Granted Sep 22, 2020

Imaging system for combine full-color reflectance and near-infrared imaging

Inventors: John Fengler (North Vancouver, CA); Paul R. Westwick (Vancouver, CA); Aurther E. Bailey (North Vancouver, CA); Paul Cottle (Vancouver, CA)
Assignee: Stryker European Operations Limited
A61B5/0086A61B1/0005A61B1/00045A61B1/00186A61B1/04A61B1/042A61B1/043A61B1/045A61B1/0638A61B1/0646A61B5/0062A61B5/0071A61B5/7425G02B27/1013H04N5/33H04N5/332A61B1/00009A61B1/00043A61B1/00163A61B1/06A61B1/0669A61B5/0075A61B5/418G06T2207/10048
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,779,734
App. No.
15/584,405
Granted
Sep 22, 2020
Kind
B2
Abstract

An imaging system for acquisition of NIR and full-color images includes a light source providing visible light and NIR light to an area under observation, such as living tissue, a camera having one or more image sensors configured to separately detect blue reflectance light, green reflectance light, and combined red reflectance light/detected NIR light returned from the area under observation. A controller in signal communication with the light source and the camera is configured to control the light source to continuously illuminate area under observation with temporally continuous blue/green illumination light and with red illumination light and NIR excitation light. At least one of the red illumination light and NIR excitation light are switched on and off periodically in synchronism with the acquisition of red and NIR light images in the camera.

Claims (22)

1. A medical imaging system for acquisition of NIR images and full-color images comprising:

a light source configured to provide visible light and NIR excitation light to a sample area; and

a camera having an image sensor, the image sensor comprising:

a barrier filter to block NIR excitation light, and

sensor pixels arranged in a stacked array, the sensor pixels including:

first sensor pixels located at a first depth in the image sensor, the first sensor pixels configured to detect blue reflectance light,

second sensor pixels located at a second depth in the image sensor that is different from the first depth, the second sensor pixels configured to detect green reflectance light,

third sensor pixels located at a third depth in the image sensor that is different from the first and second depths, the third sensor pixels configured to detect red reflectance light, and

fourth sensor pixels located at a fourth depth in the image sensor that is different from the first, second, and third depths, the fourth sensor pixels configured to detect NIR fluorescence light received from the sample area.

2. The imaging system of claim 1 , wherein the image sensor is a CMOS sensor.

3. The imaging system of claim 1 , wherein the system is configured to generate NIR images and full-color images of the sample area.

4. The imaging system of claim 1 , wherein the visible light provided by the light source comprises blue illumination light, green illumination light, and red illumination light, the blue illumination light being reflected from the tissue as blue reflectance light, the green illumination light being reflected from the tissue as green reflectance light, and the red illumination light being reflected from the tissue as red reflectance light.

5. The imaging system of claim 4 , comprising a controller in signal communication with the light source and the camera, the controller being configured to:

control the light source to illuminate the area under observation with the blue illumination light continuously and illuminate the area under observation with the red illumination light and the NIR illumination light, wherein at least one of the red illumination light and NIR illumination light is switched on and off periodically according to a predetermined timing scheme;

simultaneously acquire a first image signal corresponding to the blue illumination light, and a second image signal corresponding to the red illumination light and the NIR illumination light; and

determine the red reflectance light and detected NIR light from the second image signal, based on the predetermined timing scheme.

6. The imaging system of claim 5 , wherein the predetermined timing scheme includes alternating the red illumination light and NIR illumination light.

7. The imaging system of claim 1 , wherein the light source comprises an illuminator configured to emit a substantially constant intensity of visible light and NIR light over a continuous spectral range, and a plurality of filters disposed between the illuminator and the area under observation for transmitting temporally continuous blue light and temporally discontinuous red light and discontinuous NIR light.

8. The imaging system of claim 1 , wherein the light source comprises one or more solid state sources.

9. The imaging system of claim 1 , wherein the blue, green, and red illumination light are produced by blue, green, and red LEDs, respectively.

10. The imaging system of claim 1 , wherein the imaging system is configured as an endoscope.

11. The imaging system of claim 1 , wherein the NIR light detected by the camera is fluorescent light.

Assignments (15)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 26, 2023
From: STRYKER EUROPEAN OPERATIONS LIMITED
To: STRYKER CORPORATION
Reel/Frame 066140/0647 →
CORRECTIVE ASSIGNMENT TO CORRECT THE ERRONEOUSLY FILED AGAINST APPLICATION NO. 15/570,072 PREVIOUSLY RECORDED AT REEL: 044910 FRAME: 0507. ASSIGNOR(S) HEREBY CONFIRMS THE MERGER AND CHANGE OF NAME. Recorded May 3, 2021
From: NOVADAQ TECHNOLOGIES INC.
To: NOVADAQ TECHNOLOGIES ULC
Reel/Frame 056425/0530 →
CORRECTIVE ASSIGNMENT TO CORRECT THE ERRONEOUSLY FILED AGAINST APPLICATION NO. 15/570,072 PREVIOUSLY RECORDED AT REEL: 052873 FRAME: 0548. ASSIGNOR(S) HEREBY CONFIRMS THE NUNC PRO TUNC ASSIGNMENT EFFECTIVE 11/30/2017. Recorded May 3, 2021
From: NOVADAQ TECHNOLOGIES ULC
To: STRYKER EUROPEAN HOLDINGS I, LLC
Reel/Frame 056425/0616 →
CORRECTIVE ASSIGNMENT TO CORRECT THE ERRONEOUSLY FILED AGAINST APPLICATION NO. 15/570,072 PREVIOUSLY RECORDED AT REEL: 053823 FRAME: 0445. ASSIGNOR(S) HEREBY CONFIRMS THE NUNC PRO TUNC ASSIGNMENT EFFECTIVE 11/29/2018. Recorded May 3, 2021
From: STRYKER EUROPEAN HOLDINGS III, LLC
To: STRYKER EUROPEAN HOLDINGS LLC
Reel/Frame 056426/0496 →
CORRECTIVE ASSIGNMENT TO CORRECT THE ERRONEOUSLY FILED AGAINST APPLICATION NO. 15/570,072 PREVIOUSLY RECORDED AT REEL: 052873 FRAME: 0597. ASSIGNOR(S) HEREBY CONFIRMS THE NUNC PRO TUNC ASSIGNMENT EFFECTIVE 09/05/2018. Recorded May 3, 2021
From: STRYKER EUROPEAN HOLDINGS IV, LLC
To: STRYKER EUROPEAN HOLDINGS III, LLC
Reel/Frame 056426/0352 →
CORRECTIVE ASSIGNMENT TO CORRECT THE ERRONEOUSLY FILED AGAINST APPLICATION NO. 15/570,072 PREVIOUSLY RECORDED AT REEL: 052860 FRAME: 0900. ASSIGNOR(S) HEREBY CONFIRMS THE NUNC PRO TUNC ASSIGNMENT EFFECTIVE 12/31/2018. Recorded May 3, 2021
From: STRYKER EUROPEAN HOLDINGS LLC
To: STRYKER EUROPEAN OPERATIONS LIMITED
Reel/Frame 056426/0585 →
CORRECTIVE ASSIGNMENT TO CORRECT THE ERRONEOUSLY FILED AGAINST APPLICAITON NO. 15/570,072 PREVIOUSLY RECORDED AT REEL: 053318 FRAME: 0612. ASSIGNOR(S) HEREBY CONFIRMS THE NUNC PRO TUNC ASSIGNMENT EFFECTIVE 09/05/2018. Recorded May 3, 2021
From: STRYKER EUROPEAN HOLDINGS I, LLC
To: STRYKER EUROPEAN HOLDINGS IV, LLC
Reel/Frame 056425/0731 →
NUNC PRO TUNC ASSIGNMENT Recorded Jun 7, 2020
From: STRYKER EUROPEAN HOLDINGS III, LLC
To: STRYKER EUROPEAN HOLDINGS LLC
Reel/Frame 053823/0445 →
NUNC PRO TUNC ASSIGNMENT Recorded Jun 7, 2020
From: STRYKER EUROPEAN HOLDINGS LLC
To: STRYKER EUROPEAN OPERATIONS LIMITED
Reel/Frame 052860/0900 →
NUNC PRO TUNC ASSIGNMENT Recorded Jun 7, 2020
From: NOVADAQ TECHNOLOGIES ULC
To: STRYKER EUROPEAN HOLDINGS I, LLC
Reel/Frame 052873/0548 →
NUNC PRO TUNC ASSIGNMENT Recorded Jun 7, 2020
From: STRYKER EUROPEAN HOLDINGS IV, LLC
To: STRYKER EUROPEAN HOLDINGS III, LLC
Reel/Frame 052873/0597 →
NUNC PRO TUNC ASSIGNMENT Recorded Jun 7, 2020
From: STRYKER EUROPEAN HOLDINGS I, LLC
To: STRYKER EUROPEAN HOLDINGS IV, LLC
Reel/Frame 053318/0612 →
MERGER AND CHANGE OF NAME Recorded Dec 19, 2017
From: NOVADAQ TECHNOLOGIES INC.; STRYKER CANADA OPERATIONS ULC
To: NOVADAQ TECHNOLOGIES ULC
Reel/Frame 044910/0507 →
RELEASE OF SECURITY INTEREST Recorded Sep 8, 2017
From: MIDCAP FUNDING IV TRUST (AS SUCCESSOR AGENT TO MIDCAP FINANCIAL TRUST)
To: NOVADAQ TECHNOLOGIES INC.; NOVADAQ CORP.
Reel/Frame 043786/0344 →
RELEASE OF SECURITY INTEREST Recorded Sep 8, 2017
From: MIDCAP FINANCIAL TRUST
To: NOVADAQ TECHNOLOGIES INC.; NOVADAQ CORP.
Reel/Frame 043788/0799 →
Continuity (4)
Continuation 14873842 · Oct 2, 2015
Continuation 12933512
Provisional Application 61037514 · Mar 18, 2008
Related Publication 20170273567A1 · Sep 28, 2017
Cited By (8)
US 12,219,226 US 12,266,984 US 12,335,591 US 12,396,628 US 12,525,340 US 12,666,156 US 12,672,781 US 12,720,177