IP Library Granted Patent US 12,201,270
Granted Patent B2
US 12,201,270 · App. 18/310,515 · Granted Jan 21, 2025

Systems and methods for medical imaging using a rolling shutter imager

Inventors: William Huei Liang Chang (Milpitas, CA); Bryan Larson (San Jose, CA); John Shen (San Jose, CA); Benjamin Feingold (Tucson, AZ); Ajay Ramesh (Pleasanton, CA)
Assignee: Stryker Corporation
A61B1/045A61B1/000095A61B1/043A61B1/0684G06T7/0012H04N23/56H04N23/74H04N25/531G06T2207/10068G06T2207/30004H04N23/555
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,201,270
App. No.
18/310,515
Granted
Jan 21, 2025
Kind
B2
Abstract

A system includes an illumination source and an imaging apparatus that includes an electronic rolling shutter imager and is configured for sequentially resetting rows of pixels of the rolling shutter imager from a first row to a last row, sequentially reading charge accumulated at the rows of pixels from the first row to the last row, wherein the first row is read after resetting the last row, controlling the illumination source to illuminate the tissue of the subject with illumination light for an illumination period that lasts longer than a vertical blanking period, wherein the vertical blanking period is the period from the resetting of the last row to the reading of the first row, and generating an image frame from the readings of charge accumulated at the rows of pixels, wherein at least one reading of charge accumulated at a row of pixels is removed or replaced.

Claims (21)

1. A system for imaging tissue of a subject, the system comprising: an illumination source;

and an imaging apparatus that comprises an electronic rolling shutter imager, the imaging apparatus being configured for: sequentially resetting rows of pixels of the rolling shutter imager from a first row to a last row, sequentially reading charge accumulated at the rows of pixels from the first row to the last row, wherein the first row is read after resetting the last row, controlling the illumination source to illuminate the tissue of the subject for an illumination period that lasts longer than a vertical blanking period, wherein the vertical blanking period is the period from the resetting of the last row to the reading of the first row, and wherein the illumination period ends at or after an end of the vertical blanking period, and generating an image frame from the readings of charge accumulated at the rows of pixels, wherein at least one reading of charge accumulated at a row of pixels is removed or replaced to generate the image frame.

2. The system of claim 1 , wherein the imaging apparatus comprises a camera control unit connected to an imaging head that includes the rolling shutter imager.

3. The system of claim 1 , wherein the illumination source is configured for pulse width modulated illumination and the camera control unit generates a pulse width modulation waveform for controlling the illumination source.

4. The system of claim 1 , wherein the illumination period begins prior to the resetting of the last row.

5. The system of claim 1 , wherein the illumination period ends after the reading of the first row.

6. The system of claim 1 , wherein the illumination period begins at least when the vertical blanking period begins.

7. The system of claim 1 , wherein at least a reading of charge accumulated at the first row of pixels is removed or replaced to generate the image frame.

8. The system of claim 1 , wherein at least a reading of charge accumulated at the last row of pixels is removed or replaced to generate the image frame.

9. The system of claim 1 , wherein the at least one reading of charge accumulated at a row of pixels is replaced by at least one predetermined value to generate the image frame.

10. The system of claim 1 , wherein at least one reading of charge accumulated at a row of pixels is removed by cropping to generate the image frame.

11. The system of claim 1 , wherein the imaging apparatus is configured for controlling the illumination source to illuminate the tissue of the subject with fluorescence excitation light at least during a subsequent vertical blanking period and generating a fluorescence image frame based on light emitted from the tissue of the subject in response to the fluorescence excitation light.

12. The system of claim 11 , wherein the imaging apparatus is configured for imaging a fluorescence imaging agent present in the tissue of the subject.

13. The system of claim 11 , wherein the imaging apparatus is configured for controlling the illumination source to illuminate the tissue of the subject with fluorescence excitation light and visible illumination light simultaneously during the illumination period.

14. The system of claim 1 , wherein controlling the illumination source to illuminate the tissue of the subject with illumination light comprises controlling the illumination source to pulse the illumination light.

15. The system of claim 14 , wherein the imaging apparatus is configured for controlling a pulse width of the pulsed illumination light based on readings of charge accumulated at the rows of pixels during a previous frame.

16. The system of claim 1 , wherein the illumination light is generated by at least one LED.

17. The system of claim 1 , wherein the imaging apparatus is an endoscopic imager.

18. The system of claim 1 , wherein the rolling shutter imager comprises a mechanical shutter and the mechanical shutter remains at least partially open from before the illumination period begins until after the illumination period ends.

19. The system of claim 18 , wherein the imaging apparatus is configured for reducing an amount of light received at the rolling shutter imager by operating the mechanical shutter.

20. The system of claim 1 , wherein the imaging apparatus is configured for adjusting a gain of the rolling shutter imager based on readings of charge accumulated at the rows of pixels during a previous frame.

Assignments (1)
CHANGE OF ADDRESS Recorded Dec 18, 2024
From: STRYKER CORPORATION
To: STRYKER CORPORATION
Reel/Frame 069737/0184 →
Continuity (3)
Division 16745154 · Jan 16, 2020
Provisional Application 62793790 · Jan 17, 2019
Related Publication 20230320577A1 · Oct 12, 2023
References Cited (64)
US 3289957A · Hans-gunter et al. · 1966 [cited by applicant]
US 6293911B1 · Imaizumi · 2001 [cited by applicant]
US 7059726B2 · Engle · 2006 [cited by applicant]
US 7179222B2 · Imaizumi · 2007 [cited by applicant]
US 7397509B2 · Krymski · 2008 [cited by examiner]
US 7479990B2 · Imaizumi · 2009 [cited by applicant]
US 8540626B2 · Seto et al. · 2013 [cited by applicant]
US 8550990B2 · Seto et al. · 2013 [cited by applicant]
US 9060404B2 · Upton · 2015 [cited by applicant]
US 9131861B2 · Ince et al. · 2015 [cited by applicant]
US 9307600B2 · Upton · 2016 [cited by applicant]
US 9531156B2 · Hoffman et al. · 2016 [cited by applicant]
US 10624535B2 · Sakanoue et al. · 2020 [cited by applicant]
US 11337593B2 · Tanaka et al. · 2022 [cited by applicant]
US 11337595B2 · Ogawa · 2022 [cited by applicant]
US 11347189B1 · Herrera · 2022 [cited by examiner]
US 11446810B1 · Chua · 2022 [cited by applicant]
US 20070221823A1 · Xu · 2007 [cited by examiner]
US 20100286529A1 · Carroll · 2010 [cited by applicant]
US 20120013777A1 · Mao · 2012 [cited by examiner]
US 20130050456A1 · Sakurai · 2013 [cited by applicant]
US 20130208157A1 · Bechtel · 2013 [cited by examiner]
US 20140078277A1 · Dai · 2014 [cited by examiner]
US 20140203170A1 · Ono et al. · 2014 [cited by applicant]
US 20140225998A1 · Dai · 2014 [cited by examiner]
US 20140313386A1 · Jiang · 2014 [cited by examiner]
US 20150085077A1 · Kim · 2015 [cited by applicant]
US 20150201871A1 · Shiraishi · 2015 [cited by examiner]
US 20150216460A1 · Shigeta · 2015 [cited by examiner]
US 20150238086A1 · Saito · 2015 [cited by examiner]
US 20160374602A1 · Koshiba · 2016 [cited by examiner]
US 20170035280A1 · Yang · 2017 [cited by examiner]
US 20190324261A1 · Ogawa · 2019 [cited by examiner]
US 20200404198A1 · Kobayashi · 2020 [cited by applicant]
US 20210038066A1 · Bos et al. · 2021 [cited by applicant]
US 20220210309A1 · Feingold · 2022 [cited by applicant]
US 20220322935A1 · Suzuki · 2022 [cited by applicant]
US 20230270324A1 · Chang · 2023 [cited by applicant]
CN 104486986A · 2015 [cited by applicant]
EP 3289957A1 · 2018 [cited by applicant]
JP 2015530893A · 2015 [cited by applicant]
JP 2018202006A · 2018 [cited by applicant]
JP 2019191323A · 2019 [cited by applicant]
WO 2010059197A2 · 2010 [cited by applicant]
WO 2013175908A1 · 2013 [cited by applicant]
WO 2014018936A2 · 2014 [cited by applicant]
WO 2017065057A1 · 2017 [cited by applicant]
WO 2017221491A1 · 2017 [cited by applicant]
Chang et al., U.S. Notice of Allowance and Fee(s) Due mailed Dec. 21, 2022, directed to U.S. Appl. No. 16/745,154; 11 pages. [cited by applicant]
Chang et al., U.S. Office Action dated Jun. 8, 2022, directed to U.S. Appl. No. 16/745,154; 14 pages. [cited by applicant]
Chang et al., U.S. Restriction Requirement dated Jan. 10, 2022, directed to U.S. Appl. No. 16/745,154; 9 pages. [cited by applicant]
International Preliminary Report on Patentability dated Jun. 16, 2021, directed to International Application No. PCT/US2020/013912; 13 pages. [cited by applicant]
International Search Report and Written Opinion mailed Jun. 25, 2020, directed to International Application No. PCT/US2020/013912; 19 pages. [cited by applicant]
Invitation to Pay Additional Fees and, where Applicable, Protest Fee and Partial Search mailed Apr. 28, 2020, directed to International Application No. PCT/US2020/013912; 13 pages. [cited by applicant]
Chang et al., U.S. Office Action dated Apr. 3, 2024, directed to U.S. Appl. No. 18/310,517; 13 pages. [cited by applicant]
Chang et al., U.S. Office Action dated Sep. 28, 2023, directed to U.S. Appl. No. 18/310,517; 16 pages. [cited by applicant]
Feingold et al., U.S. Notice of Allowance and Fee(s) Due mailed Feb. 2, 2024, directed to U.S. Appl. No. 17/560,156; 8 pages. [cited by applicant]
International Preliminary Report on Patentability dated Jul. 4, 2023, directed to International Application No. PCT/US2021/073092; 12 pages. [cited by applicant]
International Search Report and Written Opinion mailed May 27, 2022, directed to International Application No. PCT/US2021/073092; 17 pages. [cited by applicant]
Invitation to Pay Additional Fees and, where applicable, Protest Fee mailed Apr. 4, 2022, directed to International Application No. PCT/US2021/073092; 14 pages. [cited by applicant]
Notice of Reasons for Refusal dated Nov. 10, 2023, directed to JP Application No. 2021-541534; 6 pages. [cited by applicant]
Office Action dated Jan. 26, 2024, directed to EP Application No. 20 706 891.7; 7 pages. [cited by applicant]
Decision of Refusal dated May 27, 2024, directed to JP Application No. 2021-541534; 4 pages. [cited by applicant]
The First Office Action dated Jun. 28, 2024, directed to CN Application No. 202080021725.2; 26 pages. [cited by applicant]