IP Library Granted Patent US 12,201,271
Granted Patent B2
US 12,201,271 · App. 18/310,517 · Granted Jan 21, 2025

Systems and methods for medical imaging using a rolling shutter imager

Inventors: William Huei Liang Chang (Milpitas, CA); Bryan Larson (San Jose, CA); John Shen (San Jose, CA); Benjamin Feingold (Tucson, AZ); Ajay Ramesh (Pleasanton, CA)
Assignee: Stryker Corporation
A61B1/045A61B1/000095A61B1/043A61B1/0684G06T7/0012H04N23/56H04N23/74H04N25/531G06T2207/10068G06T2207/30004H04N23/555
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,201,271
App. No.
18/310,517
Granted
Jan 21, 2025
Kind
B2
Abstract

A method of imaging tissue of a subject using an electronic rolling shutter imager includes sequentially resetting rows of pixels of the rolling shutter imager from a first row to a last row for a first amount of time; illuminating the tissue of the subject with illumination light over an illumination period that begins once the last row of the rolling shutter imager has been reset and lasts for at least the first amount of time; accumulating charge at the rows of pixels over at least the illumination period based on light that is received from the tissue of the subject while the tissue of the subject is illuminated with the illumination light; sequentially reading charge accumulated at the rows of pixels from the first row to the last row once the illumination period has ended; and generating an image frame from the rows of pixels.

Claims (25)

1. A method of imaging tissue of a subject using an electronic rolling shutter imager, the method comprising:

sequentially resetting rows of pixels of the rolling shutter imager from a first row to a last row, wherein the sequential resetting from the first row to the last row lasts a first amount of time;

illuminating the tissue of the subject with illumination light over an illumination period that begins once the last row of the rolling shutter imager has been reset and lasts for at least the first amount of time;

accumulating charge at the rows of pixels over at least the illumination period based on light that is received from the tissue of the subject while the tissue of the subject is illuminated with the illumination light;

sequentially reading charge accumulated at the rows of pixels from the first row to the last row once the illumination period has ended; and

generating an image frame from the readings of charge accumulated at the rows of pixels.

2. The method of claim 1 , wherein illuminating the tissue of the subject with illumination light comprises pulsing the illumination light.

3. The method of claim 1 , further comprising controlling a pulse width of the pulsed illumination light based on readings of charge accumulated at the rows of pixels during a previous frame.

4. The method of claim 1 , wherein each row of pixels accumulates charge over the illumination period.

5. The method of claim 1 , wherein each row of pixels accumulates charge for at least twice the first amount of time.

6. The method of claim 1 , wherein the illumination light is generated by at least one LED.

7. The method of claim 1 , wherein the rolling shutter imager is part of an endoscopic imager.

8. The method of claim 1 , wherein the rolling shutter imager comprises a mechanical shutter and the mechanical shutter remains at least partially open from before the illumination begins until after the illumination period ends.

9. The method of claim 8 , further comprising reducing an amount of light received at the rolling shutter imager by operating the mechanical shutter.

10. The method of claim 1 , further comprising adjusting a gain of the rolling shutter imager based on readings of charge accumulated at the rows of pixels during a previous frame.

11. A system for imaging tissue of a subject, the system comprising:

an illumination source; and

an imaging apparatus that comprises an electronic rolling shutter imager, the imaging apparatus being configured for:

sequentially resetting rows of pixels of the rolling shutter imager from a first row to a last row, wherein the sequential resetting from the first row to the last row lasts a first amount of time,

controlling the illumination source to illuminate the tissue of the subject with illumination light over an illumination period that begins once the last row of the rolling shutter imager has been reset and lasts for at least the first amount of time,

accumulating charge at the rows of pixels over at least the illumination period based on light that is received from the tissue of the subject while the tissue of the subject is illuminated with the illumination light,

sequentially reading charge accumulated at the rows of pixels from the first row to the last row once the illumination period has ended, and

generating an image frame from the readings of charge accumulated at the rows of pixels.

12. The system of claim 11 , wherein the imaging apparatus comprises a camera control unit connected to an imaging head that includes the rolling shutter imager.

13. The system of claim 12 , wherein the illumination source is configured for pulse width modulated illumination and the camera control unit generates a pulse width modulation waveform for controlling the illumination source.

Assignments (1)
CHANGE OF ADDRESS Recorded Dec 18, 2024
From: STRYKER CORPORATION
To: STRYKER CORPORATION
Reel/Frame 069737/0184 →
Continuity (3)
Division 16745154 · Jan 16, 2020
Provisional Application 62793790 · Jan 17, 2019
Related Publication 20230270324A1 · Aug 31, 2023
References Cited (63)
US 3289957A · Hans-gunter et al. · 1966 [cited by applicant]
US 6293911B1 · Imaizumi · 2001 [cited by applicant]
US 7059726B2 · Engle · 2006 [cited by applicant]
US 7179222B2 · Imaizumi · 2007 [cited by applicant]
US 7397509B2 · Krymski · 2008 [cited by examiner]
US 7479990B2 · Imaizumi · 2009 [cited by applicant]
US 8540626B2 · Seto et al. · 2013 [cited by applicant]
US 8550990B2 · Seto et al. · 2013 [cited by applicant]
US 9060404B2 · Upton · 2015 [cited by applicant]
US 9131861B2 · Ince et al. · 2015 [cited by applicant]
US 9307600B2 · Upton · 2016 [cited by applicant]
US 9531156B2 · Hoffman et al. · 2016 [cited by applicant]
US 10624535B2 · Sakanoue et al. · 2020 [cited by applicant]
US 11337593B2 · Tanaka et al. · 2022 [cited by applicant]
US 11337595B2 · Ogawa · 2022 [cited by applicant]
US 11347189B1 · Herrera · 2022 [cited by examiner]
US 11446810B1 · Chua · 2022 [cited by applicant]
US 20070221823A1 · Xu · 2007 [cited by examiner]
US 20100286529A1 · Carroll · 2010 [cited by applicant]
US 20120013777A1 · Mao · 2012 [cited by examiner]
US 20130050456A1 · Sakurai · 2013 [cited by applicant]
US 20130208157A1 · Bechtel · 2013 [cited by examiner]
US 20140078277A1 · Dai · 2014 [cited by examiner]
US 20140203170A1 · Ono et al. · 2014 [cited by applicant]
US 20140225998A1 · Dai · 2014 [cited by examiner]
US 20140313386A1 · Jiang · 2014 [cited by examiner]
US 20150085077A1 · Kim · 2015 [cited by applicant]
US 20150201871A1 · Shiraishi · 2015 [cited by examiner]
US 20150216460A1 · Shigeta · 2015 [cited by examiner]
US 20150238086A1 · Saito · 2015 [cited by examiner]
US 20160374602A1 · Koshiba · 2016 [cited by examiner]
US 20170035280A1 · Yang · 2017 [cited by examiner]
US 20190324261A1 · Ogawa · 2019 [cited by examiner]
US 20200404198A1 · Kobayashi · 2020 [cited by applicant]
US 20210038066A1 · Bos et al. · 2021 [cited by applicant]
US 20220210309A1 · Feingold · 2022 [cited by applicant]
US 20220322935A1 · Suzuki · 2022 [cited by applicant]
US 20230270324A1 · Chang · 2023 [cited by examiner]
CN 104486986A · 2015 [cited by applicant]
EP 3289957A1 · 2018 [cited by applicant]
JP 2015530893A · 2015 [cited by applicant]
JP 2018202006A · 2018 [cited by applicant]
JP 2019191323A · 2019 [cited by applicant]
WO 2010059197A2 · 2010 [cited by applicant]
WO 2013175908A1 · 2013 [cited by applicant]
WO 2014018936A2 · 2014 [cited by applicant]
WO 2017065057A1 · 2017 [cited by applicant]
WO 2017221491A1 · 2017 [cited by applicant]
Chang et al., U.S. Notice of Allowance and Fee(s) Due mailed Dec. 21, 2022, directed to U.S. Appl. No. 16/745,154; 11 pages. [cited by applicant]
Chang et al., U.S. Office Action dated Jun. 8, 2022, directed to U.S. Appl. No. 16/745,154; 14 pages. [cited by applicant]
Chang et al., U.S. Restriction Requirement dated Jan. 10, 2022, directed to U.S. Appl. No. 16/745,154; 9 pages. [cited by applicant]
International Preliminary Report on Patentability dated Jun. 16, 2021, directed to International Application No. PCT/US2020/013912; 13 pages. [cited by applicant]
International Search Report and Written Opinion mailed Jun. 25, 2020, directed to International Application No. PCT/US2020/013912; 19 pages. [cited by applicant]
Invitation to Pay Additional Fees and, where Applicable, Protest Fee and Partial Search mailed Apr. 28, 2020, directed to International Application No. PCT/US2020/013912; 13 pages. [cited by applicant]
Chang et al., U.S. Office Action dated Dec. 21, 2023, directed to U.S. Appl. No. 18/310,515; 13 pages. [cited by applicant]
Feingold et al., U.S. Notice of Allowance and Fee(s) Due mailed Feb. 2, 2024, directed to U.S. Appl. No. 17/560,156; 8 pages. [cited by applicant]
International Preliminary Report on Patentability dated Jul. 4, 2023, directed to International Application No. PCT/US2021/073092; 12 pages. [cited by applicant]
International Search Report and Written Opinion mailed May 27, 2022, directed to International Application No. PCT/US2021/073092; 17 pages. [cited by applicant]
Invitation to Pay Additional Fees and, where applicable, Protest Fee mailed Apr. 4, 2022, directed to International Application No. PCT/US2021/073092; 14 pages. [cited by applicant]
Notice of Reasons for Refusal dated Nov. 10, 2023, directed to JP Application No. 2021-541534; 6 pages. [cited by applicant]
Office Action dated Jan. 26, 2024, directed to EP Application No. 20 706 891.7; 7 pages. [cited by applicant]
Decision of Refusal dated May 27, 2024, directed to JP Application No. 2021-541534; 4 pages. [cited by applicant]
The First Office Action dated Jun. 28, 2024, directed to CN Application No. 202080021725.2; 26 pages. [cited by applicant]