IP Library › Granted Patent US 12,251,177
Granted Patent B2
US 12,251,177 · App. 17/353,550 · Granted Mar 18, 2025

Control scheme calibration for medical instruments

Inventors: Chauncey F. Graetzel (Palo Alto, CA); Russell W. Pong (Newark, CA); Sarah Plewe (Redwood City, CA); Toni Divic (Stanford, CA); Aadel Al-Jadda (San Carlos, CA)
Assignee: Auris Health, Inc.
A61B34/30A61B34/20A61B34/25A61B34/70A61B90/37A61B90/39A61B2017/00725A61B2034/2051A61B2034/2055A61B2034/301A61B2090/0807A61B2090/3937A61B2090/3983
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,251,177
App. No.
17/353,550
Granted
Mar 18, 2025
Kind
B2
Abstract

Methods, systems, and devices for calibrating a medical instrument are discussed herein. For example, a first instrument can be configured to access an anatomical site via a first access path and a second instrument can be configured to access the anatomical site via a second access path. The second instrument can include an imaging component configured to provide image data representative of the anatomical site and the first instrument. A difference can be identified between a first coordinate frame associated with the first instrument and a second coordinate frame associated with the second instrument. A control frame of reference associated with the first instrument can be updated based at least in part on the difference.

Claims (68)

1. A medical system comprising:

a first instrument configured to access an anatomical site via a first access path, the first instrument including one or more markings thereon;

a second instrument including an imaging component configured to provide image data representative of the anatomical site and the first instrument, the second instrument being configured to access the anatomical site via a second access path; and

one or more computer-readable media storing executable instructions that, when executed by control circuitry, cause the control circuitry to:

generate a user interface including an image representation of the image data and an alignment indicator that includes a ring and one or more marking indicators representing an estimated orientation of the one or more markings relative to an orientation of the second instrument;

receive input associated with an adjustment to the alignment indicator;

identify a difference between a first coordinate frame associated with the first instrument and a second coordinate frame associated with the second instrument based at least in part on the adjustment to the alignment indicator; and

update a control frame of reference associated with the first instrument based at least in part on the difference.

2. The medical system of claim 1 , wherein the first coordinate frame is based at least in part on a roll of a distal end of the first instrument and the second coordinate frame is based at least in part on a roll of a distal end of the second instrument.

3. The medical system of claim 1 , wherein the adjustment to the alignment indicator causes the one or more markings to become aligned with the one or more marking indicators.

4. The medical system of claim 1 , further comprising:

a robotic manipulator configured to connect to the first instrument and control movement of the first instrument; and

wherein the one or more computer-readable media further store executable instructions that, when executed by the control circuitry, cause the control circuitry to determine the first coordinate frame based on at least one of a position or an orientation of the robotic manipulator.

5. The medical system of claim 1 , wherein the one or more computer-readable media further store executable instructions that, when executed by the control circuitry, cause the control circuitry to:

receive a directional input signal from an input device, the directional input signal indicating a direction of movement for the first instrument; and

control movement of the first instrument based at least in part on the directional input signal and the control frame of reference.

6. A system comprising:

a first robotic manipulator configured to manipulate a direct access instrument;

a second robotic manipulator configured to manipulate a percutaneous access instrument, the percutaneous access instrument having a tip that includes one or more markings thereon; and

control circuitry communicatively coupled to the first robotic manipulator and the second robotic manipulator, the control circuitry being configured to perform operations comprising:

receiving image data from the direct access instrument, the image data representing at least a portion of the percutaneous access instrument;

generating a user interface including an image representation of the image data and an alignment indicator that includes a ring and one or more marking indicators representing an estimated orientation of the one or more markings relative to an orientation of the direct access instrument;

receiving input associated with an adjustment to the alignment indicator; and

calibrating a control scheme for the percutaneous access instrument based at least in part on the adjustment to the alignment indicator.

7. The system of claim 6 , further comprising:

the direct access instrument configured to access a target anatomical site via a natural lumen in a patient; and

the percutaneous access instrument configured to access the target anatomical site via a percutaneous access path in the patient, the percutaneous access instrument including one or more markings on a distal end.

8. The system of claim 7 , further comprising:

a display configured to display the image representation and the alignment indicator.

9. The system of claim 7 , wherein the direct access instrument comprises an endoscope and the percutaneous access instrument comprises a catheter.

10. The system of claim 6 , wherein the calibrating the control scheme comprises:

determining a roll of a distal end of the direct access instrument relative to the percutaneous access instrument based at least in part on the input; and

based at least in part on the roll of the distal end of the direct access instrument relative to the percutaneous access instrument, adjusting a control frame of reference used to control the percutaneous access instrument.

11. The system of claim 6 , wherein the operations further comprise:

receiving a first directional input signal indicating a direction of movement for the percutaneous access instrument; and

controlling movement of the percutaneous access instrument based at least in part on the first directional input signal and the control scheme.

12. A system comprising:

control circuitry; and

data storage coupled to the control circuitry and storing executable instructions that, when executed by the control circuitry, cause the control circuitry to:

generate a user interface including image data representing an anatomical site and a first instrument having a tip that includes one or more markings thereon, the first instrument being configured to access the anatomical site via a first access path, wherein the user interface also includes an alignment indicator including a ring and one or more marking indicators representing an estimated orientation of the one or more markings relative to an orientation of a second instrument that includes an imaging component configured to provide the image data, the second instrument being configured to access the anatomical site via a second path;

receive input associated with an adjustment to the alignment indicator;

identify a difference between a first coordinate frame associated with the first instrument and a second coordinate frame associated with the second instrument based at least in part on the adjustment to the alignment indicator; and

update a control frame of reference associated with the first instrument based at least in part on the difference.

13. The system of claim 12 , wherein the first coordinate frame is based at least in part on a roll of a distal end of the first instrument and the second coordinate frame is based at least in part on a roll of a distal end of the second instrument.

14. The system of claim 12 , further comprising:

a robotic manipulator configured to connect to the first instrument and control movement of the first instrument; and

wherein the data storage further stores executable instructions that, when executed by the control circuitry, cause the control circuitry to determine the first coordinate frame based on at least one of a position or an orientation of the robotic manipulator.

15. The system of claim 12 , wherein the one or more computer-readable media further store executable instructions that, when executed by the control circuitry, cause the control circuitry to:

receive a directional input signal from an input device, the directional input signal indicating a direction of movement for the first instrument; and

control movement of the first instrument based at least in part on the directional input signal and the control frame of reference.

16. A system comprising:

control circuitry; and

data storage coupled to the control circuitry and storing executable instructions that, when executed by the control circuitry, cause the control circuitry to perform operations comprising:

receiving image data from a direct access instrument, the image data representing at least a portion of a percutaneous access instrument having a tip that includes one or more markings therein;

generating a user interface including an image representation of the image data and an alignment indicator that includes a ring and one or more marking indicators representing an estimated orientation of the one or more markings relative to an orientation of the direct access instrument;

receiving input associated with an adjustment to the alignment indicator; and

calibrating a control scheme for the percutaneous access instrument based at least in part on the adjustment to the alignment indicator.

17. The system of claim 16 , wherein:

the direct access instrument is configured to access a target anatomical site via a natural lumen in a patient; and

the percutaneous access instrument is configured to access the target anatomical site via a percutaneous access path in the patient, the percutaneous access instrument including one or more markings on a distal end.

18. The system of claim 17 , further comprising:

a display configured to display the image representation and the alignment indicator.

19. The system of claim 17 , wherein the direct access instrument comprises an endoscope and the percutaneous access instrument comprises a catheter.

20. The system of claim 16 , wherein the calibrating the control scheme comprises:

determining a roll of a distal end of the direct access instrument relative to the percutaneous access instrument based at least in part on the input; and based at least in part on the roll of the distal end of the direct access instrument relative to the percutaneous access instrument, adjusting a control frame of reference used to control the percutaneous access instrument.

21. The system of claim 16 , wherein the operations further comprise:

receiving a first directional input signal indicating a direction of movement for the percutaneous access instrument; and

controlling movement of the percutaneous access instrument based at least in part on the first directional input signal and the control scheme.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 23, 2021
From: GRAETZEL, CHAUNCEY F.; PONG, RUSSELL W.; PLEWE, SARAH; DIVIC, TONI; AL-JADDA, AADEL
To: AURIS HEALTH, INC.
Reel/Frame 056963/0644 →
Continuity (2)
Provisional Application 63042457 · Jun 22, 2020
Related Publication 20210393344A1 · Dec 23, 2021
References Cited (67)
US 4456961A · Price et al. · 1984 [cited by applicant]
US 5876325A · Mizuno et al. · 1999 [cited by applicant]
US 6120433A · Mizuno et al. · 2000 [cited by applicant]
US 6448958B1 · Muta · 2002 [cited by applicant]
US 6799065B1 · Niemeyer · 2004 [cited by examiner]
US 8002694B2 · Kishi et al. · 2011 [cited by applicant]
US 8918207B2 · Prisco · 2014 [cited by examiner]
US 9002517B2 · Bosscher et al. · 2015 [cited by applicant]
US 9259283B2 · Ogawa et al. · 2016 [cited by applicant]
US 9259289B2 · Zhao et al. · 2016 [cited by applicant]
US 10639108B2 · Romo et al. · 2020 [cited by applicant]
US 10827913B2 · Ummalaneni et al. · 2020 [cited by applicant]
US 20030004610A1 · Niemeyer et al. · 2003 [cited by applicant]
US 20060106493A1 · Niemeyer et al. · 2006 [cited by applicant]
US 20060195228A1 · Igarashi · 2006 [cited by applicant]
US 20080180392A1 · Kishi et al. · 2008 [cited by applicant]
US 20110276058A1 · Choi et al. · 2011 [cited by applicant]
US 20120071895A1 · Stahler et al. · 2012 [cited by applicant]
US 20150142171A1 · Li et al. · 2015 [cited by applicant]
US 20150173837A1 · Barnett · 2015 [cited by applicant]
US 20160135910A1 · Hatta et al. · 2016 [cited by applicant]
US 20160199984A1 · Lohmeier et al. · 2016 [cited by applicant]
US 20180071032A1 · Barreto · 2018 [cited by applicant]
US 20180092700A1 · Itkowitz et al. · 2018 [cited by applicant]
US 20180214011A1 · Graetzel et al. · 2018 [cited by applicant]
US 20180279852A1 · Rafii-Tari et al. · 2018 [cited by applicant]
US 20190175288A1 · Herrell et al. · 2019 [cited by applicant]
US 20200078109A1 · Steger et al. · 2020 [cited by applicant]
US 20200100855A1 · Leparmentier et al. · 2020 [cited by applicant]
US 20210121251A1 · Aljuri · 2021 [cited by examiner]
US 20210369355A1 · Masaki · 2021 [cited by examiner]
CN 107530138A · 2018 [cited by applicant]
CN 109069136A · 2018 [cited by applicant]
CN 110602976A · 2019 [cited by applicant]
CN 110831486A · 2020 [cited by applicant]
EP 1973021B1 · 2012 [cited by applicant]
EP 1970169B1 · 2016 [cited by applicant]
JP 2002066970A · 2002 [cited by applicant]
JP 2003265500A · 2006 [cited by applicant]
JP 2008173724A · 2012 [cited by applicant]
JP 3210603 · 2017 [cited by applicant]
KR 1020080027256A · 2008 [cited by applicant]
WO 0060996A1 · 2000 [cited by applicant]
WO 2014186715A1 · 2014 [cited by applicant]
WO 2015142953A1 · 2015 [cited by applicant]
WO 2016028858A1 · 2016 [cited by applicant]
WO 2016053657A1 · 2016 [cited by applicant]
WO 2016149320A1 · 2016 [cited by applicant]
WO 2017075574A1 · 2017 [cited by applicant]
WO 2018013979A1 · 2018 [cited by applicant]
WO 2018187069A1 · 2018 [cited by applicant]
WO 2019191143A1 · 2019 [cited by applicant]
WO 2019231895A1 · 2019 [cited by applicant]
WO WO2020069404A1 · 2020 [cited by examiner]
CN Office Action for Appl. No. 202180044513.0, dated Aug. 10, 2023, 10 pages. [cited by applicant]
International search report for appl No. PCTIB2021055490, dated Sep. 24, 2021, 4 pages. [cited by applicant]
International Search Report for appl No. PCTIB2021055494, dated Sep. 27, 2021, 4 pages. [cited by applicant]
Written opinion for appl No. PCTIB2021055490, dated Sep. 24, 2021, 4 pages. [cited by applicant]
Written opinion for appl No. PCTIB2021055494, dated Sep. 27, 2021, 4 pages. [cited by applicant]
Notice of Allowance for U.S. Appl. No. 17/353,381, dated Oct. 18, 2023, 11 pages. [cited by applicant]
CN 2nd Office Action for Appl. No. 202180044513.0, dated Jan. 26, 2024, 13 pages. [cited by applicant]
Notice of Allowance for U.S. Appl. No. 17/353,381, dated Mar. 8, 2024, 8 pages. [cited by applicant]
EP Search Report for Appl. No. 21828974.2, dated Jun. 17, 2024, 15 pages. [cited by applicant]
KR Preliminary Rejection for Appl. No. 10-2023-7002339, dated Jul. 3, 2024, 7 pages. [cited by applicant]
Supplementary European Search Report, issued on Sep. 9, 2024, in European Patent Application No. 21828974.2, 14 pages. [cited by applicant]
Notice of Allowance from U.S. Appl. No. 17/353,381, dated Oct. 11, 2024, pp. 1-35. [cited by applicant]
Second Office Action from Korean Patent Application No. 10-2023-7002339, dated Jan. 24, 2025, 16 pages. [cited by applicant]