IP Library › Granted Patent US 12,573,063
Granted Patent B2
US 12,573,063 · App. 18/549,819 · Granted Mar 10, 2026

Systems and methods for registering intraoperative image data

Inventors: Lucas S. Gordon (Sunnyvale, CA); Julie Walker (San Francisco, CA); Troy K. Adebar (San Jose, CA); Benjamin G. Cohn (Oakhurst, CA); Randall L. Schlesinger (San Mateo, CA); Worth B. Walters (Campbell, CA)
Assignee: INTUITIVE SURGICAL OPERATIONS, INC.
G06T7/337A61B8/12A61B8/4254A61B8/54G06T7/74G06T2207/10132
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,573,063
App. No.
18/549,819
Filed
Sep 8, 2023
Granted
Mar 10, 2026
Kind
B2
Art Unit
3797
USPC
600/466
Abstract

A medical system comprises an elongate device, an elongate sheath configured to extend within the elongate device, and an imaging probe configured to extend within the elongate sheath. The elongate sheath includes an identification feature. The medical system further comprises a control system configured to receive imaging data from the imaging probe. The imaging data is captured by the imaging probe. The control system is further configured to analyze the imaging data to identify an appearance of the identification feature within the imaging data. The control system is further configured to, based on the appearance of the identification feature, register the imaging data to a reference frame of the elongate device.

Claims (61)

1 . A medical system comprising:

an elongate device;

an elongate sheath configured to extend within the elongate device, the elongate sheath including an identification feature;

an imaging probe configured to extend within the elongate sheath; and

a control system configured to:

receive imaging data from the imaging probe, the imaging data being captured by the imaging probe;

analyze the imaging data to identify an appearance of the identification feature within the imaging data; and

based on the appearance of the identification feature:

register the imaging data to a reference frame of the elongate device; and

determine (a) an off-axis bending of the imaging probe or (b) an insertion distance of the imaging probe relative to the elongate sheath as the imaging probe is extended within the sheath.

2 . The medical system of claim 1 , wherein:

the elongate sheath is slidably insertable relative to the elongate device;

the imaging probe is slidably insertable relative to the elongate sheath;

a distal end of the elongate sheath is configured to extend distally of a distal end of the elongate device; and

a distal end of the imaging probe is configured to extend distally of the distal end of the elongate sheath.

3 . The medical system of claim 1 , wherein the imaging probe comprises an ultrasound probe, and wherein the imaging data comprises an ultrasound image.

4 . The medical system of claim 1 , wherein the control system is configured to register the imaging data to the reference frame of the elongate device by identifying a rotational orientation of the imaging data relative to the elongate device.

5 . The medical system of claim 4 , wherein:

the elongate device includes a keyed feature and the elongate sheath includes a corresponding keyed feature that receives the keyed feature to fix a rotational orientation of the elongate sheath to a rotational orientation of the elongate device; and

identifying the rotational orientation of the imaging data relative to the elongate device comprises:

determining a rotational orientation of the imaging data relative to the rotational orientation of the elongate sheath based on the appearance of the identification feature within the imaging data; and

determining the rotational orientation of the imaging data relative to the rotational orientation of the elongate device based on the fixed rotational orientation of the elongate sheath to the rotational orientation of the elongate device.

6 . The medical system of claim 1 , wherein:

the appearance of the identification feature within the imaging data is different for different off-axis bending of the elongate sheath.

7 . The medical system of claim 1 , wherein:

the appearance of the identification feature within the imaging data is different for different insertion distances of the imaging probe relative to the elongate sheath.

8 . The medical system of claim 1 , wherein the control system is configured to register the imaging data to the reference frame of the elongate device by determining the insertion distance of the imaging probe relative to the elongate device based on the insertion distance of the imaging probe relative to the elongate sheath and an insertion distance of the elongate sheath relative to the elongate device.

9 . The medical system of claim 1 , wherein the appearance of the identification feature within the imaging data comprises at least one of:

a shape of the identification feature within the imaging data; or

a location of the identification feature within the imaging data.

10 . The medical system of claim 1 , wherein the control system is further configured to register one or more objects captured in the imaging data to the reference frame of the elongate device based on the appearance of the identification feature.

11 . The medical system of claim 1 , wherein the control system is further configured to register, based on the registration of the imaging data to the reference frame of the elongate device, at least one of:

a position of the imaging probe to the reference frame of the elongate device; or

a position of the elongate sheath to the reference frame of the elongate device.

12 . The medical system of claim 1 , wherein the identification feature comprises an elongate wire.

13 . The medical system of claim 1 , wherein the identification feature is positioned within a wall of the elongate sheath.

14 . The medical system of claim 13 , wherein:

a non-concentric portion of the wall of the elongate sheath extends radially outward from a longitudinal axis of the elongate sheath;

a first portion of the identification feature is positioned within a concentric portion of the wall;

a second portion of the identification feature is positioned within the non-concentric portion of the wall;

the first portion of the identification feature is a first thickness; and

the second portion of the identification feature is a second thickness different from the first thickness.

15 . The medical system of claim 1 , wherein the identification feature is coupled to an outer surface of the elongate sheath.

16 . The medical system of claim 1 , wherein the identification feature is configured to emit a signal, and wherein the control system is configured to analyze the signal to determine a rotational orientation of the imaging data relative to the elongate device.

17 . The medical system of claim 1 , wherein the identification feature includes a pattern of markers.

18 . The medical system of claim 1 , wherein the identification feature comprises an expandable member configured to radially expand when the elongate sheath is extended distally from a distal end of the elongate device.

19 . The medical system of claim 1 , wherein:

the imaging probe includes a shape sensor; and

the control system is configured to determine a shape of the imaging probe based on shape data captured by the shape sensor.

20 . The medical system of claim 19 , wherein the control system is further configured to determine, based on the shape data, at least one of:

a rotational orientation of the imaging data relative to the elongate device; or

an insertion distance of a distal end of the imaging probe relative to a distal end of the elongate device.

21 . A method comprising:

receiving imaging data from an imaging probe, the imaging data being captured by the imaging probe, wherein the imaging probe is configured to extend within an elongate sheath, the elongate sheath configured to extend within an elongate device, the elongate sheath including an identification feature;

analyzing the imaging data to identify an appearance of the identification feature within the imaging data; and

based on the appearance of the identification feature:

registering the imaging data to a reference frame of the elongate device; and

determining (a) an off-axis bending of the imaging probe or (b) an insertion distance of the imaging probe relative to the elongate sheath as the imaging probe is extended within the sheath.

22 . The method of claim 21 , further comprising registering the imaging data to the reference frame of the elongate device by identifying a rotational orientation of the imaging data relative to the elongate device.

23 . The method of claim 21 , wherein the appearance of the identification feature within the imaging data is different for different off-axis bending of the elongate sheath.

24 . The method of claim 21 , wherein the appearance of the identification feature within the imaging data is different for different insertion distances of the imaging probe relative to the elongate sheath.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 11, 2023
From: GORDON, LUCAS S.; WALKER, JULIE; ADEBAR, TROY K.; COHN, BENJAMIN G.; SCHLESINGER, RANDALL L.; WALTERS, WORTH B.
To: INTUITIVE SURGICAL OPERATIONS, INC.
Reel/Frame 064864/0276 →
Continuity (2)
Provisional Application 63159188 · Mar 10, 2021
Related Publication 20240153113A1 · May 9, 2024
References Cited (113)
US 5243988A · Sieben · 1993 [cited by examiner]
US 6380732B1 · Gilboa · 2002 [cited by applicant]
US 6389187B1 · Greenaway et al. · 2002 [cited by applicant]
US 6468265B1 · Evans et al. · 2002 [cited by applicant]
US 7206462B1 · Betke et al. · 2007 [cited by applicant]
US 7506650B2 · Lowe et al. · 2009 [cited by applicant]
US 7725214B2 · Diolaiti · 2010 [cited by applicant]
US 7772541B2 · Froggatt et al. · 2010 [cited by applicant]
US 7781724B2 · Childers et al. · 2010 [cited by applicant]
US 7930065B2 · Larkin et al. · 2011 [cited by applicant]
US 8062212B2 · Belson · 2011 [cited by applicant]
US 8226546B2 · Belson · 2012 [cited by applicant]
US 8248414B2 · Gattani et al. · 2012 [cited by applicant]
US 8303505B2 · Webler et al. · 2012 [cited by applicant]
US 8317746B2 · Sewell et al. · 2012 [cited by applicant]
US 8361090B2 · Belson · 2013 [cited by applicant]
US 8398541B2 · Dimaio et al. · 2013 [cited by applicant]
US 8517923B2 · Belson et al. · 2013 [cited by applicant]
US 8611983B2 · Glossop et al. · 2013 [cited by applicant]
US 8900131B2 · Chopra et al. · 2014 [cited by applicant]
US 9452276B2 · Duindam et al. · 2016 [cited by applicant]
US 10542868B2 · Gordon et al. · 2020 [cited by applicant]
US 11266387B2 · Walters et al. · 2022 [cited by applicant]
US 20020115941A1 · Whayne et al. · 2002 [cited by applicant]
US 20020133057A1 · Kukuk · 2002 [cited by applicant]
US 20030085890A1 · Baumberg et al. · 2003 [cited by applicant]
US 20030093067A1 · Panescu · 2003 [cited by applicant]
US 20040254458A1 · Govari · 2004 [cited by applicant]
US 20050182295A1 · Soper et al. · 2005 [cited by applicant]
US 20060013523A1 · Childlers et al. · 2006 [cited by applicant]
US 20060025677A1 · Verard et al. · 2006 [cited by applicant]
US 20060239544A1 · Yankelevitz et al. · 2006 [cited by applicant]
US 20070038062A1 · Redel · 2007 [cited by applicant]
US 20070167801A1 · Webler et al. · 2007 [cited by applicant]
US 20070237373A1 · Kiraly et al. · 2007 [cited by applicant]
US 20070249911A1 · Simon · 2007 [cited by applicant]
US 20070293734A1 · Coste-Maniere et al. · 2007 [cited by applicant]
US 20080082109A1 · Moll et al. · 2008 [cited by applicant]
US 20080123922A1 · Gielen et al. · 2008 [cited by applicant]
US 20080178654A1 · Hochmitz · 2008 [cited by applicant]
US 20080255505A1 · Carlson et al. · 2008 [cited by applicant]
US 20080287803A1 · Li et al. · 2008 [cited by applicant]
US 20080294034A1 · Krueger et al. · 2008 [cited by applicant]
US 20090062813A1 · Prisco et al. · 2009 [cited by applicant]
US 20090156895A1 · Higgins et al. · 2009 [cited by applicant]
US 20090163810A1 · Kanade et al. · 2009 [cited by applicant]
US 20090171184A1 · Jenkins et al. · 2009 [cited by applicant]
US 20090227861A1 · Ganatra et al. · 2009 [cited by applicant]
US 20090262980A1 · Markowitz et al. · 2009 [cited by applicant]
US 20090268010A1 · Zhao et al. · 2009 [cited by applicant]
US 20100249506A1 · Prisco · 2010 [cited by applicant]
US 20110112569A1 · Friedman et al. · 2011 [cited by applicant]
US 20110207997A1 · Greenburg et al. · 2011 [cited by applicant]
US 20110237940A1 · Raleigh · 2011 [cited by applicant]
US 20110282140A1 · Itkowitz et al. · 2011 [cited by applicant]
US 20120004533A1 · Peng et al. · 2012 [cited by applicant]
US 20120035438A1 · Ferren et al. · 2012 [cited by applicant]
US 20120059378A1 · Farrell · 2012 [cited by applicant]
US 20120065481A1 · Hunter et al. · 2012 [cited by applicant]
US 20120203067A1 · Higgins et al. · 2012 [cited by applicant]
US 20120289843A1 · Chopra et al. · 2012 [cited by applicant]
US 20120296620A1 · Aulbach · 2012 [cited by applicant]
US 20120327204A1 · Friedman et al. · 2012 [cited by applicant]
US 20120330622A1 · Butson et al. · 2012 [cited by applicant]
US 20130085774A1 · Chen et al. · 2013 [cited by applicant]
US 20130267848A1 · Fearnot · 2013 [cited by examiner]
US 20130303876A1 · Gelfand et al. · 2013 [cited by applicant]
US 20140187949A1 · Zhao · 2014 [cited by examiner]
US 20140188440A1 · Donhowe et al. · 2014 [cited by applicant]
US 20140276020A1 · Hutchins et al. · 2014 [cited by applicant]
US 20150094914A1 · Abreu · 2015 [cited by applicant]
US 20150221105A1 · Tripathi et al. · 2015 [cited by applicant]
US 20150347682A1 · Chen et al. · 2015 [cited by applicant]
US 20170132812A1 · Tripathi et al. · 2017 [cited by applicant]
US 20180000314A1 · Saadat · 2018 [cited by examiner]
US 20180235709A1 · Donhowe et al. · 2018 [cited by applicant]
US 20180240237A1 · Donhowe et al. · 2018 [cited by applicant]
US 20190142528A1 · Vertikov · 2019 [cited by examiner]
CN 101375805A · 2009 [cited by applicant]
CN 100515332C · 2009 [cited by applicant]
CN 101862205A · 2010 [cited by applicant]
CN 102186404A · 2011 [cited by applicant]
CN 102481115A · 2012 [cited by applicant]
CN 102740755A · 2012 [cited by applicant]
CN 102740791A · 2012 [cited by applicant]
EP 1481637A1 · 2004 [cited by applicant]
EP 1779802A2 · 2007 [cited by applicant]
EP 2238901A2 · 2010 [cited by applicant]
EP 2377457A1 · 2011 [cited by applicant]
JP 2009542374A · 2009 [cited by applicant]
JP 2010540021A · 2010 [cited by applicant]
JP 2011525827A · 2011 [cited by applicant]
WO WO2005082246A1 · 2005 [cited by applicant]
WO WO2006124388A1 · 2006 [cited by applicant]
WO WO2009023801A1 · 2009 [cited by applicant]
WO WO2010049834A1 · 2010 [cited by applicant]
WO WO2010078009A1 · 2010 [cited by applicant]
WO WO2014106253A1 · 2014 [cited by applicant]
WO WO2016025465A1 · 2016 [cited by applicant]
WO WO2018195216A1 · 2018 [cited by applicant]
WO WO2019209767A1 · 2019 [cited by applicant]
International Search Report and Written Opinion for Application No. PCT/US2022/019537, mailed Jun. 9, 2022, 14 pages. [cited by applicant]
Vertut, J., and Coiffet, P., “Robot Technology: Teleoperation and Robotics Evolution and Development,” English translation, Prentice-Hall, Inc., Inglewood Cliffs, NJ, USA 1986, vol. 3A, 332 pages. [cited by applicant]
International Preliminary Report on Patentability for Application No. PCT/US2022/019537 mailed Sep. 21, 2023, 08 pages. [cited by applicant]
Extended European Search Report for Application No. 13867391.8, mailed on Jul. 22, 2016, 7 pages. [cited by applicant]
Extended European Search Report for Application No. 13868283.6, mailed on Jul. 26, 2016, 7 pages. [cited by applicant]
Extended European Search Report for Application No. 18188100.4, mailed on Nov. 13, 2018, 8 pages. [cited by applicant]
International Search Report and Written Opinion for Application No. PCT/US13/78497, mailed on Apr. 28, 2014, 14 pages. [cited by applicant]
International Search Report and Written Opinion for Application No. PCT/US13/78508, mailed on Apr. 3, 2014, 15 pages. [cited by applicant]
Office Action mailed Dec. 28, 2016 for Chinese Application No. 201380068398.6 filed Dec. 31, 2013, 18 pages. [cited by applicant]
Wen R., et al., “Robot-Assisted RF Ablation with Interactive Planning and Mixed Reality Guidance,” IEEE/SICE International Symposium on System Integration, 2012, pp. 31-36. [cited by applicant]
Yaniv Z., et al., “Needle-Based Interventions With the Image-Guided Surgery Toolkit (IGSTK): From Phantoms to Clinical Trials,” IEEE Transactions on Biomedical Engineering, 2010, vol. 57 (4), pp. 922-933. [cited by applicant]
Extended European Search Report for Application No. EP25158896.8, mailed on May 9, 2025, 10 pages. [cited by applicant]