IP Library › Granted Patent US 12,678,244
Granted Patent B2
US 12,678,244 · App. 19/288,704 · Granted Jul 14, 2026

Systems and methods for robotic medical system integration with external imaging

Inventors: Dorin Panescu (San Jose, CA); Prashant Chopra (Foster City, CA); Jonathan M. Sorger (Soda Springs, CA); Tao Zhao (Sunnyvale, CA)
Assignee: INTUITIVE SURGICAL OPERATIONS, INC.
A61B34/32A61B17/00234A61B17/3478A61B34/10A61B34/30A61N5/1077A61B2034/105A61B2034/107A61B2034/2065A61B2034/302A61B2034/306
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,678,244
App. No.
19/288,704
Filed
Aug 1, 2025
Granted
Jul 14, 2026
Kind
B2
Art Unit
3797
USPC
600/1
Abstract

A medical robotic system and method of operating such comprises taking intraoperative external image data of a patient anatomy, and using that image data to generate a modeling adjustment for a control system of the medical robotic system (e.g., updating anatomic model and/or refining instrument registration), and/or adjust a procedure control aspect (e.g., regulating substance or therapy delivery, improving targeting, and/or tracking performance).

Claims (26)

1 . A system comprising:

an elongate flexible medical instrument comprising a sensor;

a display system; and

a control system comprising at least one processor configured to:

receive position data from the sensor of the medical instrument while the medical instrument is within a patient anatomy;

based at least in part on the position data, register the medical instrument to a preoperative model of the patient anatomy;

display, on the display system, a virtual navigational image for the medical instrument based at least in part on the position data, wherein the virtual navigational image indicates a location of an anatomical target relative to a distal end of the medical instrument;

receive, from an external imaging system, a tomographic reconstruction that is based at least in part on intraoperative external image data for a portion of the patient anatomy that includes a region around the distal end of the medical instrument;

generate an updated virtual navigational image for the medical instrument using the tomographic reconstruction and the position data, wherein the updated virtual navigational image indicates an updated location of the anatomical target relative to the distal end of the medical instrument; and

display, on the display system, the updated virtual navigational image.

2 . The system of claim 1 , wherein the at least one processor is further configured to:

receive instructions to navigate the medical instrument to a region proximal to the anatomical target.

3 . The system of claim 1 , wherein the intraoperative external image data is generated by the external imaging system.

4 . The system of claim 3 , wherein the external imaging system is a cone-beam computed tomography (CT) system.

5 . The system of claim 1 , wherein the at least one processor is further configured to:

receive instructions to articulate the external imaging system from a first imaging orientation directed to the portion of the patient anatomy to a second imaging orientation directed to the portion of the patient anatomy.

6 . The system of claim 1 , wherein the updated virtual navigational image characterizes a location of the distal end of the medical instrument relative to the anatomical target more accurately than the virtual navigation image.

7 . The system of claim 1 , wherein the at least one processor is further configured to:

refine, based at least in part on the intraoperative external image data, a registration between the preoperative model of the patient anatomy and the patient anatomy.

8 . The system of claim 1 , wherein the at least one processor is further configured to:

refine, based at least in part on the intraoperative external image data, a registration between the medical instrument and the patient anatomy.

9 . The system of claim 1 , wherein the at least one processor is further configured to:

based at least in part on the tomographic reconstruction, characterize a relationship between the distal end of the medical instrument and the anatomical target, wherein the updated virtual navigational image characterizes the relationship between the distal end of the medical instrument and the anatomical target more accurately than the virtual navigational image.

10 . The system of claim 1 , wherein the at least one processor is further configured to:

display, on the display system, a live camera view captured by a camera deployed via a channel of the medical instrument.

11 . The system of claim 1 , wherein the portion of the patient anatomy that includes the region around the distal end of the medical instrument for which the intraoperative external image data is received is determined based at least in part on the position data received from the sensor of the medical instrument.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 4, 2025
From: PANESCU, DORIN; SORGER, JONATHAN MICHAEL; CHOPRA, PRASHANT; ZHAO, TAO
To: INTUITIVE SURGICAL OPERATIONS, INC.
Reel/Frame 071921/0569 →
Continuity (6)
Continuation 18306908 · Apr 25, 2023
Continuation 17075163 · Oct 20, 2020
Continuation 15428273 · Feb 9, 2017
Continuation 14278812 · May 15, 2014
Provisional Application 61824298 · May 16, 2013
Related Publication 20250352287A1 · Nov 20, 2025
References Cited (82)
US 6380732B1 · Gilboa · 2002 [cited by applicant]
US 6389187B1 · Greenaway et al. · 2002 [cited by applicant]
US 7720322B2 · Prisco et al. · 2010 [cited by applicant]
US 7930065B2 · Larkin et al. · 2011 [cited by applicant]
US 8010177B2 · Csavoy et al. · 2011 [cited by applicant]
US 8112292B2 · Simon · 2012 [cited by applicant]
US 9592095B2 · Panescu et al. · 2017 [cited by applicant]
US 10842575B2 · Panescu et al. · 2020 [cited by applicant]
US 11666397B2 · Panescu et al. · 2023 [cited by applicant]
US 12097000B2 · Panescu et al. · 2024 [cited by applicant]
US 12161434B2 · Panescu et al. · 2024 [cited by applicant]
US 12232835B2 · Panescu et al. · 2025 [cited by applicant]
US 12318159B2 · Panescu et al. · 2025 [cited by applicant]
US 20060013523A1 · Childlers et al. · 2006 [cited by applicant]
US 20060281971A1 · Sauer et al. · 2006 [cited by applicant]
US 20070055128A1 · Glossop et al. · 2007 [cited by applicant]
US 20070167700A1 · Rahn et al. · 2007 [cited by applicant]
US 20070293721A1 · Gilboa · 2007 [cited by applicant]
US 20080262342A1 · Averbruch · 2008 [cited by applicant]
US 20090080737A1 · Battle et al. · 2009 [cited by applicant]
US 20090306581A1 · Claus · 2009 [cited by applicant]
US 20100082041A1 · Prisco · 2010 [cited by applicant]
US 20100217117A1 · Glossop et al. · 2010 [cited by applicant]
US 20100292570A1 · Tsukagoshi · 2010 [cited by applicant]
US 20100296723A1 · Greer et al. · 2010 [cited by applicant]
US 20110202069A1 · Prisco et al. · 2011 [cited by applicant]
US 20120065481A1 · Hunter et al. · 2012 [cited by applicant]
US 20120116416A1 · Neff et al. · 2012 [cited by applicant]
US 20120165652A1 · Dempsey · 2012 [cited by applicant]
US 20120226145A1 · Chang et al. · 2012 [cited by applicant]
US 20120239000A1 · Han et al. · 2012 [cited by applicant]
US 20120289777A1 · Chopra et al. · 2012 [cited by applicant]
US 20130030408A1 · Piferi et al. · 2013 [cited by applicant]
US 20130096377A1 · Duindam et al. · 2013 [cited by applicant]
US 20130096385A1 · Fenech et al. · 2013 [cited by applicant]
US 20130096497A1 · Duindam et al. · 2013 [cited by applicant]
US 20130096572A1 · Donhowe et al. · 2013 [cited by applicant]
US 20130296883A1 · Anvari · 2013 [cited by applicant]
US 20130303890A1 · Duindam et al. · 2013 [cited by applicant]
US 20130303891A1 · Chopra · 2013 [cited by applicant]
US 20130303893A1 · Duindam et al. · 2013 [cited by applicant]
US 20140227804A1 · Hsu et al. · 2014 [cited by applicant]
US 20140276002A1 · West et al. · 2014 [cited by applicant]
US 20140369584A1 · Fan et al. · 2014 [cited by applicant]
US 20160000302A1 · Brown et al. · 2016 [cited by applicant]
US 20230372039A1 · Panescu et al. · 2023 [cited by applicant]
CN 1582863A · 2005 [cited by applicant]
CN 1612711A · 2005 [cited by applicant]
CN 1806771A · 2006 [cited by applicant]
CN 101522134A · 2009 [cited by applicant]
CN 102470013A · 2012 [cited by applicant]
EP 1849566A2 · 2007 [cited by applicant]
EP 2277441A1 · 2011 [cited by applicant]
JP 2004523295A · 2004 [cited by applicant]
JP 2005529630A · 2005 [cited by applicant]
JP 2006149560A · 2006 [cited by applicant]
JP 2007526036A · 2007 [cited by applicant]
JP 2008018172A · 2008 [cited by applicant]
JP 2010506600A · 2010 [cited by applicant]
JP 2012183308A · 2012 [cited by applicant]
WO WO0162173A2 · 2001 [cited by applicant]
WO WO03041057A2 · 2003 [cited by applicant]
WO WO2005013841A1 · 2005 [cited by applicant]
WO WO2005043319A2 · 2005 [cited by applicant]
WO WO2005081842A2 · 2005 [cited by applicant]
WO WO2006124388A1 · 2006 [cited by applicant]
WO WO2007027962A2 · 2007 [cited by applicant]
WO WO2007141784A2 · 2007 [cited by applicant]
WO WO2010078016A1 · 2010 [cited by applicant]
WO WO2010093153A2 · 2010 [cited by applicant]
WO WO2012052929A2 · 2012 [cited by applicant]
WO WO2012085511A1 · 2012 [cited by applicant]
WO WO2012088321A1 · 2012 [cited by applicant]
WO WO2012114224A1 · 2012 [cited by applicant]
WO WO2012172474A1 · 2012 [cited by applicant]
WO WO2013050903A1 · 2013 [cited by applicant]
Extended European Search Report for Application No. 14798321.7, mailed on Mar. 4, 2017, 13 pages. [cited by applicant]
Extended European Search Report for Application No. EP20175915.6 mailed on Aug. 31, 2020, 8 pages. [cited by applicant]
International Search Report and Written Opinion for Application No. PCT/US14/038411, mailed on Oct. 16, 2014, 17 pages. [cited by applicant]
Office Action mailed Jun. 2, 2017 for Chinese Application No. 201480027424.5 filed May 13, 2014, 22 pages. [cited by applicant]
Partial Supplementary European Search Report for Application No. 14798321.7, mailed on Dec. 21, 2016, 8 pages. [cited by applicant]
Vertut, J., and Coiffet, P., “Robot Technology: Teleoperation and Robotics Evolution and Development,” English translation, Prentice-Hall, Inc., Inglewood Cliffs, NJ, USA 1986, vol. 3A, 332 pages. [cited by applicant]