IP Library › Granted Patent US 11,666,397
Granted Patent B2
US 11,666,397 · App. 17/075,163 · Granted Jun 6, 2023

Systems and methods for robotic medical system integration with external imaging

Inventors: Dorin Panescu (San Jose, CA); Prashant Chopra (Foster City, CA); Jonathan M. Sorger (Belmont, CA); Tao Zhao (Sunnyvale, CA)
Assignee: INTUITIVE SURGICAL OPERATIONS, INC.
A61B34/32A61B17/00234A61B17/3478A61B34/10A61B34/30A61N5/1077A61B2034/105A61B2034/107A61B2034/2065A61B2034/302A61B2034/306
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,666,397
App. No.
17/075,163
Filed
Oct 20, 2020
Granted
Jun 6, 2023
Kind
B2
Art Unit
3793
USPC
600/431
Abstract

A medical system comprises a memory for receiving intraoperative external image data for at least a portion of a patient anatomy. The memory further receives intraoperative pose data for a medical instrument of the medical system. The medical system further comprises a processor configured for generating a first model of the patient anatomy. The processor is further configured for, based on the intraoperative external image data, intraoperatively generating an updated model of the patient anatomy that is different from the first model. The updated model includes an anatomical structure that is not present in the first model.

Claims (36)

1. A medical system comprising:

a memory for receiving:

intraoperative external image data for at least a portion of a patient anatomy; and

intraoperative pose data for a medical instrument of the medical system; and

a processor configured for:

generating a first model of the patient anatomy;

comparing the intraoperative external image data to preoperative image data of at least the portion of the patient anatomy;

identifying a difference between the preoperative image data and the intraoperative external image data; and

based on identifying the difference, intraoperatively generating an updated model of the patient anatomy that is different from the first model, wherein the updated model includes an anatomical structure that is not present in the first model.

2. The medical system of claim 1 , wherein intraoperatively generating the updated model includes applying an intraoperative modeling adjustment to the first model.

3. The medical system of claim 2 , wherein applying the intraoperative modeling adjustment includes adding the anatomical structure to the first model to generate the updated model.

4. The medical system of claim 2 , wherein applying the intraoperative modeling adjustment includes removing a second anatomical structure from the first model to generate the updated model.

5. The medical system of claim 1 , wherein the processor is further configured for identifying the anatomical structure in the intraoperative external image data.

6. The medical system of claim 1 , wherein the medical instrument is positioned at least partially within an anatomical passageway of the patient anatomy.

7. The medical system of claim 1 , wherein the first model includes model data for one or more features in the patient anatomy, and wherein the processor is further configured for:

extracting feature image data for the one or more features from the intraoperative external image data, and

adjusting the model data based on the feature image data.

8. The medical system of claim 7 , wherein extracting the feature image data includes extracting the feature image data using at least one of an edge detection technique, a corner detection technique, a shape matching technique, or a curve evolution technique.

9. The medical system of claim 7 , wherein extracting the feature image data includes extracting reference element image data from the intraoperative external image data, the reference element image data corresponding to one or more reference elements associated with the patient anatomy.

10. The medical system of claim 1 , wherein the intraoperative external image data includes reference element image data corresponding to one or more reference elements associated with the patient anatomy, and wherein the processor is further configured for:

extracting the reference element image data from the intraoperative external image data; and

correlating the reference element image data to reference element model data in the first model to register the first model to the patient anatomy.

11. The medical system of claim 1 , wherein the intraoperative external image data includes reference element image data corresponding to one or more reference elements associated with the patient anatomy, and wherein the processor is further configured for:

extracting the reference element image data from the intraoperative external image data; and

registering the medical instrument to the patient anatomy based on the reference element image data, the medical instrument having a known relationship to the one or more reference elements.

12. The medical system of claim 1 , wherein the intraoperative external image data includes reference element image data corresponding to one or more reference elements associated with the patient anatomy, and wherein the processor is further configured for:

extracting the reference element image data from the intraoperative external image data; and

registering the medical instrument to the first model based on the reference element image data, the medical instrument having a known relationship to the one or more reference elements.

13. The medical system of claim 1 , wherein generating the updated model comprises adjusting only a portion of the first model.

14. The medical system of claim 1 , wherein the processor is further configured for adjusting the first model based on intraoperative pose data.

15. The medical system of claim 1 , further comprising a shape sensor extending within the medical instrument.

16. The medical system of claim 15 , wherein the memory is further configured for receiving shape data from the shape sensor, and wherein the intraoperative external image data includes shape data corresponding to a shape of the medical instrument within the patient anatomy.

17. The medical system of claim 16 , wherein the processor is further configured for, based on the shape data from the shape sensor and the shape data from the intraoperative external image data, adding the anatomical structure to the first model to generate the updated model.

18. The medical system of claim 15 , wherein the intraoperative external image data includes shape data corresponding to a shape of the medical instrument within the patient anatomy, wherein the processor is further configured for extracting the shape data from the intraoperative external image data, and wherein intraoperatively generating the updated model is further based on the shape data.

19. The medical system of claim 1 , wherein the processor is further configured for instructing a driver assembly to adjust a pose of the medical instrument based on the intraoperative external image data.

20. The medical system of claim 1 , wherein the medical instrument comprises a surgical instrument, and wherein the processor is further configured for displaying the intraoperative external image data to show at least one actuation state of the surgical instrument.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Oct 20, 2020
From: PANESCU, DORIN; CHOPRA, PRASHANT; SORGER, JONATHAN MICHAEL; ZHAO, TAO
To: INTUITIVE SURGICAL OPERATIONS, INC.
Reel/Frame 054111/0993 →
Continuity (4)
Continuation 15428273 · Feb 9, 2017
Continuation 14278812 · May 15, 2014
Provisional Application 61824298 · May 16, 2013
Related Publication 20210030494A1 · Feb 4, 2021
Cited By (7)
US 12,232,835 US 12,236,602 US 12,243,233 US 12,318,159 US 12,396,812 US 12,524,882 US 12,678,244