IP Library › Granted Patent US 11,636,597
Granted Patent B2
US 11,636,597 · App. 16/950,980 · Granted Apr 25, 2023

Systems and methods for using registered fluoroscopic images in image-guided surgery

Inventors: Tao Zhao (Sunnyvale, CA); Federico Barbagli (San Francisco, CA); Caitlin Q. Donhowe (Mountain View, CA); Vincent Duindam (San Francisco, CA); Michael D. Paris (San Francisco, CA); Timothy D. Soper (San Jose, CA); Oliver J. Wagner (Mountain View, CA)
Assignee: INTUITIVE SURGICAL OPERATIONS, INC.
G06T7/0014A61B6/12A61B6/487A61B6/5235A61B34/20G06T11/003A61B6/5247A61B2034/2061A61B2034/2065A61B2090/3762G06T2207/10064G06T2207/10072G06T2207/30004
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,636,597
App. No.
16/950,980
Filed
Nov 18, 2020
Granted
Apr 25, 2023
Kind
B2
Examiner
HON, MING Y
Art Unit
2666
USPC
382/131
Abstract

A medical system includes an instrument, a display system, and a processing unit. The instrument includes an instrument shape sensor. The processing unit includes one or more processors. The processing unit is configured to, receive an anatomic model of a patient anatomy, receive shape sensor data from the instrument shape sensor while the instrument is positioned within the patient anatomy and registered to the anatomic model, determine a preferred fluoroscopic image plane for display on the display system based on the received shape sensor data and the area of interest, and provide an indication on the display system to guide positioning of a fluoroscopy system to obtain a fluoroscopic image in the preferred fluoroscopic image plane. An area of interest is identified in the anatomic model.

Claims (35)

1. A medical system comprising:

an instrument including an instrument shape sensor;

a display system; and

a processing unit including one or more processors, wherein the processing unit is configured to:

receive an anatomic model of a patient anatomy, wherein an area of interest is identified in the anatomic model;

receive shape sensor data from the instrument shape sensor while the instrument is positioned within the patient anatomy and registered to the anatomic model;

determine a preferred fluoroscopic image plane for display on the display system based on the received shape sensor data and the area of interest; and

provide an indication on the display system to guide positioning of a fluoroscopy system to obtain a fluoroscopic image in the preferred fluoroscopic image plane.

2. The medical system of claim 1 , wherein the instrument shape sensor is positioned at a distal tip portion of the instrument and the processing unit is configured to determine the preferred fluoroscopic image plane for display by:

determining a pose of the distal tip portion of the instrument from the received shape sensor data; and

determining a distance between the distal tip portion of the instrument and the area of interest.

3. The medical system of claim 2 , wherein the processing unit is configured to determine the preferred fluoroscopic image plane for display by determining a fluoroscopic image plane in which the distance between the distal tip portion of the instrument and the area of interest is greatest.

4. The medical system of claim 2 , wherein the processing unit is configured to determine the preferred fluoroscopic image plane for display by determining a fluoroscopic image plane parallel to the pose of the distal tip portion.

5. The medical system of claim 1 , wherein the instrument shape sensor is a fiber optic shape sensor.

6. The medical system of claim 1 , wherein the indication comprises a graphical rendering of the fluoroscopy system in a configuration for obtaining the fluoroscopic image in the preferred fluoroscopic image plane.

7. The medical system of claim 1 , wherein the processing unit is further configured to provide a set of joint configurations for the fluoroscopy system to achieve a system configuration for obtaining the fluoroscopic image in the preferred fluoroscopic image plane.

8. The medical system of claim 1 , wherein the area of interest is a tissue area to be avoided by the instrument.

9. The medical system of claim 1 , wherein the area of interest is a tissue area to by engaged by the instrument.

10. The medical system of claim 1 , wherein the processing unit is configured to determine the preferred fluoroscopic image plane for display by selecting a fluoroscopic image plane that allows a user to visualize a tool emerging from a distal tip portion of the instrument.

11. A non-transitory computer-readable medium storing instructions that, when executed by one or more processors, cause the one or more processors to:

receive an anatomic model of a patient anatomy, wherein an area of interest is identified in the anatomic model;

receive shape sensor data from an instrument shape sensor of an instrument positioned within the patient anatomy and registered to the anatomic model;

determine a preferred fluoroscopic image plane for display on a display system based on the received shape sensor data and the area of interest; and

provide an indication on the display system to guide positioning of a fluoroscopy system to obtain a fluoroscopic image in the preferred fluoroscopic image plane.

12. The non-transitory computer-readable medium of claim 11 , wherein the instrument shape sensor is positioned at a distal tip portion of the instrument and the instructions, when executed by the one or more processors, cause the one or more processors to determine the preferred fluoroscopic image plane for display by:

determining a pose of the distal tip portion of the instrument from the received shape sensor data; and

determining a distance between the distal tip portion of the instrument and the area of interest.

13. The non-transitory computer-readable medium of claim 12 , wherein the instructions, when executed by the one or more processors, cause the one or more processors to determine the preferred fluoroscopic image plane for display by determining a fluoroscopic image plane in which the distance between the distal tip portion of the instrument and the area of interest is greatest.

14. The non-transitory computer-readable medium of claim 12 , wherein the instructions, when executed by the one or more processors, cause the one or more processors to determine the preferred fluoroscopic image plane for display by determining a fluoroscopic image plane parallel to the pose of the distal tip portion.

15. The non-transitory computer-readable medium of claim 11 , wherein the instrument shape sensor is a fiber optic shape sensor.

16. The non-transitory computer-readable medium of claim 11 , wherein the indication comprises a graphical rendering of the fluoroscopy system in a configuration for obtaining the fluoroscopic image in the preferred fluoroscopic image plane.

17. The non-transitory computer-readable medium of claim 11 , wherein the instructions, when executed by the one or more processors, cause the one or more processors to provide a set of joint configurations for the fluoroscopy system to achieve a system configuration for obtaining the fluoroscopic image in the preferred fluoroscopic image plane.

18. The non-transitory computer-readable medium of claim 11 , wherein the area of interest is a tissue area to be avoided by the instrument.

19. The non-transitory computer-readable medium of claim 11 , wherein the area of interest is a tissue area to by engaged by the instrument.

20. The non-transitory computer-readable medium of claim 11 , wherein the instructions, when executed by the one or more processors, cause the one or more processors to determine the preferred fluoroscopic image plane for display by selecting a fluoroscopic image plane that allows a user to visualize a tool emerging from a distal tip portion of the instrument.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Nov 18, 2020
From: ZHAO, TAO; BARBAGLI, FEDERICO; DONHOWE, CAITLIN Q.; DUINDAM, VINCENT; PARIS, MICHAEL D.; SOPER, TIMOTHY D.; WAGNER, OLIVER J.
To: INTUITIVE SURGICAL OPERATIONS, INC.
Reel/Frame 054400/0763 →
Continuity (4)
Continuation 16076290
Provisional Application 62294870 · Feb 12, 2016
Provisional Application 62294879 · Feb 12, 2016
Related Publication 20210073989A1 · Mar 11, 2021
Cited By (3)
US 12,236,602 US 12,243,233 US 12,524,882