IP Library › Granted Patent US 10,413,363
Granted Patent B2
US 10,413,363 · App. 15/843,341 · Granted Sep 17, 2019

Augmented reality solution to optimize the directional approach and therapy delivery of interventional cardiology tools

Inventors: Mina S. Fahim (New Brighton, MN); Peter N. Braido (Linwood, MN); Ross D. Hinrichsen (Minneapolis, MN)
Assignee: Medtronic, Inc.
A61B34/10A61B5/044A61B17/3478A61B2017/00243A61B2017/00292A61B2017/00632A61B2034/105A61B2034/107A61B2034/2065A61B2090/367A61B2090/374A61B2090/378A61B2090/3762A61B2090/502A61M2025/0089A61M2025/0166
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,413,363
App. No.
15/843,341
Filed
Dec 15, 2017
Granted
Sep 17, 2019
Kind
B2
Art Unit
2616
USPC
345/633
Abstract

A method for enhancing a surgical procedure includes providing a three-dimensional model of a patient's organ of a patient based on pre-operative image data of the patient's organ; identifying positional data corresponding to a first position of at least one target treatment anatomy of the patient relative to a second position of an ancillary target anatomy of the patient based on an analysis of the three-dimensional model of the patient's organ of the patient; selecting a puncture location based on the identified positional data; and displaying, by an augmented reality device, a virtual organ object via an augmented reality display system overlaying a real-world environment, the virtual organ object corresponding to the three-dimensional model and visually indicating the selected puncture location.

Claims (42)

1. A method of enhancing a surgical procedure, the method comprising:

providing a three-dimensional model of a heart of a patient based on image data of the heart of the patient;

identifying positional data corresponding to a first position of at least one target treatment anatomy of the patient relative to a second position of an ancillary target anatomy of the patient based on an analysis of the three-dimensional model of the heart of the patient;

selecting a puncture location based on the identified positional data of the at least one target treatment anatomy of the patient relative to the second position of an ancillary target anatomy of the patient, selecting the puncture location further comprising:

identifying a first candidate puncture location and a second candidate puncture location;

determining a first trajectory from the first candidate puncture location to the at least one target treatment anatomy and a second trajectory from the second candidate puncture location to the at least one target treatment anatomy;

selecting the puncture location based on a comparison of at least a first value associated with the first trajectory and at least a second value associated with the second trajectory; and

visually indicating one of the first trajectory and the second trajectory associated with the selected puncture location together with the visual indication of the selected puncture location on the virtual organ object being displayed in the displaying step, and

displaying, by an augmented reality device with an augmented reality display system, a virtual organ object via the augmented reality display system overlaying a real-world environment, the virtual organ object corresponding to the three-dimensional model of the heart of the patient and visually indicating the selected puncture location, each of the virtual organ object and at least a portion of the real-world environment being simultaneously viewable by a user of the augmented reality display system via the augmented reality display system.

2. The method in accordance with claim 1 , wherein:

the real-world environment and the virtual organ object are simultaneously viewable within a single field of view of the user via the augmented reality display system.

3. The method in accordance with claim 1 , wherein:

the positional data is associated with a computer-generated trajectory of a medical device from the ancillary target anatomy to the at least one target treatment anatomy; and

the medical device includes one of a catheter and a left atrial appendage closure.

4. The method in accordance with claim 1 , wherein:

the at least a first value of the first trajectory and the at least a second value of the second trajectory being compared include at least one of an angle and a distance associated with the first trajectory and the second trajectory respectively.

5. The method in accordance with claim 1 , wherein:

the visual indication of the one of the first trajectory and the second trajectory associated with the selected puncture location includes a line following a path of the one of the first trajectory and the second trajectory.

6. The method in accordance with claim 1 , wherein:

the user is a medical practitioner;

the real-world environment is a surgical room for operating on the patient; and

the displaying is performed during a surgical procedure within the surgical room.

7. The method in accordance with claim 1 , wherein:

the image data includes pre-operative image data of the heart of the patient, the pre-operative image data being associated with at least one of an MRI, an x-ray, an ultrasound, a fluoroscopy, an electrocardiogram, electroanatomical mapping, and a CT scan of the heart of the patient.

8. The method in accordance with claim 1 , further comprising:

tracking in real-time a movement of the heart of the patient during a surgery; and

attaching the virtual organ object being displayed via the augmented reality display system with the tracked movement of the heart during the surgery.

9. The method in accordance with claim 1 , further comprising:

tracking in real-time an intracardiac movement of a medical device within the heart of the patient during a surgery; and

displaying a visual indication of the tracked intracardiac movement of the medical device on the virtual organ object being displayed during the surgery via the augmented reality display system.

10. The method in accordance with claim 9 , wherein:

the visual indication of the tracked intracardiac movement of the medical device is simultaneously viewable via the augmented reality display system with the visual indication of the selected puncture location.

11. The method in accordance with claim 1 , further comprising:

determining a cross-sectional view of the heart of the patient to display in the displaying step, the displaying step further including displaying the determined cross-sectional view of the heart as the virtual organ object via the augmented reality display system.

12. The method in accordance with claim 1 , further comprising:

receiving a user-selection of a surgical procedure to be performed on the heart of the patient; and

determining a cross-sectional view of the heart of the patient to display in the displaying step based on the user-selection of the surgical procedure to be performed on the heart of the patient, the displaying step further including displaying the determined cross-sectional view of the heart as the virtual organ object via the augmented reality display system.

13. The method in accordance with claim 1 , wherein:

the ancillary target anatomy is a fossa ovalis and the at least one target treatment anatomy is one of a pulmonary vein and a left atrial appendage.

14. The method in accordance with claim 13 , wherein the selecting the puncture location further includes:

selecting the puncture location based on a computer-generated trajectory from a location on the fossa ovalis to the one of the pulmonary vein and the left atrial appendage; and

the visual indication of the selected puncture location on the virtual organ object being displayed via the augmented reality display system includes a visual indication of the computer-generated trajectory.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 15, 2017
From: FAHIM, MINA S.; BRAIDO, PETER N.; HINRICHSEN, ROSS D.
To: MEDTRONIC, INC.
Reel/Frame 044406/0709 →
Continuity (1)
Related Publication 20190183577A1 · Jun 20, 2019
Cited By (16)
US 12,220,176 US 12,225,181 US 12,229,906 US 12,237,066 US 12,266,440 US 12,295,798 US 12,310,678 US 12,336,771 US 12,336,868 US 12,347,545 US 12,349,987 US 12,362,057 US 12,380,986 US 12,465,374 US 12,484,971 US 12,521,188