IP Library Granted Patent US 10,702,226
Granted Patent B2
US 10,702,226 · App. 15/892,053 · Granted Jul 7, 2020

System and method for local three dimensional volume reconstruction using a standard fluoroscope

Inventors: Ron Barak (Tel Aviv-Jaffa, IL); Oren P. Weingarten (Herzliya, IL); Ariel Birenbaum (Herzliya, IL); Guy Alexandroni (Ramat HaSharon, IL)
Assignee: COVIDIEN LP
A61B6/12A61B6/00A61B6/463A61B6/466A61B6/487A61B6/5235A61B34/20A61B2034/2046A61B2034/2051A61B2034/2065A61B2090/367A61B2090/3762A61B2090/3908A61B2090/3966A61B2090/3983
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,702,226
App. No.
15/892,053
Filed
Feb 8, 2018
Granted
Jul 7, 2020
Kind
B2
Art Unit
3793
USPC
600/424
Abstract

A system for constructing fluoroscopic-based three-dimensional volumetric data of a target area within a patient from two-dimensional fluoroscopic images including a structure of markers, a fluoroscopic imaging device configured to acquire a sequence of images of the target area and of the structure of markers, and a computing device. The computing device is configured to estimate a pose of the fluoroscopic imaging device for at least a plurality of images of the sequence of images based on detection of a possible and most probable projection of the structure of markers as a whole on each image of the plurality of images. The computing device is further configured to construct fluoroscopic-based three-dimensional volumetric data of the target area based on the estimated poses of the fluoroscopic imaging device.

Claims (47)

1. A system for constructing fluoroscopic-based three-dimensional volumetric data of a target area within a patient from two-dimensional fluoroscopic images, comprising:

a structure of markers; and

a computing device configured to:

receive a sequence of fluoroscopic images of the target area captured by a fluoroscopic imaging device, each image comprising at least a portion of the structure of markers;

estimate a pose of the fluoroscopic imaging device for a plurality of images of the sequence of fluoroscopic images based on detection of a projection of the structure of markers on each image of the sequence of images;

construct fluoroscopic-based three-dimensional volumetric data of the target area based on each estimated pose of the fluoroscopic imaging device, the fluoroscopic-based three-dimensional volumetric data of the target area including a medical device and a target; and

analyze the constructed fluoroscopic-based three-dimensional volumetric data to determine an offset between a location of the medical device within the constructed fluoroscopic-based three-dimensional volumetric data of the target area and a location of the target within the constructed fluoroscopic-based three-dimensional volumetric data of the target area.

2. The system of claim 1 , wherein the computing device is further configured to facilitate an approach of the medical device to the target.

3. The system of claim 1 , further comprising a locating system configured to determine the location of the medical device within the patient, wherein the computing device comprises a display and is configured to:

display the target area and the location of the medical device with respect to the target based on the location of the medical device as determined by the locating system;

facilitate navigation of the medical device to the target area via the locating system and the display; and

correct the display of the location of the medical device with respect to the target based on the determined offset between the location of the medical device within the constructed fluoroscopic-based three-dimensional volumetric data and the location of the target within the constructed fluoroscopic-based three-dimensional volumetric data as determined by the computing device based on the constructed fluoroscopic-based three-dimensional volumetric data of the target area.

4. The system of claim 3 , wherein the computing device is further configured to:

display a 3D rendering of the target area on the display; and

register the locating system to the 3D rendering,

wherein the display of the location of the medical device with respect to the target is corrected by updating a registration between the locating system and the 3D rendering.

5. The system of claim 3 , wherein the locating system is an electromagnetic locating system.

6. The system of claim 3 , wherein the target area comprises at least a portion of lungs and the medical device is navigated to the target area through a luminal network.

7. The system of claim 1 , wherein structure of markers is of a periodic pattern.

8. The system of claim 1 , wherein structure of markers is of a two-dimensional pattern.

9. The system of claim 1 , wherein the target is a soft-tissue target.

10. A method for constructing fluoroscopic-based three dimensional volumetric data of a target area within a patient from two dimensional fluoroscopic images, the method comprising using at least one hardware processor for:

acquiring, via a fluoroscopic imaging device, a sequence of images of the target area, each image comprising at least a portion of a structure of markers, wherein the structure of markers is positioned between the patient and the fluoroscopic imaging device;

estimating a pose of the fluoroscopic imaging device for a plurality of images of the sequence of images based on detection of a projection of the structure of markers on each image of the sequence of images;

constructing fluoroscopic-based three-dimensional volumetric data of the target area based on each estimated pose of the fluoroscopic imaging device, the fluoroscopic-based three-dimensional volumetric data of the target area including a medical device and a target in the target area; and

analyzing the constructed fluoroscopic-based three-dimensional volumetric data to determine an offset between a location of the medical device within the constructed fluoroscopic-based three-dimensional volumetric data of the target area and a location of the target within the constructed fluoroscopic-based three-dimensional volumetric data of the target area.

11. The method of claim 10 , wherein the medical device is positioned in the target area prior to the acquiring of the sequence of images.

12. The method of claim 11 , further comprising using said at least one hardware processor for:

determining the location of the medical device via a locating system;

facilitating navigation of the medical device to the target area via the locating system indicating the location of the medical device and via a display; and

correcting a display of the location of the medical device with respect to the target based on the determined offset between the location of the medical device within the constructed fluoroscopic-based three-dimensional volumetric data and the location of the target within the constructed fluoroscopic-based three-dimensional volumetric data based on the constructed fluoroscopic-based three-dimensional volumetric data of the target area.

13. The method of claim 12 , further comprising using said at least one hardware processor for:

displaying a 3D rendering of the target area on the display; and

registering the locating system to the 3D rendering,

wherein the correcting of the display of the location of the medical device with respect to the target comprises updating a registration of the locating system to the 3D rendering.

14. The method of claim 13 , further comprising using said at least one hardware processor for generating the 3D rendering of the target area based on previously acquired CT volumetric data of the target area.

15. The method of claim 12 , wherein the locating system is an electromagnetic locating system.

16. The method of claim 12 , wherein the target area comprises at least a portion of lungs and wherein the medical device is navigated to the target area through a luminal network.

17. The method of claim 12 , wherein the structure of markers is of a periodic pattern.

18. The method of claim 12 , wherein the structure of markers is of a two-dimensional pattern.

19. The method of claim 12 , wherein the target is a soft-tissue target.

20. A system for constructing fluoroscopic-based three-dimensional volumetric data of a target area within a patient from two-dimensional fluoroscopic images, comprising:

a computing device configured to:

receive a sequence of fluoroscopic images of the target area captured by a fluoroscopic imaging device;

estimate a pose of the fluoroscopic imaging device for a plurality of images of the sequence of fluoroscopic images;

construct fluoroscopic-based three-dimensional volumetric data of the target area based on each estimated pose of the fluoroscopic imaging device, the fluoroscopic-based three-dimensional volumetric data of the target area including a medical device and a target; and

analyze the constructed fluoroscopic-based three-dimensional volumetric data to determine an offset between a location of the medical device within the constructed fluoroscopic-based three-dimensional volumetric data of the target area and a location of the target within the constructed fluoroscopic-based three-dimensional volumetric data of the target area.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 21, 2018
From: BARAK, RON; WEINGARTEN, OREN P.; BIRENBAUM, ARIEL; ALEXANDRONI, GUY
To: COVIDIEN LP
Reel/Frame 045859/0738 →
Continuity (3)
Continuation In Part 15224812 · Aug 1, 2016
Provisional Application 62201750 · Aug 6, 2015
Related Publication 20180160990A1 · Jun 14, 2018
Cited By (1)
US 12,597,135