IP Library Granted Patent US 8,934,684
Granted Patent B2
US 8,934,684 · App. 12/794,967 · Granted Jan 13, 2015

Method and system for facilitating an image guided medical procedure

View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 8,934,684
App. No.
12/794,967
Granted
Jan 13, 2015
Kind
B2
Abstract

A method for facilitating an image guided medical procedure, utilizing images relating to the procedure, that includes performing a planning stage; performing an assessment stage; and performing an assessment stage via a unified workflow and user interface. The images relating to the procedure and extracted objects from the images are treated in the same manner so that image information from the stages may be combined for pre-, intra-, and post-procedural tasks.

Claims (106)

1. A method for facilitating an image guided medical procedure, comprising:

performing a planning stage, comprising tasks of:

obtaining a plurality of pre-procedural images,

registering and fusing together said plurality of pre-procedural images, and

extracting or creating entities, based on said pre-procedural images;

performing an intervention stage, comprising tasks of:

obtaining intra-procedural images,

registering and fusing said pre-procedural and intra-procedural images,

registering and fusing said entities with said intra-procedural images, and

segmenting selected ones of said entities, based on said intra-procedural images;

performing an assessment stage, comprising tasks of:

obtaining post-procedural images,

registering and fusing said pre-procedural, said intra-procedural, and said post-procedural images,

registering and fusing said entities with said post-procedural images, and

segmenting selected ones of said entities based on said post-procedural images;

determining an availability of a task during each respective stage depending on previously performed tasks, a modality of at least one obtained image, and a respective anatomical region shown in said at least one obtained image; and

providing information on operation and the availability of a task during each respective stage to a user,

wherein said images and said entities are treated in a unified manner as data objects that enables said images and said entities to be registered and fused in a respective task,

wherein said images comprise a plurality of associated attributes,

wherein said entities comprise a plurality of different associated attributes,

wherein the plurality of associated attributes of said images and the plurality of different associated attributes of said entities differ in values, and

wherein the plurality of associated attributes of said images and the plurality of different associated attributes of said entities control a way in which said images and said entities are displayed, manipulated, and used by the respective task.

2. The method for facilitating an image guided medical procedure as recited in claim 1 , wherein said extracting or creating entities includes any of segmenting an image area, segmenting a feature, segmenting a tumor, segmenting a treated tumor, segmenting a device, simulating a device, segmenting a vessel tree, planning a needle trajectory, and tracking a needle position.

3. The method for facilitating an image guided medical procedure as recited in claim 1 , further comprising utilizing an application assistant computer software program to provide to a user information on the operation and availability of a task during a respective stage, said program being generated by utilizing a particular development tool adapted therefore.

4. The method for facilitating an image guided medical procedure as recited in claim 1 , further comprising obtaining information regarding said at least one obtained image from a respective header associated with said at least one obtained image.

5. The method for facilitating an image guided medical procedure as recited in claim 1 , further comprising utilizing a single user interface for the performing steps of said planning, intervention, and assessment stages to assist planning, intervention, and assessment stages to assist images, task results, and other data to be shared among the respective tasks of the stages.

6. The method for facilitating an image guided medical procedure as recited in claim 5 , further comprising:

developing an application assistant computer software program for facilitating said image guided medical procedure by utilizing a computer software program operating on data, said data comprising data of:

types of images to be handled by said application assistant,

tasks involved at respective stages, and

pre-required conditions necessary before performing a respective task; and

running said application assistant computer software program for facilitating said image guided medical procedure.

7. The method for facilitating an image guided medical procedure as recited in claim 6 , wherein said utilizing a computer software program operating on data comprises:

defining user interface software components that permits the user to execute an action as part of carrying out a respective task or an associated sub-task; and

defining pre-required conditions, inputs, and actions on said inputs of a respective task or an associated sub-task.

8. The method for facilitating an image guided medical procedure as recited in claim 6 , wherein a respective application assistant makes said data and images from a respective stage available to a subsequently-performed stage, including fused images comprising data from a plurality of images from at least one stage, and provides guidance for the user on the operation and availability of a particular task during a respective stage by way of said user interface.

9. The method for facilitating an image guided medical procedure as recited in claim 8 , wherein said guidance for the user comprises making available data derived from header information of a respective obtained image.

10. The method for facilitating an image guided medical procedure as recited in claim 8 , wherein said guidance for the user comprises providing step by step guidance through tasks required in a specific clinical medical procedure.

11. The method for facilitating an image guided medical procedure as recited in claim 1 , further comprising facilitating images, task results, and other data to be shared among the respective tasks of the stages.

12. A method for facilitating an image guided medical procedure, utilizing images relating to said procedure, comprising:

supporting planning, intervention, and assessment stages of said procedure via a unified image-related workflow and a user interface, each respective stage comprising a plurality of tasks, a unified image being comprised of an image or extracted, simulated, or planned image object treated with all other images and image objects in a unified manner as data objects that enables said images and said image objects to be registered and fused in a respective stage;

making data, images, and image objects from a respective stage available to a subsequent stage, including fused images comprising data from a plurality of images from at least one stage;

determining an availability of a task during each respective stage depending on previously performed tasks, a modality of at least one obtained image, and a respective anatomical region shown in said at least one obtained image; and

providing guidance for a user during each respective stage of said procedure on operation and the availability of a task by way of said user interface,

wherein said images comprise a plurality of associated attributes,

wherein said entities comprise a plurality of different associated attributes,

wherein the plurality of associated attributes of said images and the plurality of different associated attributes of said entities differ in values, and

wherein the plurality of associated attributes of said images and the plurality of different associated attributes of said entities control a way in which said images and said entities are displayed, manipulated, and used by the respective task.

13. The method as recited in claim 12 , wherein said making data, images and image objects comprises:

making available data on fused images comprising data from a plurality of images from a plurality of stages; and

making available data on fused images comprising data from image objects.

14. The method as recited in claim 12 , wherein said making data, images and image objects comprises:

making available data on fused images comprising data from a plurality of images from a plurality of stages; and

making available data on fused images comprising data from image objects including data from a plurality of stages.

15. The method as recited in claim 12 , wherein said providing guidance for the user comprises making available data derived from header information of a respective image.

16. The method as recited in claim 15 , wherein said providing guidance for the user comprises utilizing a respective application assistant computer software program to provide step by step guidance through tasks required in a specific clinical procedure.

17. A system for facilitating an image guided medical procedure, utilizing images relating to said procedure, comprising:

a memory device for storing a program and other data; and

a processor in communication with said memory device, said processor being operative with said program for:

supporting planning, intervention, and assessment stages of said procedure via a unified image-related workflow and a user interface, each respective stage comprising a plurality of tasks, a unified image being comprised of an image or extracted, simulated, or planned image object treated with all other images and image objects in a unified manner as data objects that enables said images and said image objects to be registered and fused in a respective stage;

making data, images, and image objects from a respective stage available to a subsequent stage, including fused images comprising data from a plurality of images from at least one stage;

determining an availability of a task during each respective stage depending on previously performed tasks, a modality of at least one obtained image, and a respective anatomical region shown in said at least one obtained image; and

providing guidance for a user during each respective stage of said procedure on operation and the availability of a task by way of said user interface,

wherein said images comprise a plurality of associated attributes,

wherein said entities comprise a plurality of different associated attributes,

wherein the plurality of associated attributes of said images and the plurality of different associated attributes of said entities differ in values, and

wherein the plurality of associated attributes of said images and the plurality of different associated attributes of said entities control a way in which said images and said entities are displayed, manipulated, and used by the respective task.

18. A method for facilitating an image guided medical procedure, comprising:

treating images obtained during pre-procedural, intra-procedural, and post-procedural stages of the procedure and entities either simulated, or extracted or created from said images as data objects;

establishing a single coordinate system for said data objects;

performing tasks of registration and fusion of said data objects in a coupled manner with other image-related tasks operating said data objects during each of the pre-procedural, intra-procedural, and post-procedural stages;

determining an availability of a task during each respective stage depending on previously performed tasks, a modality of at least one obtained image, and a respective anatomical region shown in said at least one obtained image; and

providing, during each respective stage, image information that combines results of the performing step carried out during a respective stage and any stage preceding said respective stage and the availability of a task during a respective stage to a user,

wherein said images comprise a plurality of associated attributes,

wherein said entities comprise a plurality of different associated attributes,

wherein the plurality of associated attributes of said images and the plurality of different associated attributes of said entities differ in values, and

wherein the plurality of associated attributes of said images and the plurality of different associated attributes of said entities control a way in which said images and said entities are displayed, manipulated, and used by the respective task.

19. A non-transitory computer medium embodied a computer program for performing method steps comprising:

performing a planning stage, comprising tasks of:

obtaining a plurality of pre-procedural images,

registering and fusing together said plurality of pre-procedural images, and

extracting or creating entities, based on said pre-procedural images;

performing an intervention stage, comprising tasks of:

obtaining intra-procedural images,

registering and fusing said pre-procedural and intra-procedural images,

registering and fusing said entities with said intra-procedural images, and

segmenting selected ones of said entities, based on said intra-procedural images;

performing an assessment stage, comprising tasks of:

obtaining post-procedural images,

registering and fusing said pre-procedural, said intra-procedural, and said post-procedural images,

registering and fusing said entities with said post-procedural images, and

segmenting selected ones of said entities based on said post-procedural images;

determining an availability of a task during each respective stage depending on previously performed tasks, a modality of at least one obtained image, and a respective anatomical region shown in said at least one obtained image;

providing information on operation and the availability of a task during each respective stage to a user; and

presenting a plurality of views for each of the method steps comprising a user interface view and an action view,

wherein said images and said entities are treated in a unified manner as data objects that enables said images and said entities to be registered and fused in a respective task,

wherein said images comprise a plurality of associated attributes,

wherein said entities comprise a plurality of different associated attributes,

wherein the plurality of associated attributes of said images and the plurality of different associated attributes of said entities differ in values,

wherein the plurality of associated attributes of said images and the plurality of different associated attributes of said entities control a way in which said images and said entities are displayed, manipulated, and used by the respective task,

wherein the user interface view presents a layout to the user via a user interface view component, and

wherein the action view presents preconditions to be met before performing said each of the method steps and inputs from previous method steps.

20. The non-transitory computer medium as recited in claim 19 ,

wherein said user interface view component is selected from the group consisting of: a push button, a radio button, and a text box,

wherein said user interface view component is clicked by the user for triggering a service task, and

wherein the service task comprises a registration service task to register an external MRI image to a real-time angiographic X-ray image.

Assignments (5)
CORRECTIVE ASSIGNMENT TO CORRECT THE ASSIGNEE PREVIOUSLY RECORDED AT REEL: 066088 FRAME: 0256. ASSIGNOR(S) HEREBY CONFIRMS THE ASSIGNMENT. Recorded Jan 17, 2024
From: SIEMENS HEALTHCARE GMBH
To: SIEMENS HEALTHINEERS AG
Reel/Frame 071178/0246 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 20, 2023
From: SIEMENS HEALTHCARE GMBH
To: SIEMENS HEALTHINEERS AG
Reel/Frame 066088/0256 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 28, 2016
From: SIEMENS AKTIENGESELLSCHAFT
To: SIEMENS HEALTHCARE GMBH
Reel/Frame 039271/0561 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Feb 9, 2011
From: SIEMENS CORPORATION
To: SIEMENS AKTIENGESELLSCHAFT
Reel/Frame 025774/0578 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 23, 2010
From: MOHAMED, ASHRAF
To: SIEMENS CORPORATION
Reel/Frame 024869/0940 →