Method for merging medical images
A method for the merged display of first image information captured using a first imaging device with second image information captured using a second imaging device is provided. The first imaging device records fluorescence images of the area under examination. A second 3D image data record of the area under examination is recorded using an examination procedure based on electromagnetic radiation, such as computer tomography (CT) or magnetic resonance imaging (MRI). The 3D fluorescence image data record and the second 3D image data record are registered with one another, and one or more fluorescence-optically marked, relevant areas of the examination volume, on the basis of the mapping rules determined by the registration process, are displayed on a monitor.
1. A method for merging and displaying images captured by a first and a second imaging device, comprising:
recording first image information including a plurality of two-dimensional images of an examination area comprising fluorescent and non-fluorescent areas, the recording of the first image information comprising fluorescence-based images using a medical instrument adapted to perform light-excitation of fluorescent areas of the examination area, the medical instrument introduced invasively into the examination area, by a first imaging device;
generating a three dimensional fluorescence image data record related to the examination area using the plurality of two-dimensional images;
recording a further three dimensional image data record of the examination area using a further medical examination procedure, by a second imaging device, wherein the medical examination procedure by the second imaging device is based on electromagnetic radiation;
generating a further three dimensional image related to the examination area using the further three dimensional image data record;
registering the three dimensional fluorescence image data record and the further three dimensional image data record with each another, wherein the registering of the three dimensional fluorescence image data record and the further three dimensional image data record with each another is based on anatomical landmarks present in both the three dimensional fluorescence image data record and the further three dimensional image data record;
processing the fluorescence image data record of the examination area to identify at least one dark area corresponding to at least one non-fluorescent area of the examination area unresponsive to the light-excitation and at least one bright area corresponding to at least one fluorescent area of the examination area responsive to the light-excitation, said processing based on respective voxel values indicative of said at least one dark area and said at least one bright area;
superimposing the three dimensional fluorescence image data record over the further three-dimensional image, wherein voxels indicative of said at least one dark area are omitted to mask out said at least one dark area; and
displaying a fluorescence-optically marked relevant area of the examination area on a screen, wherein the fluorescence-optically marked relevant area consists only of said at least one bright area responsive to the light-excitation and is positioned in the further three-dimensional image so that its position in the further three-dimensional image is anatomically correct relative to the further three-dimensional image using mapping rules included in the registering of the three dimensional fluorescence image data record with the further three dimensional image data record.
2. The method according to claim 1 , wherein positional data related to a spatial position of each two-dimensional image are recorded in parallel to recording the two-dimensional images using a coordinate system relative to a position detecting system.
3. The method according to claim 1 , wherein the three dimensional fluorescence image data record is generated using corresponding image areas included in different two-dimensional images.
4. The method according to claim 1 , wherein the further three-dimensional image is displayed as an element chosen from the group consisting of an “endoscopic view”, an MPR image, an MIP image, an SSD image and a VRT image, wherein the relevant area is displayed using an overlay mechanism.
5. The method according to claim 1 , wherein the relevant area is selected by a user and a merged image including the relevant area positioned in the further three-dimensional image is displayed on the screen.
6. The method according to claim 5 , wherein the user selects the relevant area using a table displayed on the monitor, the table including positional data of a plurality of relevant areas.
7. The method according to claim 6 , wherein the positional data are calculated automatically and recorded in the table using the two-dimensional images or the three dimensional fluorescence image data record.
8. The method according to claim 7 , wherein the user enters one or more entries into the table.
9. The method according to claim 5 , wherein the user selects the relevant area using a movable marking device, the relevant area subsequently displayed in a modified view.
10. A method for merging and displaying images captured by a first and a second imaging device, comprising:
recording first image information including a plurality of two-dimensional images of an examination area comprising fluorescent and non-fluorescent areas, the recording of the first image information comprising fluorescence-based images using a medical instrument adapted to perform light-excitation of fluorescent areas of the examination area, the medical instrument introduced invasively into the examination area, by a first imaging device;
generating a three dimensional fluorescence image data record related to the examination area using the plurality of two-dimensional images;
recording a further three dimensional image data record of the examination area using a further medical examination procedure, by a second imaging device, wherein the medical examination procedure by the second imaging device is based on electromagnetic radiation;
generating a further three dimensional image related to the examination area using the further three dimensional image data record;
processing the fluorescence image data record of the examination area to identify at least one dark area corresponding to at least one non-fluorescent area of the examination area unresponsive to the light-excitation and at least one bright area corresponding to at least one fluorescent area of the examination area responsive to the light-excitation, said processing based on respective voxel values indicative of said at least one dark area and said at least one bright area;
extracting from the fluorescence image data record a partial image data comprising only said at least one bright area, wherein voxels indicative of said at least one dark area are omitted to mask out said at least one dark area;
registering the partial fluorescence image data record and the further three dimensional image data record with each another; and
displaying a fluorescence-optically marked relevant area of the examination area on a screen, wherein the fluorescence-optically marked relevant area is positioned in the further three-dimensional image so that its position in the further three-dimensional image is anatomically correct relative to the further three-dimensional image using mapping rules included in the registering of the partial fluorescence image data record with the further three dimensional image data record.