Imaging system and method for use in surgical and interventional medical procedures
A system and method for displaying images of internal anatomy includes an image processing device configured to provide high resolution images of the surgical field from low resolution scans during the procedure. The image processing device digitally manipulates a previously-obtained high resolution baseline image to produce many representative images based on permutations of movement of the baseline image. During the procedure a representative image is selected having an acceptable degree of correlation to the new low resolution image. The selected representative image and the new image are merged to provide a higher resolution image of the surgical field. The image processing device is also configured to provide interactive movement of the displayed image based on movement of the imaging device, and to permit placement of annotations on the displayed image to facilitate communication between the radiology technician and the surgeon.
1. A method for generating a display of an image of a patient's internal anatomy in a surgical field during a medical procedure, the method comprising:
with one or more processors:
producing an image set using a machine, wherein the image set includes permutations of a first image, the first image being based on a three-dimensional representation of the surgical field including the patient's internal anatomy and being with respect to a baseline orientation;
applying a first dose of radiation to the patient to obtain the three-dimensional representation;
acquiring a new image of the surgical field by applying a second dose of radiation to the patient, wherein the first dose of radiation is greater than the second dose of radiation;
selecting a representative image from the image set based on a correlation between the representative image and the new image;
identifying, within the new image, a location of a glyph caused by a radiodense object coupled to an imaging device used to obtain the new image;
merging the selected representative image with the new image using the location of the glyph as part of the merging; and
displaying the merged image.
2. The method of claim 1 , wherein the new image corresponds to a lower dose of radiation than a dose of radiation corresponding to the first image.
3. The method of claim 1 , wherein the permutations of the first image correspond to a predefined grid of image movements.
4. The method of claim 1 , further comprising:
determining the correlation, wherein determining the correlation includes comparing overlapping pixels between the representative image and the new image.
5. The method of claim 1 , further comprising:
heuristically selecting the representative images from the image set.
6. The method of claim 1 ,
wherein the new image includes at least one region where the internal anatomy is blocked or obscured by one or more tools, instruments, implants or other objects used during the medical procedure;
wherein the method includes determining the correlation based on comparing the representative image and the new image; and
wherein the comparing the representative image and the new image includes only comparing portions of the images outside the at least one region.
7. The method of claim 6 , further comprising:
determining the at least one region based on identifying pixels having a value outside a pre-determined threshold.
8. The method of claim 1 ,
wherein the image set includes a plurality of parallel images each parallel image corresponding to another image and having certain anatomic features are reduced or enhanced relative to the another image;
wherein merging the selected representative image with the new image includes merging the parallel image with the new image.
9. The method of claim 1 , further comprising:
receiving the three-dimensional representation from a computed tomography device.
10. The method of claim 1 , wherein producing the image set includes using a graphics processing unit to perform at least part of the producing.
11. The method of claim 1 , further comprising:
receiving the three-dimensional representation of the surgical field from an intraoperative imaging device; and
receiving the new image from the intraoperative imaging device.
12. The method of claim 11 , further comprising:
tracking movement of the intraoperative imaging device, the patient, or table relative to each other from the first orientation to a second orientation.
13. The method of claim 1 , wherein the merged image is enhanced to reduce visibility of a surgical tool within the merged image relative to visibility of the surgical tool within the new image.
14. The method of claim 1 , wherein the first image is a digitally reconstructed radiograph.
15. The method of claim 1 , wherein the three-dimensional representation is a computed tomography scan.
16. The method of claim 1 , further comprising:
determining a virtual outline of a surgical instrument; and
overlaying a representation of the surgical instrument onto the merged image.
17. A system comprising:
a free standing, medical grade computer including:
one or more processors; and
memory having instructions stored thereon that, when executed by the one or more processors cause the one or more processors to:
produce an image set using a machine, wherein the image set includes permutations of a first image, the first image being based on a three-dimensional representation of a surgical field including a patient's internal anatomy and being with respect to a baseline orientation;
apply a first dose of radiation to the patient to obtain the three-dimensional representation;
acquire a new image of the surgical field by applying a second dose of radiation to the patient, wherein the first dose of radiation is greater than the second dose of radiation;
select a representative image from the image set based on a correlation between the representative image and the new image;
identify, within the new image, a location of a glyph caused by a radiodense object coupled to an imaging device used to obtain the new image;
merge the selected representative image with the new image using the location of the glyph as part of the merging; and
display the merged image.
18. The system of claim 17 ,
wherein the one or more processors include one or more graphics processing unit processors;
wherein the system further comprises an intraoperative imaging device;
wherein the instructions further cause the one or more processors to:
receive, from the intraoperative imaging device, the three-dimensional representation.