Multi-modality image acquisition
View Patent ↗One or more techniques and/or systems are described for automatically generating a transformation matrix for correlating images from an ultrasound modality with images from another modality (or with ultrasound images acquired at a different point in time). Ultrasound volumetric data and volumetric data yielded from another image modality are examined to identify and/or extract features. The transformation matrix is automatically generated, or populated, based at least in part upon common features that are identified in both the ultrasound volumetric data and the volumetric data yielded from the other image modality. The transformation matrix can then be used to correlate images from the different modalities (e.g., to display a CT image of an object next to an ultrasound image of the object, where the images are substantially similar to one another even though they were acquired using different modalities).
1. A multi-modality image correlation method, comprising:
during a surgical operation in which an instrument is inserted into a patient at a first location:
imaging the patient via an ultrasound probe to generate ultrasound information; and
tracking movement of the ultrasound probe relative to the patient to generate tracking information;
generating a volumetric ultrasound image using the ultrasound information and the tracking information, the volumetric ultrasound image comprising a representation of the instrument within the patient at the first location;
spatially correlating, based at least in part upon a transformation matrix, a volumetric image with the volumetric ultrasound image, wherein the volumetric image is yielded from an examination of the patient using a first image modality other than the ultrasound probe and wherein the instrument is not inserted into the patient at the first location during the examination of the patient using the first image modality and wherein the volumetric image does not comprise a representation of the instrument; and
imposing the instrument on the volumetric image responsive to the correlating such that the instrument appears to be present within the patient at the first location during the examination of the patient using the first image modality.
2. The method of claim 1 , comprising generating the transformation matrix, comprising:
identifying a feature in the volumetric image;
identifying the feature in the volumetric ultrasound image; and
comparing a spatial position of the feature in the volumetric image with a spatial position of the feature in the volumetric ultrasound image to generate the transformation matrix.
3. The method of claim 1 , the generating comprising:
generating the volumetric ultrasound image from two or more two-dimensional data sets acquired during the imaging.
4. The method of claim 1 , the first image modality comprising a computed tomography image modality.
5. The method of claim 1 , the first image modality comprising a magnetic resonance image modality.
6. The method of claim 1 , comprising generating the transformation matrix based at least in part upon a feature in the volumetric image and a feature in the volumetric ultrasound image.
7. The method of claim 6 , the feature in the volumetric image and the feature in the volumetric ultrasound image representing a same anatomical feature of the patient.
8. The method of claim 7 , the same anatomical feature comprising at least one of a blood vessel, a blood vessel pattern, or a topology of blood vessels trees.
9. A system for multi-modality image correlation, comprising:
a tracking component configured to track movement of an ultrasound probe relative to a patient during a surgical operation in which an instrument is inserted into the patient at a first location to generate tracking information;
a volumetric data generator configured to generate a volumetric ultrasound image using ultrasound information generated by the ultrasound probe during the surgical operation and the tracking information, the volumetric ultrasound image comprising a representation of the instrument within the patient at the first location; and
an image correlation component configured to:
spatially correlate, based at least in part upon a transformation matrix, a volumetric image with the volumetric ultrasound image, wherein the volumetric image is yielded from an examination of the patient using a first image modality other than the ultrasound probe and wherein the instrument is not inserted into the patient at the first location during the examination of the patient using the first image modality and wherein the volumetric image does not comprise a representation of the instrument, and
impose the instrument on the volumetric image responsive to spatially correlating the volumetric image with the volumetric ultrasound image such that the instrument appears to be present within the patient at the first location during the examination of the patient using the first image modality.
10. The system of claim 9 , comprising a feature extraction component configured to:
identify a feature in the volumetric image; and
identify the feature in the volumetric ultrasound image.
11. The system of claim 10 , comprising a feature correlation component configured to generate the transformation matrix based at least in part upon identifying the feature in the volumetric image and identifying the feature in the volumetric ultrasound image.
12. The system of claim 10 , the feature comprising a representation of at least one of a blood vessel, a blood vessel pattern, or a topology of blood vessels trees.
13. The system of claim 9 , the volumetric data generator configured to
compile two or more two-dimensional ultrasound images generated by the ultrasound probe based at least in part upon the tracking information to generate the volumetric ultrasound image.
14. The system of claim 9 , the tracking component implementing at least one of an active tracking technique or a passive tracking technique.
15. The system of claim 9 , the first image modality comprising a computed tomography image modality.
16. The system of claim 9 , comprising a feature correlation component configured to generate the transformation matrix in the absence of user input.
17. The system of claim 9 , comprising a refinement component configured to refine a correlation of the volumetric image and the volumetric ultrasound image using at least one of a rigid fusion technique or a non-rigid fusion technique.
18. A non-transitory computer-readable storage medium comprising computer executable instructions that when executed perform a method, comprising:
during a surgical operation in which an instrument is inserted into a patient at a first location:
imaging the patient via an ultrasound probe to generate ultrasound information; and
tracking movement of the ultrasound probe relative to the patient to generate tracking information;
generating a volumetric ultrasound image using the ultrasound information and the tracking information, the volumetric ultrasound image comprising a representation of the instrument within the patient at the first location;
spatially correlating, based at least in part upon a transformation matrix, a volumetric image with the volumetric ultrasound image, wherein the volumetric image is yielded from an examination of the patient using a first image modality other than the ultrasound probe and wherein the instrument is not inserted into the patient at the first location during the examination of the patient using the first image modality and wherein the volumetric image does not comprise a representation of the instrument; and
imposing the instrument on the volumetric image responsive to the correlating such that the instrument appears to be present within the patient at the first location during the examination of the patient using the first image modality.
19. The non-transitory computer-readable storage medium of claim 18 , the method comprising:
comparing a set of identifiable features in the volumetric image with a set of identifiable features in the volumetric ultrasound image to identify a feature that is identifiable in both the volumetric image and volumetric ultrasound image; and
generating the transformation matrix based at least in part upon the feature that is identifiable in both the volumetric image and the volumetric ultrasound image.
20. The non-transitory computer-readable storage medium of claim 18 , the first image modality comprising a computed tomography image modality.