Alignment of images from a multi-modality imaging system
A framework for aligning images from a multi-modality imaging system. A first image of a phantom positioned on a patient table may be acquired using a first camera of first modality in the multi-modality imaging system. The phantom may include first and second hot rods, as well as first, second and third cold rods. The first and second hot rods are disposed in a plane that is substantially orthogonal to a travel vector of the patient table, while the first and second cold rods are substantially orthogonal to the travel vector, and the third cold rod is substantially parallel to the travel vector. A second image of the phantom may be acquired using a second camera of second modality in the multi-modality imaging system. Misalignment parameters of the first and second cameras may be determined based on the first and second images.
1 . An imaging phantom for alignment of medical images acquired by a multi-modality imaging system, comprising:
a housing;
first, second and third cold rods enclosed by the housing, wherein the first, second and third cold rods are orthogonal to each other, wherein the first and second cold rods are orthogonal to a travel vector, and the third cold rod is parallel to the travel vector, wherein the first, second and third cold rods are visible only in images acquired by a first camera of the multi-modality imaging system; and
first and second hot rods enclosed by the housing, wherein the first and second hot rods are visible in images acquired by both the first camera and a second camera of the multi-modality imaging system, wherein the first and second cameras comprise different modalities.
2 . The imaging phantom of claim 1 wherein the first camera comprises a computed tomography (CT) camera and the second camera comprises a positron emission tomography (PET) camera.
3 . The imaging phantom of claim 1 wherein the first and second hot rods are disposed in a plane that is orthogonal to the travel vector.
4 . The imaging phantom of claim 1 wherein the first and second hot rods are orthogonal to each other.
5 . The imaging phantom of claim 1 wherein the first and second hot rods comprise a radioactive material disposed in one or more segments of each of the first and second hot rods.
6 . The imaging phantom of claim 5 wherein the one or more segments comprise a segment that extends across an entire length of each of the first and second hot rods.
7 . The imaging phantom of claim 5 wherein the one or more segments comprise short segments located at both ends of each of the first and second hot rods.
8 . The imaging phantom of claim 1 wherein the first, second and third cold rods are used to measure pitch and yaw angles of the first camera with respect to the travel vector.
9 . The imaging phantom of claim 1 wherein the third cold rod is shorter than the first and second cold rods.
10 . The imaging phantom of claim 1 wherein the housing comprises a shell-like structure that is three-dimensionally printed.
11 . The imaging phantom of claim 1 wherein the housing is supported by three legs.
12 . A method of image alignment, comprising:
acquiring a first image of a phantom positioned on a patient table using a first camera of first modality in a multi-modality imaging system, wherein the phantom includes first and second hot rods and first, second and third cold rods enclosed by a housing, wherein the first and second hot rods are disposed in a plane that is orthogonal to a travel vector of the patient table, wherein the first and second cold rods are orthogonal to the travel vector, and the third cold rod is parallel to the travel vector;
acquiring a second image of the phantom using a second camera of second modality in the multi-modality imaging system; and
determining misalignment parameters of the first and second cameras based on the first and second images.
13 . The method of claim 12 wherein the first and second hot rods comprise a vertical hot rod and a left-right horizontal hot rod.
14 . The method of claim 12 wherein the first, second and third cold rods comprise a vertical cold rod, a left-right horizontal cold rod and an axial horizontal cold rod.
15 . The method of claim 14 further comprising:
determining first tip centroids of the vertical hot rod and the vertical cold rod in the first image; and
determining second tip centroids of the left-right horizontal hot rod, the left-right horizontal cold rod and an axial cold rod in the first image.
16 . The method of claim 15 further comprising:
determining, based on the first tip centroids, a next location of the phantom for acquiring the second image of the phantom; and
moving the phantom to the next location prior to acquiring the second image of the phantom.
17 . The method of claim 15 further comprising determining third tip centroids of the vertical hot rod and the left-right horizontal hot rod in the second image.
18 . The method of claim 17 further comprising determining the misalignment parameters based on the first, second and third tip centroids.
19 . The method of claim 12 wherein determining the misalignment parameters comprises determining angular offsets of the first camera with respect to the travel vector, angular offsets of the second camera with respect to the travel vector, and relative translational and rotational offsets between the first and second cameras.
20 . One or more non-transitory computer-readable media embodying instructions executable by machine to perform operations, comprising:
acquiring a first image of a phantom positioned on a patient table using a first camera of first modality in a multi-modality imaging system, wherein the phantom includes two hot rods and three cold rods of known geometry;
acquiring a second image of the phantom using a second camera of second modality in the multi-modality imaging system; and
determining misalignment parameters of the first and second cameras based on the first and second images.