Soft tissue stereo-tracking
The disclosed method encompasses reconstruction of a three-dimensional position of a tracking structure (which may comprise a target of radiation treatment) as reconstructed tracking structure data from pairs of two-dimensional tracking images which are input as tracking image data. Each tracking image contained in a pair of tracking images is compared to a tracking representation of the tracking structure contained in a search template image generated from the same perspective onto the tracking structure as the associated tracking image and input as search template data. The tracking image having the highest at local degree of similarity to its associated search template image is selected as a starting point (the first tracking image) for computing a corresponding image position (a complement point) in the other tracking image (the second tracking image) on the basis of applying epipolar geometry outgoing from the position in the first tracking image associated with the highest local degree of similarity. The method then continues with determining whether there is a point in the second tracking image having a higher degree of similarity than the complement point. Depending on the result of this analysis, an accumulated value of similarity is determined for each pair of tracking images depending on the sum of similarity values of the maximum similarity points in the first and second tracking images so determined. The position of the tracking structure is determined as the intersection of back-projection lines of the points being associated with the highest sum of associated similarity values. Thereby, the reliability of position determination from stereoscopic two-dimensional x-ray images can be enhanced.
1. A computer-implemented method for determining a position of an anatomical tracking structure in medical image data usable for controlling radiation treatment of a patient, comprising:
acquiring, from a medical imaging device capable of capturing both image data from at least a first viewing direction and a different, second viewing direction, a first tracking representation of an anatomical tracking structure and a second tracking representation of the anatomical tracking structure, wherein the anatomical tracking structure is associated with an area to be treated with radiation;
acquiring, from the medical imaging device, current image data of the anatomical tracking structure captured from the first viewing direction and the second viewing direction;
determining that the current image data captured from the first viewing direction is associated with the first tracking representation and that the current image data captured from the second viewing direction is associated with the second tracking representation;
selecting the current image data captured from the first viewing direction as a primary tracking image based on identifying that a first image data unit of the current image data captured from the first viewing direction that has a highest level of similarity when compared to a corresponding image data unit in the associated first tracking representation;
based on selecting the current image data captured from the first viewing direction as the primary tracking image:
selecting the current image data captured from the second viewing direction as a secondary tracking image;
determining a complement image data unit of the second tracking representation that corresponds to the corresponding image data unit of the first tracking representation, and
determining a second similarity value for the complement image data unit of the second tracking representation;
determining that a second image data unit of the secondary tracking image has a higher level of similarity to a corresponding second image data unit of the second tracking representation than a level of similarity indicated for the complement image data unit by the second similarity value;
determining a reverse complement image data unit of the primary tracking image, the reverse complement image data unit corresponding to an image data unit of the primary tracking image that corresponds to the second image data unit of the secondary tracking image;
determining reconstructed tracking structure data indicating a position of the anatomical tracking structure in three dimensions, wherein the reconstructed tracking structure data is determined based on a first position of the first image data unit in the primary tracking image and based on a second position of the reverse complement image data unit in the primary tracking image; and
generating control instructions for a radiation beam treatment source, wherein the control instructions are generated based on the reconstructed tracking structure data.
2. The method of claim 1 , wherein the highest level of similarity for the first image data unit is determined based on determining at least:
a first similarity value corresponding to similarity between the first image data unit of the primary tracking image to the corresponding image data unit of the first tracking representation, and
an additional similarity value corresponding to similarity between a first image data unit of the secondary tracking image to a corresponding image data unit of the second tracking representation.
3. The method of claim 1 , wherein each tracking representation is two-dimensional and is determined based on image data captured from a different one of the two viewing directions.
4. The method of claim 3 , wherein the current image data is two-dimensional image data.
5. The method of claim 4 , wherein determining reconstructed tracking structure data and generating the control instructions are performed responsive to:
determining a first cumulative level of similarity for both the first image data unit of the primary tracking image and the complement image data unit of the second tracking representation;
determining a second cumulative level of similarity for both the reverse complement point of the primary tracking image and the second image data unit of the secondary tracking image; and
determining that the second cumulative level of similarity is greater than the first cumulative level of similarity.
6. The method of claim 5 , wherein the method further includes:
when it is determined that the first cumulative level of similarity is greater than the second cumulative level of similarity:
determining the reconstructed tracking structure data indicating the position of the anatomical tracking structure in three dimensions based on a first position of the second image data unit in the secondary tracking image and based on a second position of the complement image data unit in the secondary tracking image; and
generating control instructions for a radiation beam treatment source, wherein the control instructions are generated based on the reconstructed tracking structure data.
7. The method of claim 5 , wherein determining the reconstructed tracking structure data based on a first position of the first image data unit in the primary tracking image and based on a second position of the reverse complement image data unit in the primary tracking image comprises:
determining a position of an intersection of a back-projection line of the first image data unit in the primary tracking image and a back-projection line of the reverse complement image data unit in the primary tracking image.
8. A system including memory and one or more processors operable to execute instructions stored in the memory, comprising instructions to:
acquire, from a medical imaging device capable of capturing both image data from at least a first viewing direction and a different, second viewing direction, a first tracking representation of an anatomical tracking structure and a second tracking representation of the anatomical tracking structure, wherein the anatomical tracking structure is associated with an area to be treated with radiation;
acquire, from the medical imaging device, current image data of the anatomical tracking structure captured from the first viewing direction and the second viewing direction;
determine that the current image data captured from the first viewing direction is associated with the first tracking representation and that the current image data captured from the second viewing direction is associated with the second tracking representation;
select the current image data captured from the first viewing direction as a primary tracking image based on identifying that a first image data unit of the current image data captured from the first viewing direction that has a highest level of similarity when compared to a corresponding image data unit in the associated first tracking representation;
based on selecting the current image data captured from the first viewing direction as the primary tracking image:
select the current image data captured from the second viewing direction as a secondary tracking image;
determine a complement image data unit of the second tracking representation that corresponds to the corresponding image data unit of the first tracking representation, and
determine a second similarity value for the complement image data unit of the second tracking representation;
determine that a second image data unit of the secondary tracking image has a higher level of similarity to a corresponding second image data unit of the second tracking representation than a level of similarity indicated for the complement image data unit by the second similarity value;
determine a reverse complement image data unit of the primary tracking image, the reverse complement image data unit corresponding to an image data unit of the primary tracking image that corresponds to the second image data unit of the secondary tracking image;
determine reconstructed tracking structure data indicating a position of the anatomical tracking structure in three dimensions, wherein the reconstructed tracking structure data is determined based on a first position of the first image data unit in the primary tracking image and based on a second position of the reverse complement image data unit in the primary tracking image; and
generate control instructions for a radiation beam treatment source, wherein the control instructions are generated based on the reconstructed tracking structure data.
9. The system of claim 8 , wherein the highest level of similarity for the first image data unit is determined based on determining at least:
a first similarity value corresponding to similarity between the first image data unit of the primary tracking image to the corresponding image data unit of the first tracking representation, and
an additional similarity value corresponding to similarity between a first image data unit of the secondary tracking image to a corresponding image data unit of the second tracking representation.
10. The system of claim 8 , wherein each tracking representation is two-dimensional and is determined based on image data captured from a different one of the two viewing directions.
11. The system of claim 10 , wherein the current image data is two-dimensional image data.
12. The system of claim 11 , wherein determining reconstructed tracking structure data and generating the control instructions are performed responsive to:
determining a first cumulative level of similarity for both the first image data unit of the primary tracking image and the complement image data unit of the second tracking representation;
determining a second cumulative level of similarity for both the reverse complement point of the primary tracking image and the second image data unit of the secondary tracking image; and
determining that the second cumulative level of similarity is greater than the first cumulative level of similarity.
13. The system of claim 12 , wherein the instructions further comprise instructions to:
when it is determined that the first cumulative level of similarity is greater than the second cumulative level of similarity:
determine the reconstructed tracking structure data indicating the position of the anatomical tracking structure in three dimensions based on a first position of the second image data unit in the secondary tracking image and based on a second position of the complement image data unit in the secondary tracking image; and
generate control instructions for a radiation beam treatment source, wherein the control instructions are generated based on the reconstructed tracking structure data.
14. The system of claim 12 , wherein determining the reconstructed tracking structure data based on a first position of the first image data unit in the primary tracking image and based on a second position of the reverse complement image data unit in the primary tracking image comprises:
determining a position of an intersection of a back-projection line of the first image data unit in the primary tracking image and a back-projection line of the reverse complement image data unit in the primary tracking image.
15. A non-transitory computer-readable program storage medium storing computer instructions executable by one or more processors to:
acquire, from a medical imaging device, current image data of an anatomical tracking structure captured from a first viewing direction and a second viewing direction;
determine that the current image data captured from the first viewing direction is associated with a first tracking representation and that the current image data captured from the second viewing direction is associated with a second tracking representation;
select the current image data captured from the first viewing direction as a primary tracking image based on identifying that a first image data unit of the current image data captured from the first viewing direction that has a highest level of similarity when compared to a corresponding image data unit in the associated first tracking representation;
based on selecting the current image data captured from the first viewing direction as the primary tracking image:
select the current image data captured from the second viewing direction as a secondary tracking image;
determine a complement image data unit of the second tracking representation that corresponds to the corresponding image data unit of the first tracking representation, and
determine a second similarity value for the complement image data unit of the second tracking representation;
determine that a second image data unit of the secondary tracking image has a higher level of similarity to a corresponding second image data unit of the second tracking representation than a level of similarity indicated for the complement image data unit by the second similarity value;
determine a reverse complement image data unit of the primary tracking image, the reverse complement image data unit corresponding to an image data unit of the primary tracking image that corresponds to the second image data unit of the secondary tracking image;
determine reconstructed tracking structure data indicating a position of the anatomical tracking structure in three dimensions, wherein the reconstructed tracking structure data is determined based on a first position of the first image data unit in the primary tracking image and based on a second position of the reverse complement image data unit in the primary tracking image; and
generate control instructions for a radiation beam treatment source, wherein the control instructions are generated based on the reconstructed tracking structure data.
16. The non-transitory computer-readable program storage medium of claim 15 , wherein the highest level of similarity for the first image data unit is determined based on determining at least:
a first similarity value corresponding to similarity between the first image data unit of the primary tracking image to the corresponding image data unit of the first tracking representation, and
an additional similarity value corresponding to similarity between a first image data unit of the secondary tracking image to a corresponding image data unit of the second tracking representation.
17. The non-transitory computer-readable program storage medium of claim 15 , wherein each of the first and the second tracking representation is two-dimensional and is determined based on image data captured from a different one of the of the first and the second viewing directions.
18. The non-transitory computer-readable program storage medium of claim 15 , wherein determining reconstructed tracking structure data and generating the control instructions are performed responsive to:
determining a first cumulative level of similarity for both the first image data unit of the primary tracking image and the complement image data unit of the second tracking representation;
determining a second cumulative level of similarity for both the reverse complement point of the primary tracking image and the second image data unit of the secondary tracking image; and
determining that the second cumulative level of similarity is greater than the first cumulative level of similarity.
19. The non-transitory computer-readable program storage medium of claim 18 , wherein the instructions are further executable to cause the following:
when it is determined that the first cumulative level of similarity is greater than the second cumulative level of similarity:
determine the reconstructed tracking structure data indicating the position of the anatomical tracking structure in three dimensions based on a first position of the second image data unit in the secondary tracking image and based on a second position of the complement image data unit in the secondary tracking image; and
generate control instructions for a radiation beam treatment source, wherein the control instructions are generated based on the reconstructed tracking structure data.
20. The non-transitory computer-readable program storage medium of claim 15 , wherein determining the reconstructed tracking structure data based on a first position of the first image data unit in the primary tracking image and based on a second position of the reverse complement image data unit in the primary tracking image comprises:
determining a position of an intersection of a back-projection line of the first image data unit in the primary tracking image and a back-projection line of the reverse complement image data unit in the primary tracking image.