Fused-image visualization for surgery evaluation
Disclosed herein is a framework for facilitating fused-image visualization for surgery evaluation. In accordance with one aspect of the framework, at least one pre-operative image and at least one intra-operative image of an anatomical structure are received. A region of interest may be identified in the intra-operative image. The pre-operative image may be straightened, and a symmetric region may be identified in the straightened pre-operative image. The symmetric region is substantially symmetrical to a target region in the straightened pre-operative region. The target region corresponds to the region of interest in the intra-operative image. The symmetric region may be extracted and reflected to generate a reference image. The intra-operative image may be rigidly registered with the reference image to generate registered intra-operative image, which is overlaid on the target region in the straightened pre-operative image to generate a fused image.
1. A computer-implemented method of visualization, comprising:
(i) receiving at least one pre-operative image and at least one intra-operative image of an anatomical structure;
(ii) straightening the pre-operative image to generate a straightened pre-operative image;
(iii) identifying a region of interest in the intra-operative image;
(iv) identifying a symmetric region in the straightened pre-operative image based on the intra-operative image, wherein the symmetric region is substantially symmetrical to a target region in the straightened pre-operative image, wherein the target region corresponds to the region of interest in the intra-operative image;
(v) extracting the symmetric region from the pre-operative image and reflecting the extracted symmetric region to generate a reference image;
(vi) rigidly registering the intra-operative image with the reference image to generate a registered intra-operative image; and
(vii) overlaying the registered intra-operative image on the target region in the straightened pre-operative image to generate a first fused image.
2. The method of claim 1 further comprising acquiring the intra-operative image using a C-arm system.
3. The method of claim 1 wherein straightening the pre-operative image comprises iteratively transforming and registering the pre-operative image until an ideal plane of symmetry is substantially aligned with an image plane of symmetry associated with the pre-operative image.
4. The method of claim 3 wherein transforming the pre-operative image comprises performing a reflection of the pre-operative image about the image plane of symmetry.
5. The method of claim 1 further comprising continuously and alternately displaying flipped and non-flipped views of the straightened pre-operative image within an alternate display area.
6. The method of claim 1 wherein identifying the region of interest in the intra-operative image comprises performing a pattern recognition technique.
7. The method of claim 1 further comprising identifying the target region by performing a landmarking technique.
8. The method of claim 1 wherein identifying the symmetric region comprises performing a landmarking technique.
9. The method of claim 1 further comprising continuously and alternately displaying flipped and non-flipped views of the first fused image within an alternate display area.
10. The method of claim 1 further comprising:
reflecting the registered intra-operative image to generate a reflected intra-operative image; and
overlaying the reflected intra-operative image on the symmetric region of the straightened pre-operative image to generate a second fused image.
11. The method of claim 10 further comprising continuously and alternately displaying the second fused image and the straightened pre-operative image within an alternate display area.
12. The method of claim 10 further comprising automatically performing a quantitative assessment based on the second fused image.
13. The method of claim 12 wherein automatically performing the quantitative assessment comprises generating measurement data by measuring angles, distances or size differences between the anatomical structure in the symmetric region and the anatomical structure in the region of interest.
14. A computer-implemented method of visualization, comprising:
receiving at least one pre-operative image and at least one intra-operative image of an anatomical structure;
straightening the pre-operative image to generate a straightened pre-operative image;
identifying a region of interest in the intra-operative image;
identifying a symmetric region in the straightened pre-operative image based on the intra-operative image, wherein the symmetric region is substantially symmetrical to the region of interest;
extracting the symmetric region from the pre-operative image and reflecting the extracted symmetric region to generate a reference image;
rigidly registering the intra-operative image with the reference image to generate a registered intra-operative image;
reflecting the registered intra-operative image to generate a reflected intra-operative image; and
overlaying the reflected intra-operative image on the symmetric region of the straightened pre-operative image to generate a fused image.
15. The method of claim 14 further comprising performing a quantitative assessment based on the fused image.
16. The method of claim 15 wherein automatically performing the quantitative assessment comprises generating measurement data by measuring angles, distances or size differences between the anatomical structure in the symmetric region and the anatomical structure in the region of interest.
17. A non-transitory computer-readable medium embodying a program of instructions executable by machine to perform steps for visualization, the steps comprising:
(i) receiving at least one pre-operative image and at least one intra-operative image of an anatomical structure;
(ii) straightening the pre-operative image to generate a straightened pre-operative image;
(iii) identifying a region of interest in the intra-operative image;
(iv) identifying a symmetric region in the straightened pre-operative image based on the intra-operative image, wherein the symmetric region is substantially symmetrical to a target region in the straightened pre-operative image, wherein the target region corresponds to the region of interest in the intra-operative image;
(v) extracting the symmetric region from the pre-operative image and reflecting the extracted symmetric region to generate a reference image;
(vi) rigidly registering the intra-operative image with the reference image to generate a registered intra-operative image; and
(vii) overlaying the registered intra-operative image on the target region in the straightened pre-operative image to generate a first fused image.
18. The non-transitory computer-readable medium of claim 17 wherein the steps further comprise:
reflecting the registered intra-operative image to generate a reflected intra-operative image; and
overlaying the reflected intra-operative image on the symmetric region of the straightened pre-operative image to generate a second fused image.
19. A visualization system, comprising:
a non-transitory memory device for storing computer-readable program code; and
a processor in communication with the memory device, the processor being operative with the computer-readable program code to perform steps for visualization, the steps comprising
(i) receiving at least one pre-operative image and at least one intra-operative image of an anatomical structure,
(ii) straightening the pre-operative image to generate a straightened pre-operative image,
(iii) identifying a region of interest in the intra-operative image,
(iv) identifying a symmetric region in the straightened pre-operative image based on the intra-operative image, wherein the symmetric region is substantially symmetrical to a target region in the straightened pre-operative image, wherein the target region corresponds to the region of interest in the intra-operative image,
(v) extracting the symmetric region from the pre-operative image and reflecting the extracted symmetric region to generate a reference image,
(vi) rigidly registering the intra-operative image with the reference image to generate a registered intra-operative image, and
(vii) overlaying the registered intra-operative image on the target region in the straightened pre-operative image to generate a first fused image.
20. The system of claim 19 , wherein the steps further comprise:
reflecting the registered intra-operative image to generate a reflected intra-operative image; and
overlaying the reflected intra-operative image on the symmetric region of the straightened pre-operative image to generate a second fused image.