Method and system for cross-referencing of two-dimensional (2D) ultrasound scans of a tissue volume
A method for cross-referencing of 2D ultrasound scans of a tissue volume comprises generating first and second 2D representations of a target anatomy, respectively, from first and second series of 2D ultrasound images of the tissue volume generated. The method includes generating first and second simulated 2D representations of the target anatomy, respectively, from the second and first series of 2D ultrasound images. The 2D and simulated 2D representations are processed to at least substantially match pixel positions in the 2D and simulated 2D representations associated with the target anatomy. The method includes determining first and second correspondence transformation matrices from the processed 2D and simulated 2D representations, and using the first and second correspondence transformation matrices to determine, for a location in the second series of 2D ultrasound images associated with the target anatomy, a corresponding location in the first series of 2D ultrasound images.
1 . A method for cross-referencing of two-dimensional (2D) ultrasound scans of a tissue volume, the method comprising:
generating a first series of 2D ultrasound images of a tissue volume associated with a first plurality of positions, respectively, along a first scanning direction of the tissue volume, the tissue volume including a target anatomy;
generating a second series of 2D ultrasound images of the tissue volume associated with a second plurality of positions, respectively, along a second scanning direction of the tissue volume, wherein the second scanning direction is at least substantially orthogonal to the first scanning direction;
generating a first 2D representation of the target anatomy from the first series of 2D ultrasound images, the first 2D representation associated with one of the images of the first series of 2D ultrasound images;
generating a first simulated 2D representation, different from the first 2D representation, of the target anatomy from the second series of 2D ultrasound images, wherein the first simulated 2D representation is a projection of the second series of 2D ultrasound images onto a plane of the first series of 2D ultrasound images such that the first simulated 2D representation and the first 2D representation of the target anatomy correspond to one another in terms of viewing direction onto the target anatomy;
processing the first 2D representation and the first simulated 2D representation of the target anatomy so as to at least substantially match pixel positions associated with the target anatomy in the first simulated 2D representation with pixel positions associated with the target anatomy in the first 2D representation;
determining a first transformation matrix from the processed first 2D representation and the processed first simulated 2D representation of the target anatomy, the first transformation matrix including a first scale and translation parameter for mapping the processed first 2D representation to the processed first simulated 2D representation;
generating a second 2D representation of the target anatomy from the second series of 2D ultrasound images, the second 2D representation associated with one of the images of the second series of 2D ultrasound images;
generating a second simulated 2D representation, different from the second 2D representation, of the target anatomy from the first series of 2D ultrasound images, wherein the second simulated 2D representation is a projection of the first series of 2D ultrasound images onto a plane of the second series of 2D ultrasound images such that the second simulated 2D representation and the second 2D representation of the target anatomy correspond to one another in terms of viewing direction onto the target anatomy;
processing the second 2D representation and the second simulated 2D representation of the target anatomy so as to at least substantially match pixel positions associated with the target anatomy in the second simulated 2D representation with pixel positions associated with the target anatomy in the second 2D representation;
determining a second transformation matrix from the processed second 2D representation and the processed second simulated 2D representation of the target anatomy, the second transformation matrix including a second scale and translation parameter for mapping the processed second 2D representation to the processed second simulated 2D representation; and
using the first transformation matrix and the second transformation matrix to determine, for a first location associated with the target anatomy in the second series of 2D ultrasound images, a corresponding second location associated with the target anatomy in the first series of 2D ultrasound images, including applying a first function of the first transformation matrix and second transformation matrix to pixel coordinates corresponding to the first location so as to obtain pixel coordinates corresponding to the second location.
2 . The method of claim 1 , further comprising:
using the first transformation matrix and the second transformation matrix to determine, for a third location associated with the target anatomy in the first series of 2D ultrasound images, a corresponding fourth location associated with the target anatomy in the second series of 2D ultrasound images.
3 . The method of claim 2 , wherein using the first transformation matrix and the second transformation matrix to determine the fourth location comprises:
applying a second function of the first transformation matrix and second transformation matrix to pixel coordinates corresponding to the third location so as to obtain pixel coordinates corresponding to the fourth location.
4 . The method of claim 1 , further comprising:
generating a first plurality of binary segmentation masks from the first series of 2D ultrasound images, each binary segmentation mask of the first plurality of binary segmentation masks corresponding to a respective one of the 2D ultrasound images of the first series of 2D ultrasound images; and
generating a second plurality of binary segmentation masks from the second series of 2D ultrasound images, each binary segmentation mask of the second plurality of binary segmentation masks corresponding to a respective one of the 2D ultrasound images of the second series of 2D ultrasound images,
wherein the first 2D representation of the target anatomy is generated from one of the binary segmentation masks of the first plurality of binary segmentation masks, and
wherein the second 2D representation of the target anatomy is generated from one of the binary segmentation masks of the second plurality of binary segmentation masks.
5 . The method of claim 4 , wherein:
the first 2D representation of the target anatomy corresponds to a largest binary segmentation mask among the first plurality of binary segmentation masks; and
the second 2D representation of the target anatomy corresponds to a largest binary segmentation mask among the second plurality of binary segmentation masks.
6 . The method of claim 4 , wherein:
generating the first simulated 2D representation of the target anatomy from the second series of 2D ultrasound images comprises generating the first simulated 2D representation of the target anatomy from the second plurality of binary segmentation masks; and
generating the second simulated 2D representation of the target anatomy from the first series of 2D ultrasound images comprises generating the second simulated 2D representation of the target anatomy from the first plurality of binary segmentation masks.
7 . The method of claim 4 , wherein:
processing the first 2D representation comprises generating a first signed distance map from the first 2D representation; and
processing the second 2D representation comprises generating a second signed distance map from the second 2D representation.
8 . The method of claim 7 , wherein:
processing the first simulated 2D representation comprises scaling a width of the first simulated 2D representation so as to match a width of the first 2D representation; and
processing the second simulated 2D representation comprises scaling a width of the second simulated 2D representation so as to match a width of the second 2D representation.
9 . The method of claim 8 , wherein:
processing the first simulated 2D representation further comprises determining and sampling contour pixels associated with a contour of the target anatomy from the scaled first simulated 2D representation, and
processing the second simulated 2D representation further comprises determining and sampling contour pixels associated with a contour of the target anatomy from the scaled second simulated 2D representation.
10 . The method of claim 9 , wherein:
processing the first simulated 2D representation further comprises sampling a first subset of pixels from the scaled first simulated 2D representation; and
processing the second simulated 2D representation further comprises sampling a second subset of pixels from the scaled second simulated 2D representation.
11 . The method of claim 10 , wherein:
processing the first simulated 2D representation further comprises estimating coarse shifts between the scaled first simulated 2D representation and the first 2D representation using the first signed distance map and the first sampled subset of pixels; and
processing the second simulated 2D representation further comprises estimating coarse shifts between the scaled second simulated 2D representation and the second 2D representation using the second signed distance map and the sampled second subset of pixels.
12 . The method of claim 11 , wherein:
determining the first transformation matrix comprises estimating a scale and translation between the scaled first simulated 2D representation and the first 2D representation by minimizing a first alignment cost defined as a first cost function with respect to the first transformation matrix; and
determining the second transformation matrix comprises estimating a scale and translation between the scaled second simulated 2D representation and the second 2D representation by minimizing a second alignment cost defined as a second cost function with respect to the second transformation matrix.
13 . The method of claim 1 , wherein the first scanning direction corresponds to a transverse scan of the tissue volume and the second scanning direction corresponds to a sagittal scan of the tissue volume.
14 . A system for cross-referencing of two-dimensional (2D) ultrasound scans of a tissue volume, the system comprising:
a memory; and
at least one processor communicatively coupled to the memory, and configured to:
generate a first series of 2D ultrasound images of a tissue volume associated with a first plurality of positions, respectively, along a first scanning direction of the tissue volume, the tissue volume including a target anatomy;
generate a second series of 2D ultrasound images of the tissue volume associated with a second plurality of positions, respectively, along a second scanning direction of the tissue volume, wherein the second scanning direction is at least substantially orthogonal to the first scanning direction;
generate a first 2D representation of the target anatomy from the first series of 2D ultrasound images, the first 2D representation associated with one of the images of the first series of 2D ultrasound images;
generate a first simulated 2D representation, different from the first 2D representation, of the target anatomy from the second series of 2D ultrasound images, wherein the first simulated 2D representation is a projection of the second series of 2D ultrasound images onto a plane of the first series of 2D ultrasound images such that the first simulated 2D representation and the first 2D representation of the target anatomy correspond to one another in terms of viewing direction onto the target anatomy;
process the first 2D representation and the first simulated 2D representation of the target anatomy so as to at least substantially match pixel positions associated with the target anatomy in the first simulated 2D representation with pixel positions associated with the target anatomy in the first 2D representation;
determine a first transformation matrix from the processed first 2D representation and the processed first simulated 2D representation of the target anatomy, the first transformation matrix including a first scale and translation parameter for mapping the processed first 2D representation to the processed first simulated 2D representation;
generate a second 2D representation of the target anatomy from the second series of 2D ultrasound images, the second 2D representation associated with one of the images of the second series of 2D ultrasound images;
generate a second simulated 2D representation, different from the second 2D representation, of the target anatomy from the first series of 2D ultrasound images, wherein the second simulated 2D representation is a projection of the first series of 2D ultrasound images onto a plane of the second series of 2D ultrasound images such that the second simulated 2D representation and the second 2D representation of the target anatomy correspond to one another in terms of viewing direction onto the target anatomy;
process the second 2D representation and the second simulated 2D representation of the target anatomy so as to at least substantially match pixel positions associated with the target anatomy in the second simulated 2D representation with pixel positions associated with the target anatomy in the second 2D representation;
determine a second transformation matrix from the processed second 2D representation and the processed second simulated 2D representation of the target anatomy, the second transformation matrix including a second scale and translation parameter for mapping the processed second 2D representation to the processed second simulated 2D representation; and
use the first transformation matrix and the second transformation matrix to determine for a first location associated with the target anatomy in the second series of 2D ultrasound images a corresponding second location associated with the target anatomy in the first series of 2D ultrasound images, including applying a first function of the first transformation matrix and second transformation matrix to pixel coordinates corresponding to the first location so as to obtain pixel coordinates corresponding to the second location.
15 . The system of claim 14 , wherein the at least one processor is further configured to:
use the first transformation matrix and the second transformation matrix to determine for a third location associated with the target anatomy in the first series of 2D ultrasound images a corresponding fourth location associated with the target anatomy in the second series of 2D ultrasound images.
16 . The system of claim 15 , wherein, when the at least one processor uses the first transformation matrix and the second transformation matrix to determine the fourth location, the at least one processor is configured to:
apply a second function of the first transformation matrix and second transformation matrix to pixel coordinates corresponding to the third location so as to obtain pixel coordinates corresponding to the fourth location.
17 . The system of claim 14 , wherein the at least one processor is further configured to:
generate a first plurality of binary segmentation masks from the first series of 2D ultrasound images, each binary segmentation mask of the first plurality of binary segmentation masks corresponding to a respective one of the 2D ultrasound images of the first series of 2D ultrasound images; and
generate a second plurality of binary segmentation masks from the second series of 2D ultrasound images, each binary segmentation mask of the second plurality of binary segmentation masks corresponding to a respective one of the 2D ultrasound images of the second series of 2D ultrasound images,
wherein the first 2D representation of the target anatomy is generated from one of the binary segmentation masks of the first plurality of binary segmentation masks, and
wherein the second 2D representation of the target anatomy is generated from one of the binary segmentation masks of the second plurality of binary segmentation masks.
18 . The system of claim 17 , wherein the first 2D representation of the target anatomy corresponds to a largest binary segmentation mask among the first plurality of binary segmentation masks, and the second 2D representation of the target anatomy corresponds to a largest binary segmentation mask among the second plurality of binary segmentation masks.
19 . The system of claim 14 , wherein the first scanning direction corresponds to a transverse scan of the tissue volume and the second scanning direction corresponds to a sagittal scan of the tissue volume.
20 . The system of claim 14 , further comprising an ultrasound transducer communicatively coupled to the memory and the at least one processor, wherein the at least one processor is configured to:
generate the first series of 2D ultrasound images based on a first series of ultrasound waves acquired by the ultrasound transducer positioned at the first plurality of positions with respect to a first plurality of time instances; and
generate the second series of 2D ultrasound images based on a second series of ultrasound waves acquired by the ultrasound transducer positioned at the second plurality of positions with respect to a second plurality of time instances.
21 . A non-transitory computer-readable storage medium storing one or more programs the one or more programs comprising instructions, which when executed by at least one processor cause the at least one processor to perform a method for cross-referencing of two-dimensional (2D) ultrasound scans of a tissue volume, the method comprising:
generating a first series of 2D ultrasound images of a tissue volume associated with a first plurality of positions, respectively, along a first scanning direction of the tissue volume, the tissue volume including a target anatomy;
generating a second series of 2D ultrasound images of the tissue volume associated with a second plurality of positions, respectively, along a second scanning direction of the tissue volume, wherein the second scanning direction is at least substantially orthogonal to the first scanning direction;
generating a first 2D representation of the target anatomy from the first series of 2D ultrasound images, the first 2D representation associated with one of the images of the first series of 2D ultrasound images;
generating a first simulated 2D representation, different from the first 2D representation, of the target anatomy from the second series of 2D ultrasound images, wherein the first simulated 2D representation is a projection of the second series of 2D ultrasound images onto a plane of the first series of 2D ultrasound images such that the first simulated 2D representation and the first 2D representation of the target anatomy correspond to one another in terms of viewing direction onto the target anatomy;
processing the first 2D representation and the first simulated 2D representation of the target anatomy so as to at least substantially match pixel positions associated with the target anatomy in the first simulated 2D representation with pixel positions associated with the target anatomy in the first 2D representation;
determining a first transformation matrix from the processed first 2D representation and the processed first simulated 2D representation of the target anatomy, the first transformation matrix including a first scale and translation parameter for mapping the processed first 2D representation to the processed first simulated 2D representation;
generating a second 2D representation of the target anatomy from the second series of 2D ultrasound images, the second 2D representation associated with one of the images of the second series of 2D ultrasound images;
generating a second simulated 2D representation, different from the second 2D representation, of the target anatomy from the first series of 2D ultrasound images, wherein the second simulated 2D representation is a projection of the first series of 2D ultrasound images onto a plane of the second series of 2D ultrasound images such that the second simulated 2D representation and the second 2D representation of the target anatomy correspond to one another in terms of viewing direction onto the target anatomy;
processing the second 2D representation and the second simulated 2D representation of the target anatomy so as to at least substantially match pixel positions associated with the
target anatomy in the second simulated 2D representation with pixel positions associated with the target anatomy in the second 2D representation;
determining a second transformation matrix from the processed second 2D representation and the processed second simulated 2D representation of the target anatomy, the second transformation matrix including a second scale and translation parameter for mapping the processed second 2D representation to the processed second simulated 2D representation; and
using the first transformation matrix and the second transformation matrix to determine for a first location associated with the target anatomy in the second series of 2D ultrasound images a corresponding second location associated with the target anatomy in the first series of 2D ultrasound images, including applying a first function of the first transformation matrix and second transformation matrix to pixel coordinates corresponding to the first location so as to obtain pixel coordinates corresponding to the second location.