Methods for improved ultrasound imaging to emphasize structures of interest and devices thereof
Methods, non-transitory computer readable media, and ultrasound imaging apparatuses and systems that facilitate improved ultrasound imaging that emphasizes structures of interest are disclosed. With this technology, position data for a transducer assembly is continuously obtained along with ultrasound scan data captured via the transducer assembly. Image processing techniques are applied to ultrasound images generated from the ultrasound scan data to identify structure(s) of interest included therein and highlight the identified structures on a composite representation generated from the ultrasound images. The intensity of portions of the resulting composite representation is then adjusted to reflect the time in which the associated ultrasound scan data was captured. The composite representation is then output to an augmented reality headset or superimposed over an image of the patient to facilitate improved visibility and relation of the structures of interest.
1 . An ultrasound scanning system comprising:
an ultrasound transducer assembly configured to obtain ultrasound scan data of an anatomical region;
a tracking system configured to track and obtain position data associated with the ultrasound transducer assembly; and
an ultrasound imaging apparatus coupled to the ultrasound transducer assembly, the ultrasound imaging apparatus comprising a display device, wherein the ultrasound imaging apparatus is configured to:
generate an image of the anatomical region based on the ultrasound scan data,
determine whether an anatomical structure is present within the image,
filter portions of the image other than the anatomical structure from the image to generate a filtered image,
generate a composite representation of the anatomical structure with the filtered image of the anatomical structure and one or more additional ultrasound images of the anatomical structure based on the position data of the ultrasound transducer assembly associated with each of the filtered image and the one or more additional ultrasound images of the anatomical structure,
adjust a visual parameter of each image from which the composite representation is generated according to a time at which each image was captured to generate an adjusted composite ultrasound representation, wherein the adjusted composite ultrasound representation highlights the anatomical structure,
intraoperatively display, via the display device, a video feed of the anatomical region,
based on the obtained position data, intraoperatively register the adjusted composite ultrasound representation of the anatomical structure with the anatomical structure in the video feed,
overlay the registered adjusted composite ultrasound representation of the anatomical structure on the anatomical structure in the video feed, and
intraoperatively update the registered adjusted composite ultrasound representation of the anatomical structure overlaid on the video feed based on intraoperatively obtained ultrasound scan data of the anatomical region.
2 . The ultrasound scanning system of claim 1 , wherein:
the image comprises a first image, the filtered image comprises a first filtered image, and the composite representation comprises a first composite representation; and
the ultrasound imaging apparatus is further configured to:
generate a second image of the anatomical region based on the ultrasound scan data,
determine whether the anatomical structure is present within the second image,
filter portions of the second image other than the anatomical structure from the second image to generate a second filtered image, and
update the first composite representation with the second filtered image to a second composite representation of the anatomical structure based on the position data of the ultrasound transducer assembly associated with the second filtered image.
3 . The ultrasound scanning system of claim 1 , wherein the ultrasound imaging apparatus is configured to generate the filtered image by removing all portions of the image except for contours of the anatomical structure.
4 . The ultrasound scanning system of claim 1 , wherein the ultrasound imaging apparatus is configured to generate the filtered image using at least one of a color filter or a geometric filter.
5 . The ultrasound scanning system of claim 1 , wherein the display device comprises an augmented reality headset.
6 . The ultrasound scanning system of claim 1 , wherein the ultrasound transducer assembly is configured to operate at a frequency range corresponding to bone.
7 . The ultrasound scanning system of claim 1 , wherein the visual parameter comprises an intensity of each image from which the composite representation is generated.
8 . The ultrasound scanning system of claim 7 , wherein the ultrasound imaging apparatus is configured to adjust the intensity of each image from which the composite representation is generated by decreasing the intensity of the anatomical structure in each image from which the composite representation is generated over time.
9 . The ultrasound scanning system of claim 1 , wherein the composite representation of the anatomical structure comprises a composite image.
10 . A computer-implemented method of imaging an anatomical region using an ultrasound scanning system, the ultrasound scanning system comprising an ultrasound transducer assembly configured to obtain ultrasound scan data of the anatomical region and a tracking system configured to track and obtain position data associated with the ultrasound transducer assembly, the ultrasound imaging apparatus comprising a display device, the method comprising:
generating an image of the anatomical region based on the ultrasound scan data obtained from the ultrasound transducer assembly;
determining whether an anatomical structure is present within the image;
filtering portions of the image other than the anatomical structure from the image to generate a filtered image;
generating a composite representation of the anatomical structure with the filtered image of the anatomical structure and one or more additional ultrasound images of the anatomical structure based on the position data of the ultrasound transducer assembly obtained from the tracking system that is associated with each of the filtered image and the one or more additional ultrasound images of the anatomical structure;
adjusting an intensity of each image from which the composite representation is generated according to a time at which each image was captured to generate an adjusted composite ultrasound representation, wherein the adjusted composite ultrasound representation highlights the anatomical structure;
intraoperatively displaying, via the display device, a video feed of the anatomical region;
based on the obtained position data, intraoperatively registering the adjusted composite ultrasound representation of the anatomical structure with the anatomical structure in the video feed;
overlaying the registered adjusted composite ultrasound representation of the anatomical structure on the anatomical structure in the video feed; and
intraoperatively updating the registered adjusted composite ultrasound representation of the anatomical structure overlaid on the video feed based on intraoperatively obtained ultrasound scan data of the anatomical region.
11 . The computer-implemented method of claim 10 , wherein the image comprises a first image, the filtered image comprises a first filtered image, and the composite representation comprises a first composite representation, the method further comprising:
generating a second image of the anatomical region based on the ultrasound scan data obtained from the ultrasound transducer assembly;
determining whether the anatomical structure is present within the second image;
filtering portions of the second image other than the anatomical structure from the second image to generate a second filtered image; and
updating the first composite representation with the second filtered image to a second composite representation of the anatomical structure based on the position data of the ultrasound transducer assembly that is associated with the second filtered image.
12 . The computer-implemented method of claim 10 , wherein generating the filtered image comprises removing all portions of the image except for contours of the anatomical structure.
13 . The computer-implemented method of claim 10 , wherein generating the filtered image comprises using at least one of a color filter or a geometric filter.
14 . The computer-implemented method of claim 10 , wherein the display device comprises an augmented reality headset.
15 . The computer-implemented method of claim 10 , wherein the ultrasound transducer assembly is configured to operate at a frequency range corresponding to bone.
16 . The computer-implemented method of claim 10 , wherein the visual parameter comprises an intensity of each image from which the composite representation is generated.
17 . The computer-implemented method of claim 16 , wherein adjusting the intensity of each image from which the composite representation is generated comprises decreasing the intensity of the anatomical structure in each image from which the composite representation is generated over time.
18 . The computer-implemented method of claim 10 , wherein the composite representation of the anatomical structure comprises a composite image.