IP Library › Granted Patent US 12,277,718
Granted Patent B2
US 12,277,718 · App. 17/915,183 · Granted Apr 15, 2025

Computer-implemented method for visualization of an elongated anatomical structure

Inventors: Karthik Krishnan (Bangalore, IN); Celine Firtion (Surat, IN); Subhendu Seth (Bangalore, IN); Pallavi Vajinepalli (Bangalore, IN); David Nigel Roundhill (Woodinville, WA)
Assignee: KONINKLIJKE PHILIPS N.V.
G06T7/30A61B8/0866A61B8/0875A61B8/463A61B8/483A61B8/5253G06T3/10G06T7/0012G06T2207/10136G06T2207/20221G06T2207/30012G06T2207/30044
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,277,718
App. No.
17/915,183
Granted
Apr 15, 2025
Kind
B2
Abstract

A computer-implemented method for visualization of an elongated anatomical structure ( 20 ), for example of a fetal spine using ultrasound is provided. The method comprising the steps of: receiving a plurality of 3D ultrasound image volumes, each image volume depicting at least a portion of an elongated anatomical structure ( 20 ); on each 3D ultrasound image volume, automatically or semi-automatically fitting a parametric curve ( 30 ) to the depicted portion of the elongated anatomical structure, the parametric curve being defined by curve parameters; reformatting each 3D ultrasound image volume by applying a transformation which straightens the parametric curve along at least one axis, so as to generate a plurality of reformatted image volumes and reformatted parametric curves ( 32, 34 ); registering the reformatted image volumes with one another by determining the joining point of their respective parametric curves; and fusing the reformatted image volumes with one another to yield a fused image depicting the whole elongated anatomical structure or a larger portion thereof than the 3D ultrasound image volumes.

Claims (31)

1. A computer-implemented method for visualization of an elongated anatomical structure ( 20 ) using ultrasound, the method comprising the steps of:

receiving a plurality of 3D ultrasound image volumes, each image volume depicting at least a portion of an elongated anatomical structure having a curved longitudinal extension;

on each 3D ultrasound image volume, automatically or semi-automatically fitting a parametric curve to the depicted portion of the elongated anatomical structure along its longitudinal extension, the parametric curve being defined by curve parameters;

reformatting each 3D ultrasound image volume by applying a transformation which straightens the parametric curve along at least one axis, so as to generate a plurality of reformatted image volumes and reformatted parametric curves;

registering the reformatted image volumes with one another by determining the joining point of their respective parametric curves; and

fusing the reformatted image volumes with one another to yield a fused image depicting the whole elongated anatomical structure or a larger portion thereof than the 3D ultrasound image volumes.

2. Method according to claim 1 , wherein the reformatting of each 3D ultrasound image volume comprises the steps of:

defining the dimensions and resolution of the reformatted image volume;

for each voxel in the reformatted image volume, finding the corresponding coordinates of this voxel in the 3D ultrasound image volume by using the parametric curve and the reformatted parametric curve;

calculating an intensity value of each voxel in the reformatted image volume by interpolating the intensity values of the voxels closest to said corresponding coordinates in the 3D ultrasound image volume.

3. Method according to claim 1 or 2 , wherein the elongated anatomical structure is the spine of a fetus, and the parametric curve is fitted to a centerline of the depicted portion of the spine.

4. Method according to claim 1 , wherein the parametric curve is generated by automatically or manually identifying control points on the elongated anatomical structure, in particular on the center of each or some of the segments of the spine, and fitting a parametric curve, in particular a spline function, to the control points.

5. Method according to claim 1 , wherein the step of reformatting each 3D ultrasound image includes applying a transformation which unwarps the parametric curve so as to straighten it using a local coordinate system comprising two axes orthogonal to the tangent of the curve, so that the reformatted image volumes comprise an arc-length reformation of the elongated anatomical structure.

6. Method according to claim 3 , wherein the reformatted image volume and/or the fused image comprises a primary axis that corresponds to a tangent of the parametric curve, and a secondary axis which is orthogonal to the primary axis and parallel to the ribs of the fetus.

7. Method according to claim 1 , wherein the step of reformatting each 3D ultrasound image volume includes applying a transformation, which unwarps the parametric curve in a local coordinate system along one axis, which is orthogonal to a reference plane of the elongated anatomical structure, so that the reformatted image volumes comprise a curvature-preserving isometric reformation of the elongated anatomical structure.

8. Method according to claim 3 , wherein the reference plane of the fetus is determined by fitting a plane to the spine and/or to anatomical landmarks on the spinous processes and/or to the ribcage of the fetus.

9. Method according to claim 1 , wherein the step of registering two reformatted volumes includes:

selecting a joining point of their respective reformatted parametric curves along the parametric curves,

using the selected joining point and computing a similarity metric between the overlapping parts of the two reformatted volumes,

translating the joining point along one of the reformatted parametric curves and again computing the similarity metric.

10. The method of claim 9 , wherein the step of registering two reformatted images includes weighting the similarity metric based on a distance from the parametric curve so as to give prominence to image features close to the elongated anatomical structure.

11. Method according to claim 1 , wherein the step of registering the reformatted image volumes with one another includes re-fitting the reformatted parametric curves of the reformatted volumes.

12. Method according to claim 1 , the method further including a step of automatically performing quantitative measurements on the fused image, wherein in particular the inter-vertebral distance, lateral-pedicle distance and/or the skin line are automatically determined.

13. A computer program comprising program code instructions which, when executed by a processor, enables the processor to carry out the method according to claim 1 .

14. An image evaluation device comprising:

a storage for receiving a plurality of 3D ultrasound image volumes, each image volume depicting at least a portion of an elongated anatomical structure,

a computing unit for performing the method according to claim 1 , and

a screen for displaying the reformatted image volumes, or the fused image.

15. An ultrasound system comprising:

a probe configured to obtain 3D ultrasound volumes, and

an image evaluation device according to claim 14 .

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 28, 2022
From: KRISHNAN, KARTHIK; FIRTION, CELINE; SETH, SUBHENDU; VAJINEPALLI, PALLAVI; ROUNDHILL, DAVID NIGEL
To: KONINKLIJKE PHILIPS N.V.
Reel/Frame 061238/0734 →
Continuity (2)
Provisional Application 63004547 · Apr 3, 2020
Related Publication 20230124879A1 · Apr 20, 2023
References Cited (17)
US 10460508B2 · Zhan et al. · 2019 [cited by applicant]
US 20080287796A1 · Kiraly et al. · 2008 [cited by applicant]
US 20110129137A1 · Tian · 2011 [cited by examiner]
US 20200015777A1 · Ciofolo-Veit · 2020 [cited by examiner]
US 20210202069A1 · van der Veen · 2021 [cited by examiner]
WO 2005048198A1 · 2005 [cited by applicant]
WO 2015063632A2 · 2015 [cited by applicant]
WO 2019016064A1 · 2019 [cited by applicant]
International Search Report and Written Opinion for PCT/EP2021/057514; Mailing date: Jul. 9, 2021, 10 pages. [cited by applicant]
Hanaoka, S. et al., “Automated segmentation method for spinal column based on a dual elliptic column model and its application for virtual spinal straightening”, J Comput Assist Tomogr, 2010, vol. 34, No. 1, pp. 156-162. [cited by applicant]
Kretschmer, J. et al., “ADR—Anatomy-Driven Reformation”, IEEE Transactions on Visualization and Computer Graphics, 2014, vol. 20, No. 12, 10 pages. [cited by applicant]
Gilboa et al., “Vertebral Anomalies”, Chapter 17, Book Ultrasonography of the PreNatal Brain, 3rd Ed, McGraw Hill Medical, 2015, Abstract Only. [cited by applicant]
Wilson, R.D. et al., “Prenatal Screening, Diagnosis, and Pregnancy Management of Fetal Neural Tube Defects”, J Obstet Gynaecol Can, 2021, vol. 43, No. 1, pp. 124-139. [cited by applicant]
Harrison, L.A. et al., “Abnormal Spinal Curvature in the Fetus”, J Ultrasound Med., 1992, vol. 11, pp. 473-479. [cited by applicant]
De Biasio, P. et al., “Spine length measurement in the first trimester of pregnancy”, Prenat Diagn., 2002, vol. 22, pp. 818-822. [cited by applicant]
Sepulveda, W. et al., “Fetal spinal anomalies in a first-trimester sonographic screening program for aneuploidy”, Prenat Diagn., 2011, vol. 31, p. 107-114. [cited by applicant]
Kanitsar, A. et al., “CPR—Curved Planar Reformation”, IEEE Visualization, 2002, pp. 37-44. [cited by applicant]