IP Library Granted Patent US 12,400,752
Granted Patent B2
US 12,400,752 · App. 17/423,179 · Granted Aug 26, 2025

Image analysis method and device

Inventors: Tobias Wissel (Lübeck, DE); Irina Waechter-Stehle (Hamburg, DE); Frank Michael Weber (Hamburg, DE); Arne Ewald (Hamburg, DE)
Assignee: KONINKLIJKE PHILIPS N.V.
G16H30/40G06N20/00G06T7/0014G06T7/11G06T7/136G06T7/143G06T7/174G06T2207/10132
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,400,752
App. No.
17/423,179
Granted
Aug 26, 2025
Kind
B2
Abstract

An image analysis method and device is for detecting failure or error in an image segmentation procedure. The method comprises comparing ( 14 ) segmentation outcomes for two or more images, representative of a particular anatomical region at different respective time points, and identifying a degree of consistency or deviation between them. Based on this derived consistency or deviation measure, a measure of accuracy of the segmentation procedure is determined ( 16 ).

Claims (51)

1. An image analysis method for determining failures in an image segmentation procedure that identifies and segments one or more anatomical features in an image, the method comprising:

obtaining different image segmentations of two or more images of an anatomical region of a patient, representative of the anatomical region at different respective time points, wherein each of the two or more images is segmented using the image segmentation procedure;

determining one or more measures of consistency between the different image segmentations based on a comparison of the different image segmentations; and

determining a measure of accuracy of the image segmentation procedure based on the one or more measures of consistency and on reference to a pre-determined normal degree of inconsistency between the different image segmentations of the two or more images,

wherein the one or more measures of consistency are distinct from the measure of accuracy,

wherein the pre-determined normal degree of inconsistency is representative of expected variations or movement of the anatomical region at the different respective time points, and

wherein the different respective time points correspond to defined time points in a periodic or cyclic movement pattern of the anatomical region.

2. The method as claimed in claim 1 , wherein determining the one or more measures of consistency comprises comparing one or more similar segmented features, segmented in each of the different image segmentations, and determining the one or more measures of consistency between the one or more similar segmented features in the different image segmentations.

3. The method as claimed in claim 2 , wherein determining the one or more measures of consistency comprises comparing at least one of a position, a shape, or one or more dimensions of at least a portion of the different image segmentations.

4. The method as claimed in claim 1 , wherein the measure of accuracy is further based on applying one or more pre-determined minimum thresholds for the one or more measures of consistency.

5. The method as claimed in claim 1 , wherein at least one of determining the one or more measures of consistency or determining the measure of accuracy comprises use of a machine learning algorithm.

6. The method as claimed in claim 5 , wherein determining the measure of accuracy comprises use of a machine learning algorithm, and

wherein the machine learning algorithm is trained for distinguishing between normal and abnormal levels of inconsistency between image segmentations of the anatomical region at different time points.

7. The method as claimed in claim 5 , wherein both determining the one or more measures of consistency and determining the measure of accuracy comprise use of a machine learning algorithm.

8. The method as claimed in claim 1 , wherein the measure of accuracy comprises a probabilistic measure of accuracy.

9. The method as claimed in claim 1 , wherein the method is performed in real time with obtaining of the different image segmentations.

10. The method as claimed in claim 1 , wherein the method is an ultrasound image analysis method such that the two or more images of the anatomical region are ultrasound images.

11. The method as claimed in claim 1 , wherein the obtaining of the different image segmentations comprises:

receiving the two or more images of the anatomical region; and

processing the two or more images with the image segmentation procedure.

12. The method as claimed in claim 1 , wherein obtaining the one or more image segmentations comprises:

receiving ultrasound data;

processing the ultrasound data to derive the two or more images of the anatomical region, representative of the anatomical region at different respective time points; and

processing the derived two or more images with the image segmentation procedure.

13. The method as claimed in claim 1 , wherein the measure the accuracy is configured to indicate whether a variation in the one or more measures of consistency is representative of:

the failures in the image segmentation procedure; or

natural movement of the anatomical region.

14. The method as claimed in claim 1 , further comprising outputting a first representation of the measure of accuracy to a display.

15. The method as claimed in claim 14 , further comprising outputting a second representation of a recommendation for changing acquisition of images of the anatomical region.

16. The method as claimed in claim 1 ,

wherein, when the measure of accuracy for the different image segmentations is unacceptable, at least one of the two or more images of the anatomical region are not output to a display, and

wherein, when the measure of accuracy for the different image segmentations is acceptable, the two or more images of the anatomical region are output to a display.

17. An image analysis device for determining failures in an image segmentation procedure that identifies and segments one or more anatomical features in an image, the image analysis device comprising:

an acquisition module configured to obtain different image segmentations of two or more images of an anatomical region of a patient, representative of the anatomical region at different respective time points, wherein each of the two or more images is segmented using the image segmentation procedure, wherein the different respective time points correspond to defined time points in a periodic or cyclic movement pattern of the anatomical region;

a comparison module configured to determine a measure of consistency between the different image segmentations based on a comparison of the different image segmentations; and

an analysis module configured to determine a measure of accuracy of the image segmentation procedure based on the measure of consistency and on reference to a pre-determined normal degree of inconsistency between the different image segmentations of the two or more images,

wherein the measure of consistency is distinct from the measure of accuracy, and

wherein the pre-determined normal degree of inconsistency is representative of expected variations or movement of the anatomical region at the different respective time points.

18. An ultrasound system, comprising:

an ultrasound transducer unit; and

the image analysis device as claimed in claim 17 , operatively coupled with the ultrasound transducer unit for use in obtaining different image segmentations.

19. An image analysis device for determining failures in an image segmentation procedure that identifies and segments one or more anatomical features in an image, the image analysis device comprising:

one or more processors; and

one or more non-transitory storage media storing instructions that, when executed by the one or more processors, cause the one or more processors to:

receive two or more images of an anatomical region of a patient representative of the anatomical region at different respective time points;

perform image segmentation of the two or more images using the image segmentation procedure to provide different image segmentations of the two or more images, wherein the different respective time points correspond to defined time points in a periodic or cyclic movement pattern of the anatomical region;

determine a measure of consistency between the different image segmentations based on a comparison of the different image segmentations; and

determine a measure of accuracy of the image segmentation procedure based on the measure of consistency and on reference to a pre-determined normal degree of inconsistency between the different image segmentations of the two or more images,

wherein the measure of consistency is distinct from the measure of accuracy, and

wherein the pre-determined normal degree of inconsistency is representative of expected variations or movement of the anatomical region at the different respective time points.

20. The image analysis device as claimed in claim 19 , wherein determining the measure of consistency comprises comparing one or more similar segmented features, segmented in each of the different image segmentations, and determining the measure of consistency between the one or more similar segmented features in the different image segmentations.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 15, 2021
From: WISSEL, TOBIAS; WAECHTER-STEHLE, IRINA; WEBER, FRANK MICHAEL; EWALD, ARNE
To: KONINKLIJKE PHILIPS N.V.
Reel/Frame 056864/0378 →
Priority Claims (1)
EP 19151746 · Jan 15, 2019 · regional
Continuity (1)
Related Publication 20220130523A1 · Apr 28, 2022
References Cited (19)
US 5469850A · Tizuka et al. · 1995 [cited by applicant]
US 10140544B1 · Zhao · 2018 [cited by examiner]
US 20080205717A1 · Reeves · 2008 [cited by examiner]
US 20130182935A1 · Wang et al. · 2013 [cited by applicant]
US 20190188852A1 · Reicher · 2019 [cited by examiner]
US 20200167930A1 · Wang · 2020 [cited by examiner]
US 20200401854A1 · Peng · 2020 [cited by examiner]
US 20210383548A1 · Wilson · 2021 [cited by examiner]
International Search Report and Written Opinion of PCT/EP2019/087136, dated Feb. 13, 2020. [cited by applicant]
Jorgensen, Alex Skovsbo et al “An Improved Algorithm for Coronary Bypass Anastomosis Segmentation in Epicardial Ultrasound Sequences”, Ultrasound in Medicine and Biology, vol. 42, No. 12, Sep. 2016, pp. 3010-3021. [cited by applicant]
Kirisli, H. et al “Evaluation of a Multi-Atlas Based Method for Segmentation of Cardiac CTA data: a Large-Scale, Multicenter, and Multivendor Study”, Medical Physics, vol. 37, No. 12, Nov. 2010, pp. 6279-6291. [cited by applicant]
Li, Wei et al “Learning Image Context for Segmentation of the Prostate in CT-Guided Radiotherapy”, Physics in Medicine and Biology, vol. 57, No. 5, Feb. 2012, pp. 1283-1308. [cited by applicant]
Ecabert, O. et al “Automatic Model-Based Segmentation of the Heart in CT Images” IEEE Transactions on Medical Imaging, vol. 27, No. 9, 2008, pp. 1189-1201. [cited by applicant]
Cortes, C. et al “Support-Vector Networks” Machine Learning, vol. 20, pp. 273-297, 1995. [cited by applicant]
Bishop, Christopher M. Neural Networks for pattern Recognition, Oxford Press, Inc. 1995. [cited by applicant]
Hautvast, G. et al “Validation of Automatic Segmentation Algorithms for SHort-Axis Cine Cardiac Magnetic Resonance”, Proc. Intl. Society Mag. Reson. Med. vol. 15, 2007. [cited by applicant]
Barbosa, Daniel et al “Fast and Fully Automatic 3-D Echocardiographic Segmentation using B-Spline Explicit Active Surfaces: Feasibility Study and Validation in a Clinical Setting” Ultrasound in Medicine and Biology, vol… [cited by applicant]
Elen, An et al “A Spatio-Temporal Model for Joint Segmentation and Registration of Cardiac Cine MR Images” MICCAI 2010 Workshop. [cited by applicant]
Suri, J.S. et al.“Greedy Algorithm for Error Correction in Automatically produced Boundaries form Low Contrast Ventrigulograms”, Pattern Analysis and Applications, 2000. [cited by applicant]