IP Library Granted Patent US 10,546,049
Granted Patent B2
US 10,546,049 · App. 14/971,095 · Granted Jan 28, 2020

Systems and methods for validating and correcting automated medical image annotations

Inventors: Leo J. Grady (Millbrae, CA); Romain Moreau-Gobard (Redwood City, CA); Michiel Schaap (Mountain View, CA)
Assignee: HeartFlow, Inc.
G06F17/241A61B6/032A61B6/468G06F3/04845G06F19/321G06K9/00369G06T7/0012G06T17/00G06T19/00G06T19/003G16H30/20G06T2207/30048G06T2207/30101G06T2207/30196G06T2219/004
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,546,049
App. No.
14/971,095
Granted
Jan 28, 2020
Kind
B2
Abstract

Systems and methods are disclosed for manipulating image annotations. One method includes receiving an image of an individual's anatomy; automatically determining, using a processor, one or more annotations for anatomical features identified in the image of the individual's anatomy; determining a dependency or hierarchy between at least two of the one or more annotations for anatomical features identified in the image of the individual's anatomy; and generating, based on the dependency or hierarchy, a workflow prompting a user to manipulate the one or more annotations for anatomical features identified in the image of the individual's anatomy.

Claims (52)

1. A computer-implemented method of manipulating medical image annotations, the method comprising:

receiving an image of at least a portion of an individual's anatomy;

producing a set of annotations for annotating anatomical features automatically identified by a processor within the image of at least the portion of the individual's anatomy;

determining a sequence of dependencies between at least two annotations of the set of annotations based on the anatomical features associated with each of the at least two annotations of the set of annotations, the sequence of dependencies being preconfigured prior to receiving the image, the anatomical features including one or more of an aorta, a vessel centerline, and a vessel lumen, wherein the sequence of dependencies defines an order according to which a first annotation of the at least two annotations is followed by a second annotation of the at least two annotations, and wherein the second annotation is dependent upon the first annotation such that an identification of the second annotation is based on a prior identification of, or modification to, the first annotation;

presenting the set of annotations to a user for validation, the presenting including presenting the first annotation and the second annotations in the order;

upon validation, by the user, of the set of annotations including the first annotation and the second annotation, determining one or more critical parameters associated with the set of annotations, the one or more critical parameters including one or more of: a size of the annotation, a shape of the annotation, an appearance of the annotation, a density of the annotation, or a relationship of the annotation to other annotations among the set of annotations;

identifying a critical subset of the set of annotations based on values of the one or more critical parameters; and

presenting the critical subset of the set of annotations to the user or to another user.

2. The method of claim 1 , wherein

the presenting the set of annotations includes presenting a selected annotation of the set of annotations earlier if another annotation of the set of annotations is dependent on the selected annotation of the set of annotations.

3. The method of claim 2 , further comprising:

requesting validation for the selected annotation of the set of annotations prior to presenting the another annotation of the set of annotations.

4. The method of claim 1 , further comprising:

requesting validations for the critical subset of the set of the image annotations.

5. The method of claim 1 , further comprising:

receiving one or more modifications to the set of annotations based on tools associated with one or more visualizations of the set of annotations.

6. The method of claim 5 , further comprising:

determining one or more dependent annotations in the set of annotations, wherein the one or more dependent annotations are associated with the one or more modifications; and

determining a re-computation of the one or more dependent annotations in the set of annotations based on the one or more modifications.

7. A system for manipulating medical image annotations, the system comprising:

a data storage device storing instructions for manipulating medical image annotations; and

a processor configured to execute the instructions to perform a method including:

receiving an image of at least a portion of an individual's anatomy;

producing a set of annotations for annotating anatomical features automatically identified by a processor within the image of at least the portion of the individual's anatomy;

determining a sequence of dependencies between at least two annotations of the set of annotations based on the anatomical features associated with each of the at least two annotations of the set of annotations, the sequence of dependencies being preconfigured prior to receiving the image, the anatomical features including one or more of an aorta, a vessel centerline, and a vessel lumen, wherein the sequence of dependencies defines an order according to which a first annotation of the at least two annotations is followed by a second annotation of the at least two annotations, and wherein the second annotation is dependent upon the first annotation such that an identification of the second annotation is based on a prior identification of, or modification to, the first annotation;

presenting the set of annotations to a user for validation, the presenting including presenting the first annotation and the second annotations in the order;

upon validation, by the user, of the set of annotations including the first annotation and the second annotation, determining one or more critical parameters associated with the set of annotations, the one or more critical parameters including one or more of: a size of the annotation, a shape of the annotation, an appearance of the annotation, a density of the annotation, or a relationship of the annotation to other annotations among the set of annotations;

identifying a critical subset of the set of annotations based on values of the one or more critical parameters; and

presenting the critical subset of the set of annotations to the user or to another user.

8. The system of claim 7 , wherein

the presenting the set of annotations includes presenting a selected annotation of the set of annotations earlier if another annotation of the set of annotations is dependent on the selected annotation of the set of annotations.

9. The system of claim 8 , wherein the system is further configured for:

requesting validation for the selected annotation of the set of annotations prior to presenting the another annotation of the set of annotations.

10. The system of claim 7 , wherein the system is further configured for:

requesting validations for the critical subset of the set of the image annotations.

11. The system of claim 7 , wherein the system is further configured for:

receiving one or more modifications to the set of annotations based on tools associated with one or more visualizations of the set of annotations.

12. The system of claim 11 , wherein the system is further configured for:

determining one or more dependent annotations in the set of annotations, wherein the one or more dependent annotations are associated with the one or more modifications; and

determining a re-computation of the one or more dependent annotations in the set of annotations based on the one or more modifications.

13. A non-transitory computer readable storage medium for use on a computer system containing computer-executable programming instructions for performing a method of manipulating medical image annotations, the method comprising:

receiving an image of at least a portion of an individual's anatomy;

producing a set of annotations for annotating anatomical features automatically identified by a processor within the image of at least the portion of the individual's anatomy;

determining a sequence of dependencies between at least two annotations of the set of annotations based on the anatomical features associated with each of the at least two annotations of the set of annotations, the sequence of dependencies being preconfigured prior to receiving the image, the anatomical features including one or more of an aorta, a vessel centerline, and a vessel lumen, wherein the sequence of dependencies defines an order according to which a first annotation of the at least two annotations is followed by a second annotation of the at least two annotations, and wherein the second annotation is dependent upon the first annotation such that an identification of the second annotation is based on a prior identification of, or modification to, the first annotation;

presenting the set of annotations to a user for validation, the presenting including presenting the first annotation and the second annotations in the order;

upon validation, by the user, of the set of annotations including the first annotation and the second annotation, determining one or more critical parameters associated with the set of annotations, the one or more critical parameters including one or more of: a size of the annotation, a shape of the annotation, an appearance of the annotation, a density of the annotation, or a relationship of the annotation to other annotations among the set of annotations;

identifying a critical subset of the set of annotations based on values of the one or more critical parameters; and

presenting the critical subset of the set of annotations to the user or to another user.

14. The non-transitory computer readable storage medium of claim 13 , wherein

the presenting the set of annotations includes presenting a selected annotation of the set of annotations earlier if another annotation of the set of annotations is dependent on the selected annotation of the set of annotations.

15. The non-transitory computer readable storage medium of claim 14 , the method further comprising:

requesting validation for the selected annotation of the set of annotations prior to presenting the another annotation of the set of annotations.

Assignments (5)
RELEASE OF SECURITY INTEREST Recorded Sep 11, 2025
From: HAYFIN SERVICES LLP
To: HEARTFLOW, INC.
Reel/Frame 072876/0775 →
RELEASE OF SECURITY INTEREST Recorded Jun 21, 2024
From: HAYFIN SERVICES LLP
To: HEARTFLOW, INC.
Reel/Frame 067801/0032 →
SECURITY INTEREST Recorded Jun 18, 2024
From: HEARTFLOW, INC.
To: HAYFIN SERVICES LLP
Reel/Frame 067775/0966 →
SECURITY INTEREST Recorded Jan 20, 2021
From: HEARTFLOW, INC.
To: HAYFIN SERVICES LLP
Reel/Frame 055037/0890 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 16, 2015
From: GRADY, LEO J.; MOREAU-GOBARD, ROMAIN; SCHAAP, MICHIEL
To: HEARTFLOW, INC.
Reel/Frame 037308/0590 →
Cited By (1)
US 12,670,998