IP Library › Granted Patent US 11,830,607
Granted Patent B2
US 11,830,607 · App. 17/939,619 · Granted Nov 28, 2023

Systems and methods for facilitating image finding analysis

Inventors: Andrew Dennis Smith (Hoover, AL); Robert B. Jacobus (Mountain Brook, AL); Paige Elaine Severino (Birmingham, AL)
Assignee: AI METRICS, LLC
G16H30/40G06T7/0012G06T7/11G10L15/26G16H15/00G16H30/20G16H50/20G06T2207/30096
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,830,607
App. No.
17/939,619
Granted
Nov 28, 2023
Kind
B2
Abstract

A system for facilitating image finding analysis includes one or more processors and one or more hardware storage devices storing instructions that are executable by the one or more processors to configure the system to perform acts such as (i) presenting an image on a user interface, the image being one of a plurality of images provided on the user interface in a navigable format, (ii) obtaining a voice annotation for the image, the voice annotation being based on a voice signal of a user, and (iii) binding the voice annotation to at least one aspect of the image, wherein the binding modifies metadata of the image based on the voice annotation.

Claims (41)

1. A system for facilitating image finding analysis, comprising:

one or more processors; and

one or more hardware storage devices storing computer-executable instructions that are executable by the one or more processors to configure the system to:

present an image on a user interface, the image being one of a plurality of images provided on the user interface in a navigable format;

receive first user input directed to a portion of a structure present in the image;

in response to the first user input, automatically obtain a structure type and a structure anatomical location for the structure present in the image utilizing one or more first artificial intelligence (AI) modules, the one or more first AI modules being trained to identify structure type and structure anatomical location based on input image data;

in response to second user input, activate a dictation tool to obtain a human voice signal associated with a user;

obtain a voice annotation for the image based on the human voice signal utilizing one or more second AI modules, the one or more second AI modules being trained to transcribe human voice signals; and

display the voice annotation, the structure type, and the structure anatomical location contemporaneous with presentation of the structure of the image.

2. The system of claim 1 , wherein the second user input comprises selection of a selectable user interface element for activating the dictation tool.

3. The system of claim 1 , wherein the instructions are executable by the one or more processors to further configure the system to:

in response to the first user input, obtain a segmentation of the structure and/or one or more axis measurements of the structure.

4. The system of claim 1 , wherein the voice annotation, the structure type, and the structure anatomical location are displayed contemporaneous with presentation of the structure of the image of the plurality of images provided on the user interface in the navigable format, wherein the plurality of images comprises a set of cross-sectional medical images of a patient.

5. The system of claim 1 , wherein the plurality of images comprises a plurality of cross-sectional medical images.

6. The system of claim 5 , wherein the structure comprises one or more of a mass, a lymph node, a metastasis, or other bodily structure captured in the plurality of cross-sectional medical images.

7. The system of claim 1 , wherein the voice annotation is obtained contemporaneous with presentation of the structure of image on the user interface.

8. The system of claim 1 , wherein the first user input directed to the portion of the structure present in the image comprises a user selection of the portion of the structure present in the image.

9. The system of claim 8 , wherein the user selection of the portion of the structure present in the image triggers placement of a label on the image indicating at least the structure type and the structure anatomical location.

10. The system of claim 1 , wherein the instructions are executable by the one or more processors to further configure the system to:

bind the voice annotation to at least one aspect of the image, wherein the binding modifies metadata of the image based on the voice annotation.

11. The system of claim 10 , wherein the voice annotation comprises a text transcription of the human voice signal associated with the user.

12. The system of claim 11 , wherein the image and the voice annotation bound to the at least one aspect of the image are configured as training data usable to train one or more AI modules for determining attributes of other images.

13. A system for facilitating image finding analysis, the system comprising:

one or more processors; and

one or more hardware storage devices storing computer-executable instructions that are executable by the one or more processors to configure the system to:

present a first image of a first plurality of images associated with a first timepoint, the first image comprising a structure;

present a second image of a second plurality of images associated with a second timepoint, the second timepoint being subsequent to the first timepoint, the second image of the second plurality of images being presented in navigable form, the second plurality of images comprising a set of cross-sectional medical images of a patient;

obtain first metadata of the first image, the first metadata describing one or more aspects of the structure, the first metadata comprising a first voice annotation based on a first human voice signal obtained during first analysis of the first image;

present a representation of the first voice annotation contemporaneous with the structure and the second image, the second image of the second plurality of images being presented in navigable form; and

prompt a user to evaluate presence and/or status of the structure in the second image.

14. The system of claim 13 , wherein the first metadata further comprises structure type and structure anatomical location for the structure.

15. The system of claim 14 , wherein the instructions are executable by the one or more processors to further configure the system to:

present a representation of the structure type and the structure anatomical location for the structure contemporaneous with the structure and the second image.

16. The system of claim 13 , wherein the first metadata further comprises a segmentation of the structure and/or one or more axis measurements of the structure.

17. The system of claim 16 , wherein the instructions are executable by the one or more processors to further configure the system to:

present a representation of the segmentation and the one or more axis measurements contemporaneous with the structure and the second image.

18. The system of claim 13 , wherein the structure comprises one or more of a mass, a lymph node, a metastasis, or other bodily structure.

19. The system of claim 13 , wherein the instructions are executable by the one or more processors to further configure the system to:

obtain a second voice annotation for the second image based on a second human voice signal, wherein the second voice annotation indicates the presence and/or status of the structure in the second image.

20. The system of claim 19 , wherein the instructions are executable by the one or more processors to further configure the system to:

bind the second voice annotation to at least one aspect of the second image, wherein the binding modifies second metadata of the second image based on the second voice annotation.

Assignments (2)
CORRECTIVE ASSIGNMENT TO CORRECT THE CORRECT NAME OF THE ASSIGNEE IS AI METRICS, LLC INSTEAD OF AL METRICS, LLC PREVIOUSLY RECORDED AT REEL: 061016 FRAME: 0955. ASSIGNOR(S) HEREBY CONFIRMS THE ASSIGNMENT. Recorded Sep 9, 2022
From: SMITH, ANDREW DENNIS; JACOBUS, ROBERT B.; SEVERINO, PAIGE ELAINE
To: AI METRICS, LLC
Reel/Frame 061462/0502 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 7, 2022
From: SMITH, ANDREW DENNIS; JACOBUS, ROBERT B.; SEVERINO, PAIGE ELAINE
To: AL METRICS, LLC
Reel/Frame 061016/0955 →
Continuity (2)
Provisional Application 63241858 · Sep 8, 2021
Related Publication 20230076821A1 · Mar 9, 2023