IP Library Granted Patent US 10,276,265
Granted Patent B2
US 10,276,265 · App. 15/253,746 · Granted Apr 30, 2019

Automated anatomically-based reporting of medical images via image annotation

Inventors: Murray A. Reicher (Rancho Santa Fe, CA); Flora Gilboa-Solomon (Haifa, IL); Guy Amit (Ganei Tikva, IL)
Assignee: International Business Machines Corporation
G16H15/00G06F19/00G06F19/321
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,276,265
App. No.
15/253,746
Granted
Apr 30, 2019
Kind
B2
Abstract

Methods and systems for generating an electronic structured report associated with a displayed electronic medical image. One method includes receiving an annotation for the electronic medical image, automatically determining, with an electronic processor, an anatomical location within the electronic medical image associated with the annotation, and automatically determining, with the electronic processor, a location within the electronic structured report associated with the anatomical location based on a predetermined mapping. The method also includes automatically populating the location of the electronic structured report based on the annotation.

Claims (28)

1. A method of generating an electronic structured report associated with a displayed electronic medical image, the method comprising:

receiving an annotation for the displayed electronic medical image;

automatically determining, with an electronic processor, an anatomical location within the displayed electronic medical image associated with the annotation;

automatically determining, with the electronic processor, a location within the electronic structured report associated with the anatomical location based on a predetermined mapping; and

automatically populating the determined location of the electronic structured report with data based on the annotation.

2. The method of claim 1 , wherein receiving the annotation for the displayed electronic medical image includes receiving the annotation from a reader through an input mechanism.

3. The method of claim 1 , wherein receiving the annotation for the displayed electronic medical image includes receiving an automatically-generated annotation.

4. The method of claim 1 , wherein determining the location within the electronic structured report includes determining the location within an electronic, anatomically-structured report.

5. The method of claim 1 , further comprising automatically dividing an anatomical structure represented in the displayed electronic medical image into a plurality of depths and displaying at least one depth graphic on the displayed electronic medical image based on the plurality of depths.

6. The method of claim 5 , wherein displaying the at least one depth graphic includes displaying the at least one depth graphic transiently.

7. The method of claim 5 , wherein displaying the at least one depth graphic includes displaying the at least one depth graphic in response to at least selected from a group consisting of receiving the annotation from a reader through an input mechanism and activation of a microphone.

8. The method of claim 5 , wherein automatically determining the anatomical location associated within the displayed electronic medical image includes determining the anatomical location based on the plurality of depths.

9. The method of claim 5 , wherein the at least one depth graphic includes an oblique line and further comprising automatically determining an angle of the oblique line based on information stored in a meta-file associated with the displayed electronic medical image.

10. The method of claim 1 , further comprising automatically displaying a label at an anatomical position within the displayed electronic medical image.

11. The method of claim 10 , wherein receiving the annotation for the displayed electronic medical image includes receiving a selection of the label.

12. The method of claim 10 , wherein automatically displaying the label includes automatically displaying the label for at least one selected from a group consisting of an areola position, a subreolar position, a dermal position, a subdermal position, a subcutaneous position, an axillary position, and a chest wall position, an implant position.

13. The method of claim 10 , wherein automatically displaying the label includes automatically displaying the label based on at least one rule associated with at least one selected from a group consisting of a reader, a workstation, an organization, an application, a patient, an imaging modality, an anatomical structure, and the displayed electronic medical image.

14. The method of claim 10 , wherein automatically displaying the label includes displaying the label based on a position of a cursor within the displayed electronic medical image.

15. The method of claim 1 , wherein receiving the annotation for the displayed electronic medical image includes receiving a label and a finding, wherein automatically determining the anatomical location within the displayed electronic medical image includes determining a position of the label within an anatomical structure represented in the displayed electronic medical image, wherein automatically determining the location of the electronic structured report includes determining at least one line item included in the electronic structured report associated with the position of the label and the anatomical structure, and wherein automatically populating the location of the electronic structured report based on the annotation includes populating the at least one line item with the finding.

16. The method of claim 1 , wherein receiving the annotation for the displayed electronic medical image includes receiving a label and wherein automatically populating the location of the electronic structured report includes transferring the label to the location of the electronic structured report.

17. The method of claim 1 , wherein automatically determining the anatomical location includes automatically generating an anatomical location syntax associated with the annotation and wherein automatically populating the location of the electronic structured report based on the annotation includes populating the location with at least one value included in the anatomical location syntax.

18. A system comprising:

an electronic processor configured to

display an electronic medical image, receive an annotation for the electronic medical image,

automatically determine an anatomical location within the electronic medical image associated with the annotation,

automatically determine a location within an electronic structured report associated with the anatomical location based on a predetermined mapping;

automatically populate the determined location of the electronic structured report with data based on the annotation; and

automatically output data to a reader of the electronic medical image informing the reader of the location of the electronic structured report, wherein the output data includes at least one of visual data and audio data.

Assignments (4)
SECURITY INTEREST Recorded Oct 1, 2025
From: MERATIVE US L.P.; MERGE HEALTHCARE INCORPORATED
To: TCG SENIOR FUNDING L.L.C., AS COLLATERAL AGENT
Reel/Frame 072808/0442 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 21, 2022
From: INTERNATIONAL BUSINESS MACHINES CORPORATION
To: MERATIVE US L.P.
Reel/Frame 061496/0752 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 10, 2017
From: AMIT, GUY; GILBOA-SOLOMON, FLORA
To: INTERNATIONAL BUSINESS MACHINES CORPORATION
Reel/Frame 042954/0361 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 14, 2016
From: REICHER, MURRAY A.
To: INTERNATIONAL BUSINESS MACHINES CORPORATION
Reel/Frame 039742/0155 →
Continuity (1)
Related Publication 20180060533A1 · Mar 1, 2018
Cited By (16)
US 12,193,853 US 12,193,886 US 12,211,124 US 12,211,608 US 12,236,582 US 12,236,597 US 12,239,471 US 12,254,586 US 12,307,604 US 12,324,707 US 12,446,842 US 12,475,992 US 12,505,645 US 12,507,980 US 12,564,365 US 12,672,778