IP Library Granted Patent US 12,136,481
Granted Patent B2
US 12,136,481 · App. 16/909,570 · Granted Nov 5, 2024

Medical imaging characteristic detection, workflows, and AI model management

Inventors: Brian M Baker (Minnetonka, MN); Wade J. Steigauf (Bloomington, MN); Benjamin Strong (Tucson, AZ); Robert Harris (Maple Grove, MN); Jerry Lohr (Burnsville, MN); Steven Towey (Eden Prairie, MN)
Assignee: Virtual Radiologic Corporation
G16H30/20A61B6/52A61B6/5294G06N3/08G16H30/40G16H40/63G16H40/67G16H50/20G16H50/70G16H70/60G16H80/00
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,136,481
App. No.
16/909,570
Granted
Nov 5, 2024
Kind
B2
Abstract

Systems and methods for processing electronic imaging data obtained from medical imaging procedures, with use of trained artificial intelligence (AI) models, are disclosed herein. In an example, a use of a medical evaluation workflow involving an AI model includes: obtaining image data and non-image data associated with a medical imaging study; using at least one AI model to analyze the image data, with the trained AI model being validated with a defined governance standard to identify a characteristic or particular type of characteristic; identifying the characteristic with the AI model; and communicating the identified characteristic to a location associated with evaluation of the medical imaging study.

Claims (85)

1. A method of processing data in a medical evaluation workflow, performed with electronic operations executed with a processor of a computing device, the electronic operations comprising:

obtaining image data and non-image data associated with a medical imaging study for a human subject;

using at least one trained artificial intelligence (AI) model to analyze the image data, wherein the trained AI model is validated with a defined governance standard to identify at least one particular characteristic;

identifying the particular characteristic in the image data, based on output from the trained AI model, wherein the identified particular characteristic is not indicated by the non-image data; and

communicating the identified particular characteristic to a location associated with evaluation of the medical imaging study, wherein the identified particular characteristic controls at least one automated medical image data processing action at the location associated with evaluation.

2. The method of claim 1 , wherein the defined governance standard establishes a specificity and sensitivity to identify the particular characteristic within multiple medical imaging studies performed for multiple human subjects.

3. The method of claim 2 , wherein the trained AI model is validated based on a verified identification of the particular characteristic, using a comparison of results identified by natural language processing in study reports and results identified by the trained AI model, the study reports and results being performed on the multiple medical imaging studies performed for the multiple human subjects.

4. The method of claim 1 , wherein using the trained AI model includes use of multiple trained AI models, wherein output from a first trained AI model is used as an input to a second trained AI model.

5. The method of claim 1 , wherein using the trained AI model to analyze the image data comprises causing execution of at least a first AI model on a portion of the image data at an on-premise computing location, and causing execution of at least a second AI model on a portion of the image data at an off-premise computing location.

6. The method of claim 1 , the electronic operations further comprising:

selecting the trained AI model from among a plurality of trained AI models, based on at least one characteristic indicated in the non-image data.

7. The method of claim 1 , the electronic operations further comprising:

using at least one other trained AI model to analyze the image data and the non-image data, wherein a value of the particular characteristic identified by the trained AI model differs from a value of the particular characteristic identified by the other trained AI model.

8. The method of claim 1 , the electronic operations further comprising:

receiving report data provided from evaluation of the medical imaging study;

using at least one AI model, trained for analysis of natural language processing, to analyze the report data;

identifying the particular characteristic in the report data, based on output from the AI model trained for analysis of natural language processing; and

determining at least one evaluation action based on the identifying of the particular characteristic from the report data and the identifying of the particular characteristic from the image data.

9. The method of claim 1 , wherein the identified particular characteristic relates to at least one of:

priority of the medical imaging study;

characteristics of a medical imaging procedure used to capture the image data;

at least one anatomical feature represented in the image data; or

at least one medical condition represented in the image data.

10. The method of claim 1 , wherein communicating the identified particular characteristic to a location associated with evaluation causes at least one prioritization action, including at least one of:

adding or prioritizing of an assignment of the medical imaging study in a worklist;

providing a notification of an emergent or critical finding to a source of the medical imaging study; or

prioritizing results and reporting for the medical imaging study.

11. The method of claim 1 , wherein communicating the identified particular characteristic to a location associated with evaluation causes at least one validation action, including at least one of:

validation of data in the non-image data;

identification of discrepancies between characteristics detected in the image data and indicated in the non-image data;

adding the medical imaging study to a quality assurance workflow; or

adding the medical imaging study to a second read workflow.

12. The method of claim 1 , wherein communicating the identified particular characteristic to a location associated with evaluation causes at least one corrective action, including at least one of:

performing corrective actions to the non-image data; or

performing corrective actions to a report associated with the medical imaging study.

13. The method of claim 1 , wherein communicating the identified particular characteristic to a location associated with evaluation causes at least one display action, including at least one of:

providing an indication of the identified particular characteristic to an evaluator of the medical imaging study;

changing a display of the image data at a display of an evaluator of the medical imaging study; or

changing a report prepared at a display of an evaluator of the medical imaging study.

14. The method of claim 1 , wherein the image data is provided from a radiological imaging procedure, wherein the non-image data is provided from a radiological imaging order, and wherein the medical imaging study corresponds to a radiological read request for diagnostic evaluation of the image data by a medical professional evaluator, the radiological read request indicated by the radiological imaging order.

15. The method of claim 1 , wherein the trained AI model is a: machine learning model or convolutional neural network.

16. A non-transitory machine-readable storage medium, the machine-readable storage medium comprising instructions that, when executed by a processor of a computing device, causes the computing device to perform operations comprising:

obtaining image data and non-image data associated with a medical imaging study for a human subject;

using at least one trained artificial intelligence (AI) model to analyze the image data, wherein the trained AI model is validated with a defined governance standard to identify at least one particular characteristic;

identifying the particular characteristic in the image data, based on output from the trained AI model, wherein the identified particular characteristic is not indicated by the non-image data; and

communicating the identified particular characteristic to a location associated with evaluation of the medical imaging study, wherein the identified particular characteristic controls at least one automated medical image data processing action at the location associated with evaluation.

17. The machine-readable storage medium of claim 16 ,

wherein the defined governance standard establishes a specificity and sensitivity to identify the particular characteristic within multiple medical imaging studies performed for multiple human subjects,

wherein the trained AI model is validated based on a verified identification of the particular characteristic, using a comparison of results identified by natural language processing in study reports and results identified by the trained AI model, the study reports and results being performed on the multiple medical imaging studies performed for the multiple human subjects.

18. The machine-readable storage medium of claim 16 , the instructions further to cause the computing device to perform operations comprising:

receiving report data provided from evaluation of the medical imaging study;

using at least one AI model, trained for analysis of natural language processing, to analyze the report data;

identifying the particular characteristic in the report data, based on output from the AI model trained for analysis of natural language processing; and

determining at least one evaluation action based on the identifying of the particular characteristic from the report data and the identifying of the particular characteristic from the image data.

19. The machine-readable storage medium of claim 16 , wherein communicating the identified particular characteristic to a location associated with evaluation causes at least one prioritization action, including at least one of:

adding or prioritizing of an assignment of the medical imaging study in a worklist;

providing a notification of an emergent or critical finding to a source of the medical imaging study; or

prioritizing results and reporting for the medical imaging study.

20. The machine-readable storage medium of claim 16 , wherein communicating the identified particular characteristic to a location associated with evaluation causes at least one validation action, including at least one of:

validation of data in the non-image data;

identification of discrepancies between characteristics detected in the image data and indicated in the non-image data;

adding the medical imaging study to a quality assurance workflow; or

adding the medical imaging study to a second read workflow.

21. The machine-readable storage medium of claim 16 , wherein communicating the identified particular characteristic to a location associated with evaluation causes at least one corrective action, including at least one of:

performing corrective actions to the non-image data; or

performing corrective actions to a report associated with the medical imaging study.

22. The machine-readable storage medium of claim 16 , wherein communicating the identified particular characteristic to a location associated with evaluation causes at least one display action, including at least one of:

providing an indication of the identified particular characteristic to an evaluator of the medical imaging study;

changing a display of the image data at a display of an evaluator of the medical imaging study; or

changing a report prepared at a display of an evaluator of the medical imaging study.

23. A computing system, comprising:

a processor; and

a memory device comprising instructions stored thereon, which when executed by the processor, configure the processor to perform electronic operations with the computing system comprising:

obtaining image data and non-image data associated with a medical imaging study for a human subject;

using at least one trained artificial intelligence (AI) model to analyze the image data, wherein the trained AI model is validated with a defined governance standard to identify at least one particular characteristic;

identifying the particular characteristic in the image data, based on output from the trained AI model, wherein the identified particular characteristic is not indicated by the non-image data; and

communicating the identified particular characteristic to a location associated with evaluation of the medical imaging study, wherein the identified particular characteristic controls at least one automated medical image data processing action at the location associated with evaluation.

24. The computing system of claim 23 ,

wherein the defined governance standard establishes a specificity and sensitivity to identify the particular characteristic within multiple medical imaging studies performed for multiple human subjects,

wherein the trained AI model is validated based on a verified identification of the particular characteristic, using a comparison of results identified by natural language processing in study reports and results identified by the trained AI model, the study reports and results being performed on the multiple medical imaging studies performed for the multiple human subjects.

25. The computing system of claim 23 , the processor further to perform electronic operations comprising:

receiving report data provided from evaluation of the medical imaging study;

using at least one AI model, trained for analysis of natural language processing, to analyze the report data;

identifying the particular characteristic in the report data, based on output from the AI model trained for analysis of natural language processing; and

determining at least one evaluation action based on the identifying of the particular characteristic from the report data and the identifying of the particular characteristic from the image data.

Assignments (12)
RELEASE (REEL 066660 / FRAME 0573) Recorded Jul 1, 2025
From: BARCLAYS BANK PLC
To: VIRTUAL RADIOLOGIC CORPORATION; RADIOLOGY PARTNERS, INC.
Reel/Frame 071781/0746 →
RELEASE OF SECURITY INTEREST Recorded Jul 1, 2025
From: WILMINGTON TRUST, NATIONAL ASSOCIATION
To: RADIOLOGY PARTNERS, INC.; VIRTUAL RADIOLOGIC CORPORATION
Reel/Frame 071575/0916 →
SECURITY AGREEMENT (FIRST LIEN) Recorded Jul 1, 2025
From: VIRTUAL RADIOLOGIC CORPORATION; RADIOLOGY PARTNERS, INC.
To: BARCLAYS BANK PLC, AS AGENT
Reel/Frame 071781/0790 →
SECURITY AGREEMENT (NOTES) Recorded Jul 1, 2025
From: VIRTUAL RADIOLOGIC CORPORATION; RADIOLOGY PARTNERS, INC.
To: WILMINGTON TRUST, NATIONAL ASSOCIATION, AS NOTES COLLATERAL AGENT
Reel/Frame 071781/0802 →
RELEASE OF SECURITY INTEREST IN PATENTS Recorded Apr 5, 2024
From: BARCLAYS BANK PLC
To: RADIOLOGY PARTNERS, INC.; VIRTUAL RADIOLOGIC CORPORATION
Reel/Frame 067530/0105 →
SECURITY INTEREST Recorded Feb 26, 2024
From: RADIOLOGY PARTNERS, INC.; VIRTUAL RADIOLOGIC CORPORATION
To: WILMINGTON TRUST, NATIONAL ASSOCIATION
Reel/Frame 066564/0242 →
SECURITY INTEREST Recorded Feb 26, 2024
From: RADIOLOGY PARTNERS, INC.; VIRTUAL RADIOLOGIC CORPORATION
To: WILMINGTON TRUST, NATIONAL ASSOCIATION
Reel/Frame 066564/0185 →
RELEASE OF SECURITY INTEREST Recorded Feb 23, 2024
From: WILMINGTON TRUST, NATIONAL ASSOCIATION
To: RADIOLOGY PARTNERS, INC.; VIRTUAL RADIOLOGIC CORPORATION
Reel/Frame 066548/0715 →
SECURITY AGREEMENT (FIRST LIEN) Recorded Feb 22, 2024
From: RADIOLOGY PARTNERS, INC.; VIRTUAL RADIOLOGIC CORPORATION
To: BARCLAYS BANK PLC, AS AGENT
Reel/Frame 066660/0573 →
FIRST LIEN SECURITY AGREEMENT Recorded Mar 5, 2021
From: VIRTUAL RADIOLOGIC CORPORATION; RADIOLOGY PARTNERS, INC.
To: BARCLAYS BANK PLC
Reel/Frame 055588/0246 →
FIRST LIEN NOTES SECURITY AGREEMENT Recorded Dec 16, 2020
From: RADIOLOGY PARTNERS, INC.; VIRTUAL RADIOLOGIC CORPORATION
To: WILMINGTON TRUST, NATIONAL ASSOCIATION
Reel/Frame 054772/0211 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 16, 2020
From: BAKER, BRIAN M; STEIGAUF, WADE J; STRONG, BENJAMIN; HARRIS, ROBERT; LOHR, JERRY; TOWEY, STEVEN
To: VIRTUAL RADIOLOGIC CORPORATION
Reel/Frame 053782/0953 →