IP Library Granted Patent US 12,400,437
Granted Patent B2
US 12,400,437 · App. 17/741,384 · Granted Aug 26, 2025

Model combining and interaction for medical imaging

Inventors: Babak Rasolzadeh (San Francisco, CA); Maya Khalife (San Francisco, CA); Christian Arne Ulstrup (Milton, DE)
Assignee: Arterys Inc.
G06V10/80G06T11/00G06V10/87G16H30/40G06T2210/41
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,400,437
App. No.
17/741,384
Granted
Aug 26, 2025
Kind
B2
Abstract

This disclosure relates to the combining and interaction of multiple artificial intelligence (AI) models for medical image analysis. An example method includes obtaining AI models from model providers and organizing them to form associations. In response to a user request, base models are selected and provided. Additional models are further selected to combine with the base models, and medical image analysis results are presented based on applying a combination of the models to target medical image data.

Claims (36)

1. A computer-implemented method for facilitating medical image analysis, comprising:

obtaining a plurality of artificial intelligence (AI) models for medical image analysis from one or more model providers;

organizing the plurality of models into groups to form associations among the models, wherein at least a subset of the groups reference one another to associate models with one another;

in response to a user request received from a user device, providing one or more base models selected from the plurality of models;

searching, based on the one or more base models, the organized plurality of models in accordance with the models' associations to identify one or more additional models as candidates for combining with the one or more base models;

providing the one or more additional models selected from the organized plurality of models to combine with the one or more base models; and

causing presentation of medical image analysis results based, at least in part, on applying a combination of the one or more base models and the one or more additional models to target medical image data, wherein causing presentation of the medical image analysis results comprises causing presentation of image overlay features concurrently with one or more images of the target medical image data.

2. The method of claim 1 , wherein organizing the plurality of models comprises organizing the plurality of models into a hierarchy of the groups based on grouping criteria.

3. The method of claim 2 , wherein the grouping criteria includes at least one of a similarity of input between models, a similarity of output between models, or an overlap between a model's output and another model's input.

4. The method of claim 1 , wherein the user request indicates at least one of an analysis purpose, context, applicable medical data, model structure, model input or output, or performance requirement.

5. The method of claim 1 , further comprising selecting the one or more base models based, at least in part, on the associations among the models.

6. The method of claim 1 , wherein the one or more additional models and the one or more base models are designed to receive same or overlapping input features and to generate different output features.

7. The method of claim 1 , wherein the one or more additional models and the one or more base models are designed to generate same or overlapping output features.

8. The method of claim 1 , wherein the one or more additional models and the one or more base models are linkable to form a configurable workflow.

9. The method of claim 8 , wherein the configurable workflow includes at least one of a chain, tree, or lattice structure to link models.

10. The method of claim 1 , wherein causing presentation of the medical image analysis results comprises causing presentation of one or more user interfaces via the user device.

11. The method of claim 10 , wherein causing presentation of the medical image analysis results further comprises causing presentation of image overlay features corresponding to results from the combination of the one or more base models and the one or more additional models, via the one or more user interfaces.

12. One or more non-transitory computer-readable media collectively storing contents that, when executed by one or more processors, cause the one or more processors to perform actions comprising:

organizing a plurality of models for medical image analysis into groups to form associations among the models, wherein at least a subset of the groups reference one another to associate models with one another;

searching, based on one or more first models, the organized plurality of models in accordance with the models' associations to identify one or more second models for combining with the one or more first models;

combining at least a subset of the one or more first models with at least a subset of the one or more second models to form a combination of models based, at least in part, on a user request; and

causing presentation of medical image analysis results based, at least in part, on applying the combination of models to target medical image data, wherein causing presentation of the medical image analysis results comprises causing presentation of image overlay features concurrently with one or more images of the target medical image data.

13. The one or more non-transitory computer-readable media of claim 12 , wherein the image overlay features include at least one of bounding boxes for object detection and localization, or graded heat maps corresponding to clinical metrics.

14. The one or more non-transitory computer-readable media of claim 12 , wherein the image overlay features include a single feature that integrates results generated from individual models that form the combination of models.

15. The one or more non-transitory computer-readable media of claim 14 , wherein the single feature is generated by at least one of intersection, union, averaging, weighted averaging, or probabilistic sampling operation.

16. A system, comprising:

one or more processors; and

non-transitory memory storing contents that, when executed by the one or more processors, cause the system to:

organize a plurality of models into groups for medical image analysis to form associations among the models, wherein at least a subset of the groups reference one another to associate models with one another;

search, based on one or more first models, the organized plurality of models in accordance with the models' associations to identify one or more second models for combining with the one or more first models;

combine at least a subset of the one or more first models with at least a subset of the one or more second models to form a combination of models based, at least in part, on a user request; and

cause presentation of medical image analysis results based, at least in part, on applying the combination of models to target medical image data, wherein causing presentation of the medical image analysis results comprises causing presentation of image overlay features concurrently with one or more images of the target medical image data.

17. The system of claim 16 , wherein organizing the plurality of models comprises organizing the plurality of models into a hierarchy of the groups based on grouping criteria.

18. The system of claim 16 , wherein individual models that form the combination of models are designed to receive same or overlapping input features and to generate different output features.

19. The system of claim 16 , wherein individual models of that form the combination of models are designed to generate same or overlapping output features.

20. The system of claim 16 , wherein individual models of that form the combination of models are linkable to form a workflow including at least one of a chain, tree, or lattice structure to link models.

Assignments (3)
RELEASE OF SECURITY INTEREST Recorded May 14, 2026
From: ARES CAPITAL CORPORATION, AS COLLATERAL AGENT
To: ARTERYS INC.
Reel/Frame 074653/0610 →
SECURITY INTEREST Recorded Nov 22, 2022
From: ARTERYS INC.
To: ARES CAPITAL CORPORATION, AS COLLATERAL AGENT
Reel/Frame 061857/0870 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 10, 2022
From: RASOLZADEH, BABAK; KHALIFÉ, MAYA; ULSTRUP, CHRISTIAN ARNE
To: ARTERYS INC.
Reel/Frame 060169/0001 →
Continuity (2)
Provisional Application 63187676 · May 12, 2021
Related Publication 20220366680A1 · Nov 17, 2022
References Cited (4)
US 20140176602A1 · Yoshihara · 2014 [cited by examiner]
US 20210005307A1 · Knoplioch · 2021 [cited by examiner]
US 20210081720A1 · Polleri et al. · 2021 [cited by applicant]
International Search Report and Written Opinion, mailed Jul. 26, 2022, for International Application No. PCT/US2022/028573, 16 pages. [cited by applicant]