IP Library Granted Patent US 12,314,321
Granted Patent B1
US 12,314,321 · App. 18/658,081 · Granted May 27, 2025

Automated selection of foundation models for client-specific generative artificial intelligence needs

Inventors: Ahamed Jalaldeen Shahul Hamid (Bangalore, IN); Mukundan Sundararajan (Bangalore, IN); Deepak Malik (Gurgaon, IN); Hemant Singh (Gurgaon, IN)
Assignee: International Business Machines Corporation
G06F16/9035
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,314,321
App. No.
18/658,081
Granted
May 27, 2025
Kind
B1
Abstract

Automatically recommending appropriate foundation models is provided. A list of recommended foundation models, along with a corresponding ranking for each respective foundation model in the list is generated based on a corresponding attribute matching score and a justification for the corresponding ranking of each respective foundation model. The list of the recommended foundation models, along with the corresponding ranking for each respective foundation model in the list and the justification for the corresponding ranking of each respective foundation model is sent to a user. Feedback is received from the user regarding accuracy of a user-selected foundation model from the list of the recommended foundation models. The user-selected foundation model is adjusted based on the feedback received from the user regarding the accuracy of the user-selected foundation model from the list of the recommended foundation models.

Claims (71)

1. A computer-implemented method for automatically recommending appropriate foundation models, the computer-implemented method comprising:

generating, by a computer, using a foundation model advisor, a list of recommended foundation models, along with a corresponding ranking for each respective foundation model in the list based on a corresponding attribute matching score and a justification for the corresponding ranking of each respective foundation model;

determining a subset of foundation models based on the justification to form the list of recommended foundation models;

in response to the determining the subset of foundation models,

sending, by the computer, using the foundation model advisor, the list of the recommended foundation models, along with the corresponding ranking for each respective foundation model in the list and the justification for the corresponding ranking of each respective foundation model to a user;

receiving, by the computer, using the foundation model advisor, feedback from the user regarding accuracy of a user-selected foundation model from the list of the recommended foundation models; and

adjusting, by the computer, using a generative AI manager, the user-selected foundation model based on the feedback received from the user regarding the accuracy of the user-selected foundation model from the list of the recommended foundation models.

2. The computer-implemented method of claim 1 , further comprising:

deploying, by the computer, using the generative AI manager, the user-selected foundation model on a client device of the user to develop a generative AI solution in response to adjusting the user-selected foundation model based on the feedback.

3. The computer-implemented method of claim 1 , further comprising:

receiving, by the computer, using the foundation model advisor, project requirements corresponding to a generative AI solution from the user; and

performing, by the computer, using the foundation model advisor, a comparison of the project requirements received from the user with attributes of each respective foundation model of a plurality of foundation models contained in a foundation model catalog.

4. The computer-implemented method of claim 3 , further comprising:

generating, by the computer, using the foundation model advisor, an attribute matching score for each respective foundation model of the plurality of foundation models contained in the foundation model catalog based on the comparison of the project requirements received from the user with the attributes of each respective foundation model; and

selecting, by the computer, using the foundation model advisor, the recommended foundation models having the corresponding attribute matching score greater than a predefined minimum attribute matching score threshold level.

5. The computer-implemented method of claim 1 , further comprising:

identifying, by the computer, using robotic process automation, a plurality of foundation model hubs, each foundation model hub contains a plurality of foundation models along with attributes of corresponding foundation models;

retrieving, by the computer, using the robotic process automation, a list of foundation models from each respective foundation model hub of the plurality of foundation model hubs along with the attributes of each respective foundation model in response to identifying the plurality of foundation model hubs; and

generating, by the computer, using the generative AI manager of the computer, a foundation model catalog based on the list of foundation models retrieved from each respective foundation model hub of the plurality of foundation model hubs along with the attributes of each respective foundation model.

6. The computer-implemented method of claim 5 , further comprising:

training, by the computer, using the generative AI manager of the computer, a general-purpose foundation model of the computer using the foundation model catalog.

7. The computer-implemented method of claim 6 , further comprising:

implementing, by the computer, using the generative AI manager of the computer, the foundation model advisor of the computer based on the general-purpose foundation model that was trained with the foundation model catalog; and

adding, by the computer, using the generative AI manager of the computer, the general-purpose foundation model to the foundation model advisor of the computer.

8. The computer-implemented method of claim 6 , further comprising:

utilizing, by the computer, the foundation model advisor to generate the list of the recommended foundation models in accordance with received project requirements, along with a ranking corresponding to each particular foundation model in the list, and the justification in natural language for the ranking of each particular foundation model.

9. A computer system for automatically recommending appropriate foundation models, the computer system comprising:

a communication fabric;

a set of computer-readable storage media connected to the communication fabric, wherein the set of computer-readable storage media collectively stores program instructions; and

a set of processors connected to the communication fabric, wherein the set of processors executes the program instructions to:

generate, using a foundation model advisor, a list of recommended foundation models, along with a corresponding ranking for each respective foundation model in the list based on a corresponding attribute matching score and a justification for the corresponding ranking of each respective foundation model;

determining a subset of foundation models based on the justification to form the list of recommended foundation models;

in response to the determining the subset of foundation models,

send, using the foundation model advisor, the list of the recommended foundation models, along with the corresponding ranking for each respective foundation model in the list and the justification for the corresponding ranking of each respective foundation model to a user;

receive, using the foundation model advisor, feedback from the user regarding accuracy of a user-selected foundation model from the list of the recommended foundation models; and

adjust, using a generative AI manager, the user-selected foundation model based on the feedback received from the user regarding the accuracy of the user-selected foundation model from the list of the recommended foundation models.

10. The computer system of claim 9 , wherein the set of processors further executes the program instructions to:

deploy, using the generative AI manager, the user-selected foundation model on a client device of the user to develop a generative AI solution in response to adjusting the user-selected foundation model based on the feedback.

11. The computer system of claim 9 , wherein the set of processors further executes the program instructions to:

receive, using the foundation model advisor, project requirements corresponding to a generative AI solution from the user; and

perform, using the foundation model advisor, a comparison of the project requirements received from the user with attributes of each respective foundation model of a plurality of foundation models contained in a foundation model catalog.

12. The computer system of claim 11 , wherein the set of processors further executes the program instructions to:

generate, using the foundation model advisor, an attribute matching score for each respective foundation model of the plurality of foundation models contained in the foundation model catalog based on the comparison of the project requirements from the user with the attributes of each respective foundation model; and

select, using the foundation model advisor, the recommended foundation models having the corresponding attribute matching score greater than a predefined minimum attribute matching score threshold level.

13. The computer system of claim 9 , wherein the set of processors further executes the program instructions to:

identify, using robotic process automation, a plurality of foundation model hubs, each foundation model hub contains a plurality of foundation models along with attributes of corresponding foundation models;

retrieve, using the robotic process automation, a list of foundation models from each respective foundation model hub of the plurality of foundation model hubs along with the attributes of each respective foundation model in response to identifying the plurality of foundation model hubs; and

generate, using the generative AI manager of the computer system, a foundation model catalog based on the list of foundation models retrieved from each respective foundation model hub of the plurality of foundation model hubs along with the attributes of each respective foundation model.

14. The computer system of claim 13 , wherein the set of processors further executes the program instructions to:

train, using the generative AI manager of the computer system, a general-purpose foundation model of the computer system using the foundation model catalog.

15. A computer program product for automatically recommending appropriate foundation models, the computer program product comprising a set of computer-readable storage media having program instructions collectively stored therein, the program instructions executable by a computer to cause the computer to:

generate, using a foundation model advisor, a list of recommended foundation models, along with a corresponding ranking for each respective foundation model in the list based on a corresponding attribute matching score and a justification for the corresponding ranking of each respective foundation model;

determining a subset of foundation models based on the justification to form the list of recommended foundation models;

in response to the determining the subset of foundation models,

send, using the foundation model advisor, the list of the recommended foundation models, along with the corresponding ranking for each respective foundation model in the list and the justification for the corresponding ranking of each respective foundation model to a user;

receive, using the foundation model advisor, feedback from the user regarding accuracy of a user-selected foundation model from the list of the recommended foundation models; and

adjust, using a generative AI manager, the user-selected foundation model based on the feedback received from the user regarding the accuracy of the user-selected foundation model from the list of the recommended foundation models.

16. The computer program product of claim 15 , wherein the program instructions further cause the computer to:

deploy, using the generative AI manager, the user-selected foundation model on a client device of the user to develop a generative AI solution in response to adjusting the user-selected foundation model based on the feedback.

17. The computer program product of claim 15 , wherein the program instructions further cause the computer to:

receive, using the foundation model advisor, project requirements corresponding to a generative AI solution from the user; and

perform, using the foundation model advisor, a comparison of the project requirements received from the user with attributes of each respective foundation model of a plurality of foundation models contained in a foundation model catalog.

18. The computer program product of claim 17 , wherein the program instructions further cause the computer to:

generate, using the foundation model advisor, an attribute matching score for each respective foundation model of the plurality of foundation models contained in the foundation model catalog based on the comparison of the project requirements received from the user with the attributes of each respective foundation model; and

select, using the foundation model advisor, the recommended foundation models having the corresponding attribute matching score greater than a predefined minimum attribute matching score threshold level.

19. The computer program product of claim 15 , wherein the program instructions further cause the computer to:

identify, using robotic process automation, a plurality of foundation model hubs, each foundation model hub contains a plurality of foundation models along with attributes of corresponding foundation models;

retrieve, using the robotic process automation, a list of foundation models from each respective foundation model hub of the plurality of foundation model hubs along with the attributes of each respective foundation model in response to identifying the plurality of foundation model hubs; and

generate, using the generative AI manager of the computer, a foundation model catalog based on the list of foundation models retrieved from each respective foundation model hub of the plurality of foundation model hubs along with the attributes of each respective foundation model.

20. The computer program product of claim 19 , wherein the program instructions further cause the computer to:

train, using the generative AI manager of the computer, a general-purpose foundation model of the computer using the foundation model catalog.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 8, 2024
From: SHAHUL HAMID, AHAMED JALALDEEN; SUNDARARAJAN, MUKUNDAN; MALIK, DEEPAK; SINGH, HEMANT
To: INTERNATIONAL BUSINESS MACHINES CORPORATION
Reel/Frame 067347/0220 →
References Cited (25)
US 10475099B1 · Nomula · 2019 [cited by examiner]
US 10664500B2 · Chang · 2020 [cited by examiner]
US 11244373B2 · August · 2022 [cited by examiner]
US 11334949B2 · Kim · 2022 [cited by examiner]
US 11631017B2 · White · 2023 [cited by examiner]
US 20040267730A1 · Dumais · 2004 [cited by examiner]
US 20080126273A1 · Carus · 2008 [cited by examiner]
US 20120131020A1 · Nitz · 2012 [cited by examiner]
US 20130173583A1 · Hueter · 2013 [cited by examiner]
US 20170185669A1 · Chang · 2017 [cited by examiner]
US 20190286664A1 · Adams · 2019 [cited by examiner]
US 20200320829A1 · Smith · 2020 [cited by examiner]
US 20210158074A1 · Wray · 2021 [cited by examiner]
US 20210272045A1 · Reshef · 2021 [cited by examiner]
US 20240337464A1 · Mencotti · 2024 [cited by examiner]
CN 117520514A · 2024 [cited by applicant]
Anonymous, “Method and Apparatus for UI-Based Model Adapter for Foundation Models,” ip.com Prior Art Database, Apr. 4, 2023, 9 pages, ip.com, accessed April 9. 2024, https://priorart.ip.com/IPCOM/000272059. [cited by applicant]
Author unknown, “Choosing a foundation model in watsonx.ai,” IBM Documentation, Feb. 15, 2024, 6 pages, ibm.com, https://www.ibm.com/docs/en/watsonx-as-a-service?topic=models-choosing-model. [cited by applicant]
Author unknown, “Hugging Face Foundation Models Hub,” Hugging Face, 2024, huggingface.co, accessed Apr. 22, 2024, https://huggingface.co/models. [cited by applicant]
Author unknown, “IBM watsonx Foundation Models Library,” IBM Products, 2024, ibm.com, accessed Apr. 22, 2024, www.ibm.com/products/watsonx-ai/foundation-models. [cited by applicant]
Author unknown, “Nuclia multi-model generative AI selection,” Nuclia, 2024, 7 pages, nuclia.com, accessed Apr. 9, 2024, https://nuclia.com/generative-ai/. [cited by applicant]
Dhurandhar et al., “Ranking Large Language Models without Ground Truth,” Arxiv, Feb. 21, 2024, 19 pages, arxiv.org, accessed Apr. 9, 2024, https://arxiv.org/abs/2402.14860. [cited by applicant]
Gharse, “Announcing Foundation Models in Azure Machine Learning,” Microsoft Community Hub, May 23, 2023, 8 pages, Microsoft AI—Machine Learning Blog, accessed Apr. 9, 2024, https://techcommunity.microsoft.com/t5/ai-mach… [cited by applicant]
Lu et al., “A Taxonomy of Foundation Model Based Systems Through the Lens of Software Architecture,” Arxiv, Jan. 22, 2024, pp. 2-14, arxiv.org, accessed Apr. 9, 2024, https://arxiv.org/abs/2305.05352. [cited by applicant]
Moss, “Supercharging the Customer Experience with AI Modeling,” Concentrix, 2024, 6 pages, concentrix.com, accessed Apr. 9, 2024, https://www.concentrix.com/insights/blog/customer-experience-ai-modeling/. [cited by applicant]