IP Library › Granted Patent US 11,501,191
Granted Patent B2
US 11,501,191 · App. 16/138,566 · Granted Nov 15, 2022

Recommending machine learning models and source codes for input datasets

Inventors: Samiulla Shaikh (Bangalore, IN); Sameep Mehta (New Delhi, IN); Manish Bhide (SeriLingamaplly, IN); William B. Lobig (Trabuco Canyon, CA)
Assignee: International Business Machines Corporation
G06N5/045G06F16/211G06K9/6267G06N20/00
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,501,191
App. No.
16/138,566
Granted
Nov 15, 2022
Kind
B2
Abstract

Asset recommendation for a particular input dataset is provided. Candidate data analysis assets having a corresponding relatedness score associated with the particular input dataset greater than a defined relatedness score threshold value are selected. Those candidate data analysis assets having a corresponding relatedness score greater than the defined relatedness score threshold value are ranked by score. Those candidate data analysis assets having a corresponding relatedness score greater than the defined relatedness score threshold value are listed by rank from highest to lowest. A justification for each candidate data analysis asset is inserted in the ranked list of candidate data analysis assets. The ranked list of candidate data analysis assets along with each respective justification is outputted on a display device.

Claims (66)

1. A computer-implemented method for asset recommendation for a particular input dataset, the computer-implemented method comprising:

selecting, by a computer, candidate machine learning models and source codes having a corresponding relatedness score to the particular input dataset greater than a defined relatedness score threshold value;

ranking, by the computer, those selected candidate machine learning models and source codes having a corresponding relatedness score greater than the defined relatedness score threshold value by score to form a ranked list of selected candidate machine learning models and source codes;

selecting, by the computer, one of a highest-ranking candidate machine learning model or a highest-ranking candidate source code in the ranked list of selected candidate machine learning models and source codes as a highest-ranking data analysis asset to classify the particular input dataset:

applying, by the computer, the highest-ranking data analysis asset to the particular input dataset to classify the particular input dataset for performing a task using the particular input dataset:

performing, by the computer, an analysis of the particular input dataset to determine semantics corresponding to the particular input dataset;

providing, by the computer, recommendations for the selected candidate machine learning models and source codes based on the semantics corresponding to the particular input dataset; and

training, by one of the candidate source codes, one of the candidate machine learning models using the particular input dataset.

2. The computer-implemented method of claim 1 further comprising:

calculating, by the computer, a relatedness score between the particular input dataset and the selected candidate machine learning models and source codes based on semantics corresponding to the particular input dataset and semantics corresponding to each candidate machine learning model and source code of the selected candidate machine learning models and source codes.

3. The computer-implemented method of claim 2 , wherein the relatedness score is a measure of strength of relationship between a particular candidate machine learning model and the particular input dataset and a particular candidate source code and the particular input dataset.

4. The computer-implemented method of claim 2 , wherein the semantics corresponding to the particular input dataset include at least one of structure and content of the particular input dataset, types of users who have used the particular input dataset previously, types of problems that users were trying to solve using the particular input dataset, types of data pattern analysis algorithms, data transformations, and source codes previously applied to the particular input dataset, and machine learning models previously trained using the particular input dataset.

5. The computer-implemented method of claim 2 , wherein the semantics corresponding to each candidate machine learning model and source code include domain, structure, and content of data used to train each particular candidate machine learning model and source code.

6. The computer-implemented method of claim 1 further comprising:

utilizing, by the computer, a user profile of a user to assist in providing the recommendations for the selected candidate machine learning models and source codes, wherein the user profile comprises a user type of the user and historical usage patterns that represent a pattern of dataset usage by the user.

7. The computer-implemented method of claim 1 further comprising:

determining, by the computer, whether a user input was received to open an existing dataset stored on the computer; and

responsive to the computer determining that a user input was received to open an existing dataset stored on the computer, retrieving, by the computer, a pre-computed set of semantics corresponding to the existing dataset from a storage device of the computer.

8. The computer-implemented method of claim 1 further comprising:

determining, by the computer, whether a user input was received to upload a new dataset to the computer;

responsive to the computer determining that a user input was received to upload a new dataset to the computer, computing, by the computer, a set of semantics corresponding to the new dataset; and

storing, by the computer, the new dataset and the set of semantics corresponding to the new dataset in a storage device of the computer.

9. The computer-implemented method of claim 1 further comprising:

displaying, by the computer, the recommendations for the candidate machine learning models and source codes to form displayed recommendations.

10. The computer-implemented method of claim 9 further comprising:

receiving, by the computer, a user selection of a particular machine learning model and source code in the displayed recommendations.

11. The computer-implemented method of claim 1 , wherein the computer is a data engineering platform located in a cloud environment.

12. A computer system for asset recommendation for a particular input dataset, the computer system comprising:

a bus system;

a storage device connected to the bus system, wherein the storage device stores program instructions; and

a processor connected to the bus system, wherein the processor executes the program instructions to:

select candidate machine learning models and source codes having a corresponding relatedness score to the particular input dataset greater than a defined relatedness score threshold value;

rank those selected candidate machine learning models and source codes having a corresponding relatedness score greater than the defined relatedness score threshold value by score to form a ranked list of selected candidate machine learning models and source codes;

select one of a highest-ranking candidate machine learning model or a highest- ranking candidate source code in the ranked list of selected candidate machine learning models and source codes as a highest-ranking data analysis asset to classify the particular input dataset;

apply the highest-ranking data analysis asset to the particular input dataset to classify the particular input dataset for performing a task using the particular input dataset;

perform an analysis of the particular input dataset to determine semantics corresponding to the particular input dataset;

providing recommendations for the selected candidate machine learning models and source codes based on the semantics corresponding to the particular input dataset; and

train, by one of the candidate source codes, one of the candidate machine learning models using the particular input dataset.

13. The computer system of claim 12 , wherein the processor further executes the program instructions to:

calculate a relatedness score between the particular input dataset and the selected candidate machine learning models and source codes based on semantics corresponding to the particular input dataset and semantics corresponding to each candidate machine learning model and source code of the plurality of selected candidate machine learning models and source codes.

14. A computer program product for asset recommendation for a particular input dataset, the computer program product comprising a computer readable storage medium having program instructions embodied therewith, the program instructions executable by a computer to cause the computer to perform a method comprising:

selecting, by the computer, candidate machine learning models and source codes having a corresponding relatedness score to the particular input dataset greater than a defined relatedness score threshold value;

ranking, by the computer, those selected candidate machine learning models and source codes having a corresponding relatedness score greater than the defined relatedness score threshold value by score to form a ranked list of selected candidate machine learning models and source codes;

selecting, by the computer, one of a highest-ranking candidate machine learning model or a highest-ranking candidate source code in the ranked list of selected candidate machine learning models and source codes as a highest-ranking data analysis asset to classify the particular input dataset:

applying, by the computer, the highest-ranking data analysis asset to the particular input dataset to classify the particular input dataset for performing a task using the particular input dataset:

performing, by the computer, an analysis of the particular input dataset to determine semantics corresponding to the particular input dataset;

providing, by the computer, recommendations for the selected candidate machine learning models and source codes based on the semantics corresponding to the particular input dataset; and

training, by one of the candidate source codes, one of the candidate machine learning models using the particular input dataset.

15. The computer program product of claim 14 further comprising:

calculating, by the computer, a relatedness score between the particular input dataset and the selected candidate machine learning models and source codes based on semantics corresponding to the particular input dataset and semantics corresponding to each candidate machine learning model and source code of the selected candidate machine learning models and source codes.

16. The computer program product of claim 15 , wherein the relatedness score is a measure of strength of relationship between a particular candidate machine learning model and the particular input dataset and a particular candidate source code and the particular input dataset.

17. The computer program product of claim 15 , wherein the semantics corresponding to the particular input dataset include at least one of structure and content of the particular input dataset, types of users who have used the particular input dataset previously, types of problems that users were trying to solve using the particular input dataset, types of data pattern analysis algorithms, data transformations, and source codes previously applied to the particular input dataset, and machine learning models previously trained using the particular input dataset.

18. The computer program product of claim 15 , wherein the semantics corresponding to each candidate machine learning model and source code include domain, structure, and content of data used to train each particular candidate machine learning model and source code.

19. The computer program product of claim 14 further comprising:

utilizing, by the computer, a user profile of a user to assist in providing the recommendations for the selected candidate machine learning models and source codes, wherein the user profile comprises a user type of the user and historical usage patterns that represent a pattern of dataset usage by the user.

20. The computer program product of claim 14 further comprising:

determining, by the computer, whether a user input was received to open an existing dataset stored on the computer; and

responsive to the computer determining that a user input was received to open an existing dataset stored on the computer, retrieving, by the computer, a pre-computed set of semantics corresponding to the existing dataset from a storage device of the computer.

21. The computer program product of claim 14 further comprising:

determining, by the computer, whether a user input was received to upload a new dataset to the computer;

responsive to the computer determining that a user input was received to upload a new dataset to the computer, computing, by the computer, a set of semantics corresponding to the new dataset; and

storing, by the computer, the new dataset and the set of semantics corresponding to the new dataset in a storage device of the computer.

22. The computer program product of claim 14 further comprising:

displaying, by the computer, the recommendations for the candidate machine learning models and source codes to form displayed recommendations.

23. The computer program product of claim 22 further comprising:

receiving, by the computer, a user selection of a particular machine learning model and source code in the displayed recommendations.

Assignments (2)
CORRECTIVE ASSIGNMENT TO CORRECT THE SPELLING OF RECEIVING PARTY NAME INTERNATIONAL BUSINESS MACHINES CORPORATION PREVIOUSLY RECORDED ON REEL 046942 FRAME 0237. ASSIGNOR(S) HEREBY CONFIRMS THE ASSIGNMENT. Recorded Dec 4, 2018
From: SHAIKH, SAMIULLA; MEHTA, SAMEEP; BHIDE, MANISH; LOBIG, WILLIAM B.
To: INTERNATIONAL BUSINESS MACHINES CORPORATION
Reel/Frame 047718/0565 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 21, 2018
From: SHAIKH, SAMIULLA; MEHTA, SAMEEP; BHIDE, MANISH; LOBIG, WILLIAM B.
To: INTERNATIONAL BUSINESS MACHINE CORPORATION
Reel/Frame 046942/0237 →
Continuity (1)
Related Publication 20200097845A1 · Mar 26, 2020
Cited By (3)
US 12,287,848 US 12,613,683 US 12,645,437