IP Library › Granted Patent US 12,190,254
Granted Patent B2
US 12,190,254 · App. 18/501,716 · Granted Jan 7, 2025

Chatbot for defining a machine learning (ML) solution

Inventors: Alberto Polleri (London, GB); Sergio Lopez (London, GB); Marc Michiel Bron (London, GB); Dan David Golding (London, GB); Alexander Ioannides (London, GB); Maria del Rosario Mestre (London, GB); Hugo Alexandre Pereira Monteiro (London, GB); Oleg Gennadievich Shevelev (London, GB); Larissa Cristina Dos Santos Romualdo Suzuki (Wokingham, GB); Xiaoxue Zhao (London, GB); Matthew Charles Rowe (Milton Keynes, GB)
Assignee: Oracle International Corporation
G06N5/04G06F40/40G06N20/00G06N20/20H04L51/02
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,190,254
App. No.
18/501,716
Granted
Jan 7, 2025
Kind
B2
Abstract

The present disclosure relates to systems and methods for an intelligent assistant (e.g., a chatbot) that can be used to enable a user to generate a machine learning system. Techniques can be used to automatically generate a machine learning system to assist a user. In some cases, the user may not be a software developer and may have little or no experience in either machine learning techniques or software programming. In some embodiments, a user can interact with an intelligent assistant. The interaction can be aural, textual, or through a graphical user interface. The chatbot can translate natural language inputs into a structural representation of a machine learning solution using an ontology. In this way, a user can work with artificial intelligence without being a data scientist to develop, train, refine, and compile machine learning models as stand-alone executable code.

Claims (58)

1. A computer-implemented method comprising:

receiving, from a user device, a first input;

predicting, using a computational technique, a type of desired result based on the first input;

identifying, using metadata associated with each machine-learning-model framework of a set of machine-learning-model frameworks, one or more machine-learning-model frameworks based on the predicted type of desired result, wherein the one or more machine-learning-model frameworks are of the set of machine-learning-model frameworks;

presenting, for each machine-learning-model framework of the one or more machine-learning-model frameworks, a representation of a corresponding machine-learning-model architecture on a display, wherein one or more machine-learning-model architectures are presented;

receiving a second input identifying a selection of a particular machine-learning-model architecture of the one or more machine-learning-model architectures;

receiving a third input identifying a data source for generating a machine learning architecture;

receiving a fourth input identifying one or more constraints for the machine learning architecture;

generating code for a machine learning model based at least in part on the second input identifying the selection of the particular machine-learning-model architecture, the third input identifying the data source, and the fourth input identifying the one or more constraints; and

storing the generated code in a memory.

2. The computer-implemented method of claim 1 , wherein the particular machine-learning-model architecture includes a neural network.

3. The computer-implemented method of claim 1 , wherein the particular machine-learning-model architecture includes a classifier network.

4. The computer-implemented method of claim 1 , further comprising:

analyzing the one or more constraints to generate a second plurality of code for the particular machine-learning-model architecture based at least in part on optimizing the one or more constraints;

generating an optimized solution; and

displaying the optimized solution.

5. The computer-implemented method of claim 1 , further comprising deploying the particular machine-learning-model architecture via an intelligent assistant interface.

6. The computer-implemented method of claim 1 , wherein the first input includes textual input.

7. The computer-implemented method of claim 1 , wherein the one or more constraints includes a constraint pertaining to at least one of resources, location, security, or privacy.

8. A system comprising:

one or more data processors; and

a non-transitory computer readable storage medium containing instructions which, when executed on the one or more data processors, cause the one or more data processors to perform a set of actions including:

receiving, from a user device, a first input;

predicting, using a computational technique, a type of desired result based on the first input;

identifying, using metadata associated with each machine-learning-model framework of a set of machine-learning-model frameworks, one or more machine-learning-model frameworks based on the predicted type of desired result, wherein the one or more machine-learning-model frameworks are of the set of machine-learning-model frameworks;

presenting, for each machine-learning-model framework of the one or more machine-learning-model frameworks, a representation of a corresponding machine-learning-model architecture on a display, wherein one or more machine-learning-model architectures are presented;

receiving a second input identifying a selection of a particular machine-learning-model architecture of the one or more machine-learning-model architectures;

receiving a third input identifying a data source for generating a machine learning architecture;

receiving a fourth input identifying one or more constraints for the machine learning architecture;

generating code for a machine learning model based at least in part on the second input identifying the selection of the particular machine-learning-model architecture, the third input identifying the data source, and the fourth input identifying the one or more constraints; and

storing the generated code in a memory.

9. The system of claim 8 , wherein the particular machine-learning-model architecture includes a neural network.

10. The system of claim 8 , wherein the particular machine-learning-model architecture includes a classifier network.

11. The system of claim 8 , wherein the set of actions further includes:

analyzing the one or more constraints to generate a second plurality of code for the particular machine-learning-model architecture based at least in part on optimizing the one or more constraints;

generating an optimized solution; and

displaying the optimized solution.

12. The system of claim 8 , wherein the set of actions further includes deploying the particular machine-learning-model architecture via an intelligent assistant interface.

13. The system of claim 8 , wherein the first input includes textual input.

14. The system of claim 8 , wherein the one or more constraints includes a constraint pertaining to at least one of resources, location, security, or privacy.

15. A computer-program product tangibly embodied in a non-transitory machine-readable storage medium, including instructions configured to cause one or more data processors to perform a set of actions including:

receiving, from a user device, a first input;

predicting, using a computational technique, a type of desired result based on the first input;

identifying, using metadata associated with each machine-learning-model framework of a set of machine-learning-model frameworks, one or more machine-learning-model frameworks based on the predicted type of desired result, wherein the one or more machine-learning-model frameworks are of the set of machine-learning-model frameworks;

presenting, for each machine-learning-model framework of the one or more machine-learning-model frameworks, a representation of a corresponding machine-learning-model architecture on a display, wherein one or more machine-learning-model architectures are presented;

receiving a second input identifying a selection of a particular machine-learning-model architecture of the one or more machine-learning-model architectures;

receiving a third input identifying a data source for generating a machine learning architecture;

receiving a fourth input identifying one or more constraints for the machine learning architecture;

generating code for a machine learning model based at least in part on the second input identifying the selection of the particular machine-learning-model architecture, the third input identifying the data source, and the fourth input identifying the one or more constraints; and

storing the generated code in a memory.

16. The computer-program product of claim 15 , wherein the particular machine-learning-model architecture includes a neural network.

17. The computer-program product of claim 15 , wherein the particular machine-learning-model architecture includes a classifier network.

18. The computer-program product of claim 15 , wherein the set of actions further includes:

analyzing the one or more constraints to generate a second plurality of code for the particular machine-learning-model architecture based at least in part on optimizing the one or more constraints;

generating an optimized solution; and

displaying the optimized solution.

19. The computer-program product of claim 15 , wherein the set of actions further includes deploying the particular machine-learning-model architecture via an intelligent assistant interface.

20. The computer-program product of claim 15 , wherein the first input includes textual input.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Nov 6, 2023
From: POLLERI, ALBERTO; LOPEZ, SERGIO; BRON, MARC MICHIEL; GOLDING, DAN DAVID; IOANNIDES, ALEXANDER; MESTRE, MARIA DEL ROSARIO; MONTEIRO, HUGO ALEXANDRE PEREIRA; SHEVELEV, OLEG GENNADIEVICH; SUZUKI, LARISSA CRISTINA DOS SANTOS ROMUALDO; ZHAO, XIAOXUE; ROWE, MATTHEW CHARLES
To: ORACLE INTERNATIONAL CORPORATION
Reel/Frame 065473/0344 →
Continuity (4)
Continuation 18100458 · Jan 23, 2023
Continuation 16893193 · Jun 4, 2020
Provisional Application 62900537 · Sep 14, 2019
Related Publication 20240070494A1 · Feb 29, 2024
References Cited (144)
US 5343527A · Moore · 1994 [cited by applicant]
US 5699507A · Goodnow et al. · 1997 [cited by applicant]
US 9306738B2 · Loftus et al. · 2016 [cited by applicant]
US 9384450B1 · Cordes et al. · 2016 [cited by applicant]
US 10198399B1 · Fritchman et al. · 2019 [cited by applicant]
US 10417577B2 · Bowers et al. · 2019 [cited by applicant]
US 10657447B1 · McDonnell et al. · 2020 [cited by applicant]
US 11182691B1 · Zhang · 2021 [cited by applicant]
US 11238377B2 · Polleri et al. · 2022 [cited by applicant]
US 11663523B2 · Polleri et al. · 2023 [cited by applicant]
US 11811925B2 · Polleri et al. · 2023 [cited by applicant]
US 11847578B2 · Polleri et al. · 2023 [cited by applicant]
US 11921815B2 · Polleri et al. · 2024 [cited by applicant]
US 20040006761A1 · Anand et al. · 2004 [cited by applicant]
US 20050102227A1 · Solonchev · 2005 [cited by applicant]
US 20070043734A1 · Cannon et al. · 2007 [cited by applicant]
US 20070239630A1 · Davis et al. · 2007 [cited by applicant]
US 20080133435A1 · Chintalapti · 2008 [cited by examiner]
US 20090144698A1 · Fanning et al. · 2009 [cited by applicant]
US 20090276389A1 · Constantine et al. · 2009 [cited by applicant]
US 20110099532A1 · Coldicott et al. · 2011 [cited by applicant]
US 20130204809A1 · Bilenko et al. · 2013 [cited by applicant]
US 20140180738A1 · Phillipps et al. · 2014 [cited by applicant]
US 20150170053A1 · Miao · 2015 [cited by applicant]
US 20160055426A1 · Aminzadeh et al. · 2016 [cited by applicant]
US 20160110657A1 · Gibiansky et al. · 2016 [cited by applicant]
US 20160179063A1 · Septfontaines et al. · 2016 [cited by applicant]
US 20160275964A1 · Kim et al. · 2016 [cited by applicant]
US 20160358099A1 · Sturlaugson et al. · 2016 [cited by applicant]
US 20170061021A1 · Royzner · 2017 [cited by examiner]
US 20170277693A1 · Mehedy et al. · 2017 [cited by applicant]
US 20180052824A1 · Ferrydiansyah · 2018 [cited by examiner]
US 20180060738A1 · Achin et al. · 2018 [cited by applicant]
US 20180060744A1 · Achin et al. · 2018 [cited by applicant]
US 20180089593A1 · Patel et al. · 2018 [cited by applicant]
US 20180136617A1 · Xu et al. · 2018 [cited by applicant]
US 20180222776A1 · Quicksall et al. · 2018 [cited by applicant]
US 20180314250A1 · Lewis · 2018 [cited by examiner]
US 20180314926A1 · Schwartz · 2018 [cited by examiner]
US 20180314936A1 · Barik · 2018 [cited by examiner]
US 20180322365A1 · Yehezkel Rohekar · 2018 [cited by examiner]
US 20180322387A1 · Sridharan · 2018 [cited by examiner]
US 20180322403A1 · Ron · 2018 [cited by examiner]
US 20180349447A1 · Maccartney · 2018 [cited by examiner]
US 20180349499A1 · Pawar · 2018 [cited by examiner]
US 20190108417A1 · Talagala et al. · 2019 [cited by applicant]
US 20190163758A1 · Zhivotvorev · 2019 [cited by examiner]
US 20190228261A1 · Chan · 2019 [cited by applicant]
US 20190236894A1 · Paradise et al. · 2019 [cited by applicant]
US 20190279114A1 · Deshpande et al. · 2019 [cited by applicant]
US 20190317805A1 · Metsch et al. · 2019 [cited by applicant]
US 20190334716A1 · Kocsis et al. · 2019 [cited by applicant]
US 20190354765A1 · Chan et al. · 2019 [cited by applicant]
US 20200012900A1 · Walters et al. · 2020 [cited by applicant]
US 20200081899A1 · Shapur et al. · 2020 [cited by applicant]
US 20200151619A1 · Mopur et al. · 2020 [cited by applicant]
US 20200210769A1 · Hou et al. · 2020 [cited by applicant]
US 20200242510A1 · Duesterwald et al. · 2020 [cited by applicant]
US 20200333772A1 · Srivastava et al. · 2020 [cited by applicant]
US 20200394044A1 · Keski-Valkama · 2020 [cited by applicant]
US 20200410011A1 · Shi · 2020 [cited by examiner]
US 20210065048A1 · Salonidis et al. · 2021 [cited by applicant]
US 20210081720A1 · Polleri et al. · 2021 [cited by applicant]
US 20210081819A1 · Polleri et al. · 2021 [cited by applicant]
US 20210081837A1 · Polleri et al. · 2021 [cited by applicant]
US 20210083855A1 · Polleri et al. · 2021 [cited by applicant]
US 20210133670A1 · Cella et al. · 2021 [cited by applicant]
US 20210174217A1 · Pai et al. · 2021 [cited by applicant]
US 20210250305A1 · Santo · 2021 [cited by applicant]
US 20210358601A1 · Pillai et al. · 2021 [cited by applicant]
US 20230237348A1 · Polleri et al. · 2023 [cited by applicant]
US 20230267374A1 · Polleri et al. · 2023 [cited by applicant]
US 20230336340A1 · Polleri et al. · 2023 [cited by applicant]
CN 101782976A · 2010 [cited by applicant]
CN 114556322A · 2020 [cited by applicant]
CN 114586048A · 2020 [cited by applicant]
CN 114616560A · 2020 [cited by applicant]
EP 4028874A1 · 2022 [cited by applicant]
EP 4028875A1 · 2022 [cited by applicant]
EP 4028903A1 · 2022 [cited by applicant]
WO 2018111270A1 · 2018 [cited by applicant]
WO 2018217635A1 · 2018 [cited by applicant]
WO 2018222776A1 · 2018 [cited by applicant]
WO 2019236894A1 · 2019 [cited by applicant]
WO 2021050382A1 · 2021 [cited by applicant]
WO 2021050391A1 · 2021 [cited by applicant]
WO 2021051031A1 · 2021 [cited by applicant]
Notice of Allowance for U.S. Appl. No. 17/019,258, dated Nov. 3, 2023. [cited by applicant]
Office Action for U.S. Appl. No. 17/019,254, dated Nov. 3, 2023. [cited by applicant]
What is Automated Machine Learning (AutoML)?, Microsoft Docs, available online at https://docs.microsoft.com/en-us/azure/machine-learning/concept-automated-ml, Apr. 22, 2020. [cited by applicant]
Xu et al., “CryptoNN: Training Neural Networks over Encrypted Data”, available online at http://www.lichao.work/files/2019-C-ICDCS.pdf, Apr. 15, 2019. [cited by applicant]
Zoller et al., “Benchmark and Survey of Automated Machine Learning Frameworks”, Journal of Artificial Intelligence Research 1, 1993. [cited by applicant]
U.S. Appl. No. 18/132,859, filed Apr. 10, 2023, Alberto Polleri. [cited by applicant]
“Home—Welcome to MIbox's Official Documentation, MLBox, Machine Learning Box”, available online at https://mlbox.readthedocs.io/en/latest/, accessed from the Internet on Sep. 17, 2020. [cited by applicant]
“Xpanse AI, The power of AI at the click of a button”, Automated Data Science, available online at https://xpanse.ai/, accessed from the Internet on Sep. 17, 2020. [cited by applicant]
Abrams, Machine Learning Model Pipelines: Part I, Hacker Noon, available online at https://hackermoon.com/machine-learning-model-pipelines-part-i-e138b7a7c1ef, Aug. 29, 2018. [cited by applicant]
Altunay et al., “Generate Machine Learning Model Pipelines to Choose the Best Model for Your Problem”, AutoAI, IBM Developer, available online at https://developer.ibm.com/tutorials/generate-machine-learning-model-pipel… [cited by applicant]
Amazon SageMaker, Available online at https://aws.amazon.com/sagemaker/, accessed from Internet on Sep. 17, 2020. [cited by applicant]
Autokeras, available online at https://autokeras.com/, accessed from the Internet on Sep. 17, 2020. [cited by applicant]
Cloud AutoML, Google Cloud, avaiable online at https://cloud.google.com/automl/, accessed from the Internet of Sep. 17, 2020. [cited by applicant]
Datarobot Flagship Product, “Empowering the Human Heroes of the Intelligence Revolution”, Robot, available online at https://www.datarobot.com/, 2020. [cited by applicant]
File Encryption and Decryption using Python, Eduonix Blog, available online at https://blog.eduonix.com/software-development/file-encryption-decryption-using-python/, Nov. 8, 2018. [cited by applicant]
First Action Interview Pilot Program Pre-Interview Communication for U.S. Appl. No. 16/893,193, dated Jun. 8, 2022. [cited by applicant]
Gordon, “AI & Security Innovations Help Developers Preserve Privacy While Delivering Insight”, available online at https://software.intel.com/content/www/US/en/develop/articles/ai-security-innovations-help-developers-pr… [cited by applicant]
H2O Driverless AI, Open Source Leader in AI and ML, available online at https://www.h2o.ai/products/h2o-driverless-ai/, accessed from the Internet on Sep. 17, 2020. [cited by applicant]
International Search Report and Written Opinion for International Patent Application No. PCT/US2020/049429, dated Nov. 27, 2020. [cited by applicant]
International Search Report and Written Opinion for International Patent Application No. PCT/US2020/049500, dated Nov. 27, 2020. [cited by applicant]
International Search Report and Written Opinion for International Patent Application No. PCT/US2020/050600, dated Nov. 27, 2020. [cited by applicant]
Jarmul, Katharine, “Privacy Attacks on Machine Learning Models”, Virtual Event, InfoQLive: Delivering Technology Through Software Engineering Leadership, Sep. 23, 2020, available online at https://www.infoq.com/articles… [cited by applicant]
Lariffle, “OpenMined/PySyft, GitHub—OpenMined/Pysyft: a library for answering questions using data you cannot see”, accessed from the Internet on Sep. 16, 2020. [cited by applicant]
Lokuciejewski et al., “Automatic Selection of Machine Learning Models for Compiler Heuristic Generation”, available online at https://www.semanticscholar.org/paper/automatic-selection-of-machine-learning-models-for-loku… [cited by applicant]
Luo, “A Review of Automatic Selection Methods for Machine Learning Algorithms and Hyper-Parameter Values, Network Modeling Analysis in Health Informatics and Bioinformatics”, vol. 5, No. 18, May 23, 2016. [cited by applicant]
Mohr et al., “Towards, the Automated Composition of Machine Learning Services”, 2018 IEEE International Conference on Services Computing (SCC), 2018. [cited by applicant]
Neustadter, “Why AI Needs Security”, available online at https://www.synopsys.com/designware-ip/technical-bulletin/why-ai-needs-security-dwtb-q318.html, accessed from the Internet on Sep. 16, 2020. [cited by applicant]
Non-Final Office Action for U.S. Appl. No. 16/892,724 dated Aug. 26, 2022. [cited by applicant]
Non-Final Office Action for U.S. Appl. No. 16/892,724, dated May 5, 2022. [cited by applicant]
Non-Final Office Action for U.S. Appl. No. 16/893,073, dated Dec. 20, 2021. [cited by applicant]
Non-Final Office Action for U.S. Appl. No. 16/893,189, dated Aug. 2, 2022. [cited by applicant]
Notice of Allowance for U.S. Appl. No. 16/892,724, dated Sep. 28, 2022. [cited by applicant]
Notice of Allowance for U.S. Appl. No. 16/892,935, dated Nov. 25, 2022. [cited by applicant]
Notice of Allowance for U.S. Appl. No. 16/893,189, dated Jan. 19, 2023. [cited by applicant]
Notice of Allowance for U.S. Appl. No. 16/893,193, dated Sep. 16, 2022. [cited by applicant]
Notice of Allowance for U.S. Appl. No. 17/019,255 dated Nov. 2, 2021. [cited by applicant]
Notice of Allowance for U.S. Appl. No. 17/019,256, dated Jul. 19, 2023. [cited by applicant]
Notice of Allowance for U.S. Appl. No. 18/100,458, dated Aug. 9, 2023. [cited by applicant]
Office Action for U.S. Appl. No. 17/019,258, dated Aug. 7, 2023. [cited by applicant]
Office Action for U.S. Appl. No. 18/100,458, dated May 23, 2023. [cited by applicant]
Overview of Kubeflow Pipelines, Kubeflow, available online at https://www.kubeflow.org/docs/pipelines/overview/pipelines-overview/, last modified Mar. 8, 2020, accessed from the Internet on Sep. 17, 2020. [cited by applicant]
Pathak, TPOT in Python, DataCamp, available online at https://www.datacamp.com/community/tutorials/tpot-machine-learning-python, Sep. 21, 2018. [cited by applicant]
PurePredictive, available online at https://www.purepredictive.com/, accessed from the Internet on Sep. 17, 2020. [cited by applicant]
Sacha et al., “VIS4ML: an Ontology for Visual Analytics Assisted Machine Learning”, IEEE Transactions on Visualization and Computer Graphics, vol. 25, No. 1, pp. 385-395, Jan. 1, 2019. [cited by applicant]
SecML: A Library for Secure and Explainable Machine Learning, released Aug. 6, 2020, available online at https://pypi.org/project/secml/. [cited by applicant]
Set Up Authentication for Azure Machine Learning Resources and Workflows, Azure Machine Learning, Microsoft Docs, available online at https://docs.microsoft.com/en-us/azure/machine-learning/hot-to-setup-authentication, … [cited by applicant]
Sparks et al., KeystoneML: Optimizing Pipelines for Large-Scale Advanced Analytics, 2017 IEEE 33rd International Conference on Data Engineering (ICDE), Apr. 2017. [cited by applicant]
Tensor Flow, The TFX User Guide, available online at https://www.tensorflow.org/tfx/guide, accessed from the Internet on Sep. 17, 2020. [cited by applicant]
The ModelValidator TFX Pipeline Component (Deprecated), TensorFlow, last updated Jul. 8, 2020, available online at https://www.tensorflow.org/tfx/guide/modelval, accessed on the Internet on Sep. 17, 2020. [cited by applicant]
TPOT Automated Machine Learning in Python, available online at http://epistasislab.github.io/tpot/. [cited by applicant]
Track Model Metrics and Deploy ML Models wit MLflow and Azure Machine Learning (Preview), Microsoft Docs, available on online at https://docs.microsoft.com/en-us/azure/machine-learning/how-to-use-mlflow, Jun. 4, 2020. [cited by applicant]
TransmogrifAI, available online at https://transmogrif.ai/, accessed from the Internet on Sep. 17, 2020. [cited by applicant]
Using TPOT, available online at http://epistasislab.github.io/tpot/using/#crashfreeze-issue-with-n_jobs-1-under-osx-or-linux. [cited by applicant]
Waymo: Automated Model Selection for Self-Driving Vehicles, available online at https://waymo.com/, accessed from the Internet on Sep. 17, 2020. [cited by applicant]
Notice of Allowance for U.S. Appl. No. 18/132,85, dated Jun. 14, 2024. [cited by applicant]
Non-Final Office Action for U.S. Appl. No. 18/132,859, dated May 6, 2024. [cited by applicant]
Notice of Allowance for U.S. Appl. No. 17/019,254, dated Mar. 4, 2024. [cited by applicant]
Cited By (1)
US 12,566,982