IP Library › Granted Patent US 11,921,815
Granted Patent B2
US 11,921,815 · App. 17/019,258 · Granted Mar 5, 2024

Techniques for the automated customization and deployment of a machine learning application

Inventors: Alberto Polleri (London, GB); Sergio Aldea Lopez (London, GB); Marc Michiel Bron (London, GB); Dan David Golding (London, GB); Alexander Ioannides (London, GB); Maria del Rosario Mestre (London, GB); Hugo Alexandre Pereira Monteiro (London, GB); Oleg Gennadievich Shevelev (London, GB); Larissa Cristina Dos Santos Romualdo Suzuki (Wokingham, GB); Xiaoxue Zhao (London, GB); Matthew Charles Rowe (Milton Keynes, GB)
Assignee: Oracle International Corporation
G06F18/213G06F8/75G06F8/77G06F11/3003G06F11/3409G06F11/3433G06F11/3452G06F11/3466G06F16/211G06F16/2365G06F16/24573G06F16/24578G06F16/285G06F16/367G06F16/9024G06F16/9035G06F16/907G06F18/10G06F18/2115G06F18/2155G06N5/01G06N5/025G06N20/00G06N20/20H04L9/088H04L9/3236
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,921,815
App. No.
17/019,258
Filed
Sep 13, 2020
Granted
Mar 5, 2024
Kind
B2
Examiner
SHEN, QUN
Art Unit
2662
USPC
382/103
Abstract

A server system can receive an input identifying a problem to generate a solution using a machine-learning application. The method selects a machine-learning model template from a plurality of templates based at least in part on the input. The method analyzes one or more formats of the customer data to generate a customer data schema based at least in part a data ontology that applies to the identified problem. The method determines whether the customer data schema is misaligned with one or more key features of the selected machine-learning model template. Based on this determination, the method analyzes the metadata for the selected machine-learning model template to determine what additional information is required to re-align the customer data with the data expectations. The method can include gathering the addition information required to re-align the customer data with the data expectations of the selected machine-learning model template.

Claims (53)

1. A method for automatically creating a machine-learning application for use in a production environment, the method comprising:

receiving an input, wherein the input identifies a problem to be solved using the machine-learning application;

selecting a machine-learning model template from a plurality of templates based at least in part on the input, wherein the machine-learning model template includes metadata, the metadata specifies data expectations and available data formats;

analyzing one or more formats of customer data to generate a customer data schema based at least in part on a data ontology that applies to the identified problem;

determining whether the customer data schema is misaligned with one or more key features of the selected machine-learning model template;

based at least in part on the determination that the customer data schema is misaligned with the one or more key features of the selected model, analyzing the metadata for the selected machine-learning model template to determine what additional information is required to re-align the customer data with the data expectations of the selected machine-learning model template as indicated in the metadata;

gathering the additional information required to re-align the customer data with the data expectations of the selected machine-learning model template;

based at least in part on the additional information, performing one or more remedial actions on the customer data to re-align with the data expectations of the selected machine-learning model template to result in a transformed dataset, wherein a remedial action of the one or more remedial actions comprises rescaling the customer data to fit the data expectations of the selected machine-learning model template, the rescaling of the customer data includes an infrastructure deployment corresponding to one or more micro services architecture in the transformed dataset; and

training the machine-learning application using the selected machine-learning model template and the transformed dataset.

2. The method of claim 1 , wherein the metadata for the selected machine-learning model template is derived based at least in part on historical model inputs.

3. The method of claim 1 , wherein the determining whether the customer data schema is misaligned comprises determining that the customer data is entirely missing one or more features that were expected.

4. The method of claim 1 , wherein the determining whether the customer data schema is misaligned comprises determining that the customer data contains values for one or more features, and determining that the customer data does not contain enough values for the one or more features to satisfy the data expectations of the selected machine-learning model template; and

further comprising adding, to the customer data, duplicates of one or more of the values for the one or more features.

5. The method of claim 1 , wherein the determining whether the customer data schema is misaligned comprises determining that one or more units of the customer data is different from the one or more key features of the selected machine-learning model template.

6. The method of claim 1 , further comprising:

determining that the customer data is out of scale with the data expectations of the selected machine-learning model template; and

based at least in part on the determining, executing the remedial action comprising the rescaling of the customer data to fit the data expectations of the selected machine-learning model template.

7. The method of claim 1 , wherein the determining whether the customer data schema is misaligned comprises determining that a data distribution of the customer data is different from the data expectations of the selected machine-learning model template based at least in part on historical data distributions for different applications of the machine-learning model template.

8. The method of claim 1 , wherein the determining whether the customer data schema is misaligned comprises determining that a data distribution of the customer data is different from the data expectations of the selected machine-learning model template based at least in part on detecting a lack of data continuity with respect to at least one metric.

9. The method of claim 1 , wherein the determining whether the customer data schema is misaligned comprises determining that a data distribution of the customer data is different from the data expectations of the selected machine-learning model template based at least in part on detecting a lack of data coverage for one metric based at least in part on a particular value of at least one other metric.

10. A server system, comprising:

one or more memories storing instructions; and

one or more processors communicatively coupled to the one or more memories to execute the instructions to perform operations to:

receive an input, wherein the input identifies a problem to be solved using a machine-learning application;

select a machine-learning model template from a plurality of templates based at least in part on the input, wherein the machine-learning model template includes metadata, the metadata specifies data expectations and available data formats;

analyze one or more formats of customer data to generate a customer data schema based at least in part on a data ontology that applies to the identified problem;

determine whether the customer data schema is misaligned with one or more key features of the selected machine-learning model template;

based at least in part on the determination that the customer data schema is misaligned with the one or more key features of the selected model, analyze the metadata for the selected machine-learning model template to determine what additional information is required to re-align the customer data with the data expectations of the selected machine-learning model template as indicated in the metadata;

gather the additional information required to re-align the customer data with the data expectations of the selected machine-learning model template;

based at least in part on the additional information, performing one or more remedial actions on the customer data to re-align with the data expectations of the selected machine-learning model template to result in a transformed dataset, wherein a remedial action of the one or more remedial actions comprises rescaling the customer data to fit the data expectations of the selected machine-learning model template, the rescaling of the customer data includes an infrastructure deployment corresponding to one or more micro services architecture in the transformed dataset; and

train the machine-learning application using the selected machine-learning model template and the transformed dataset.

11. The server system of claim 10 , wherein the metadata for the selected machine-learning model template is derived based at least in part on historical model inputs.

12. The server system of claim 10 , wherein the determination whether the customer data schema is misaligned comprises determining that the customer data is entirely missing one or more features that were expected.

13. The server system of claim 10 , wherein the determination whether the customer data schema is misaligned comprises determining that the customer data contains values for one or more features, and determining that the customer data does not contain enough values for the one or more features to satisfy the data expectations of the selected machine-learning model template; and

further comprising adding, to the customer data, duplicates of one or more of the values for the one or more features.

14. The server system of claim 10 , wherein the determination whether the customer data schema is misaligned comprises determining that one or more units of the customer data is different from the one or more key features of the selected machine-learning model template.

15. The server system of claim 10 , wherein the one or more processors is configured to:

determine that the customer data is out of scale with the data expectations of the selected machine-learning model template; and

based at least in part on the determination, execute the remedial action comprising the rescaling of the customer data to fit the data expectations of the selected machine-learning model template.

16. The server system of claim 10 , wherein the determination whether the customer data schema is misaligned comprises determining that a data distribution of the customer data is different from the data expectations of the selected machine-learning model template based at least in part on historical data distributions for different applications of the machine-learning model template.

17. The server system of claim 10 , wherein the determination whether the customer data schema is misaligned comprises determining that a data distribution of the customer data is different from the data expectations of the selected machine-learning model template based at least in part on detecting a lack of data continuity with respect to at least one metric.

18. The server system of claim 10 , wherein the determination whether the customer data schema is misaligned comprises determining that a data distribution of the customer data is different from the data expectations of the selected machine-learning model template based at least in part on detecting a lack of data coverage for one metric based at least in part on a particular value of at least one other metric.

19. A non-transitory computer-readable medium storing instructions, the instructions comprising:

one or more instructions that, when executed by one or more processors, cause the one or more processors to:

receive an input, wherein the input identifies a problem to be solved using a machine-learning application;

select a machine-learning model template from a plurality of templates based at least in part on the input, wherein the machine-learning model template includes metadata, the metadata specifies data expectations and available data formats;

analyze one or more formats of customer data to generate a customer data schema based at least in part on a data ontology that applies to the identified problem;

determine whether the customer data schema is misaligned with one or more key features of the selected machine-learning model template;

based at least in part that on the determination that the customer data schema is misaligned with the one or more key features of the selected model, analyze the metadata for the selected machine-learning model template to determine what additional information is required to re-align the customer data with the data expectations of the selected machine-learning model template as indicated in the metadata;

gather the additional information required to re-align the customer data with the data expectations of the selected machine-learning model template;

based at least in part on the additional information, perform one or more remedial actions on the customer data to re-align with the data expectations of the selected machine-learning model template to result in a transformed dataset, wherein a remedial action comprises rescaling the customer data to fit the data expectations of the selected machine-learning model template, the rescaling of the customer data includes an infrastructure deployment corresponding to one or more micro services architecture in the transformed dataset; and

train the machine-learning application using the selected machine-learning model template and the transformed dataset.

20. The non-transitory computer-readable medium of claim 19 , wherein the metadata for the selected machine-learning model template is derived based at least in part on historical model inputs.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 30, 2020
From: POLLERI, ALBERTO; LOPEZ, SERGIO ALDEA; BRON, MARC MICHIEL; GOLDING, DAN DAVID; IOANNIDES, ALEXANDER; MESTRE, MARIA DEL ROSARIO; MONTEIRO, HUGO ALEXANDRE PEREIRA; SHEVELEV, OLEG GENNADIEVICH; SUZUKI, LARISSA CRISTINA DOS SANTOS ROMUALDO; ZHAO, XIAOXUE; ROWE, MATTHEW CHARLES
To: ORACLE INTERNATIONAL CORPORATION
Reel/Frame 053941/0019 →
Continuity (2)
Provisional Application 62900537 · Sep 14, 2019
Related Publication 20210081720A1 · Mar 18, 2021
Cited By (4)
US 12,190,254 US 12,386,918 US 12,443,515 US 12,566,982