IP Library Granted Patent US 11,586,916
Granted Patent B2
US 11,586,916 · App. 16/776,961 · Granted Feb 21, 2023

Automated ML microservice and function generation for cloud native platforms

Inventor: Victor Fong (Medford, MA)
Assignee: EMC IP HOLDING COMPANY LLC
G06N3/08G06N3/04
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,586,916
App. No.
16/776,961
Granted
Feb 21, 2023
Kind
B2
Abstract

One example method includes receiving, as an input, an ML pipeline definition, identifying a group of layers required to be created for the ML pipeline definition, for one of more of the layers, receiving input concerning one or more characteristics of the layer, creating the layers for which input has been received, and packaging the created layers with the ML pipeline definition to create a production-ready ML model.

Claims (30)

1. A method, comprising:

receiving, as an input, an ML pipeline definition;

identifying a group of layers required to be created for the ML pipeline definition;

for one of more of the layers, receiving input concerning one or more characteristics of the layer;

creating the layers for which input has been received; and

packaging the created layers with the ML pipeline definition to create a production-ready ML model.

2. The method as recited in claim 1 , wherein the production-ready ML model comprises an inference microservice.

3. The method as recited in claim 2 , further comprising implementing a training microservice operable to implement ML training of the inference microservice.

4. The method as recited in claim 1 , wherein the production-ready ML model is operable in a cloud native environment.

5. The method as recited in claim 1 , wherein the created layers comprise a pipeline execution layer, a microservice/function wrapper layer, an input/output data transformation layer, a test suites layer, a deployment definition layer, and an integration wrapper layer.

6. The method as recited in claim 1 , wherein the production-ready ML model is not constrained for use with any particular vendor.

7. The method as recited in claim 1 , wherein one or more of the layers is created with a respective user-customizable template.

8. The method as recited in claim 1 , further comprising creating the ML pipeline definition.

9. The method as recited in claim 1 , further comprising deploying the production-ready ML model in a production environment.

10. The method as recited in claim 1 , wherein one of the created layers is a microservice/function wrapper layer that specifies an inference deployment platform, a training deployment platform, and an invocation mechanism.

11. A non-transitory storage medium having stored therein instructions that are executable by one or more hardware processors to perform operations comprising:

receiving, as an input, an ML pipeline definition;

identifying a group of layers required to be created for the ML pipeline definition;

for one of more of the layers, receiving input concerning one or more characteristics of the layer;

creating the layers for which input has been received; and

packaging the created layers with the ML pipeline definition to create a production-ready ML model.

12. The non-transitory storage medium as recited in claim 11 , wherein the production-ready ML model comprises an inference microservice.

13. The non-transitory storage medium as recited in claim 12 , wherein the operations further comprise implementing a training microservice operable to implement ML training of the inference microservice.

14. The non-transitory storage medium as recited in claim 11 , wherein the production-ready ML model is operable in a cloud native environment.

15. The non-transitory storage medium as recited in claim 11 , wherein the created layers comprise a pipeline execution layer, a microservice/function wrapper layer, an input/output data transformation layer, a test suites layer, a deployment definition layer, and an integration wrapper layer.

16. The non-transitory storage medium as recited in claim 11 , wherein the production-ready ML model is not constrained for use with any particular vendor.

17. The non-transitory storage medium as recited in claim 1 , wherein one or more of the layers is created with a respective user-customizable template.

18. The non-transitory storage medium as recited in claim 1 , wherein the operations further comprise creating the ML pipeline definition.

19. The non-transitory storage medium as recited in claim 1 , wherein the operations further comprise deploying the production-ready ML model in a production environment.

20. The non-transitory storage medium as recited in claim 1 , wherein one of the created layers is a microservice/function wrapper layer that specifies an inference deployment platform, a training deployment platform, and an invocation mechanism.

Assignments (9)
RELEASE OF SECURITY INTEREST IN PATENTS PREVIOUSLY RECORDED AT REEL/FRAME (053311/0169) Recorded Jun 23, 2022
From: THE BANK OF NEW YORK MELLON TRUST COMPANY, N.A., AS NOTES COLLATERAL AGENT
To: DELL PRODUCTS L.P.; EMC CORPORATION; EMC IP HOLDING COMPANY LLC
Reel/Frame 060438/0742 →
RELEASE OF SECURITY INTEREST IN PATENTS PREVIOUSLY RECORDED AT REEL/FRAME (053546/0001) Recorded Jun 23, 2022
From: THE BANK OF NEW YORK MELLON TRUST COMPANY, N.A., AS NOTES COLLATERAL AGENT
To: DELL MARKETING L.P. (ON BEHALF OF ITSELF AND AS SUCCESSOR-IN-INTEREST TO CREDANT TECHNOLOGIES, INC.); DELL INTERNATIONAL L.L.C.; DELL PRODUCTS L.P.; DELL USA L.P.; EMC CORPORATION; DELL MARKETING CORPORATION (SUCCESSOR-IN-INTEREST TO FORCE10 NETWORKS, INC. AND WYSE TECHNOLOGY L.L.C.); EMC IP HOLDING COMPANY LLC
Reel/Frame 071642/0001 →
RELEASE OF SECURITY INTEREST IN PATENTS PREVIOUSLY RECORDED AT REEL/FRAME (052216/0758) Recorded Jun 23, 2022
From: THE BANK OF NEW YORK MELLON TRUST COMPANY, N.A., AS NOTES COLLATERAL AGENT
To: DELL PRODUCTS L.P.; EMC IP HOLDING COMPANY LLC
Reel/Frame 060438/0680 →
RELEASE OF SECURITY INTEREST AF REEL 052243 FRAME 0773 Recorded Nov 2, 2021
From: CREDIT SUISSE AG, CAYMAN ISLANDS BRANCH
To: DELL PRODUCTS L.P.; EMC IP HOLDING COMPANY LLC
Reel/Frame 058001/0152 →
SECURITY INTEREST Recorded Jun 5, 2020
From: DELL PRODUCTS L.P.; EMC CORPORATION; EMC IP HOLDING COMPANY LLC
To: THE BANK OF NEW YORK MELLON TRUST COMPANY, N.A., AS COLLATERAL AGENT
Reel/Frame 053311/0169 →
SECURITY AGREEMENT Recorded Apr 22, 2020
From: CREDANT TECHNOLOGIES INC.; DELL INTERNATIONAL L.L.C.; DELL MARKETING L.P.; DELL PRODUCTS L.P.; DELL USA L.P.; EMC CORPORATION; FORCE10 NETWORKS, INC.; WYSE TECHNOLOGY L.L.C.; EMC IP HOLDING COMPANY LLC
To: THE BANK OF NEW YORK MELLON TRUST COMPANY, N.A.
Reel/Frame 053546/0001 →
SECURITY AGREEMENT Recorded Mar 26, 2020
From: DELL PRODUCTS L.P.; EMC IP HOLDING COMPANY LLC
To: CREDIT SUISSE AG, CAYMAN ISLANDS BRANCH
Reel/Frame 052243/0773 →
PATENT SECURITY AGREEMENT (NOTES) Recorded Mar 24, 2020
From: DELL PRODUCTS L.P.; EMC IP HOLDING COMPANY LLC
To: THE BANK OF NEW YORK MELLON TRUST COMPANY, N.A., AS COLLATERAL AGENT
Reel/Frame 052216/0758 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 30, 2020
From: FONG, VICTOR
To: EMC IP HOLDING COMPANY LLC
Reel/Frame 051672/0698 →