IP Library Granted Patent US 11,544,099
Granted Patent B2
US 11,544,099 · App. 17/074,271 · Granted Jan 3, 2023

Analytic model execution engine with instrumentation for granular performance analysis for metrics and diagnostics for troubleshooting

Inventors: Stuart Bailey (San Jose, CA); Matthew Mahowald (Chicago, IL); Maksym Kharchenko (Kyiv, UA)
Assignee: ModelOp, Inc.
G06F9/45558G06F8/31G06F8/51G06F8/60G06F9/455G06F9/45504G06F9/5077G06F8/30G06N5/003G06N20/00G06N20/20G06Q10/067
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,544,099
App. No.
17/074,271
Granted
Jan 3, 2023
Kind
B2
Abstract

At an interface an analytic model for processing data is received. The analytic model is inspected to determine a language, an action, an input type, and an output type. A virtualized execution environment is generated for an analytic engine that includes executable code to implement the analytic model for processing an input data stream.

Claims (45)

1. A system, comprising:

an interface;

a processor configured to:

receive, at the interface, an analytic model for processing; an input data stream;

inspect the analytic model to determine a programming language of the analytic model, an action to be performed on the input data stream, a type of the input data stream, and a type of an output data stream;

generate a virtualized execution environment (VEE), the VEE including executable code to implement the analytic model, the implemented analytic model for processing the input data stream;

add, at runtime of the VEE, a sensor to instrument the implemented analytic model, wherein the sensor is configured to instrument the VEE for an analytic engine, wherein the sensor provides metrics for debugging a performance of the analytic model;

debug the performance of the analytic model until the analytic engine is optimized and at least one bug is eradicated from the analytic model; and

remove the sensor via the interface after a determination that the sensor is no longer required for the debugging; and

a memory coupled to the processor and configured to provide the processor with instructions.

2. The system recited in claim 1 , wherein the analytic model is implemented using a container to provide the VEE for the analytic engine.

3. The system recited in claim 2 , wherein the container is a portable and independently executable microservice.

4. The system recited in claim 1 , wherein the analytic model includes an input configuration schema that specifies the type of the input data stream, an output configuration schema that specifies the type of the output data stream, and an I/O descriptor abstraction that specifies abstracts the input data stream type.

5. The system recited in claim 1 , wherein the VEE includes a plurality of runtime engines that each supports a distinct analytic model programming language.

6. The system recited in claim 4 , wherein the processor is further configured to:

bind the analytic model and the I/O descriptor abstraction;

receive the input data stream at a stream processor;

process the input data stream using the executable code that implements the analytic model, wherein the stream processor enforces the type of the input data stream; and

generate the output data stream using the stream processor based on the type of the output data stream, wherein the output data stream includes a score and/or a metric.

7. The system recited in claim 1 , wherein the interface for receiving the analytic model includes an Application Programming Interface (API), a Command Line Interface (CLI), and/or a dashboard interface.

8. The system recited in claim 5 , wherein the analytic model is coded in a first programming language, and wherein the processor is further configured to:

translate the first programming language to a first analytic model programming language; and

route the executable code to one of the plurality of runtime engines based on the first analytic model programming language.

9. A method, comprising:

receiving at an interface an analytic model for processing an input data stream;

inspecting the analytic model to determine a programming language of the analytic model, an action to be performed on the input data stream, a type of the input data stream, and a type of an output data stream;

generating a virtualized execution environment (VEE), the VEE including executable code to implement the analytic model, the implemented analytic model for processing the input data stream;

adding, at runtime of the VEE, a sensor to the implemented analytic model, the sensor to instrument the VEE for an analytic engine, wherein the sensor provides metrics for debugging a performance of the analytic model;

debugging the performance of the analytic model until the analytic engine is optimized and at least one bug is eradicated from the analytic model; and

removing the sensor via the interface after determining that the sensor is no longer required for the debugging.

10. The method of claim 9 , wherein the analytic model is implemented using a container to provide the VEE for the analytic engine.

11. The method of claim 10 , wherein the container is a portable and independently executable microservice.

12. The method of claim 9 , wherein the analytic model includes an input configuration schema that specifies the type of the input data stream, an output configuration schema that specifies the type of the output data stream, and an I/O descriptor abstraction that abstracts the input data stream type.

13. The method of claim 9 , wherein the VEE for the analytic engine includes a plurality of runtime engines that each supports a distinct analytic model language.

14. A computer program product, the computer program product being embodied in a tangible non-transitory computer readable storage medium and comprising computer instructions for:

receiving at an interface an analytic model for processing an input data stream;

inspecting the analytic model to determine a programming language of the analytic model, an action to be performed on the input data stream, a type of the input data stream, and a type of an output data stream;

generating a virtualized execution environment (VEE), the VEE including executable code to implement the analytic model, the implemented analytic model for processing the input data stream;

adding, at runtime of the VEE, a sensor to the implemented analytic model, the sensor to instrument the VEE for an analytic engine, wherein the sensor provides metrics for debugging a performance of the analytic model;

debugging the performance of the analytic model until the analytic engine is optimized and at least one bug is eradicated from the analytic model; and

removing the sensor via the interface after determining that the sensor is no longer required for the debugging.

15. The computer program product recited in claim 14 , wherein the analytic model is implemented using a container to provide the VEE for the analytic engine.

16. The computer program product recited in claim 15 , wherein the container is a portable and independently executable microservice.

17. The computer program product recited in claim 14 , wherein the analytic model includes an input configuration schema that specifies the type of the input data stream, an output configuration schema that specifies the type of the output data stream, and an I/O descriptor abstraction that abstracts the input data stream type.

18. The computer program product recited in claim 14 , wherein the VEE for the analytic engine includes a plurality of runtime engines that each supports a distinct analytic model language.

Continuity (4)
Continuation 16782904 · Feb 5, 2020
Continuation 15721310 · Sep 29, 2017
Provisional Application 62542218 · Aug 7, 2017
Related Publication 20210049034A1 · Feb 18, 2021
Cited By (1)
US 12,293,166