IP Library › Granted Patent US 10,824,479
Granted Patent B2
US 10,824,479 · App. 16/454,887 · Granted Nov 3, 2020

Cross-cloud orchestration of data analytics for a plurality of research domains

Inventors: Joseph Peter Jubinski (Sykesville, MD); Ransom Kershaw Winder (Hanover, MD); Angela McIntee O'Hanlon (Alexandria, VA); Nathan Louis Giles (Odenton, MD)
Assignee: The MITRE Corporation
G06F9/5083G06F9/4881G06F9/5038G06F9/542G06F16/2457G06F16/24575G06F16/25G06F16/951
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,824,479
App. No.
16/454,887
Granted
Nov 3, 2020
Kind
B2
Abstract

A system, apparatus, article of manufacture, method, and/or computer program product are disclosed for a cross-cloud orchestration of data analytics for a plurality of research domains. A system operates by receiving one or more command and control (C&C) requests to execute one or more analytic applications of a workflow. The workflow includes the analytic applications for execution. The system further operates by generating one or more native access requests to execute the analytic applications at one or more analytics computing environments, and transmitting one or more native access requests to the analytics computing environments, wherein at least two native access requests are configured for different access protocol.

Claims (56)

1. A system, comprising:

at least one processor configured to execute a command and control (C&C) service application operatively coupled to a knowledge application, at least one analytic application, and an executive service application, wherein the C&C service application is configured to

request at least one analytics computing environment to execute at least one analytic application of an analytic workflow based on at least execution application information that identifies the at least one analytic application to be executed by the at least one analytics computing environment and execution input information that identifies at least one of ingested data or analytics data to be analyzed by the at least one analytic application, wherein

the at least one analytic application is configured to generate execution result data based on at least an analysis of at least one of the ingested data or the analytics data,

the at least one analytics computing environment is configured to generate provenance data based on at least the execution application information and execution input information associated with each execution of the at least one analytic application, and

the provenance data identifies a derivation history of the execution result data; and

request the knowledge application to transfer the execution result data to a knowledge datastore, wherein an adapter component of the knowledge application is configured to convert at least a portion of the execution result data to an ontology data model.

2. The system of claim 1 , wherein

the executive service application is configured to execute the analytic workflow that includes the at least one analytic application;

the at least one analytics computing environment is configured to generate the provenance data based on at least the execution of the at least one analytic application, and

the knowledge application is operatively coupled to the knowledge datastore configured to store at least, the analytics data and the provenance data.

3. The system of claim 2 , wherein

the executive service application is configured to execute the analytic workflow at least twice,

the executions of the analytic workflow are represented as a first workflow execution instance and a second workflow execution instance,

the first workflow execution instance includes a first set of analytic applications that is executed by the at least one analytics computing environment, and

the second workflow execution instance includes a second set of analytic applications that is executed by the at least one analytics computing environment.

4. The system of claim 3 , wherein the second set of analytic applications includes a shared analytic application that is in the first set of analytic applications, and the second set of analytic applications includes a non-shared analytic application that is not in the first set of analytic applications.

5. The system of claim 4 , wherein the provenance data is represented as provenance class information associated with each analytic application of the at least one analytic application in the analytic workflow, and the provenance class information aggregates provenance instance information associated with each execution of the shared analytic application during the executions of the first workflow execution instance and the second workflow execution instance by the executive service application.

6. The system of claim 1 , wherein the provenance data is represented as provenance class information associated with each analytic application of the at least one analytic application in the analytic workflow, and the provenance class information aggregates provenance instance information generated by each execution of an analytic application of the at least one analytic application in the analytic workflow.

7. The system of claim 1 , wherein to request the at least one analytics computing environment to execute the at least one analytic application, the C&C service application is further configured to: transmit a first native access request to a first analytics computing environment to request execution of a first analytic application, and transmit a second native access request to a second analytics computing environment to request execution of a second analytic application, wherein the first native access request is a different access protocol than the second native access request, and the first analytics computing environment is a different analytics computing environment than the second analytics computing environment.

8. A computer implemented method, comprising:

requesting, by a command and control (C&C) service application, at least one analytics computing environment to execute at least one analytic application of an analytic workflow based on at least execution application information that identifies the at least one analytic application to be executed by the at least one analytics computing environment and execution input information that identifies at least one of ingested data or analytics data to be analyzed by the at least one analytic application, wherein

the at least one analytic application is configured to generate execution result data based on at least an analysis of at least one of the ingested data or the analytics data;

the at least one analytics computing environment is configured to generate provenance data based on at least the execution application information and execution input information associated with each execution of the at least one analytic application, and the provenance data identifies a derivation history of the execution result data; and

requesting, by the C&C service application, a knowledge application to transfer the execution result data to a knowledge datastore, wherein an adapter component of the knowledge application is configured to convert at least a portion of the execution result data to an ontology data model.

9. The computer implemented method of claim 8 , wherein

an executive service application is configured to execute the analytic workflow that includes the at least one analytic application;

the at least one analytics computing environment is configured to generate the provenance data based on at least the execution of the at least one analytic application, and

the knowledge application is operatively coupled to the knowledge datastore configured to store at least the analytics data and the provenance data.

10. The computer implemented method of claim 9 , wherein

the executive service application is configured to execute the analytic workflow at least twice,

the executions of the analytic workflow are represented as a first workflow execution instance and a second workflow execution instance,

the first workflow execution instance includes a first set of analytic applications that is executed by the at least one analytics computing environment, and

the second workflow execution instance includes a second set of analytic applications that is executed by the at least one analytics computing environment.

11. The computer implemented method of claim 10 , wherein the second set of analytic applications includes a shared analytic application that is in the first set of analytic applications, and the second set of analytic applications includes a non-shared analytic application that is not in the first set of analytic applications.

12. The computer implemented method of claim 11 , wherein the provenance data is represented as provenance class information associated with each analytic application of the at least one analytic application in the analytic workflow, and the provenance class information aggregates provenance instance information associated with each execution of the shared analytic application during the executions of the first workflow execution instance and the second workflow execution instance by the executive service application.

13. The computer implemented method of claim 12 , wherein the provenance instance information associated with each execution of the shared analytic application includes provenance timestamp information identifying a time and a date of the shared analytic application execution, provenance input information identifying at least one of the ingested data or the analytics data, and provenance execution output information identifying the execution result data.

14. The computer implemented method of claim 8 , wherein the requesting, by the C&C service application, the at least one analytics computing environment to execute the at least one analytic application further comprises: transmitting a first native access request to a first analytics computing environment to request execution of a first analytic application, and transmitting a second native access request to a second analytics computing environment to request execution of a second analytic application, wherein the first native access request is a different access protocol than the second native access request, and the first analytics computing environment is a different analytics computing environment than the second analytics computing environment.

15. A non-transitory tangible computer-readable device having instructions stored thereon that, upon execution by at least one computing device, cause the at least one computing device to perform operations comprising:

requesting, by a command and control (C&C) service application, at least one analytics computing environment to execute at least one analytic application of an analytic workflow based on at least execution application information that identifies the at least one analytic application to be executed by the at least one analytics computing environment and execution input information that identifies at least one of ingested data or analytics data to be analyzed by the at least one analytic application, wherein

the at least one analytic application is configured to generate execution result data based on at least an analysis of at least one of the ingested data or the analytics data;

the at least one analytics computing environment is configured to generate provenance data based on at least the execution application information and execution input information associated with each execution of the at least one analytic application, and

the provenance data identifies a derivation history of the execution result data; and

requesting, by the C&C service application, a knowledge application to transfer the execution result data to a knowledge datastore, wherein an adapter component of the knowledge application is configured to convert at least a portion of the execution result data to an ontology data model.

16. The non-transitory tangible computer-readable device of claim 15 , wherein

an executive service application is configured to execute the analytic workflow that includes the at least one analytic application;

the at least one analytics computing environment is configured to generate the provenance data based on at least the execution of the at least one analytic application, and

the knowledge application is operatively coupled to the knowledge datastore configured to store at least the analytics data and the provenance data.

17. The non-transitory tangible computer-readable device of claim 16 , wherein

the executive service application is configured to execute the analytic workflow at least twice,

the executions of the analytic workflow are represented as a first workflow execution instance and a second workflow execution instance,

the first workflow execution instance includes a first set of analytic applications that is executed by the at least one analytics computing environment, and

the second workflow execution instance includes a second set of analytic applications that is executed by the at least one analytics computing environment.

18. The non-transitory tangible computer-readable device of claim 17 , wherein the second set of analytic applications includes a shared analytic application that is in the first set of analytic applications, and the second set of analytic applications includes a non-shared analytic application that is not in the first set of analytic applications.

19. The non-transitory tangible computer-readable device of claim 18 , wherein the provenance data is represented as provenance class information associated with each analytic application of the at least one analytic application in the analytic workflow, and the provenance class information aggregates provenance instance information associated with each execution of the shared analytic application during the executions of the first workflow execution instance and the second workflow execution instance by the executive service application.

20. The non-transitory tangible computer-readable device of claim 15 , wherein the instructions for requesting, by the C&C service application, the at least one analytics computing environment to execute the at least one analytic application further cause the at least one computing device to perform operations comprising: transmitting a first native access request to a first analytics computing environment to request execution of a first analytic application, and transmitting a second native access request to a second analytics computing environment to request execution of a second analytic application, wherein the first native access request is a different access protocol than the second native access request, and the first analytics computing environment is a different analytics computing environment than the second analytics computing environment.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 14, 2020
From: JUBINSKI, JOSEPH PETER; WINDER, RANSOM KERSHAW; O'HANLON, ANGELA MCINTEE; GILES, NATHAN LOUIS
To: THE MITRE CORPORATION
Reel/Frame 053503/0508 →
Continuity (2)
Continuation 14871302 · Sep 30, 2015
Related Publication 20190317830A1 · Oct 17, 2019