Cross-cloud orchestration of data analytics for a plurality of research domains
A system, apparatus, article of manufacture, method, and/or computer program product are disclosed for a cross-cloud orchestration of data analytics for a plurality of research domains. A system operates by receiving one or more command and control (C&C) requests to execute one or more analytic applications of a workflow. The workflow includes the analytic applications for execution. The system further operates by generating one or more native access requests to execute the analytic applications at one or more analytics computing environments, and transmitting one or more native access requests to the analytics computing environments, wherein at least two native access requests are configured for different access protocol.
1 . A system comprising:
a processor configured for executing operations in an analytics computing environment, a storage system operatively coupled to the processor, wherein the storage system stores data based on an ontology data model comprising a plurality of ontological models with one or more merged ontological elements, wherein the ontology data model defines one or more knowledge domains, and wherein the operations comprise:
receiving a request to execute an analytic workflow, wherein the analytic workflow comprises at least a first analytic application executable in a first analytics computing environment and a second analytic application executable in a second analytics computing environment, and wherein the first analytics computing environment and the second analytics computing environment are configured to communicate and execute by adapting to a common schema consistent with the ontology data model;
initiating a session for execution of the analytic workflow via a workflow component, wherein the workflow component is configured to compile, link, and execute the analytic workflow;
receiving executed results data of the execution of the analytic workflow; and
adapting the executed results data to the ontological model and transferring to the storage system.
2 . The system of claim 1 , wherein, for each application of the first analytic application and the second analytic application to be executed in the analytic workflow, an executive service application transmits a request to execute each application to a command and control service application.
3 . The system of claim 2 , wherein, in response to receiving the requests to execute each application in the analytic workflow, the command and control service application requests initiation of inputs for a respective one of the first analytic application and the second analytic application to be executed.
4 . The system of claim 3 , wherein the command and control service application requests the initiation of the inputs by requesting the storage system to transfer data identified by execution input information to the respective first analytics computing environment and the second analytics computing environment.
5 . The system of claim 3 , wherein the command and control service application requests initiation of the inputs by requesting an adapter to transfer analytics data identified to a respective one of the first analytics computing environment and the second analytics computing environment.
6 . The system of claim 3 , wherein the command and control service application requests execution of each application of the analytic workflow by transmitting a native access request to a respective one of the first analytics computing environment and the second analytics computing environment.
7 . The system of claim 6 , wherein, for each application to be executed in the analytic workflow, the command and control service application requests to transfer execution results of each application.
8 . The system of claim 7 , wherein the command and control service application transmits the request to transfer the execution results of each application to an adapter, and in response, the adapter is configured to transfer the execution results to the storage system.
9 . The system of claim 8 , wherein the command and control service application provides a response to the workflow component indicating completion of the execution of the analytic application.
10 . A computer-implemented method, comprising:
creating, for an ontology datastore, an ontology data model comprising a plurality of ontological models with one or more merged ontological elements, wherein the ontology data model defines one or more knowledge domains;
receiving a request to execute an analytic workflow, wherein the analytic workflow comprises at least a first analytic application executable in a first analytics computing environment and a second analytic application executable in a second analytics computing environment, and wherein the first analytics computing environment and the second analytics computing environment are configured to communicate and execute by adapting to a common schema consistent with the ontology data model;
initiating a session for execution of the analytic workflow via a workflow component, wherein the workflow component is configured to compile, link, execute, and perform the analytic workflow;
receiving executed results data of the execution of the analytic workflow; and
adapting the executed results data to the ontological model and transferring to a storage system.
11 . The computer-implemented method of claim 10 , further comprising transmitting, for each application of the first analytic application and the second analytic application to be executed in the analytic workflow, a request to execute each application from an executive service application to a command and control service application.
12 . The computer-implemented method of claim 11 , further comprising requesting, by the command and control service application, initiation of inputs for a respective one of the first analytic application and the second analytic application to be executed in response to receiving the requests to execute each application in the analytic workflow.
13 . The computer-implemented method of claim 12 , further comprising requesting, by the command and control service application, execution of each application of the analytic workflow by transmitting a native access request to a respective one or the first analytics computing environment and the second analytics computing environment.
14 . The computer-implemented method of claim 13 , further comprising requesting, by the command and control service application, to transfer execution results of each application to be executed in the analytic workflow.
15 . A tangible computer-readable device having instructions stored thereon that, upon execution by at least one computing device, cause the at least one computing device to perform operations comprising:
creating, for an ontology datastore, an ontology data model comprising a plurality of ontological models with one or more merged ontological elements, wherein the ontology data model defines one or more knowledge domains;
receiving a request to execute an analytic workflow, wherein the analytic workflow comprises at least a first analytic application executable in a first analytics computing environment and a second analytic application executable in a second analytics computing environment, and wherein the first analytics computing environment and the second analytics computing environment are configured to communicate and execute by adapting to a common schema consistent with the ontology data model;
initiating a session for execution of the analytic workflow via a workflow component, wherein the workflow component is configured to compile, link, execute, and perform the analytic workflow; and
receiving executed results data of the execution of the analytic workflow; and
adapting the executed results data to the ontological model and transferring to a storage system.
16 . The tangible computer-readable device of claim 15 , the operations further comprising:
transmitting, for each analytic application of the first analytic application and the second analytic application to be executed in the analytic workflow, a request to execute each application from an executive service application to a command and control service application.
17 . The tangible computer-readable device of claim 16 , the operations further comprising:
requesting, by the command and control service application, initiation of inputs for a respective one of the first analytic application and the second analytic application to be executed in response to receiving the requests to execute each application in the analytic workflow.
18 . The tangible computer-readable device of claim 17 , the operations further comprising:
transmitting, by the command and control service application, a request to transfer execution results of each application to an adapter; and
in response, transferring, by the adapter, the execution results to the storage system.
19 . The tangible computer-readable device of claim 18 , the operations further comprising:
providing, by the command and control service application, a response to the executive service application indicating completion of the execution of a respective one of the first analytic application and the second analytic application.
20 . The tangible computer-readable device of claim 19 , the operations further comprising:
requesting, by the command and control service application, to transfer execution results of each application to be executed in the analytic workflow.