IP Library Granted Patent US 10,635,689
Granted Patent B2
US 10,635,689 · App. 15/801,129 · Granted Apr 28, 2020

System and method of orchestration with data integration

Inventor: Hiroshi Nakagoe (Los Gatos, CA)
Assignee: HITACHI, LTD.
G06F16/254G06F8/60G06F16/211H04L67/10
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,635,689
App. No.
15/801,129
Granted
Apr 28, 2020
Kind
B2
Abstract

Example implementations are directed to a system and method to reduce deployment cost of data analytics application by designing both an application deployment plan and data integration plan, implementing the plans into an application template automatically and deploying application components and data in accordance with the desired implementation. Through example implementations, the need for separate terminals for a data engineer and an application engineer can be eliminated.

Claims (68)

1. A method for analytics deployment, comprising:

generating one or more data schemas for a data analytics plan and a selection of one or more databases by:

extracting from the data analytics plan, a use case, a metadata of source data, and a data extraction type,

referring to data schema mapping information that maps the use case, the metadata of source data, and the data extraction type corresponding to one or more databases and the one or more data schemas,

selecting the corresponding one or more databases from the reference to the data schema mapping information as the one or more databases, and

generating the one or more data schemas from the referring to the data schema mapping information;

generating a logical topology of application components and an Extract, Transfer, Load (ETL) plan;

generating a deployment plan from an application template generated based on the generated logical topology of application components and the generated ETL plan, the deployment plan comprising executable code for a deployment engine; and

executing the executable code on the deployment engine to deploy the data analytics plan on a cloud computing platform.

2. The method of claim 1 , wherein the generating a logical topology of application components and an Extract, Transfer, Load (ETL) plan comprises:

processing, from the data analytics plan and the selection of the one or more databases, the connections between the application components;

generating the logical topology of the application components from connections between the application components; and

generating the ETL plan from transforms defined in the data analytics plan between data sources defined in the data analytics plan and the one or more databases.

3. The method of claim 1 , wherein the generating a deployment plan from the logical topology of application components and the ETL plan, the deployment plan comprising executable code for a deployment engine, comprises:

determining, from application catalog information, an application template for each of the application components, the application template comprising a database template configured to assign a database;

determining from an application repository information, a corresponding application configuration file for each of the application components, each of the corresponding application configuration files comprising executable application code and metadata indicative of valid databases for the each of the application components; and

generating the deployment plan from the corresponding application configuration file for each of the application components and the application template for each of the application components.

4. The method of claim 1 , wherein the executing the executable code on the deployment engine to deploy the data analytics plan on the cloud computing platform comprises:

deploying application components according to the deployment plan;

generating connections between the application components according to the deployment plan; and

loading data to the selected one or more databases according to the generated one or more data schemas.

5. The method of claim 1 , wherein the method for analytics deployment is conducted through a single terminal.

6. A non-transitory computer readable medium, storing instructions for analytics deployment, the instructions comprising:

generating one or more data schemas for a data analytics plan and a selection of one or more databases by:

extracting from the data analytics plan, a use case, a metadata of source data, and a data extraction type,

referring to data schema mapping information that maps the use case, the metadata of source data, and the data extraction type to corresponding one or more databases and the one or more data schemas,

selecting the corresponding one or more databases from the reference to the data schema mapping information as the one or more databases, and

generating the one or more data schemas from the referring to the data schema mapping information;

generating a logical topology of application components and an Extract, Transfer, Load (ETL) plan;

generating a deployment plan from an application template generated based on the generated logical topology of application components and the generated ETL plan, the deployment plan comprising executable code for a deployment engine; and

executing the executable code on the deployment engine to deploy the data analytics plan on a cloud computing platform.

7. The non-transitory computer readable medium of claim 6 , wherein the generating a logical topology of application components and an Extract, Transfer, Load (ETL) plan comprises:

processing, from the data analytics plan and the selection of the one or more databases, the connections between the application components;

generating the logical topology of the application components from connections between the application components; and

generating the ETL plan from transforms defined in the data analytics plan between data sources defined in the data analytics plan and the one or more databases.

8. The non-transitory computer readable medium of claim 6 , wherein the generating a deployment plan from the logical topology of application components and the ETL plan, the deployment plan comprising executable code for a deployment engine, comprises:

determining, from application catalog information, an application template for each of the application components, the application template comprising a database template configured to assign a database;

determining from an application repository information, a corresponding application configuration file for each of the application components, each of the corresponding application configuration files comprising executable application code and metadata indicative of valid databases for the each of the application components;

generating the deployment plan from the corresponding application configuration file for each of the application components and the application template for each of the application components.

9. The non-transitory computer readable medium of claim 6 , wherein the executing the executable code on the deployment engine to deploy the data analytics plan on the cloud computing platform comprises:

deploying application components according to the deployment plan;

generating connections between the application components according to the deployment plan; and

loading data to the selected one or more databases according to the generated one or more data schemas.

10. The non-transitory computer readable medium of claim 6 , wherein the instructions for analytics deployment is executed through a single terminal.

11. A system configured to manage analytics deployment for a cloud computing platform, the system comprising:

a memory, configured to manage a plurality of databases, and

a processor, configured to:

generate one or more data schemas for a data analytics plan and a selection of one or more databases from the plurality of databases by:

extracting from the data analytics plan, a use case, a metadata of source data, and a data extraction type,

referring to data schema mapping information that maps the use case, the metadata of source data, and the data extraction type to corresponding one or more databases and the one or more data schemas,

selecting the corresponding one or more databases from the reference to the data schema mapping information as the one or more databases, and

generating the one or more data schemas from the referring to the data schema mapping information;

generate a logical topology of application components and an Extract, Transfer, Load (ETL) plan;

generate a deployment plan from an application template generated based on the generated logical topology of application components and the generated ETL plan, the deployment plan comprising executable code for a deployment engine; and

execute the executable code on the deployment engine to deploy the data analytics plan on the cloud computing platform.

12. The system of claim 11 , wherein the generating a logical topology of application components and an Extract, Transfer, Load (ETL) plan comprises:

processing, from the data analytics plan and the selection of the one or more databases, the connections between the application components;

generating the logical topology of the application components from connections between the application components; and

generating the ETL plan from transforms defined in the data analytics plan between data sources defined in the data analytics plan and the one or more databases.

13. The system of claim 11 , wherein the processor is configured to generate a deployment plan from the logical topology of application components and the ETL plan, the deployment plan comprising executable code for a deployment engine, by:

determining, from application catalog information, an application template for each of the application components, the application template comprising a database template configured to assign a database;

determining from an application repository information, a corresponding application configuration file for each of the application components, each of the corresponding application configuration files comprising executable application code and metadata indicative of valid databases for the each of the application components;

generating the deployment plan from the corresponding application configuration file for each of the application components and the application template for each of the application components.

14. The system of claim 11 , wherein the processor is configured to execute the executable code on the deployment engine to deploy the data analytics plan on the cloud computing platform by:

deploying application components according to the deployment plan;

generating connections between the application components according to the deployment plan; and

loading data to the selected one or more databases according to the generated one or more data schemas.

15. The system of claim 11 , wherein the system is a single terminal.

Assignments (2)
COMPANY SPLIT Recorded Aug 20, 2024
From: HITACHI, LTD.
To: HITACHI VANTARA, LTD.
Reel/Frame 069518/0761 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Nov 1, 2017
From: NAKAGOE, HIROSHI
To: HITACHI, LTD.
Reel/Frame 044011/0536 →
Continuity (1)
Related Publication 20190130008A1 · May 2, 2019