IP Library › Granted Patent US 8,965,838
Granted Patent B2
US 8,965,838 · App. 13/351,819 · Granted Feb 24, 2015

Efficient loading of data in databases

Inventor: Kartika Garg (Haryana, IN)
Assignee: International Business Machines Coporation
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 8,965,838
App. No.
13/351,819
Granted
Feb 24, 2015
Kind
B2
Abstract

A computer implemented method, system and computer program product for managing data in databases generates a control file for a database by utilizing a definition file associated with the database and predefined column definitions, organizes data within a data file in a predefined format, wherein the data is desirable to be loaded in the database, and loads the data from the data file to the database by utilizing the control file and the data file.

Claims (40)

1. A computer system for managing data in a database system, the computer system comprising one or more processors including program instructions to:

dynamically generate a control file at runtime for loading data to any of a plurality of different databases, wherein the dynamically generating the control file includes:

parsing a XML definition file with syntax specific to a database selected from among the plurality of different databases to identify one or more attributes and a column definition syntax indicated by a column meta-tag for defining one or more columns for the control file, wherein the identified column meta-tag is replaced with a column definition extracted from schema definitions of an information server and interpreted according to a XML definition;

applying predefined column definitions for the database to the column definition syntax to provide column definitions specific to the database for the control file; and

retrieving and applying values for the one or more attributes to the syntax of the definition file to dynamically generate the control file with the syntax specified in the definition file;

organize data within a data file in at least one of a delimited format and comma separated version format, wherein the data is desirable to be loaded in the database; and

load the data from the data file to the database by utilizing the dynamically generated control file for the database and the data file using a single stage, wherein loading the data from the data file to the database is performed simultaneously while the data is being formatted and stored in the data file.

2. The computer system of claim 1 , wherein the data file is at least one of a FIFO file and a flat file.

3. The computer system of claim 1 , wherein the one or more processors include further instructions to organize contents in the control file according to the syntax specific to the database, wherein that syntax is defined in the definition file associated with the database.

4. The computer system of claim 1 , wherein the one or more processors include further instructions to use the predefined column definitions from a graphical user interface of a data integration platform.

5. The computer system of claim 1 , wherein the one or more processors include further instructions to:

receive user inputs at runtime; and

utilize the user inputs, parsed definition file and the predefined column definitions to create the control file.

6. A computer program product for loading data in databases comprising:

one or more computer-readable storage mediums and program instructions stored on at least one or more of the computer-readable storage mediums, the program instructions comprising:

program instructions to dynamically generate a control file at runtime for loading data to any of a plurality of different databases, wherein the dynamically generating the control file includes:

parsing a XML definition file with syntax specific to a database selected from among the plurality of different databases to identify one or more attributes and a column definition syntax indicated by a column meta-tag for defining one or more columns for the control file, wherein the identified column meta-tag is replaced with a column definition extracted from schema definitions of an information server and interpreted according to a XML definition;

applying predefined column definitions for the database to the column definition syntax to provide column definitions specific to the database for the control file; and

retrieving and applying values for the one or more attributes to the syntax of the definition file to dynamically generate the control file with the syntax specified in the definition file;

program instructions to organize data within a data file in at least one of a delimited format and comma separated version format, wherein the data is desirable to be loaded in the database; and

program instructions to load the data from the data file to the database by utilizing the dynamically generated control file for the database and the data file using a single stage, wherein loading the data from the data file to the database is performed simultaneously while the data is being formatted and stored in the data file.

7. The computer program product of claim 6 , further comprising program instructions to organize contents in the control file according to the syntax specific to the database, wherein that syntax is defined in the definition file associated with the database.

8. The computer program product of claim 6 , further comprising program instructions to use the predefined column definitions from a graphical user interface of a data integration platform.

9. The computer program product of claim 6 , further comprising program instructions to:

receive user inputs at runtime; and

utilize the user inputs, parsed definition file and the predefined column definitions to create the control file.

10. A computer implemented method for managing data in a database system,

the method comprising:

dynamically generating, via a processor at runtime, a control file for loading data to any of a plurality of different databases, wherein the dynamically generating the control file includes:

parsing a XML definition file with syntax specific to a database selected from among the plurality of different databases to identify one or more attributes and a column definition syntax indicated by a column meta-tag for defining one or more columns for the control file, wherein the identified column meta-tag is replaced with a column definition extracted from schema definitions of an information server and interpreted according to a XML definition;

applying predefined column definitions for the database to the column definition syntax to provide column definitions specific to the database for the control file; and

retrieving and applying values for the one or more attributes to the syntax of the definition file to dynamically generate the control file with the syntax specified in the definition file;

organizing data within a data file in at least one of a delimited format and comma separated version format, wherein the data is desirable to be loaded in the database; and

loading the data from the data file to the database by utilizing the dynamically generated control file for the database and the data file using a single stage, wherein loading the data from the data file to the database is performed simultaneously while the data is being formatted and stored in the data file.

11. The method of claim 10 , wherein the data file is at least one of a FIFO file and a flat file.

12. The method of claim 10 , wherein dynamically generating the control file comprises organizing contents in the control file according to the syntax specific to the database, wherein that syntax is defined in the definition file associated with the database.

13. The method of claim 10 further comprising using the predefined column definitions from a graphical user interface of a data integration platform.

14. The method of claim 10 , wherein dynamically generating the control file comprises:

receiving user inputs at runtime; and

utilizing the user inputs, parsed definition file and the predefined column definitions to create the control file.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 17, 2012
From: GARG, KARTIKA
To: INTERNATIONAL BUSINESS MACHINES CORPORATION
Reel/Frame 027544/0915 →
Continuity (1)
Related Publication 20130185249A1 · Jul 18, 2013