Flexible architecture component (FAC) for efficient data integration and information interchange using web services
A flexible architecture component for providing data integration and exchange between a plurality of client applications is disclosed. The client applications are coupled to a network and access respective data sources, wherein the data sources of each of the client applications may be stored in different formats and are not directly accessible by the other client applications. Aspects of the present invention include providing an adapter API that provides a first set of methods for the client applications to use to translate data into XML. Each of the client applications is then modified to invoke the methods in the adapter API to convert data in their respective data sources into XML format and to have the XML formatted data imported into a database on a server, thereby standardizing the data from the data sources. In a further embodiment, a second set of methods is included in the adapter API for the same or different client applications to use that export data from the database into the client applications using standard Web services.
1. A method for providing data integration and exchange between a plurality of client applications over a network, wherein each of the client applications access a respective data source, the method comprising:
(a) providing an adapter AP at each of the client applications that provides a first set of methods for the client applications to use to translate data in the respective data sources into XML format, wherein the data sources of each of the client applications store different types of data in different formats, wherein the data from a given data source is not directly accessible by the other client applications that utilize data of a different type or format;
(b) modifying each of the client applications to invoke the first set of methods in the adapter API to convert the data in the respective data sources into XML format according to a registered schema definition and saving the XML format data from the respective data sources in XML files;
(c) submitting each of the XML files to an import repository at a server, wherein the import repository is separate from a database at the server;
(d) prior to storing data from the XML files in a database, validating each of the XML files in the import repository against a document type definition (DTD) corresponding to the respective data sources;
(e) parsing the validated XML files in the import repository and storing name/value pairs in a database at the server according to a hierarchy specified by the corresponding DTD, thereby standardizing the data from the data sources of the client applications; and
(f) including a second set of methods in the adapter API for the client applications that provides consumption logic and methods for automatically exporting data defined in a Web-based schema registry, from the database into the client applications using Web services.
2. The method of claim 1 further including: registering the respective data sources with a schema registry in order to create the schema definition and the document type definition (DTD).
3. The method of claim 2 wherein the adapter API includes an XML API comprising the first set of methods and the second set of methods, wherein the first set of methods comprises a Writer API, and the second set of methods comprises a Reader API.
4. The method of claim 3 wherein the client applications are modified with generator logic that makes calls to methods comprising the adapter API, wherein once called, the Writer API converts data into the XML format in memory and saves the XML format data in the XML files, which are then transported to the server.
5. The method of claim 4 wherein the adapter further includes verification code that verifies the generated XML data against the DTD defined in schema registry.
6. A computer-readable medium containing program instructions for providing data integration and exchange between a plurality of client applications over a network, wherein each of the client applications access a respective data source, the program instructions for:
(a) providing an adapter API at each of the client applications that provides a first set of methods for the client applications to use to translate data in the respective data sources into XML format, wherein the data sources of each of the client applications store different types of data in different formats, wherein the data from a given data source is not directly accessible by the other client applications that utilize data of a different type or format;
(b) modifying each of the client applications to invoke the first set of methods in the adapter API to convert the data in the respective data sources into XML format according to a registered schema definition and saving the XML format data from the respective data sources in an XML file;
(c) submitting each of the XML files from the client applications to an import repository at a server, wherein the import repository is separate from a database at the server;
(d) prior to storing data from the XML files in a database, validating each of the XML files in the import repository against a document type definition (DTD) corresponding to the respective data sources;
(e) parsing the validated XML files in the import repository and storing name/value pairs in a database at the server according to a hierarchy specified by the corresponding DTD, thereby standardizing the data from the data sources of the client applications; and
(f) including a second set of methods in the adapter API for the client applications that provides consumption logic and methods for automatically exporting data defined in a Web-based schema registry, from the database into the client applications using Web services.
7. The computer-readable medium of claim 6 further including the instruction of: registering the respective data sources with a schema registry in order to create the schema definition and the document type definition (DTD).
8. The computer-readable medium of claim 7 wherein the adapter API includes an XML API comprising the first set of methods and the second set of methods, wherein the first set of methods comprises a Writer API, and the second set of methods comprises a Reader API.
9. The computer-readable medium of claim 8 wherein the client applications are modified with generator logic that makes calls to methods comprising the adapter API, wherein once called, the Writer API converts data into the XML format in memory and saves the XML format data in the XML files, which are transported to the server.
10. The computer-readable medium of claim 9 wherein the adapter further includes verification code that verifies the generated XML data against the DTD defined in schema registry.
11. A data integration system, comprising:
a network;
a server coupled to the network, the server including a schema registry, an import repository, an XML loader, a database, and a published adapter API at each of the client applications that provides a first set of methods for translating data in respective data source into XML format; and
a plurality of client applications coupled to the network and in communication with the server, wherein each of the client applications access the respective data source, and wherein the data sources of each of the client applications store different types of data in different formats, wherein the data from a given data source is not directly accessible by the other client applications that utilize data of a different type or format, and
wherein at least a portion of the client applications includes a corresponding schema definition and document type definition (DTD) registered with the schema registry, and the portion of the client applications includes generation logic for making calls to the first set of methods in the adapter API, such that data in the respective data sources are converted into XML format according to the corresponding schema definition and stored in XML files,
wherein each of the XML files is submitted to the import repository at the server, wherein the import repository is separate from a database at the server, wherein each of the XML files in the import repository is validated against the corresponding DTD prior to storing data from the XML files in a database, and wherein the XML loader parses the validated XML files in the import reposition and stores name/value pairs in the database at the server according to a hierarchy specified by the corresponding DTD, thereby standardizing the data from the data sources of the client applications;
wherein the adapter API further includes a second set of methods for the client applications that that provides consumption logic and methods for automatically exporting data defined in the schema registry, from the database into the client applications using Web services.
12. The system of claim 11 wherein the adapter API includes an XML API comprising the first set of methods and the second set of methods, wherein the first set of methods comprises a Writer API and the second set of methods comprises a Reader API.
13. The system of claim 12 wherein the server further includes a schema generator for generating the schema definition, a DTD generator for generating the DTD, and an adapter software kit that is downloaded from the server and used to incorporate the adapter API into the client applications.