Generating and reusing transformations for evolving schema mapping
A system and method of use resolves the frustration of repeated manual work during schema mapping. The system utilizes a transformation graph—a collection of nodes (unified attributes) and edges (transformations) in which source attributes are mapped and transformed. The system further leverages existing mappings and transformations for the purpose of suggesting to a user the optimal paths (i.e., the lowest cost paths) for mapping new sources, which is particularly useful when new sources share similarity with previously mapped sources and require the same transformations. As such, the system also promotes an evolving schema by allowing users to select which unified attributes they want to include in a target schema at any time. The system addresses the technical challenge of finding optimal transformation paths and how to present these to the user for evaluation.
1. A method for creating a new target schema from an existing target schema, wherein the existing target schema is represented as a collection of nodes within an electronically represented and visually displayed initial transformation graph, the electronically represented and visually displayed initial transformation graph being an evolving graph of nodes and edges, the electronically represented and visually displayed initial transformation graph including nodes which represent unified attributes and edges which represent a flow of data via transformations between the nodes, and wherein the electronically represented and visually displayed initial transformation graph includes transformation paths which are reusable, the method comprising:
(a) adding a new node which represents a new unified attribute to the electronically represented and visually displayed initial transformation graph, thereby creating an electronically represented and visually displayed revised transformation graph, wherein the new node which represents the new unified attribute is added to the electronically represented and visually displayed initial transformation graph via user input of a transformation edge between the new node and an existing node into a first graphical user interface (GUI); and
(b) adding the new node which represents the new unified attribute to the existing target schema, thereby creating a revised target schema, the revised target schema being a new target schema created from the existing target schema that reuses the transformation paths of the electronically represented and visually displayed initial transformation graph, wherein the new node which represents the new unified attribute is selected for inclusion in the revised target schema via user input into a second GUI,
wherein the new node which represents the new unified attribute and edge are used by a central processing unit executing software code to propagate data using the electronically represented and visually displayed revised transformation graph and the revised target schema.
2. The method of claim 1 further comprising:
(c) populating the new node which represents the new unified attribute with one or more source attribute mappings.
3. The method of claim 1 further comprising:
(c) setting the new node which represents the new unified attribute as an output from an existing node of the revised transformation graph through an edge between the new node which represents the new unified attribute and the existing node in the revised transformation graph, and specifying the transformation to be performed by that edge.
4. A computer system for creating a new target schema from an existing target schema, wherein the existing target schema is represented as a collection of nodes within an electronically represented and visually displayed initial transformation graph, the electronically represented and visually displayed initial transformation graph being an evolving graph of nodes and edges, the electronically represented and visually displayed initial transformation graph including nodes which represent unified attributes and edges which represent a flow of data via transformations between the nodes, and wherein the electronically represented and visually displayed initial transformation graph includes transformation paths which are reusable, the computer system comprising:
(a) a first graphical user interface (GUI);
(b) a second GUI; and
(c) a central processing unit operating software stored on non-transitory computer media, the software comprising instructions to:
(i) add a new node which represents a new unified attribute to the electronically represented and visually displayed initial transformation graph, thereby creating an electronically represented and visually displayed revised transformation graph, wherein the new node which represents the new unified attribute is added to the electronically represented and visually displayed initial transformation graph via user input of a transformation edge between the new node which represents the new unified attribute and an existing node into the first GUI; and
(ii) add the new node which represents the new unified attribute to the existing target schema, thereby creating a revised target schema, the revised target schema being a new target schema created from the existing target schema that reuses the transformation paths of the electronically represented and visually displayed initial transformation graph, wherein the new node which represents the new unified attribute is selected for inclusion in the revised target schema via user input into the second GUI,
wherein the new node which represents the new unified attribute and edge are used by the central processing unit operating the software to propagate data using the electronically represented and visually displayed revised transformation graph and the revised target schema.
5. The computer system of claim 4 wherein the software comprises further instructions to:
(iii) populate the new node which represents the new unified attribute with one or more source attribute mappings.
6. The computer system of claim 4 wherein the software comprises further instructions to:
iii) set the new node which represents the new unified attribute as an output from an existing node of the revised transformation graph through an edge between the new node which represents the new unified attribute and the existing node in the revised transformation graph, and specify the transformation to be performed by that edge.