Method and computer system for aggregating data from a plurality of operational databases
A method and computer system for aggregating data from a plurality of operational databases are provided. It is determined if a transformation script stored in storage of a computer system has been modified. Delta data extracted from said operational databases and specified by the transformation script is automatically merged and transformed if the transformation script is unmodified. All data extracted from said operational databases and specified by the transformation script is automatically merged and transformed if the transformation script is unmodified.
1. A method for aggregating data from a plurality of operational databases, comprising:
determining if a transformation script stored in storage of a computer system has been modified;
upon determining that said transaction script is unmodified, extracting delta data from said operational databases, and automatically merging and transforming said delta data, wherein delta data comprises data that has changed in said operational databases regardless of whether the transformation script has been modified, and wherein said delta data is specified by said transformation script; and,
upon determining that said transaction script has been modified, extracting all data from said operational databases and automatically merging and transforming said all data, wherein said all data is specified by said transformation script.
2. The method of claim 1 , wherein said determining comprises:
comparing a version number for said transformation script to a registered version number for said transformation script when previously executed.
3. The method of claim 1 , wherein said determining comprises:
comparing the value of a hash function of said transformation script to a registered value of said hash function for said transformation script when previously executed.
4. The method of claim 1 , wherein said automatically merging and transforming is performed during a regularly-scheduled update to a data mart.
5. A computer system for aggregating data from a plurality of operational databases, comprising:
computer-executable instructions stored in storage of said computer system, said computer-executable instructions, when executed by a processor of said computer system:
determining if a transformation script stored in storage of a computer system has been modified;
upon determining that said transaction script is unmodified, extracting delta data from said operational databases, and automatically merging and transforming said delta data, wherein delta data comprises data that has changed in said operational databases regardless of whether the transformation script has been modified, and wherein said delta data is specified by said transformation script; and,
upon determining that said transaction script has been modified, extracting all data from said operational databases and automatically merging and transforming said all data, wherein said all data is specified by said transformation script.
6. The computer system of claim 5 , wherein said determining comprises:
comparing a version number for said transformation script to a registered version number for said transformation script when previously executed.
7. The computer system of claim 5 , wherein said determining comprises:
comparing the value of a hash function of said transformation script to a registered value of said hash function for said transformation script when previously executed.
8. The computer system of claim 5 , wherein said automatically merging and transforming is performed during a regularly-scheduled update to a data mart.
9. The method of claim 1 , further comprising obtaining, from a data vault log, delta data for each of said operational databases.
10. The method of claim 5 , further comprising obtaining, from a data vault log, delta data for each of said operational databases.