Method, system and program product for developing a data model in a data mining system
View Patent ↗A database table of predefined data transformations is provided. Each predefined data transformation is associated in the table with a unique identifier, a corresponding description and a validity period. When a data modeler wishes to develop a data model for a desired prediction, he/she will first determine a set of variables that will be used therefor. The set of variables can include any of the predefined data transformations from the database table. The data model will then be developed by applying raw data to the set of variables and determining a mathematical relationship there between. Once the data model has been developed, the data modeler will write a reusable specification for applying the data model operationally. Thereafter, IT personnel or the like can code and deploy the data model using the specification.
1. A computerized system for developing a data model in a data mining system, comprising:
a processor and a memory, the memory includes;
a database table of user predefined data transformations, at least one of the data transformations in the database table being reused by a plurality of data models;
a data import system for extracting raw data from a data warehouse;
a variable determination system for determining a set of variables for a desired prediction, wherein the set of variables comprises at least one predefined data transformation selected from the database table, wherein the database table of predefined data transformations associates each of the predefined data transformations with a unique identifier, a description and a validity period, and wherein the variable determination system retrieves the at least one predefined data transformation from the database table according to its unique identifier;
a model development system for developing a data model for the desired prediction using the determined variables; and
a specification development system for developing a specification for applying the data model operationally;
wherein the model development system applies the raw data to the set of variables and derives a mathematical relationship between the set of variables.
2. The system of claim 1 , further comprising an output system for outputting the data model for coding and deployment based on the specification.
3. The system of claim 1 , wherein the specification comprises a reusable set of instructions for applying the variables of the data model operationally.
4. The system of claim 1 , further comprising a modification policy that governs modification of the predefined data transformations in the database table.
5. A program product stored on a computer readable storage device for developing a data model in a data mining system, which when executed, comprises:
program code for extracting raw data from a data warehouse;
program code for determining a set of variables for a desired prediction, wherein the set of variables comprises at least one predefined data transformation selected from a database table of user predefined data transformations, at least one of the data transformations in the database table being reused by a plurality of data models;
program code for developing a data model for the desired prediction using the determined variables;
program code for developing a specification for applying the data model operationally; and
program code for outputting the data model for coding and deployment based on the specification,
wherein the database table of predefined data transformations associates each of the predefined data transformations with a unique identifier, a description and a validity period, and wherein the program code for determining retrieves the at least one predefined data transformation from the database table according to its unique identifier;
wherein the program code for developing a data model applies the raw data to the set of variables and derives a mathematical relationship between the set of variables.
6. The program product of claim 5 , wherein the specification comprises a re-useable set of instructions for applying the variables of the data model operationally.
7. The program product of claim 5 , further comprising a modification policy that governs modification of the predefined data transformations in the database table.