Warehouse based reporting and operational reporting integration

1. One or more non-transitory computer readable storage mediums storing one or more sequences of instructions, which when executed by one or more processors, causes automatic integration of an operational reporting system and a warehouse based reporting system that are supported by two separate vendors using a common dimensional model and separate data processing infrastructure, by performing the steps of:

querying said operational reporting system for model and mapping information extraction;

automatically enforcing consistency between a data model of said operational reporting system and a dimensional data model of said warehouse based reporting system by aligning said dimensional data model of said warehouse based reporting system with said data model of said operational reporting system using software aids, wherein said software aids query said dimensional data model of said warehouse based reporting system and said data model of said operational reporting system for model definitions and mappings of metrics to source elements tracked using lineage capabilities to identify equivalent model elements for model alignment by comparison of their definitions;

automatically ensuring consistency of (i) data extraction methods between said operational reporting system and said warehouse based reporting system, (ii) timestamping, and timezones of data associated with said operational reporting system and said warehouse based reporting system, and (iii) collations across said operational reporting system and said warehouse based reporting system, upon determining that populating the data in a common or consistent dimensional model occurs;

automatically analyzing real time content provided by said operational reporting system with historical content and cross subject perspective provided by said warehouse based reporting system; and

automatically enabling predictions for said real time content based on said common or consistent dimensional model that links said real time content of said operational reporting system with historical content and predictive models of said warehouse based reporting system.

2. The one or more non-transitory computer readable storage mediums storing one or more sequences of instructions of claim 1 , which when executed by one or more processors further causes:

automatic detection of one or more data discrepancies, between same metrics of said operational reporting system and said warehouse based reporting system, caused due to (a) different data refresh times of the data associated with said operational reporting system and said warehouse based reporting system, and (b) skipping data quality correction on the data associated with said operational reporting system for efficiency;

automatic elimination of said data discrepancies caused due to different data refresh times by identifying using lineage, tables including logically connected tables, based on which said metrics are computed, and incrementally refreshing the said tables using code generated incremental refresh jobs to have the same data in both said operational reporting system and said warehouse based reporting system; and

automatic elimination of said data discrepancies caused due to skipped data quality transforms by incorporating said data quality transforms for said operational reporting system.

3. The one or more non-transitory computer readable storage mediums storing one or more sequences of instructions of claim 2 , which when executed by one or more processors further causes:

automatic identification of relevant trends from said data discrepancies by comparing metric values of said operational reporting system with current and historical values of same metrics in said warehouse based reporting system; and

automatic generation of alerts upon determining that said data discrepancies exceed a predefined value, or an auto identified threshold value.

4. The one or more non-transitory computer readable storage mediums storing one or more sequences of instructions of claim 1 , which when executed by one or more processors further causes displaying said relevant trends using business intelligence charts.

5. An integrated system that integrates a warehouse based reporting system with an operational reporting system using a common dimensional model, said integrated system comprising:

a memory that stores a database and a first set of modules;

a processor that executes said first set of modules, wherein said first set of modules comprises;

a rendering module that automatically analyzes real time content provided by said operational reporting system with historical content and cross subject perspective provided by said warehouse based reporting system;

a predictive analysis module that automatically enables predictions for said real time content based on said common or consistent dimensional model that links said real time content of said operational reporting system with historical content and predictive models of said warehouse based reporting system;

a data discrepancy detection module that automatically detects one or more data discrepancies, between same metrics of said operational reporting system and said warehouse based reporting system, caused due to (a) different data refresh times of the data associated with said operational reporting system and said warehouse based reporting system, and (b) skipping data quality correction on the data associated with said operational reporting system for efficiency;

a relevant trend identification module that automatically identifies relevant trends from said data discrepancies by comparing metric values of said operational reporting system with current and historical values of the same metrics in said warehouse based reporting system;

a proactive alerting module that automatically generates alerts upon determining that said data discrepancies exceed a predefined value, or an auto identified threshold value;

a data discrepancy elimination module that automatically eliminates said data discrepancies caused due to different data refresh times by identifying using lineage, tables including logically connected tables, based on which said metrics are computed, and incrementally refreshing the said tables, using code generated incremental refresh jobs to have the same data in both said operational reporting system and said warehouse based reporting system; and

a data correction module that automatically eliminates said data discrepancies caused due to skipped data quality transforms by incorporating said data quality transforms for said operational reporting system.

6. The integrated system as claimed in claim 5 , wherein upon determining that said operational reporting system and said warehouse based reporting system are supported by two separate vendors using a common dimensional model and separate data processing infrastructure, said integrated system additionally comprises:

an operational reporting system analysis module that queries an operational reporting system for model and mapping information extraction; and

a model and mapping consistency validation module that automatically enforces consistency between a data model of said operational reporting system and a dimensional data model of said warehouse based reporting system by aligning said dimensional data model of said warehouse based reporting system with said data model of said operational reporting system using software aids, wherein said software aids query said dimensional data model of said warehouse based reporting system and said data model of said operational reporting system for model definitions and mappings of metrics to source elements tracked using lineage capabilities to identify equivalent model elements for model alignment by comparison of their definitions.

7. The integrated system as claimed in claim 5 , wherein upon determining that (i) said operational reporting system is supported by a warehouse vendor using a common dimensional data model with separate data processing infrastructure, or (ii) said operational reporting system and said warehouse based reporting system are supported by two separate vendors using a common dimensional model and separate data processing infrastructure, said integrated system additionally comprises a parameters consistency enforcement module that automatically ensures consistency of (i) data extraction methods between said operational reporting system and said warehouse based reporting system, (ii) timestamping, and timezones of data associated with said operational reporting system and said warehouse based reporting system, and (iii) collations across said operational reporting system and said warehouse based reporting system upon determining that populating the data in a common or consistent dimensional model occurs.

8. The integrated system as claimed in claim 5 , wherein upon determining that said operational reporting system is supported by a warehouse vendor using a common dimensional data model with a common or separate data processing infrastructure, said integrated system additionally comprises:

an altering existing warehouse jobs module that automatically ensures that modified jobs are generated for near real time data access and real time data access for a subset of warehouse tables upon determining that (i) ensuring logically related group of warehouse tables are updated together to avoid any inconsistencies with selective updating, and (ii) tracking dropped transforms which may cause potential data discrepancies; and

a real time data capture module for capturing source data changes in real time for said operational reporting system.

9. One or more non-transitory computer readable storage mediums storing one or more sequences of instructions, which when executed by one or more processors, causes automatic integration of a warehouse based reporting system, and an operational reporting system that is supported by a warehouse vendor using a common dimensional data model and common data processing infrastructure for said operational reporting system and said warehouse based reporting system, by performing the steps of:

automatically ensuring that modified jobs are generated for near real time data access and real time data access for a subset of warehouse tables upon determining that (i) ensuring logically related group of warehouse tables are updated together to avoid any inconsistencies with selective updating, and (ii) tracking dropped transforms which may cause potential data discrepancies;

automatically capturing source data changes in real time for said operational reporting system;

automatically analyzing real time content provided by said operational reporting system with historical content and cross subject perspective provided by said warehouse based reporting system;

automatically enabling predictions for said real time content based on a common or consistent dimensional model that links said real time content of said operational reporting system with historical content and predictive models of said warehouse based reporting system;

automatically detecting one or more data discrepancies between said operational reporting system and said warehouse based reporting system caused due to (a) different data refresh times of the data associated with said operational reporting system and said warehouse based reporting system, and (b) skipping data quality correction on the data associated with said operational reporting system for efficiency;

automatically identifying relevant trends from said data discrepancies by comparing metric values of said operational reporting system with current and historical values of the same metrics in said warehouse based reporting system;

automatically generating alerts upon determining that said data discrepancies exceed a predefined value, or an auto identified threshold value;

automatically eliminating said data discrepancies caused due to different data refresh times by identifying using lineage, tables including logically connected tables, based on which said metrics are computed and incrementally refreshing the said tables, using code generated incremental refresh jobs to have the same data in both said operational reporting system and said warehouse based reporting system; and

automatically eliminating said data discrepancies caused due to skipped data quality transforms by incorporating said data quality transforms for said operational reporting system.

10. One or more non-transitory computer readable storage mediums storing one or more sequences of instructions, which when executed by one or more processors, causes automatic integration of a warehouse based reporting system and an operational reporting system that is supported by a warehouse vendor using a common dimensional data model and separate data processing infrastructure for said operational reporting system and said warehouse based reporting system, by performing the steps of:

automatically ensuring that modified jobs are generated for near real time data access and real time data access for a subset of warehouse tables upon determining that (i) ensuring logically related group of warehouse tables are updated together to avoid any inconsistencies with selective updating, and (ii) tracking dropped transforms which may cause potential data discrepancies;

automatically ensuring consistency of (i) data extraction methods between said operational reporting system and said warehouse based reporting system, (ii) timestamping, and timezones of data associated with said operational reporting system and said warehouse based reporting system, and (iii) collations across said operational reporting system and said warehousing based reporting system upon determining that populating the data in a common or consistent dimensional model occurs;

automatically capturing source data changes in real time for said operational reporting system;

automatically analyzing said real time content provided by said operational reporting system with historical content and cross subject perspective provided by said warehousing based reporting system;

automatically enabling predictions for real time content based on said common or consistent dimensional model that links said real time content of said operational reporting system with historical content and predictive models of said warehousing based reporting system;

automatically detecting one or more data discrepancies between said operational reporting system and said warehouse based reporting system caused due to (a) different data refresh times of the data associated with said operational reporting system and said warehouse based reporting system, and (b) skipping data quality correction on the data associated with said operational reporting system for efficiency;

automatically identifying relevant trends from said data discrepancies by comparing metric values of said operational reporting system with current and historical values of the same metrics in said warehousing based reporting system;

automatically generating alerts upon determining that said data discrepancies exceed a predefined value, or an auto identified threshold value;

automatically eliminating said data discrepancies caused due to different data refresh times by automatically identifying using lineage, tables including logically connected tables, based on which said metrics are computed, and incrementally refreshing the said tables, using code generated incremental refresh jobs to have the same data in both said operational reporting system and said warehouse based reporting system; and

automatically eliminating said data discrepancies caused due to skipped data quality transforms by incorporating said data quality transforms for said operational reporting system.