Data management system providing a data thesaurus for mapping between multiple data schemas or between multiple domains within a data schema
In one embodiment, a system is provided for managing a centrally managed master repository for core enterprise reference data associated with an enterprise. A centralized master repository contains the reference data, the reference data being associated with multiple schemas, each schema including one or more data models for reference data, each data model including one or more fields. A data management services framework coupled to the repository provides services for managing the reference data in the repository. The services framework supports a master schema including a union of multiple models and associated fields in the multiple schemas. The services framework also supports a thesaurus including, for each field in the master schema, a set of synonyms each representing a mapping between the field in the master schema and a corresponding field in a particular one of the multiple schemas. The master schema and thesaurus facilitate centralized management of the reference data in the repository across multiple heterogeneous external operational systems that have different associated data models and are provided indirect access to the reference data in the repository for operational use of the reference data according to associated business workflows.
1. A system for managing core enterprise reference data associated with an enterprise, comprising:
a centralized master repository tangibly embodied on a computer-readable medium and comprising the core enterprise reference data, the core enterprise reference data associated with a plurality of data schemas, each data schema comprising one or more data models for core enterprise reference data, each data model comprising one or more fields; and
a data management services framework tangibly embodied on a computer-readable medium and configured to provide services that manage the core enterprise reference data in the centralized master repository, the data management services framework including a data management services framework subsystem configured to provide data access services between user interface levels, data management rules, and the centralized master repository wherein at least one of the data management rules comprises a validation rule that automatically selects a level of validation based on one or more characteristics of inbound data.
2. The system of claim 1 , wherein the data management services framework subsystem is further configured to provide data access services that support a persistent mapping to underlying data structures within a database.
3. The system of claim 1 , wherein the data management services framework subsystem is further configured to provide data access services including a data cache.
4. The system of claim 3 , wherein a copy of the core enterprise reference data is held in the data cache for manipulation.
5. The system of claim 4 , wherein the state of the core enterprise reference data in a core data repository that corresponds to the copy of the core enterprise reference data held in the data cache is maintained as locked for read only access until the manipulation process is completed.
6. The system of claim 4 , wherein the data management services framework subsystem provides data staging services.
7. The system of claim 6 , wherein the data staging services include synchronization of inbound and outbound staging areas with managed data areas of a database.
8. A method for managing core enterprise reference data associated with an enterprise, comprising:
using a centralized master repository to store core enterprise reference data, the core enterprise reference data associated with a plurality of data schemas, each data schema comprising one or more data models for core enterprise reference data, each data model comprising one or more fields; and
using a data management services framework coupled with the centralized master repository that provides services to manage the core enterprise reference data in the centralized master repository, the data management services framework including a data management services framework subsystem that provides data access services between user interface levels, data management rules, and the centralized master repository wherein at least one of the data management rules comprises a validation rule that automatically selects a level of validation based on one or more characteristics of inbound data.
9. The method of claim 8 , further comprising using the data management services framework subsystem to provide data access services that support a persistent mapping to underlying data structures within a database.
10. The method of claim 8 , further comprising using the data management services framework subsystem to provide data access services including a data cache.
11. The method of claim 10 , further comprising holding a copy of the core enterprise reference data in the data cache for manipulation.
12. The method of claim 11 , further comprising maintaining the state of the core enterprise reference data in a core data repository that corresponds to the copy of the reference data held in the data cache as locked for read only access until the manipulation process is completed.
13. The method of claim 8 , further comprising using the data management services framework subsystem to provide data staging services.
14. The method of claim 13 , wherein the data staging services include synchronization of inbound and outbound staging areas with managed data areas of a database.
15. A non-transitory computer-readable medium embodied with software for managing core enterprise reference data associated with an enterprise, the software when executed using one or more computers is configured to:
access a centralized master repository to store core enterprise reference data, the core enterprise reference data associated with a plurality of data schemas, each data schema comprising one or more data models for core enterprise reference data, each data model comprising one or more fields; and
provide a data management services framework coupled with the centralized master repository and providing services that manage the core enterprise reference data in the centralized master repository, the data management services framework including a data management services framework subsystem configured to provide data access services between user interface levels, data management rules, and the centralized master repository wherein at least one of the data management rules comprises a validation rule that automatically selects a level of validation based on one or more characteristics of inbound data.
16. The computer-readable medium of claim 15 , wherein the software is further configured to provide a data management services framework subsystem of the data management services framework that provides data access services that support a persistent mapping to underlying data structures within a database.
17. The computer-readable medium of claim 15 , wherein the software is further configured to provide a data management services framework subsystem of the data management services framework that provides data access services including a data cache.
18. The computer-readable medium of claim 17 , wherein the software is further configured to hold a copy of the core enterprise reference data in the data cache for manipulation.
19. The computer-readable medium of claim 18 , wherein the software is further configured to maintain the state of the core enterprise reference data in a core data repository that corresponds to the copy of the core enterprise reference data held in the data cache as locked for read only access until the manipulation process is completed.
20. The computer-readable medium of claim 18 , wherein the software is further configured to provide data staging services provided by the data management services framework subsystem.
21. The computer-readable medium of claim 18 , wherein the software is further configured to provide data staging services including synchronization of inbound and outbound staging areas with managed data areas of a database.