Data normalizer
View Patent ↗A data normalizer for processing data for use by a CDM system which is capable of dynamically updating user-defined normalization criteria and which is further capable of operating in a multi-tenant environment in which each tenant has distinct data normalization policies.
1. A computer apparatus comprised of:
a normalization processing component configured to receive mass exported data from disparate data sources for a plurality of tenants,
wherein each of said plurality of tenants uses heterogeneous Contact Data Management (CDM) systems,
wherein said normalization processing component is further configured to return normalized data to each of said heterogeneous systems,
wherein said mass exported data is normalized by said normalization processing component based on a data normalization policy associated with each tenant,
wherein said mass exported data is normalized using at least one normalization schema comprised of standard semantic and linguistic character combinations utilized in all CDM systems,
wherein said normalization processing component further includes a set of computer readable instructions to retrieve said normalization schema and compare said normalization schema to data in an external database and to assign a reliability score to said data based on said external database.
2. The apparatus of claim 1 which further includes at least one computer readable media for storing said at least one data normalization schema.
3. The apparatus of claim 1 which further includes a component for updating said at least one data normalization policy which is used to create at least one updated data normalization schema in real time.
4. The apparatus of claim 3 wherein said normalization processing component includes an open source software component configured to enable a user to update said at least one updated data normalization policy by updating an open source database of normalization schema.
5. The apparatus of claim 1 wherein said at least one data normalization schema calls functions which transform data to be consistent with normalization schema.
6. The apparatus of claim 1 wherein said normalization processing component is web-based and associates said at least one data normalization schema with at least one tenant in a multi-user environment.
7. The apparatus of claim 3 which associates said at least one updated data normalization schema with at least one tenant.
8. The apparatus of claim 1 which is configured to perform a data handoff function to at least one CDM system.
9. The apparatus of claim 1 which is further configured to perform a data handoff function to a plurality of CDM systems.
10. The apparatus of claim 1 wherein said at least one normalization processing component is web-based.
11. The apparatus of claim 1 wherein said at least one normalization processing component resides on a local area network with at least one CDM.
12. The apparatus of claim 7 which is further configured with software to allow said computer apparatus to perform a data handoff function to at least one user-selected CDM system.
13. The apparatus of claim 1 wherein said at least one data source is selected from a group consisting of keyed data, mass exported data, and data obtained by a data gathering tool.
14. A data preprocessing apparatus comprised of:
at least one computer having at least one CDM system;
at least one collection module configured to interface with said at least one CDM system and obtaining data collected by said at least one CDM system; and
a normalization processing component configured to receive mass exported data from disparate data sources for a plurality of tenants,
wherein each of said plurality of tenants uses heterogeneous CDM systems,
wherein said normalization processing component is further configured to return normalized data to each of said heterogeneous systems,
wherein said mass exported data is normalized by said normalization processing component based on a data normalization policy associated with each tenant,
wherein said mass exported data is normalized using at least one normalization schema comprised of standard semantic and linguistic character combinations utilized in all CDM systems,
wherein said normalization processing component further includes a set of computer readable instructions to retrieve said normalization schema and compare said normalization schema to data in an external database and to assign a reliability score to said data based on said external database.
15. The apparatus of claim 14 which includes at least one normalization policy tracking component which is configured to update said at least one normalization schema with at least one tenant.
16. The apparatus of claim 14 which is further configured to update said at least one normalization schema to create an updated normalization schema and associating said updated normalization schema with at least one normalization policy to create an updated normalization schema.
17. The apparatus of claim 14 wherein said at least one normalization schema is updated by at least one administrator in real time using a graphical user interface.
18. The apparatus of claim 14 wherein said at least one normalization schema includes computer readable instructions to compare data derived from a first database to data contained in a second database.