DATA COLLECTION AND CLEANING AT SOURCE
Apparatus and method to cleanse data, the apparatus including: a receiver to collect electronic data to cleanse; a processor coupled to the receiver, the processor configured to receive the data from the receiver; a memory coupled to the processor, the memory configured to store an application program; a first interface to an instantiation module, to process data collected by the receiver; and a second interface to a configuration manager module, the configuration manager module configured to control data structure and rules used by the instantiation module to process data, wherein the first interface and the second interface are callable from the application program to cleanse the data collected by the receiver.
1 . An apparatus to cleanse data, comprising:
a receiver to collect electronic data to cleanse;
a processor coupled to the receiver, the processor configured to receive the data collected by the receiver;
a memory coupled to the processor, the memory configured to store an application program;
a first interface to an instantiation module, to process data collected by the receiver; and
a second interface to a configuration manager module, the configuration manager module configured to control data structure and rules used by the instantiation module to process data,
wherein the first interface and the second interface are callable from the application program to cleanse the data collected by the receiver.
2 . The apparatus of claim 1 , wherein the instantiation module and the configuration manager module are hosted by the apparatus.
3 . The apparatus of claim 1 , wherein at least one of the instantiation module and the configuration manager module are hosted externally to the apparatus.
4 . The apparatus of claim 1 , wherein the first interface and the second interface comprise a respective application program interface (API).
5 . The apparatus of claim 1 , further comprising a structure manager module coupled to the instantiation module, the structure manager module configured to validate data processed by the instantiation module, by use of self-referential rules.
6 . The apparatus of claim 5 , further comprising a rules manager module coupled to the instantiation module, the rules manager module configured to validate data processed by the instantiation module, by use of rules to compare one datum processed by the instantiation module relative to another datum.
7 . The apparatus of claim 6 , wherein the structure manager module and the rules manager module are configurable without change to the application program.
8 . The apparatus of claim 7 , wherein configuration changes to at least one of the structure manager module and the rules manager module take effect without restarting application program.
9 . The apparatus of claim 7 , wherein configuration changes to at least one of the structure manager module and the rules manager module are determined algorithmically.
10 . The apparatus of claim 6 , wherein the structure manager module and the rules manager module operate substantially in real time to validate data.
11 . A method to cleanse data, comprising:
providing an apparatus comprising a processor coupled to a memory, the memory configured to store an application program;
collecting, by a receiver coupled to a processor, electronic data to cleanse;
processing data collected by the receiver, by use of a first interface to execute an instantiation module by the processor;
controlling data structure and rules used by the instantiation module to process data, by use of a second interface to execute a configuration manager module by the processor;
wherein the first interface and the second interface are callable from the application program to cleanse the data collected by the receiver.
12 . The method of claim 11 , wherein the instantiation module and the configuration manager module are hosted by the apparatus.
13 . The method of claim 11 , wherein at least one of the instantiation module and the configuration manager module are hosted externally to the apparatus.
14 . The method of claim 11 , wherein the first interface and the second interface comprise a respective application program interface (API).
15 . The method of claim 11 , wherein the step of processing data collected by the receiver comprises validating data processed by the instantiation module, by use of self-referential rules.
16 . The method of claim 15 , wherein the step of processing data collected by the receiver further comprises validating data by use of rules to compare one datum relative to another datum.
17 . The method of claim 16 , wherein the self-referential rules and the rules to compare one datum relative to another datum are configurable without change to the application program.
18 . The method of claim 17 , wherein configuration changes to at least one of the self-referential rules and the rules to compare one datum relative to another datum take effect without restarting application program.
19 . The method of claim 17 , wherein configuration changes to at least one of the self-referential rules and the rules to compare one datum relative to another datum are determined algorithmically.
20 . The method of claim 16 , wherein the step of processing data collected by the receiver operates substantially in real time to validate data.