Data enrichment using business compendium
Embodiments relate to enrichment of a data warehouse utilizing a business compendium. Embodiments may employ a process comprising data standardization and cleansing, de-duplication of entries, and matching and enrichment, followed by manual review of an enriched record by a user. During standardization, data may be transformed into consistent content, placing correct data elements into appropriate fields, removing invalid characters, and/or standardizing names and addresses. Duplicate records are then detected and marked. During matching and enrichment, the existence of an entity (such as a supplier), may be verified by progressive matching against the business compendium. Enrichment may provide additional information regarding the entity (e.g. related to risk, diversity, and bankruptcy). The enriched record is available for manual review, allowing the user to change duplicates, matches, and parent/child linkages. Feedback from the user review may enhance accuracy of subsequent enrichment by self-learning aspects, reducing over time a need for manual review.
1. A computer system comprising:
one or more processors;
a software program, executable on said computer system, the software program configured to:
cause an enrichment engine to receive an input data set comprising a first supplier and a second supplier;
cause the enrichment engine to perform standardization and cleansing of the input data set, the standardization comprising validating supplier addresses to a locality/city level;
cause the enrichment engine to identify duplicate entries in the input data set;
cause a matching component of the enrichment engine to perform matching of non-duplicate entries of the input data set to a business compendium having data compiled from a third party source, wherein the matching is performed according to criteria comprising,
a first priority comprising name or address having a score greater than a minimum and changed manually in the past,
a second priority comprising name or address having the score greater than the minimum and generated by a matching engine,
a third priority comprising the third party source as a preferred data provider, and
a fourth priority comprising a most recent updating;
cause the enrichment engine to create an enriched data set including additional information based upon the matching, wherein the additional information comprises common corporate ownership and a unique supplier location indicating the first supplier as a subsidiary of the second supplier; and
providing the enriched data set to a user for manual review.
2. A computer system as in claim 1 wherein the computer program is further configured to provide feedback to the matching component based upon the manual review.
3. A computer system as in claim 1 wherein the additional information further comprises diversity information, government sanction information, bankruptcy information, or risk information.
4. A computer system as in claim 1 further comprising logging the enriched data set with a rejection of a match during the manual review.
5. A computer system as in claim 4 wherein the logging precludes including the additional information in the enriched data set in the future.
6. A computer system as in claim 1 wherein the additional information includes a duplicate data record identifier.
7. A computer system as in claim 1 wherein the additional information includes a parent identifier of a hierarchy.
8. A computer system as in claim 7 wherein the parent identifier comprises a compendium identifier in the business compendium.