IP Library › Granted Patent US 11,681,689
Granted Patent B2
US 11,681,689 · App. 17/342,895 · Granted Jun 20, 2023

Automatic generation of a matching algorithm in master data management

Inventors: Abhishek Seth (Deoband, IN); Soma Shekar Naganna (Bangalore, IN); James Albert O'Neill, Jr. (Austin, TX); Geetha Sravanthi Pulipaty (Bangalore, IN); Neeraj Ramkrishna Singh (Bangalore, IN)
Assignee: International Business Machines Corporation
G06F16/2379G06F16/2255G06F16/2272
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,681,689
App. No.
17/342,895
Granted
Jun 20, 2023
Kind
B2
Abstract

A method for receiving an additional dataset including a plurality of additional data records; determining a record type using classifiers and an internal domain knowledge corpus; dividing the plurality of additional data records into a plurality of indexing groups; assigning the given additional data record to a match set based on completeness and similarity of natures of attributes of the given additional data record; and assigning the given additional data record to and a comparison group based on completeness and similarity of natures of attributes of the given additional data record.

Claims (56)

1. A computer-implemented method (CIM) for use in a master data management (MDM) environment including a plurality of master data records stored in a set of storage device(s), the CIM comprising:

receiving a plurality of additional records that include data that is to be incorporated into the plurality of master data records;

automatically generating a full matching algorithm to determine whether subject matter of data of each additional record matches any of the records of the plurality of master data records, with the full matching algorithm including code for performing the following operations:

determining a record type for the additional records using classifiers and an internal domain knowledge corpus,

calculating a Jaccard coefficient for a plurality of candidate lists,

assigning the each additional data record to a match set based on completeness and similarity of natures of attributes of the additional record, and

for each given additional record of the plurality of additional records, assigning the given additional record to a comparison group based on completeness and similarity of natures of attributes of the given additional data record;

applying the full matching algorithm to determine whether each additional record matches an existing master data record; and

for additional data records that match an existing master data record, merging the matching additional data record with its matching master data record in the set of storage device(s) to generate an updated version of the matching master data record that includes data from the matching additional record.

2. The CIM of claim 1 the full matching algorithm includes code for performing the following further operations:

determining a plurality of standardizers; and

determining recipes for the plurality of standardizers.

3. The CIM of claim 2 the full matching algorithm includes code for performing the following further operations:

determining of a plurality of attribute types for each column in the additional records of the plurality of additional records; and

creating syntax to specify the plurality of attribute types that is compatible with the MDM environment.

4. The CIM of claim 1 the full matching algorithm includes code for performing the following further operations:

for each given additional record of the plurality of additional records, determining, an entity type using classifiers and an internal domain knowledge corpus.

5. A computer program product (CPP) for use in a master data management (MDM) environment including a plurality of master data records stored in a set of storage device(s), the CIM comprising:

a set of storage device(s); and

computer code stored collectively in the set of storage device(s), with the computer code including data and instructions to cause a processor(s) set to perform at least the following operations:

receiving a plurality of additional records that include data that is to be incorporated into the plurality of master data records,

automatically generating a full matching algorithm to determine whether subject matter of data of each additional record matches any of the records of the plurality of master data records, with the full matching algorithm including code for performing the following operations,

determining a record type for the additional records using classifiers and an internal domain knowledge corpus,

calculating a Jaccard coefficient for a plurality of candidate lists,

assigning the each additional data record to a match set based on completeness and similarity of natures of attributes of the additional record, and

for each given additional record of the plurality of additional records, assigning the given additional record to a comparison group based on completeness and similarity of natures of attributes of the given additional data record, and

applying the full matching algorithm to determine whether each additional record matches an existing master data record, and

for additional data records that match an existing master data record, merging the matching additional data record with its matching master data record in the set of storage device(s) to generate an updated version of the matching master data record that includes data from the matching additional record.

6. The CPP of claim 5 the full matching algorithm includes code for performing the following further operations:

determining a plurality of standardizers; and

determining recipes for the plurality of standardizers.

7. The CPP of claim 6 the full matching algorithm includes code for performing the following further operations:

determining of a plurality of attribute types for each column in the additional records of the plurality of additional records; and

creating syntax to specify the plurality of attribute types that is compatible with the MDM environment.

8. The CPP of claim 5 the full matching algorithm includes code for performing the following further operations:

for each given additional record of the plurality of additional records, determining, an entity type using classifiers and an internal domain knowledge corpus.

9. A computer system (CS) comprising:

a processor(s) set;

a set of storage device(s); and

computer code stored collectively in the set of storage device(s), with the computer code including data and instructions to cause the processor(s) set to perform at least the following operations:

receiving a plurality of additional records that include data that is to be incorporated into the plurality of master data records,

automatically generating a full matching algorithm to determine whether subject matter of data of each additional record matches any of the records of the plurality of master data records, with the full matching algorithm including code for performing the following operations,

determining a record type for the additional records using classifiers and an internal domain knowledge corpus,

calculating a Jaccard coefficient for a plurality of candidate lists,

assigning the each additional data record to a match set based on completeness and similarity of natures of attributes of the additional record, and

for each given additional record of the plurality of additional records, assigning the given additional record to a comparison group based on completeness and similarity of natures of attributes of the given additional data record, and

applying the full matching algorithm to determine whether each additional record matches an existing master data record, and

for additional data records that match an existing master data record, merging the matching additional data record with its matching master data record in the set of storage device(s) to generate an updated version of the matching master data record that includes data from the matching additional record.

10. The CS of claim 9 the full matching algorithm includes code for performing the following further operations:

determining a plurality of standardizers; and

determining recipes for the plurality of standardizers.

11. The CS of claim 10 the full matching algorithm includes code for performing the following further operations:

determining of a plurality of attribute types for each column in the additional records of the plurality of additional records; and

creating syntax to specify the plurality of attribute types that is compatible with the MDM environment.

12. The CS of claim 9 the full matching algorithm includes code for performing the following further operations:

for each given additional record of the plurality of additional records, determining, an entity type using classifiers and an internal domain knowledge corpus.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 9, 2021
From: SETH, ABHISHEK; NAGANNA, SOMA SHEKAR; O'NEILL, JAMES ALBERT, JR.; PULIPATY, GEETHA SRAVANTHI; SINGH, NEERAJ RAMKRISHNA
To: INTERNATIONAL BUSINESS MACHINES CORPORATION
Reel/Frame 056487/0711 →
Continuity (1)
Related Publication 20220398241A1 · Dec 15, 2022
Cited By (3)
US 12,242,433 US 12,314,268 US 12,475,086