IP Library › Granted Patent US 10,698,755
Granted Patent B2
US 10,698,755 · App. 14/290,030 · Granted Jun 30, 2020

Analysis of a system for matching data records

Inventors: Glenn E. Goldenberg (Austin, TX); Scott Schumacher (Porter Ranch, CA); Jason Woods (Round Rock, TX)
Assignee: International Business Machines Corporation
G06F11/0769G06F11/079G06F16/2462
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,698,755
App. No.
14/290,030
Filed
May 29, 2014
Granted
Jun 30, 2020
Kind
B2
Art Unit
2156
USPC
707/736
Abstract

Embodiments disclosed herein provide a system and method for analyzing an identity hub. Particularly, a user can connect to the identity hub, load an initial set of data records, create and/or edit an identity hub configuration locally, analyze and/or validate the configuration via a set of analysis tools, including an entity analysis tool, a data analysis tool, a bucket analysis tool, and a linkage analysis tool, and remotely deploy the validated configuration to an identity hub instance. In some embodiments, through a graphical user interface, these analysis tools enable the user to analyze and modify the configuration of the identity hub in real time while the identity hub is operating to ensure data quality and enhance system performance.

Claims (42)

1. A computer-implemented method for analyzing a system for matching data records, the method comprising:

producing a configuration of said system for matching data records, the configuration of the system including a bucketing strategy employing matching functions and matching parameters to create buckets containing data records, wherein said buckets are created by comparing sets of one or more attributes of initial data records with corresponding attributes of candidate data records in said system, wherein each bucket is associated with a corresponding set of attributes, and wherein data records associated with a same entity are determined and linked by comparing one or more attributes of the initial data records to corresponding attributes of the candidate data records within the buckets in accordance with the matching functions and matching parameters;

applying said configuration to said system and analyzing buckets created during operation of said system according to the bucketing strategy associated with said configuration of said system;

analyzing an effect of said buckets on throughput of said system via a bucket analysis tool providing a user interface, wherein analyzing an effect of said buckets further comprises:

executing one or more queries from the user interface of the bucket analysis tool to produce characteristics associated with the buckets created during operation of the system, wherein the characteristics include distribution of data within the created buckets and data records not placed in the created buckets; and

identifying performance issues of the system from the characteristics of the created buckets produced from the one or more queries; and

modifying said configuration during operation of said system to adjust distribution of the data records within said buckets in real time to address the identified performance issues and enable the throughput of said system to reside within a predetermined desired range, wherein modifying said configuration includes:

changing said matching functions and matching parameters of said bucketing strategy for creating said buckets based on said identified performance issues to alter the comparing of said attributes and determination of the association of data records with the same entity for said buckets, wherein changing said matching functions and matching parameters includes providing a different combination of attributes for the corresponding set of attributes for at least one bucket.

2. The method of claim 1 , wherein said changing said matching functions and matching parameters of said bucketing strategy further comprises editing an algorithm utilized in creating said buckets or changing one or more parameter values associated with said algorithm.

3. The method of claim 1 , wherein said modifying said configuration further comprises:

estimating performance of said system with said modified configuration under a real time load via the bucket analysis tool to ensure the throughput of said system resides within said predetermined desired range.

4. The method of claim 2 , wherein said algorithm is associated with an entity type, and said method further comprises analyzing entities categorized as having said entity type in said system.

5. The method of claim 4 , wherein said analyzing said entities further comprises one or more from a group of analyzing an entity size distribution, analyzing said entities by size, analyzing said entities by composition, analyzing a score distribution associated with said entities, and analyzing member comparisons associated with said entities.

6. The method of claim 1 , further comprising analyzing validity of attributes of said initial data records.

7. The method of claim 1 , wherein said analyzing said buckets further comprises one or more from a group of analyzing statistics associated with said buckets, analyzing a bucket size distribution, analyzing said buckets by size, analyzing said buckets by composition, analyzing a bulk cross match comparison distribution, analyzing members by bucket count, analyzing member bucket values, analyzing member bucket frequencies, and analyzing a member comparison distribution.

8. The method of claim 1 , further comprising analyzing error rates associated with said initial data records, wherein said error rates comprise a record error rate and a person error rate.

9. The method of claim 1 , wherein said configuration of said system comprises a clerical review threshold and an autolink threshold, and wherein said clerical review threshold and said autolink threshold are indicative of tolerance of said system to false positive and false negative rates in matching said initial data records, further comprising analyzing said clerical review threshold and said autolink threshold.

10. A system for analyzing an identity system for matching data records, the system comprising:

at least one processor with logic to:

produce a configuration of said identity system for matching data records, the configuration of the identity system including a bucketing strategy employing matching functions and matching parameters to create buckets containing data records, wherein said buckets are created by comparing sets of one or more attributes of initial data records with corresponding attributes of candidate data records in said identity system, wherein each bucket is associated with a corresponding set of attributes, and wherein data records associated with a same entity are determined and linked by comparing one or more attributes of the initial data records to corresponding attributes of the candidate data records within the buckets in accordance with the matching functions and matching parameters;

apply said configuration to said identity system and analyze buckets created during operation of said identity system according to the bucketing strategy associated with said configuration of said identity system;

analyze an effect of said buckets on throughput of said identity system via a bucket analysis tool providing a user interface, wherein analyzing an effect of said buckets further comprises:

executing one or more queries from the user interface of the bucket analysis tool to produce characteristics associated with the buckets created during operation of the identity system, wherein the characteristics include distribution of data within the created buckets and data records not placed in the created buckets; and

identifying performance issues of the identity system from the characteristics of the created buckets produced from the one or more queries; and

modify said configuration during operation of said identity system to adjust distribution of the data records within said buckets in real time to address the identified performance issues and enable the throughput of said identity system to reside within a predetermined desired range, wherein modifying said configuration includes:

changing said matching functions and matching parameters of said bucketing strategy for creating said buckets based on said identified performance issues to alter the comparing of said attributes and determination of the association of data records with the same entity for said buckets, wherein changing said matching functions and matching parameters includes providing a different combination of attributes for the corresponding set of attributes for at least one bucket.

11. The system of claim 10 , wherein said at least one processor further displays an algorithm editor through which an algorithm utilized in creating said buckets is edited.

12. The system of claim 10 , wherein said bucketing strategy is associated with an entity type, and wherein said at least one processor further displays an entity analysis tool through which entities categorized as having said entity type in said identity system are analyzed.

13. The system of claim 10 , wherein said at least one processor further provides a plurality of functions through an entity analysis tool, wherein said plurality of functions enables analysis of one or more from a group of an entity size distribution, said entities by size, said entities by composition, a score distribution associated with said entities, and member comparisons associated with said entities.

14. The system of claim 10 , wherein said at least one processor further displays a data analysis tool through which said initial data records are analyzed.

15. The system of claim 14 , wherein said at least one processor further provides at least one function through said data analysis tool, wherein said at least one function enables analysis of attribute validity of said initial data records.

16. The system of claim 10 , wherein said analyzing said buckets further comprises one or more from a group of analyzing statistics associated with said buckets, analyzing a bucket size distribution, analyzing said buckets by size, analyzing said buckets by composition, analyzing a bulk cross match comparison distribution, analyzing members by bucket count, analyzing member bucket values, analyzing member bucket frequencies, and analyzing a member comparison distribution.

17. The system of claim 10 , wherein said at least one processor further displays a linkage analysis tool through which error rates associated with said initial data records are analyzed, wherein said error rates comprise a record error rate and a person error rate.

18. A non-transitory computer readable storage medium storing computer instructions executable by a processor for analyzing a system for matching data records, when executed by said processor, said computer instructions cause said processor to:

produce a configuration of said system for matching data records, the configuration of the system including a bucketing strategy employing matching functions and matching parameters to create buckets containing data records, wherein said buckets are created by comparing sets of one or more attributes of initial data records with corresponding attributes of candidate data records in said system, wherein each bucket is associated with a corresponding set of attributes, and wherein data records associated with a same entity are determined and linked by comparing one or more attributes of the initial data records to corresponding attributes of the candidate data records within the buckets in accordance with the matching functions and matching parameters;

apply said configuration to said system and analyze buckets created during operation of said system according to the bucketing strategy associated with said configuration of said system;

analyze an effect of said buckets on throughput of said system via a bucket analysis tool providing a user interface, wherein analyzing an effect of said buckets further comprises:

executing one or more queries from the user interface of the bucket analysis tool to produce characteristics associated with the buckets created during operation of the system, wherein the characteristics include distribution of data within the created buckets and data records not placed in the created buckets; and

identifying performance issues of the system from the characteristics of the created buckets produced from the one or more queries; and

modify said configuration during operation of said system to adjust distribution of the data records within said buckets in real time to address the identified performance issues and enable the throughput of said system to reside within a predetermined desired range, wherein modifying said configuration includes:

changing said matching functions and matching parameters of said bucketing strategy for creating said buckets based on said identified performance issues to alter the comparing of said attributes and determination of the association of data records with the same entity for said buckets, wherein changing said matching functions and matching parameters includes providing a different combination of attributes for the corresponding set of attributes for at least one bucket.

19. The non-transitory computer readable storage medium of claim 18 , wherein said analyzing said buckets further comprises one or more from a group of analyzing statistics associated with said buckets, analyzing a bucket size distribution, analyzing said buckets by size, analyzing said buckets by composition, analyzing a bulk cross match comparison distribution, analyzing members by bucket count, analyzing member bucket values, analyzing member bucket frequencies, and analyzing a member comparison distribution.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 29, 2014
From: GOLDENBERG, GLENN E.; SCHUMACHER, SCOTT; WOODS, JASON
To: INTERNATIONAL BUSINESS MACHINES CORPORATION
Reel/Frame 032988/0167 →
Continuity (3)
Continuation 12239448 · Sep 26, 2008
Provisional Application 60997038 · Sep 28, 2007
Related Publication 20140281729A1 · Sep 18, 2014