IP Library Granted Patent US 8,078,651
Granted Patent B2
US 8,078,651 · App. 12/257,269 · Granted Dec 13, 2011

Match rules to identify duplicate records in inbound data

Assignee: Oracle International Corporation
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 8,078,651
App. No.
12/257,269
Granted
Dec 13, 2011
Kind
B2
Abstract

Techniques for identifying duplicate records in data to be imported into a data hub. In one set of embodiments, a batch of records to be imported into a data hub is received and a match rule for the batch of records is selected. The match rule includes a set of match criteria for matching records in the inbound batch to records stored in the data hub. A matching process is then carried out, prior to importing the batch of records, to determine whether any of the records in the batch are duplicates of records stored in the data hub. By identifying potential duplicate records before (rather than after) importation, the problems associated with prior art duplicate identification techniques are minimized or avoided. In a particular embodiment, an import workbench application comprising a plurality of user interface screens is provided for aiding a user in managing the matching process.

Claims (71)

1. A method for identifying duplicate records in inbound data, the method comprising:

receiving, by a computer system, data originating from a source system, the data including a plurality of records to be imported from the source system into a data hub;

selecting, by the computer system, a first match rule comprising a first set of match criteria, the first set of match criteria identifying one or more attributes of the plurality of records and one or more match operators for matching the plurality of records with records stored in the data hub; and

determining, by the computer system based on the first match rule, a first set of records in the plurality of records that match records stored in the data hub, wherein the determining is performed prior to importing any of the plurality of records into the data hub.

2. The method of claim 1 further comprising:

presenting the first set of records to a user;

receiving, from the user, a selection of at least one record in the first set of records; and

importing said at least one record into the data hub, wherein the importing comprises merging said at least one record with a matching record stored in the data hub.

3. The method of claim 1 further comprising:

presenting the first set of records to a user;

receiving, from the user, a selection of at least one record in the first set of records; and

discarding said at least one record, such that the at least one record is not imported into the data hub.

4. The method of claim 1 further comprising:

automatically importing the first set of records into the data hub, wherein the automatic importing comprises merging the first set of records with matching records stored in the data hub.

5. The method of claim 1 further comprising:

presenting the first set of records to a user;

receiving, from the user, a selection of a second match rule comprising a second set of match criteria, the second set of match criteria being distinct from the first set of match criteria; and

determining, based on the second match rule, a second set of records in the plurality of records that match records stored in the data hub, wherein the determining is performed prior to importing any of the plurality of records into the data hub.

6. The method of claim 5 further comprising:

presenting the second set of records to the user;

receiving, from the user, a selection of at least one record in the second set of records; and

importing said at least one record into the data hub, wherein the importing comprises merging said at least one record with a matching record stored in the data hub.

7. The method of claim 5 further comprising:

presenting the second set of records to a user;

receiving, from the user, a selection of at least one record in the second set of records; and

discarding said at least one record, such that the at least one record is not imported into the data hub.

8. The method of claim 5 further comprising:

automatically importing the second set of records into the data hub, wherein the automatic importing comprises merging the second set of records with matching records stored in the data hub.

9. The method of claim 1 , wherein the first match rule is selected based on the plurality of records, the source system, or a category associated with the plurality of records.

10. The method of claim 1 , wherein the one or more attributes of the plurality of records are user-defined attributes.

11. The method of claim 1 , wherein the one or more match operators include a fuzzy match operator, a stemming match operator, and a synonym match operator.

12. The method of claim 1 , wherein the determining is performed as a concurrent request process.

13. A method for identifying duplicate records in inbound data, the method comprising:

receiving, by a computer system, data originating from a source system, the data including a plurality of records to be imported from the source system into a data hub; and

for each record in the plurality of records:

selecting, by the computer system, a match rule comprising a set of match criteria, wherein the match rule is selected based on a category associated with the record, and wherein the set of match criteria identifies one or more attributes of the record and one or more match operators for matching the record with records stored in the data hub; and

determining, by the computer system based on the match rule, whether the record matches any records stored in the data hub,

wherein the determining is performed for each record in the plurality of records prior to importing any of the plurality of records into the data hub.

14. A system for identifying duplicate records in inbound data, the system comprising:

a data repository configured to store a plurality of match rules; and

a server communicatively coupled with the data repository, the server being configured to:

receive data originating from a source system, the data including a plurality of records to be imported from the source system into a data hub;

select a first match rule comprising a first set of match criteria, the first set of match criteria identifying one or more attributes of the plurality of records and one or more match operators for matching the plurality of records with records stored in the data hub; and

determine, based on the first match rule, a first set of records in the plurality of records that match records stored in the data hub, wherein the determining is performed prior to importing any of the plurality of records into the data hub.

15. The system of claim 14 , wherein the server is further configured to:

generate a user interface presenting the first set of records to a user;

receive, from the user, a selection of at least one record in the first set of records; and

import said at least one record into the data hub, wherein the importing comprises merging said at least one record with a matching record stored in the data hub.

16. The system of claim 14 , wherein the server is further configured to:

automatically import the first set of records into the data hub, wherein the automatic importing comprises merging the first set of records with matching records stored in the data hub.

17. The system of claim 14 , wherein the server is further configured to:

generate a user interface presenting the first set of records to a user;

receive, from the user, a selection of a second match rule comprising a second set of match criteria, the second set of match criteria being distinct from the first set of match criteria; and

determine, based on the second match rule, a second set of records in the plurality of records that match records stored in the data hub, wherein the determining is performed prior to importing any of the plurality of records into the data hub.

18. The system of claim 14 , wherein the server is further configured to generate a user interface screen for defining the plurality of match rules.

19. The system of claim 18 , wherein the user interface screen includes one or more user interface components for defining match criteria for a match rule.

20. The system of claim 18 , wherein the user interface screen further includes one or more user interface components for defining attributes for a match rule.

21. A non-transitory machine-readable medium for a computer system, the machine-readable medium having stored thereon program code for identifying duplicate records in inbound data, the program code comprising:

code for receiving data originating from a source system, the data including a plurality of records to be imported from the source system into a data hub;

code for selecting a first match rule comprising a first set of match criteria, the first set of match criteria identifying one or more attributes of the plurality of records and one or more match operators for matching the plurality of records with records stored in the data hub; and

code for determining, based on the first match rule, a first set of records in the plurality of records that match records stored in the data hub, wherein the determining is performed prior to importing any of the plurality of records into the data hub.

22. The non-transitory machine-readable medium of claim 21 , wherein the program code further comprises:

code for presenting the first set of records to a user;

code for receiving, from the user, a selection of at least one record in the first set of records; and

code for importing said at least one record into the data hub, wherein the importing comprises merging said at least one record with a matching record stored in the data hub.

23. The non-transitory machine-readable medium of claim 21 , wherein the program code further comprises:

code for automatically importing the first set of records into the data hub, wherein the automatic importing comprises merging the first set of records with matching records stored in the data hub.

24. The non-transitory machine-readable medium of claim 21 , wherein the program code further comprises:

code for presenting the first set of records to a user;

code for receiving, from the user, a selection of a second match rule comprising a second set of match criteria, the second set of match criteria being distinct from the first set of match criteria; and

code for determining, based on the second match rule, a second set of records in the plurality of records that match records stored in the data hub, wherein the determining is performed prior to importing any of the plurality of records into the data.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Oct 23, 2008
From: DESAI, KUNAL; PHILIP, DEENA
To: ORACLE INTERNATIONAL CORPORATION
Reel/Frame 021728/0929 →
Continuity (2)
Provisional Application 61023184 · Jan 24, 2008
Related Publication 20090193046A1 · Jul 30, 2009