System and methods for improved linguistic pattern matching
A system and method for reducing the number of false negatives with minimal impact on false positive search results while allowing searches to return phonetic equivalents, misspellings, common short names, and other such applicable information. New, N-Gram based indexing and search systems and methods facilitate searching of data containing non-Arabic letters, such as numbers, symbols, and foreign language characters. Ability to customize indexing and other features further enhance search results. Linguistic pattern matching search results are improved based on dynamically modified search attributes.
1. A system for comparing a query against data contained within at least one database comprising:
(a) a central processing unit having at least one electronic communications port for receiving said query, wherein said central processing unit is attached to said at least one database and said query includes a party's name;
(b) at least one extraction tool accessible to said central processing unit for extracting a plurality of attributes from a plurality of user selectable match areas from said query;
(c) at least one linguistic pattern analytical tool having characteristics at least some of which are user selectable and being accessible to said central processing unit for converting said plurality of attributes from said query into a plurality of linguistic pattern strings, and for comparing, using at least one user selectable index property, said plurality of linguistic pattern strings with at least one stored linguistic pattern string from at least one stored attribute contained within said at least one database for providing a set of matches;
(d) said at least one linguistic pattern analytical tool accessible to said central processing unit for analyzing said set of matches to provide at least one set of matched attributes;
(e) at least one combining tool accessible to said central processing unit for combining all of said at least one set of matched attributes to provide a combined result;
(f) at least one monitoring tool for monitoring information about said party;
(g) at least one monitoring tool for monitoring information in said database;
(h) wherein, responsive to any change to said party's information, the system automatically rescreens said party for determining whether said party is approved for receiving certain goods; and
(i) wherein, responsive to any change to said database information, the system automatically rescreens said party for determining whether said party is approved for receiving certain goods; and
(j) wherein said at least one database includes names of parties restricted from receiving certain goods.
2. The system of claim 1 , further comprising at least one filtering tool accessible to said central processing unit for filtering said combined result according to at least one user selectable criteria.
3. The system of claim 1 , wherein said at least one linguistic pattern analytical tool is comprised of at least one of a Metaphone based analysis, a Phonex based analysis, a Soundex based analysis, an N-gram based analysis, an edit-distance based analysis and a dictionaries based analysis.
4. A computer program product for querying a database comprising a computer useable medium having a computer readable program code-executable on a computer system for performing the operations of:
(a) receiving a query;
wherein said query includes a party's name;
(b) extracting a plurality of attributes from a plurality of user selectable match areas from said query;
(c) providing at least one linguistic pattern analytical tool having characteristics at least some of which are user selectable for converting information of a plurality of attributes from said query into a plurality of linguistic pattern strings;
(d) comparing, with at least one user selectable index property, said plurality of linguistic pattern strings with at least one stored linguistic pattern string from at least one stored attribute contained within said database to provide a set of matches;
(e) analyzing said set of matches, using said at least one linguistic pattern analytical tool, to provide at least one set of matched attributes;
(f) combining all of said at least one set of matched attributes to provide a combined result;
(g) monitoring information about said party;
(h) monitoring information in said database;
(i) responsive to any change to said party's information, automatically rescreening said party for determining whether said party is approved for receiving certain goods; and
(j) responsive to any change to said database information, automatically rescreening said party for determining whether said party is approved for receiving certain goods;
wherein said database includes names of parties restricted from receiving certain goods;
wherein at least one of the actions of receiving, extracting, converting, comparing, analyzing, and combining is implemented using at least one data processing system.
5. The computer program product of claim 4 , further comprising computer readable code for filtering said combined result according to at least one user selectable criteria.
6. The computer program product of claim 4 , wherein said computer readable program code for converting said query into a plurality of linguistic pattern strings and for comparing said plurality of linguistic pattern strings with at least one stored linguistic pattern string contained within said database to provide a set of matches is comprised of at least one of a Metaphone based analysis code, Phonex based analysis code, Soundex based analysis code, N-gram based analysis code, edit-distance based analysis code and dictionaries based analysis code.
7. A method for comparing a query against data contained within a database comprising the steps of:
(a) receiving said query;
wherein said query includes a party's name;
(b) extracting a plurality of attributes from a plurality of potential match areas from said query;
wherein said plurality of potential match areas are user selectable;
(c) converting said plurality of attributes from said query, using at least one linguistic pattern matching analytical tool, into a plurality of linguistic pattern strings;
wherein said at least one linguistic pattern matching analytical tool used for converting has characteristics at least some of which are user selectable;
(d) comparing, using at least one user selectable index property, said plurality of linguistic pattern strings with at least one stored linguistic pattern string from at least one stored attribute contained within said database for providing a set of matches;
(e) analyzing said set of matches, using said at least one linguistic pattern matching analytical tool, to provide at least one set of matched attributes;
(f) combining all of said at least one set of matched attributes to provide a combined result;
(g) monitoring information about said party;
(h) monitoring information in said database;
(i) responsive to any change to said party's information, automatically rescreening said party for determining whether said party is approved for receiving certain goods; and
(j) responsive to any change to said database information, automatically rescreening said party for determining whether said party is approved for receiving certain goods;
wherein said database includes names of parties restricted from receiving certain goods;
wherein at least one of the actions of receiving, extracting, converting, comparing, analyzing, and combining is implemented using at least one data processing system.
8. The method of claim 7 , further including the step of filtering said combined result according to at least one user selectable criteria.
9. The method of claim 7 , further comprising the step of employing at least one of a Metaphone based analysis, a Phonex based analysis, a Soundex based analysis, an N-gram based analysis, an edit-distance based analysis and a dictionaries based analysis.
10. The method of claim 7 , wherein said comparing is by edit distance.
11. The method of claim 7 , further comprising the step of employing a Metaphone based analysis, a Phonex based analysis, a Soundex based analysis, an Alphabetic N-gram based analysis, a Consonant N-gram based analysis, a Numeric N-gram based analysis, an Fdi N-gram based analysis, an Fml N-gram based analysis, an edit-distance based analysis and a dictionaries based analysis.
12. The method of claim 7 , further comprising designating, responsive to a match candidate containing an unusual word in an unusual words dictionary, said match candidate to be a match.