System for software source code comparison
A system for analyzing similarities between a first and second corpus or between a set of concepts and a corpus uses natural language processing and machine intelligence methods to replace terms or phrases in the corpus with concepts, determine the frequency of each concept in the corpus, and convert the corpus into a concept frequency file to enable easy comparison of the two corpuses or easy retrieval of items from the corpus that contain concept. Difference analysis and a combination of content and spectral analysis may be employed.
1. A method for searching and fingerprinting a corpus of data objects, comprising:
receiving a list of concepts;
relating at least one of said concepts to at least one search term;
searching each of said corpus of data objects for each of said search terms by computer;
determining whether each of said concepts is present within each data object of said corpus of data objects, based upon the presence, within each said data object, of the one or more said search terms related to each said concept;
determining the correlation of at least a first concept with respect to at least a second concept, in said corpus of data objects based on the presence of first search terms relating to said first concept and second search terms relating to said second concept in the same data object said correlation representing the degree to which said first concept appears within the set of data objects containing said second concept;
separately determining the correlation of each concept with each other concept; and
constructing an n-dimensional grid comprising at least two axes, each axis comprising one or more of said concepts, each intersection within said grid comprising at least the correlation value of the two concepts associated with said axes forming said intersection.
2. The method of claim 1 , wherein said corpus of data objects is a database of documents.
3. The method of claim 2 , wherein said receiving a list of concepts comprises a computer program receiving a list of concepts posted from an internet web page.
4. The method of claim 1 , wherein said determining the correlation further comprises determining the correlation of each concept with two or more other concepts.