Systems and methods of retrieving relevant information
The present invention provides systems and methods of retrieving the pages according to the quality of the individual pages. The rank of a page for a keyword is a combination of intrinsic and extrinsic ranks. Intrinsic rank is the measure of the relevancy of a page to a given keyword as claimed by the author of the page while extrinsic rank is a measure of the relevancy of a page on a given keyword as indicated by other pages. The former is obtained from the analysis of the keyword matching in various parts of the page while the latter is obtained from the context-sensitive connectivity analysis of the links connecting the entire Web. The present invention also provides the methods to solve the self-consistent equation satisfied by the page weights iteratively in a very efficient way. The ranking mechanism for multi-word query is also described. Finally, the present invention provides a method to obtain the more relevant page weights by dividing the entire hypertext pages into distinct number of groups.
1. A computer implemented method of searching the Internet, comprising:
crawling the entire Internet, to collect web pages without limitation to topic;
extracting text and link structure from each collected web page;
generating an indexed database of all collected webpages in which each indexed word is associated with collected web pages on which said indexed word is used, and with other web pages having outbound links from said web pages on which said indexed word is used;
for each indexed word, ranking each web page in the indexed database associated therewith in descending order of rank;
wherein the ranking for said each web page on which said indexed word is used, is adjusted, in part, by summing rankings of each of said other collected web page having an outbound link from said each web page; and thereafter
receiving one or more keywords in a query;
searching the ranked, indexed database for that one or more keywords to quickly provide a ranked list of pages on the Internet in descending order of ranking.
2. The method of claim 1 wherein ranking further comprises:
adjusting the intrinsic ranking in accordance with the page weight for the first page;
adjusting the extrinsic ranking in accordance with a page weight for each of said other pages;
and then
combining the adjusted rankings.
3. The method of claim 2 wherein adjusting the extrinsic ranking, further comprises:
adjusting the extrinsic ranking in accordance with the number of outbound links to the collected web page.
4. The method of claim 2 wherein adjusting intrinsic ranking, further comprises:
determining the page weight for the collected web page in accordance with a probability of a user viewing the collected web page as a result of viewing pages on the Internet in a random fashion.
5. The method of claim 2 wherein adjusting the intrinsic ranking, further comprises:
adjusting the intrinsic ranking in accordance with a proximity on the collected web between at least two of the first plurality of words.
6. The method of claim 2 wherein adjusting the intrinsic ranking, further comprises:
adjusting the intrinsic ranking in accordance with a word order on the collected web between at least two of the indexed words.
7. The method of claim 1 wherein ranking the usage of a keyword on a collected web page further comprises:
determining an intrinsic ranking for the collected page in accordance with the usage of the keyword on the collected page;
determining an extrinsic ranking for the collected page in accordance with the usage of the keyword on said other collected web pages having an outbound link from the collected page; and
combining the first and second rankings to rank the use of the keyword on the collected page.
8. The method of claim 7 , further comprising:
for each collected web page, adjusting the intrinsic ranking for page weight.
9. The method of claim 7 , further comprising:
for each other collected web page, adjusting the extrinsic ranking having an outbound link from the collected page, for page weight;
summing said adjusted extrinsic rankings to form the extrinsic ranking for the collected page; and
for each collected web page, adjusting the intrinsic ranking for page weight.
10. The method of claim 1 , wherein summing rankings of each of said other collected web page having an outbound link to said each web page, further comprising:
for each said other collected web page, adjusting the extrinsic ranking having an outbound link to said collected page, for page weight; and
summing said adjusted extrinsic rankings to form the extrinsic ranking for said collected page.