Collection and organization of actual search results data for particular destinations
A tracking system passively tracks and records searches conducted by actual search engine users. The recorded data for each search event preferably includes the search query submitted, the search engine used, the search result item (e.g., web page) selected, the position (e.g., page number) of this item, and the user's IP address. The collected data is aggregated and analyzed to generate data regarding the search queries used to locate and access particular destinations (e.g., web pages and sites). This data may be used for various purposes, such as ( 1 ) to generate reports showing, e.g., how users reach a particular destination from different search engines and geographic locations, ( 2 ) to select content to display on a destination page, such that the content is relevant to search queries commonly used to locate that page, and ( 3 ) to update the database of one search engine to reflect searches conducted on other search engines.
1. A method of collecting search result ranking information for statistical analysis, the method comprising:
for a particular destination page, collecting referrers used to access the particular destination page, wherein said referrers include Uniform Resource Locators (URLs) of search results pages from a plurality of different search engines;
when a referrer of the referrers corresponds to a results page from a search engine of the different search engines, then:
parsing, by a computer system having a processor and memory, the referrer to identify the search engine, search query, and search results page number;
associating an Internet protocol (IP) address of a user computer with the parsed referrer;
collecting the associated IP address along with the identified search engine, the search query, and the search results page number for the particular destination page for statistical data, wherein the search result ranking information comprises the associated IP address, the identified search engine, the search query, and the search results page number;
generating a search engine comparison report and programmatically incorporating the statistical data into the search engine comparison report wherein, for each search engine of the search engines and from calculated usage statistics for locating and accessing the destination page, the search engine comparison report separately indicates search queries used to access the destination page, a number of users who submitted each search query, and the search results page number; and
generating a supplemental web server access log from collected search activity data;
wherein the generation of the search engine comparison report is based on the collected search activity data and the collected associated IP addresses.
2. The method of claim 1 , wherein collecting referrers comprises collecting via at least two disparate techniques, wherein one of the at least two techniques comprises receiving referrers via JavaScript code executed by browsers.
3. The method of claim 1 , further comprising using the statistical data to vary a ranking of the destination page in search results of a particular search engine.
4. The method of claim 1 , wherein the search engine comparison report additionally includes information about geographic locations of said users.
5. A computer system for collecting search result ranking information, the computer system comprising:
a computer;
a computer storage device having data repository that stores for at least a particular destination page, referrers used to access the particular destination page, said destination page being associated with a web server, wherein said referrers include Uniform Resource Locators (URLs) of search results pages from a plurality of different search engines, wherein the computer storage device further stores an Internet protocol (IP) address of a user computer with each referrer; and
an analysis component configured to:
parse the referrers to identify a search engine of the different search engines, search query, and search results page number, wherein the parsed referrers are associated with the IP addresses of user computers;
associate the IP address of a user computer with each parsed referrer of the parsed referrers;
collect the associated IP address along with the identified search engine, the search query, and the search results page number information for the particular destination page for statistical data, wherein the search result ranking information comprises the associated IP address, the identified search engine, the search query, and the search results page number information;
programmatically generate a search engine comparison report and incorporate the statistical data into the search engine comparison report wherein, for each search engine of the search engines and from calculated usage statistics for locating and accessing the destination page, the search engine comparison report separately indicates search queries used to access the destination page, a number of users who submitted each search query, and the search results page number; and
generate, for the web server, a supplemental web server access log from collected search activity data;
wherein the generated search engine comparison report is based on the collected search activity data and the collected associated IP addresses.
6. The computer system of claim 5 , further comprising a data collection component configure to collect referrers via at least two disparate techniques, wherein one of the at least two techniques comprises JavaScript code executed by browsers.
7. The computer system of claim 5 , wherein the analysis component is further configured to vary a ranking of the destination page in search results of a particular search engine based at least partly on the statistical data.
8. The computer system of claim 5 , wherein the search engine comparison report additionally includes information about geographic locations of said users.