Automated user behavior feedback system for whole page search success optimization
Various users' navigational behaviors relative to search results presented by a search engine are monitored. URLs that are visited and revised queries that are submitted after the submission of an original query are placed within a trail that begins with the original query. These trails are grouped based on the original queries with which they begin. For each trail group, a set of URLs that frequently occur in that group's trails, and a set of revised queries that frequently occur in that group's trails, are determined. These frequently occurring elements are mapped to the original queries with which all the trails in the corresponding trail group begin. In response to subsequent submissions of the same original query, the search engine ensures that URLs and revised queries that are mapped to the original query are prominently displayed on the search results pages that are initially returned in response to those submissions.
1. A computer-implemented method comprising the steps of:
generating a plurality of navigation trails based on an ordered sequence of navigational activities performed by a plurality of users;
grouping the plurality of navigation trails into a plurality of navigation trail groups based on original queries with which navigation trails in the plurality of navigation trails begin;
for at least a particular navigation trail group of the plurality of navigation trail groups, determining one or more uniform resource locators (URLs) or revised queries that occur in at least a specified proportion of navigation trails in the particular navigation trail group;
generating a search results page based at least in part on the one or more URLs or revised queries that occur in at least a specified proportion of navigation trails in the particular navigation trail group; and
storing the search results page on a computer-readable storage medium;
wherein at least one navigation trail in the particular navigation trail group contains at least one URL or revised query that another navigation trail in the particular navigation trail group does not contain; and
wherein the steps are performed by one or more computing devices.
2. The method of claim 1 , wherein generating the plurality of navigation trails comprises:
recording URLs of resources that a particular user of the plurality of users selected from a set of search results that an Internet search engine returned to the particular user in response to receiving an original query from the particular user; and
placing the URLs in a particular navigation trail of the plurality of navigation trails;
wherein the particular navigation trail begins with the original query; and
wherein the one or more URLs or revised queries include one or more URLs of the URLs in the particular navigation trail.
3. The method of claim 1 , wherein generating the plurality of navigation trails comprises:
recording revised queries that a particular user of the plurality of users submitted to an Internet search engine after the Internet search engine received an original query from the particular user; and
placing the revised queries in a particular navigation trail of the plurality of navigation trails;
wherein the particular navigation trail begins with the original query; and
wherein the one or more URLs or revised queries include one or more revised queries of the revised queries in the particular navigation trail.
4. The method of claim 1 , wherein generating the plurality of navigation trails comprises:
for each search result that a particular user of the plurality of users selected from a set of search results that an Internet search engine returned to the particular user, determining an amount of time that passed in between (a) a moment that the particular user was presented with a resource that corresponds to that search result and (b) a moment that the particular user navigated away from that resource;
determining whether a particular amount of time that passed in between (a) a moment that the particular user was presented with a particular resource that corresponds to a particular search result and (b) a moment that the particular user navigated away from that particular resource is at least as much as a specified threshold; and
in response to determining that the particular amount of time is at least as much as the specified threshold, ending a particular navigation trail of the plurality of navigation trail with a URL of the particular search result.
5. The method of claim 1 , wherein generating the plurality of navigation trails comprises:
for each search result that a particular user of the plurality of users selected from a set of search results that an Internet search engine returned to the particular user, determining whether user input that expressed the particular user's interest in a resource to which the search result refers was received from the particular user before a moment that the particular user navigated away from that resource;
determining whether particular user input that expressed the particular user's interest in a particular resource to which a particular search result refers was received from the particular user before a moment that the particular user navigated away from that particular resource; and
in response to determining that the particular user input was received from the particular user before the moment that the particular user navigated away from the particular resource, ending a particular navigation trail of the plurality of navigation trail with a URL of the particular search result.
6. The method of claim 1 , wherein grouping the plurality of navigation trails into a plurality of navigation trail groups comprises:
grouping all navigation trails that begin with a first original query into a first navigation trail group of the plurality of navigation trail groups; and
grouping all navigation trails that begin with a second original query into a second navigation trail group of the plurality of navigation trail groups;
wherein the first original query differs from the second original query.
7. The method of claim 1 , wherein determining the one or more URLs or revised queries that occur in at least a specified proportion of navigation trails in the particular navigation trail group comprises:
determining whether a particular URL, which corresponds to a particular search result that a user selected from a set of search results returned by an Internet search engine on the search results page, occurs in at least a specified proportion of navigation trails in the particular navigation trail group; and
in response to determining that the particular URL occurs in at least the specified proportion of navigation trails in the particular navigation trail group, including the particular URL within the one or more URLs or revised queries.
8. The method of claim 1 , wherein determining the one or more URLs or revised queries that occur in at least a specified proportion of navigation trails in the particular navigation trail group comprises:
determining whether a particular revised query, which a user submitted to an Internet search engine after submitting an original query with which each of the navigation trails in the particular navigation trail group begin, occurs in at least a specified proportion of navigation trails in the particular navigation trail group; and
in response to determining that the particular revised query occurs in at least the specified proportion of navigation trails in the particular navigation trail group, including the particular revised query within the one or more URLs or revised queries.
9. The method of claim 1 , wherein generating the search results page based at least in part on the one or more URLs or revised queries that occur in at least a specified proportion of navigation trails in the particular navigation trail group comprises:
determining a set of search results that are relevant to a query that an Internet search engine received from a user;
ranking search results in the set of search results based on relevance of those search results to the query;
in response to determining that a particular URL is mapped to the query within rank adjustment data that were generated based on the plurality of navigation trails, including, within the set of search results, a particular search result to which the particular URL refers;
generating the search results page in which the particular search result appears more highly ranked than one or more other search results from the set of search results; and
sending the search results page over the Internet to the user as an initial search results page that the Internet search result engine sent to the user in response to the query.
10. The method of claim 1 , wherein generating the search results page based at least in part on the one or more URLs or revised queries that occur in at least a specified proportion of navigation trails in the particular navigation trail group comprises:
determining a set of search results that are relevant to an original query that an Internet search engine received from a user;
in response to determining that a particular revised query is mapped to the original query within associative query data that were generated based on the plurality of navigation trails, including the particular revised query within a set of alternative queries;
generating the search results page on which the set of alternative queries appear in conjunction with one or more search results from the set of search results; and
sending the search results page over the Internet to the user as an initial search results page that the Internet search result engine sent to the user in response to the query.
11. A non-transitory computer storage medium storing instructions which, when processed by one or more processors, cause:
generating a plurality of navigation trails based on an ordered sequence of navigational activities performed by a plurality of users;
grouping the plurality of navigation trails into a plurality of navigation trail groups based on original queries with which navigation trails in the plurality of navigation trails begin;
for at least a particular navigation trail group of the plurality of navigation trail groups, determining one or more uniform resource locators (URLs) or revised queries that occur in at least a specified proportion of navigation trails in the particular navigation trail group;
generating a search results page based at least in part on the one or more URLs or revised queries that occur in at least a specified proportion of navigation trails in the particular navigation trail group; and
storing the search results page on a computer-readable storage medium;
wherein at least one navigation trail in the particular navigation trail group contains at least one URL or revised query that another navigation trail in the particular navigation trail group does not contain.
12. The non-transitory computer storage medium of claim 11 , wherein generating the plurality of navigation trails comprises:
recording URL of resources that a particular user of the plurality of users selected from a set of search results that an Internet search engine returned to the particular user in response to receiving an original query from the particular user; and
placing the URLs in a particular navigation trail of the plurality of navigation trails;
wherein the particular navigation trail begins with the original query; and
wherein the one or more URLs or revised queries include one or more URLs of the URLs in the particular navigation trail.
13. The non-transitory computer storage medium of claim 11 , wherein generating the plurality of navigation trails comprises:
recording revised queries that a particular user of the plurality of users submitted to an Internet search engine after the Internet search engine received an original query from the particular user; and
placing the revised queries in a particular navigation trail of the plurality of navigation trails;
wherein the particular navigation trail begins with the original query; and
wherein the one or more URLs or revised queries include one or more revised queries of the revised queries in the particular navigation trail.
14. The non-transitory computer storage medium of claim 11 , wherein generating the plurality of navigation trails comprises:
for each search result that a particular user of the plurality of users selected from a set of search results that an Internet search engine returned to the particular user, determining an amount of time that passed in between (a) a moment that the particular user was presented with a resource that corresponds to that search result and (b) a moment that the particular user navigated away from that resource;
determining whether a particular amount of time that passed in between (a) a moment that the particular user was presented with a particular resource that corresponds to a particular search result and (b) a moment that the particular user navigated away from that particular resource is at least as much as a specified threshold; and
in response to determining that the particular amount of time is at least as much as the specified threshold, ending a particular navigation trail of the plurality of navigation trail with a URL of the particular search result.
15. The non-transitory computer storage medium of claim 11 , wherein generating the plurality of navigation trails comprises:
for each search result that a particular user of the plurality of users selected from a set of search results that an Internet search engine returned to the particular user, determining whether user input that expressed the particular user's interest in a resource to which the search result refers was received from the particular user before a moment that the particular user navigated away from that resource;
determining whether particular user input that expressed the particular user's interest in a particular resource to which a particular search result refers was received from the particular user before a moment that the particular user navigated away from that particular resource; and
in response to determining that the particular user input was received from the particular user before the moment that the particular user navigated away from the particular resource, ending a particular navigation trail of the plurality of navigation trail with a URL of the particular search result.
16. The non-transitory computer storage medium of claim 11 , wherein grouping the plurality of navigation trails into a plurality of navigation trail groups comprises:
grouping all navigation trails that begin with a first original query into a first navigation trail group of the plurality of navigation trail groups; and
grouping all navigation trails that begin with a second original query into a second navigation trail group of the plurality of navigation trail groups;
wherein the first original query differs from the second original query.
17. The non-transitory computer storage medium of claim 11 , wherein determining the one or more URLs or revised queries that occur in at least a specified proportion of navigation trails in the particular navigation trail group comprises:
determining whether a particular URL, which corresponds to a particular search result that a user selected from a set of search results on a page returned by an Internet search engine on the search results page, occurs in at least a specified proportion of navigation trails in the particular navigation trail group; and
in response to determining that the particular URL occurs in at least the specified proportion of navigation trails in the particular navigation trail group, including the particular URL within the one or more URLs or revised queries.
18. The non-transitory computer storage medium of claim 11 , wherein determining the one or more URLs or revised queries that occur in at least a specified proportion of navigation trails in the particular navigation trail group comprises:
determining whether a particular revised query, which a user submitted to an Internet search engine after submitting an original query with which each of the navigation trails in the particular navigation trail group begin, occurs in at least a specified proportion of navigation trails in the particular navigation trail group; and
in response to determining that the particular revised query occurs in at least the specified proportion of navigation trails in the particular navigation trail group, including the particular revised query within the one or more URLs or revised queries.
19. The non-transitory computer storage medium of claim 11 , wherein generating the search results page based at least in part on the one or more URLs or revised queries that occur in at least a specified proportion of navigation trails in the particular navigation trail group comprises:
determining a set of search results that are relevant to a query that an Internet search engine received from a user;
ranking search results in the set of search results based on relevance of those search results to the query;
in response to determining that a particular URL is mapped to the query within rank adjustment data that were generated based on the plurality of navigation trails, including, within the set of search results, a particular search result to which the particular URL refers;
generating the search results page in which the particular search result appears more highly ranked than one or more other search results from the set of search results; and
sending the search results page over the Internet to the user as an initial search results page that the Internet search result engine sent to the user in response to the query.
20. The non-transitory computer storage medium of claim 11 , wherein generating the search results page based at least in part on the one or more URLs or revised queries that occur in at least a specified proportion of navigation trails in the particular navigation trail group comprises:
determining a set of search results that are relevant to an original query that an Internet search engine received from a user;
in response to determining that a particular revised query is mapped to the original query within associative query data that were generated based on the plurality of navigation trails, including the particular revised query within a set of alternative queries;
generating the search results page on which the set of alternative queries appear in conjunction with one or more search results from the set of search results; and
sending the search results page over the Internet to the user as an initial search results page that the Internet search result engine sent to the user in response to the query.