Time based ranking
View Patent ↗Apparatus, systems and methods for content ranking are disclosed. Historical click-through rates of first and second content items for a query are determined from an analysis of click logs and query logs. Temporal changes in the historical click-through rate of the first and second content items are identified. The rankings of the first and second content items are adjusted based on the temporal change.
1. A method comprising:
determining historical click-through rates over a plurality of time periods for a first search result responsive to a query and for a second search result responsive to the query wherein the first and second search results refer to different respective web pages;
calculating click-fractions for one or more of the plurality of time periods based on the determined historical click-through rates of the first and second search results;
determining that a particular click-fraction of the calculated click-fractions in a first time period of the plurality of time periods exceeds a minimum change threshold;
receiving the query from a user during a second time period that chronologically follows the plurality of time periods;
obtaining search results responsive to the query;
adjusting a ranking of the first search result in the obtained search results during the second time period; and
providing the search results including the adjusted ranking of the first search result to the user.
2. The method of claim 1 , wherein the adjustment of the ranking of the first search result is in proportion to a magnitude of a change of the historical click-through rate of the first search result relative to a change of the historical click-through rate of the second search result during the first time period.
3. The method of claim 1 , further comprising:
identifying a keyword related to the first search result; and
adding the keyword to the query when the query is submitted to a search engine during the second time period.
4. The method of claim 1 , wherein the determined historical click-through rates are for a first geographic region.
5. The method of claim 4 , wherein adjusting the ranking of the first search result further comprises determining that a region from which the query is received is the first geographic region.
6. The method of claim 1 , wherein a click-fraction of the calculated click fractions is a ratio of the determined historical click-through rate of the first search result in the time period to the determined historical click-through rate of the second search result in the time period.
7. The method of claim 1 , wherein the first time period and the second time period are corresponding periods based on a lunar calendar or a Gregorian calendar.
8. The method of claim 1 , wherein the first time period and the second time period are each a same day of a week, same days of a week, same annual holidays, same weeks of a month, same weeks of a year, same biweekly periods of a year, same months of a year, or same seasons of a year.
9. The method of claim 1 , wherein the minimum change threshold is a standard deviation of the calculated click-fractions.
10. The method of claim 1 , wherein the obtained search results include the first search result.
11. A system comprising at least one:
data processing apparatus programmed to perform operations comprising:
determining historical click-through rates over a plurality of time periods for a first search result responsive to a query and for a second search result responsive to the query wherein the first and second search results refer to different respective web pages;
calculating click-fractions for one or more of the plurality of time periods based on the determined historical click-through rates of the first and second search results;
determining that a particular click-fraction of the calculated click-fractions in a first time period of the plurality of time periods exceeds a minimum change threshold;
receiving the query from a user during a second time period that chronologically follows the plurality of time periods;
obtaining search results responsive to the query;
adjusting a ranking of the first search result in the obtained search results during the second time period; and
providing the search results including the adjusted ranking of the first search result to the user.
12. The system of claim 11 , wherein the adjustment of the ranking of the first search result is in proportion to a magnitude of a change of the historical click-through rate of the first search result relative to a change of the historical click-through rate of the second search result during the first time period.
13. The system of claim 11 , wherein the operations further comprise:
identifying a keyword related to the first search result; and
adding the keyword to the query when the query is submitted to a search engine during the second time period.
14. The system of claim 11 , wherein the determined historical click-through rates are for a first geographic region.
15. The system of claim 14 , wherein adjusting the ranking of the first search result further comprises determining that a region from which the query is received is the first geographic region.
16. The system of claim 11 , wherein a click-fraction of the calculated click fractions is a ratio of the determined historical click-through rate of the first search result in the time period to the determined historical click-through rate of the second search result in the time period.
17. The system of claim 11 , wherein the first time period and the second time period are corresponding periods based on a lunar calendar or a Gregorian calendar.
18. The system of claim 11 , wherein the first time period and the second time period are each a same day of a week, same days of a week, same annual holidays, same weeks of a month, same weeks of a year, same biweekly periods of a year, same months of a year, or same seasons of a year.
19. The system of claim 11 , wherein the minimum change threshold is a standard deviation of the calculated click-fractions.
20. The system of claim 11 , wherein the obtained search results include the first search result.
21. A non-transitory machine-readable storage device having instructions stored thereon which, when executed by at least one data processing apparatus, cause the at least one data processing apparatus to perform operations comprising:
determining historical click-through rates over a plurality of time periods for a first search result responsive to a query and for a second search result responsive to the query wherein the first and second search results refer to different respective web pages;
calculating click-fractions for one or more of the plurality of time periods based on the determined historical click-through rates of the first and second search results;
determining that a particular click-fraction of the calculated click-fractions in a first time period of the plurality of time periods exceeds a minimum change threshold;
receiving the query from a user during a second time period that chronologically follows the plurality of time periods;
obtaining search results responsive to the query;
adjusting a ranking of the first search result in the obtained search results during the second time period; and
providing the search results including the adjusted ranking of the first search result to the user.
22. The storage device of claim 21 , wherein the adjustment of the ranking of the first search result is in proportion to a magnitude of a change of the historical click-through rate of the first search result relative to a change of the historical click-through rate of the second search result during the first time period.
23. The storage device of claim 21 , wherein the operations further comprise:
identifying a keyword related to the first search result; and
adding the keyword to the query when the query is submitted to a search engine during the second time period.
24. The storage device of claim 21 , wherein the determined historical click-through rates are for a first geographic region.
25. The storage device of claim 24 , wherein adjusting the ranking of the first search result further comprises determining that a region from which the query is received is the first geographic region.
26. The storage device of claim 21 , wherein a click-fraction of the calculated click fractions is a ratio of the determined historical click-through rate of the first search result in the time period to the determined historical click-through rate of the second search result in the time period.
27. The storage device of claim 21 , wherein the first time period and the second time period are corresponding periods based on a lunar calendar or a Gregorian calendar.
28. The storage device of claim 21 , wherein the first time period and the second time period are each a same day of a week, same days of a week, same annual holidays, same weeks of a month, same weeks of a year, same biweekly periods of a year, same months of a year, or same seasons of a year.
29. The storage device of claim 21 , wherein the minimum change threshold is a standard deviation of the calculated click-fractions.
30. The storage device of claim 21 , wherein the obtained search results include the first search result.