Method and system for ranking search results based on category demand normalized using impressions
Described herein are methods and systems for promoting item listings that satisfy a query based on the item listings being assigned to certain categories that have, based on historical click data, exhibited high demand characteristics for the query. Consistent with some embodiments, a certain number of leaf-level categories are identified based on demand data for those categories, and the item listings assigned to those categories are promoted through a normalized weighting factor derived in part based on the click probability score associated with the category, clicks per impression rate, and weighted clicks per impression by ranking rate.
1. A computer-implemented method comprising:
receiving, at a server, a query to identify a set of item listings;
identifying a sub-category for each item listing satisfying the query;
obtaining a click probability score for each identified sub-category;
determining sub-categories from the identified sub-categories with click probability scores exceeding a threshold score common to the identified sub-categories; and
generating, at the server, a search results page with the item listings ordered based in part on the sub-categories with click probability scores exceeding the threshold score common to the identified sub-categories.
2. The computer-implemented method of claim 1 , further comprising:
for each of the determined sub-categories, calculating a category boost score for use in determining the order in which the item listings are to be presented in the search results page;
normalizing the category boost score for one or more determined sub-categories; and
presenting the search results page with the item listings ordered based in part on the normalized category boost score for the sub-category to which each item listing is assigned.
3. The computer-implemented method of claim 1 , wherein normalizing further comprises:
calculating a constant boost score for the one or more determined sub-categories.
4. The computer-implemented method of claim 1 , wherein normalizing further comprises:
determining a respective number of clicks per impression for each sub-category; and
calculating the normalized category boost score of a sub-category based on the respective number of clicks per impression.
5. The computer-implemented method of claim 1 , wherein normalizing further comprises:
determining a weighted impression by rank for each sub-category;
determining a respective weighted number of clicks per impression by rank for each sub-category; and
calculating the normalized category boost score of each sub-category based on the respective weighted number of clicks per impression by rank.
6. The computer-implemented method of claim 1 , wherein the threshold score is derived as a percentage of the click probability score of the sub-category with a highest click probability score.
7. The computer-implemented method of claim 1 , wherein the threshold score is derived by dividing the click probability score of the sub-category with a highest click probability score by one less than the predetermined number.
8. The computer-implemented method of claim 1 , wherein the category boost score for each determined sub-category is derived based in part on the click probability score of each identified sub-category.
9. The computer-implemented method of claim 1 , wherein the item listings are ordered based on a ranking score derived with an algorithm utilizing the category boost score as a factor.
10. The computer-implemented method of claim 1 , wherein obtaining a click probability score for each sub-category to which an item listing satisfying the query has been assigned includes dividing a number of clicks for a particular sub-category by the total number of clicks for all sub-categories to which an item listing satisfying the query has been assigned.
11. A system for an item listing presentation management, the system comprising:
at least one processor comprising:
a listing identifier module configured to process a query to identify a set of item listings, each item listing associated with an item or service being offered and assigned to a sub-category, and to identify a sub-category for each item listing satisfying the query;
a probability score module configured to obtain for the query a click probability score for each sub-category to which an item listing satisfying the query has been assigned, and
identifying up to a predetermined number of sub-categories from all sub-categories from the set of item listings identified with the query with click probability scores exceeding a threshold score common to all sub-categories; and
a listing generator module configured to generate a search results page with the item listings ordered based in part on the sub-categories with click probability scores exceeding the threshold score common to the identified sub-categories.
12. The system of claim 11 , further comprising:
a category boost module configured to calculate a category boost score, for each of the identified sub-categories, for use in determining the order in which the item listings are to be presented in the search results page;
a normalizing module configured to normalize the category boost score for one or more identified sub-categories; and
a listing generator module configured to present a search results page with the item listings ordered based in part on the normalized category boost score for the sub-category to which each item listing is assigned.
13. The system of claim 11 , wherein the normalizing module comprises:
a constant boost module configured to calculate a constant boost score for the one or more identified sub-categories.
14. The system of claim 11 , wherein the normalizing module comprises:
a click through rate module configured to determine a respective number of clicks per impression for each sub-category, and to calculate the normalized category boost score of a sub-category based on the respective number of clicks per impression.
15. The system of claim 11 , wherein the normalizing module comprises:
a weight click through rate by rank module configured to determine a weighted impression by rank for each sub-category, to determine a respective weighted number of clicks per impression by rank for each sub-category, and to calculate the normalized category boost score of each sub-category based on the respective weighted number of clicks per impression by rank.
16. The system of claim 11 , wherein the item listing presentation management module is to derive the threshold score as a percentage of the click probability score of the sub-category with a highest click probability score.
17. The system of claim 11 , wherein the item listing presentation management module is to derive the threshold score by dividing the click probability score of the sub-category with a highest click probability score by one less than the predetermined number.
18. The system of claim 11 , wherein the click probability score for each category represents a probability, for a particular query, that an item listing assigned to the category will be selected from a search results page, the click probability score for each category derived based on analysis of historical click data.
19. The system of claim 11 , wherein obtaining a click probability score for each sub-category to which an item listing satisfying the query has been assigned includes dividing a number of clicks for a particular sub-category by the total number of clicks for all sub-categories to which an item listing satisfying the query has been assigned.
20. A non-transitory computer-readable storage medium storing a set of instructions that, when executed by a processor, cause the processor to perform operations, comprising:
receiving, at a server, a query to identify a set of item listings;
identifying a sub-category for each item listing satisfying the query;
obtaining a click probability score for each identified sub-category;
determining sub-categories from the identified sub-categories with click probability scores exceeding a threshold score common to the identified sub-categories; and
generating, at the server, a search results page with the item listings ordered based in part on the sub-categories with click probability scores exceeding the threshold score common to the identified sub-categories.