Watch time based ranking
View Patent ↗Methods, systems, and apparatus, including computer programs encoded on computer storage media, for ranking search results. One of the methods includes identifying one or more sessions for a query and associating watch times of the respective resources watched in the sessions with the query. One or more watch time signals are calculated for a first resource and the query based on the watch times associated with the query. A first search result responsive to the query is obtained, wherein the first search result identifies the first resource and has an associated score S. A new score S′ is calculated based on a least S and a watch time function, the watch time function being a function of the one or more watch time signals. The new score S′ is provided to a process for ranking search results including the first search result.
1. A computer-implemented method comprising:
identifying one or more sessions for a query, each session comprising a chain of respective resources linked to each other and watched by a respective user, each session beginning with a first resource that was identified by a first search result responsive to the query and linked to one or more second resources, wherein each second resource was associated with a different resource in the session by a respective link, and wherein the user visited each second resource by following the links;
associating a total of watch times of the respective resources watched in the sessions with the query;
calculating one or more watch time signals for the first resource and the query based on the total of watch times associated with the query;
after the one or more sessions have ended:
receiving the query from a user;
obtaining a search result responsive to the query, wherein the search result identifies the first resource and has an associated score S;
calculating an updated score S′ based on at least S and a watch time function, the watch time function being a function of the one or more watch time signals; and
providing the updated score S′ to a process for ranking search results including the search result.
2. The method of claim 1 , wherein each respective link is a reference to a respective suggested resource.
3. The method of claim 1 , wherein resources in a session comprise video content, and wherein a watch time of a resource is a length of time that a user spent watching the video content.
4. The method of claim 3 , further comprising:
computing a total of watch times for the session using pings received during the session, wherein each ping identifies a point in video content that a user has reached.
5. The method of claim 1 , wherein the watch time function is given by:
S′=S×M Q,D i ,
wherein M Q,D i is a watch time multiplier computed from the one or more watch time signals for the query and the first resource.
6. The method of claim 5 , wherein the one or more watch time signals for the first resource include two or more watch time signals, and the watch time multiplier is based on a product of two or more of the watch time signals for the first resource.
7. The method of claim 1 , wherein one of the one or more watch time signals is a document-query fraction score that is based on a portion of a total k of the watch times associated with the query that are attributable to the first resource.
8. The method of claim 1 , wherein one of the one or more watch time signals is a relative document performance score that is based on ratio of (1) an average session watch time for the first resource in the sessions of the query, to (2) an average session watch time for all resources in the sessions of the query.
9. The method of claim 1 , wherein one of the one or more watch time signals is a clicks per impression score that is based on a ratio of (1) a number of times the first resource in the sessions of the query was selected as a search result to (2) a number of impressions for the first resource in the sessions of the query.
10. The method of claim 1 , wherein one of the one or more watch time signals is a watch time per watch score that is based on an average session watch time for the first resource in viewing sessions of the query.
11. A system comprising:
one or more computers and one or more storage devices storing instructions that are operable, when executed by the one or more computers, to cause the one or more computers to perform operations comprising:
identifying, by a processor of a computer in the one or more computers, one or more sessions for a query, each session comprising a chain of respective resources and linked to each other and watched by a respective user, each session beginning with a first resource that was identified by a first search result responsive to the query linked to one or more second resources, wherein each second resource was associated with a different resource in the session by a respective link, and wherein the user visited each second resource by following the links;
associating a total of watch times of the respective resources watched in the sessions with the query;
calculating one or more watch time signals for the first resource and the query based on the total of watch times associated with the query;
after the one or more sessions have ended:
receiving the query from a user;
obtaining a search result responsive to the query, wherein the search result identifies the first resource and has an associated score S;
calculating an updated score S′ based on at least S and a watch time function, the watch time function being a function of the one or more watch time signals; and
providing the updated score S′ to a process for ranking search results including the first search result.
12. The system of claim 11 , wherein each respective link is a reference to a respective suggested resource.
13. The system of claim 11 , wherein resources in a session comprise video content, and wherein a watch time of a resource is a length of time that a user spent watching the video content.
14. The system of claim 13 , wherein the operations further comprise:
computing a total of watch times for the session using pings received during the session, wherein each ping identifies a point in video content that a user has reached.
15. The system of claim 11 , wherein the watch time function is given by:
S′=S×M Q,D i ,
wherein M Q,D i is a watch time multiplier computed from the one or more watch time signals for the query and the first resource.
16. The system of claim 15 , wherein the one or more watch time signals for the first resource include two or more watch time signals, and the watch time multiplier is based on a product of two or more of the watch time signals for the first resource.
17. The system of claim 11 , wherein one of the one or more watch time signals is a document-query fraction score that is based on a portion of a total k of the watch times associated with the query that are attributable to the first resource.
18. The system of claim 11 , wherein one of the one or more watch time signals is a relative document performance score that is based on ratio of (1) an average session watch time for the first resource in the sessions of the query, to (2) an average session watch time for all resources in the sessions of the query.
19. The system of claim 11 , wherein one of the one or more watch time signals is a clicks per impression score that is based on a ratio of (1) a number of times the first resource in the sessions of the query was selected as a search result to (2) a number of impressions for the first resource in the sessions of the query.
20. The system of claim 11 , wherein one of the one or more watch time signals is a watch time per watch score that is based on an average session watch time for the first resource in viewing sessions of the query.