IP Library Granted Patent US 8,738,436
Granted Patent B2
US 8,738,436 · App. 12/241,815 · Granted May 27, 2014

Click through rate prediction system and method

Inventors: Looja Tuladhar (Sunnyvale, CA); Manish Satyapal Gupta (Bangalore Karnataka, IN)
Assignee: Yahoo! Inc.
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 8,738,436
App. No.
12/241,815
Granted
May 27, 2014
Kind
B2
Abstract

A computer implemented method comprises analyzing a plurality of attributes of a sample of online documents using a boosted decision tree and generating a model from it. The model is used to predict a click through rate (CTR) of an additional online document based on the analyzing. The predicted CTR is output to a display device, storage medium or network.

Claims (36)

1. A computer implemented method comprising:

analyzing a plurality of attributes of a sample of online documents using a boosted decision tree and generating a machine learning model therefrom;

using the machine learning model to predict a click through rate (CTR) of an additional online document based on the analyzing;

outputting the predicted CTR to a display device, storage medium or network,

wherein the plurality of attributes include a CTR of other documents having titles that are the same as or similar to a title of the additional online document;

determining similarity of any two documents by cardinality of a difference set that includes non-overlapping terms included in the title of one of the two documents but not included in the title of the other of the two documents;

using the machine learning model to predict respective CTR of a plurality of additional online documents based on the analyzing; and

ranking the plurality of additional online documents by using the respective predicted CTR of each of the plurality of additional online documents as an input factor.

2. The method of claim 1 , further comprising:

rendering the additional online documents or portions thereof for display in order of their respective rankings.

3. The method of claim 1 , wherein the additional online document is one of the group consisting of an advertisement, a response to a search query, a photograph, a movie, an image, an audio clip, a video clip and a commercial document product.

4. The method of claim 1 , wherein the plurality of attributes include at least one of the group consisting of CTR of other documents by the same author as the additional online document, CTR of other documents published by the same publisher of the additional online document, and CTR of other documents having the same type as the additional online document.

5. The method of claim 1 , wherein the plurality of attributes includes a measure indicating an amount of spam feedback received relating to the document.

6. A system comprising:

a machine readable storage medium storing a sample of online documents; and

a processor configured to analyze a plurality of attributes of the sample of online documents using a boosted decision tree and generating a model therefrom;

the processor configured to use the model to predict a click through rate (CTR) of an additional online document based on the analyzing;

the processor configured to output the predicted CTR to a display device, storage medium or network,

wherein the plurality of attributes include a CTR of other documents having titles that are the same as or similar to a title of the additional online document;

the processor configured to determine similarity of any two documents by cardinality of a difference set that includes non-overlapping terms included in the title of one of the two documents but not included in the title of the other of the two documents;

the processor configured to use the model to predict respective CTR of a plurality of additional online documents based on the analyzing; and

the processor configured to rank the plurality of additional online documents by using the respective predicted CTR of each of the plurality of additional online documents as an input factor.

7. The system of claim 6 , wherein:

the processor is configured to render the additional online documents or portions thereof for display in order of their respective rankings.

8. The system of claim 6 , wherein the plurality of attributes include at least one of the group consisting of CTR of other documents by the same author as the additional online document, CTR of other documents published by the same publisher of the additional online document, and CTR of other documents having the same type as the additional online document.

9. A machine readable storage medium encoded with computer program code, wherein when the computer program code is executed by a processor, the processor performs a machine implemented method comprising the steps of:

analyzing a plurality of attributes of a sample of online documents using a boosted decision tree and generating a model therefrom;

using the model to predict a click through rate (CTR) of an additional online document based on the analyzing;

outputting the predicted CTR to a display device, storage medium or network,

wherein the plurality of attributes include a CTR of other documents having titles that are the same as or similar to a title of the additional online document;

determining similarity of any two documents by cardinality of a difference set that includes non-overlapping terms included in the title of one of the two documents but not included in the title of the other of the two documents;

using the model to predict respective CTR of a plurality of additional online documents based on the analyzing; and

ranking the plurality of additional online documents by using the respective predicted CTR of each of the plurality of additional online documents as an input factor.

10. The machine readable storage medium of claim 9 , further comprising:

rendering the additional online documents or portions thereof for display in order of their respective rankings.

11. The machine readable storage medium of claim 9 , wherein the plurality of attributes include at least one of the group consisting of CTR of other documents by the same author as the additional online document, CTR of other documents published by the same publisher of the additional online document, and CTR of other documents having the same type as the additional online document.

Assignments (9)
CORRECTIVE ASSIGNMENT TO CORRECT THE THE ASSIGNOR NAME PREVIOUSLY RECORDED AT REEL: 052853 FRAME: 0153. ASSIGNOR(S) HEREBY CONFIRMS THE ASSIGNMENT. Recorded Mar 29, 2021
From: R2 SOLUTIONS LLC
To: STARBOARD VALUE INTERMEDIATE FUND LP, AS COLLATERAL AGENT
Reel/Frame 056832/0001 →
CORRECTIVE ASSIGNMENT TO CORRECT THE ASSIGNEE NAME PREVIOUSLY RECORDED ON REEL 053654 FRAME 0254. ASSIGNOR(S) HEREBY CONFIRMS THE RELEASE OF SECURITY INTEREST GRANTED PURSUANT TO THE PATENT SECURITY AGREEMENT PREVIOUSLY RECORDED. Recorded Dec 30, 2020
From: STARBOARD VALUE INTERMEDIATE FUND LP
To: R2 SOLUTIONS LLC
Reel/Frame 054981/0377 →
RELEASE OF SECURITY INTEREST IN PATENTS Recorded Jul 8, 2020
From: STARBOARD VALUE INTERMEDIATE FUND LP
To: ACACIA RESEARCH GROUP LLC; AMERICAN VEHICULAR SCIENCES LLC; BONUTTI SKELETAL INNOVATIONS LLC; CELLULAR COMMUNICATIONS EQUIPMENT LLC; INNOVATIVE DISPLAY TECHNOLOGIES LLC; LIFEPORT SCIENCES LLC; LIMESTONE MEMORY SYSTEMS LLC; MOBILE ENHANCEMENT SOLUTIONS LLC; MONARCH NETWORKING SOLUTIONS LLC; NEXUS DISPLAY TECHNOLOGIES LLC; PARTHENON UNIFIED MEMORY ARCHITECTURE LLC; R2 SOLUTIONS LLC; SAINT LAWRENCE COMMUNICATIONS LLC; STINGRAY IP SOLUTIONS LLC; SUPER INTERCONNECT TECHNOLOGIES LLC; TELECONFERENCE SYSTEMS LLC; UNIFICATION TECHNOLOGIES LLC
Reel/Frame 053654/0254 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 25, 2020
From: EXCALIBUR IP, LLC
To: R2 SOLUTIONS LLC
Reel/Frame 053459/0059 →
PATENT SECURITY AGREEMENT Recorded Jun 5, 2020
From: ACACIA RESEARCH GROUP LLC; AMERICAN VEHICULAR SCIENCES LLC; BONUTTI SKELETAL INNOVATIONS LLC; CELLULAR COMMUNICATIONS EQUIPMENT LLC; INNOVATIVE DISPLAY TECHNOLOGIES LLC; LIFEPORT SCIENCES LLC; LIMESTONE MEMORY SYSTEMS LLC; MERTON ACQUISITION HOLDCO LLC; MOBILE ENHANCEMENT SOLUTIONS LLC; MONARCH NETWORKING SOLUTIONS LLC; NEXUS DISPLAY TECHNOLOGIES LLC; PARTHENON UNIFIED MEMORY ARCHITECTURE LLC; R2 SOLUTIONS LLC; SAINT LAWRENCE COMMUNICATIONS LLC; STINGRAY IP SOLUTIONS LLC; SUPER INTERCONNECT TECHNOLOGIES LLC; TELECONFERENCE SYSTEMS LLC; UNIFICATION TECHNOLOGIES LLC
To: STARBOARD VALUE INTERMEDIATE FUND LP, AS COLLATERAL AGENT
Reel/Frame 052853/0153 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 3, 2016
From: YAHOO! INC.
To: EXCALIBUR IP, LLC
Reel/Frame 038950/0592 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 1, 2016
From: EXCALIBUR IP, LLC
To: YAHOO! INC.
Reel/Frame 038951/0295 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 18, 2016
From: YAHOO! INC.
To: EXCALIBUR IP, LLC
Reel/Frame 038383/0466 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 30, 2008
From: TULADHAR, LOOJA; GUPTA, MANISH SATYAPAL
To: YAHOO! INC.
Reel/Frame 021627/0798 →
Continuity (1)
Related Publication 20100082421A1 · Apr 1, 2010