IP Library Granted Patent US 7,698,331
Granted Patent B2
US 7,698,331 · App. 11/334,096 · Granted Apr 13, 2010

Matching and ranking of sponsored search listings incorporating web search technology and web content

Assignee: Yahoo! Inc.
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 7,698,331
App. No.
11/334,096
Granted
Apr 13, 2010
Kind
B2
Abstract

A system is disclosed for generating a search result list in response to a search request from a searcher using a computer network. A first database is maintained that includes a first plurality of search listings. A second database is maintained that includes documents having general web content. A search request is received from the searcher. A first set of search listings is identified from the first database having documents generating a match with the search request and a second set of search listings is identified from the second database having documents generating a match with the search request. A confidence score is determined for each listing from the first set of search listings wherein the confidence score is determined in accordance with a relevance of each listing when compared to the listings of the second set of search listings. The identified search listings from the first set of search listing are ordered in accordance, at least in part, with the confidence score for each search listing.

Claims (64)

1. A method of generating a search result list in response to a search query from a searcher using a computer network, the method executed with a computer having a processor, the method comprising:

(a) maintaining a first database including a first plurality of search listings comprising sponsored search listings having a sponsored content;

(b) maintaining a second database including documents having a general web content;

(c) receiving, by the processor, a search query from the searcher;

(d) identifying, by the processor, from the first database a first set of search listings comprising sponsored search listings having documents generating a match with the search query, and from the second database a second set of search listings comprising general web listings having documents generating a match with the same search query as used to identify the sponsored first set of search listings;

(e) determining, by the processor, a confidence score for each listing from the first set of search listings, wherein the confidence score is determined in accordance with a relevance of each listing when compared to the listings of the second set of search listings after execution of step (d);

(f) ranking, by the processor, the sponsored first set of search listings in accordance, at least in part, with the confidence score for each search listing thereof,

wherein the processor associates the sponsored first set of search listings with at least one feature different than the relevance of each search listing when compared to the listings of the second set of search listings, and the processor further orders the sponsored first set of search listings in accordance with the at least one feature, the at least one feature comprising any of a number of clicks, a click-through rate, and a conversion rate derived from historical click-through and conversion data from user activity on the sponsored first set of search listings;

(g) computing a plurality of demotion terms related to a plurality of the top-ranked sponsored first set of search listings, wherein the demotion terms capture non-ideal characteristics thereof;

(h) updating the confidence score of each of the top-ranked sponsored first set of search listings based on the plurality of demotion terms; and

(i) re-ranking the top-ranked sponsored first set of search listings according to the updated confidence scores.

2. The method of claim 1 , wherein each search listing is associated with one or more search terms.

3. The method of claim 2 , wherein at least one of the one or more search terms associated with at least one search listing is automatically generated based on information located at a first address associated with the at least one search listing.

4. The method of claim 1 , further comprising:

modifying the query before identifying the first and second sets of search listings in step (d).

5. The method of claim 1 , wherein each listing from the first set of search listings is associated with a first set of attributes, each attribute of the first set of attributes associated with an attribute weight, and wherein the confidence score is determined by weighting at least one attribute for each listing with the associated attribute weight.

6. The method of claim 5 , wherein the searcher is associated with a geographical region, and wherein the confidence score is determined by weighting at least one attribute for each listing with a second set of attribute weights associated with the geographical region.

7. The method of claim 1 , comprising discarding at least one of the sponsored first set of search listings in accordance with a list of negative keywords.

8. The method of claim 1 , wherein the confidence scores are determined using a machine-learning method.

9. A server for generating a search result list in response to a search query from a searcher using a computer network, comprising:

(a) a memory for use in storing data and instructions; and

(b) a processor in communication with the memory and for enabling actions based on the stored instructions, the stored instructions including instructions for:

(i) communicating with a first database, the first database including a first plurality of search listings comprising sponsored search listings having a sponsored content;

(ii) communicating with a second database, the second database including documents having a general web content;

(iii) receiving a search query from the searcher;

(iv) identifying from the first database a first set of search listings comprising sponsored search listings having documents generating a match with the search query, and from the second database a second set of search listings comprising general web listings having documents generating a match with the same search query as used to identify the sponsored first set of search listings;

(v) determining a confidence score for each listing from the first set of search listings, wherein the confidence score is determined in accordance with a relevance of each listing when compared to the listings of the second set of search listings after execution of step (b)(iv); and

(vi) ordering the identified sponsored first set of search listings in accordance, at least in part, with the confidence score for each search listing thereof,

wherein the sponsored first set of search listings are associated with at least one feature different than the relevance of each search listing when compared to the listings of the second set of search listings, and the sponsored first set of search listings are further ordered in accordance with the at least one feature, the at least one feature comprising any of a number of clicks, a click-through rate, and a conversion rate derived from historical click-through and conversion data from user activity on the sponsored first set of search listings;

(vii) computing a plurality of demotion terms related to a plurality of the top-ranked sponsored first set of search listings, wherein the demotion terms capture non-ideal characteristics thereof;

(viii) updating the confidence score of each of the top-ranked sponsored first set of search listings based on the plurality of demotion terms; and

(ix) re-ranking the top-ranked sponsored first set of search listings according to the updated confidence scores.

10. The server of claim 9 , wherein the stored instructions further comprise instructions for

modifying the search query in a first manner for identifying the first set of search listings; and

modifying the search query in a second manner for identifying the second set of search listings.

11. The server of claim 10 , wherein each listing from the first set of search listings is associated with a first set of attributes, each attribute of the first set of attributes associated with an attribute weight, and wherein the confidence score is determined by weighting at least one attribute for each listing with the associated attribute weight.

12. The server of claim 9 , wherein the stored instructions further comprise instructions for:

storing the second set of search listings; and

updating, automatically, the second set of search listings after a predetermined period of time.

13. The server of claim 9 , wherein the first database is maintained by a first entity and the second database is maintained by a second, specific entity.

14. The server of claim 9 , wherein the processor executes instructions to discard at least one of the sponsored first set of search listings in accordance with a list of negative keywords.

15. The server of claim 9 , wherein each search listing is associated with one or more search terms.

16. A processor-readable medium having processor-executable code thereon for enabling and performing operations to generate a search result list in response to a search query from a searcher using a computer network, the operations comprising:

(a) maintaining a first database including a first plurality of search listings comprising sponsored search listings having a sponsored content;

(b) maintaining a second database including documents having a general web content;

(c) receiving a search query from the searcher;

(d) identifying from the first database a first set of search listings comprising sponsored search listings having documents generating a match with the search query, and from the second database a second set of search listings comprising general web listings having documents generating a match with the same search query as used to identify the sponsored first set of search listings;

(e) determining a confidence score for each listing from the first set of search listings wherein the confidence score is determined in accordance with a relevance of each listing when compared to the listings of the second set of search listings after execution of step (d); and

(f) ordering the sponsored first set of search listings in accordance, at least in part, with the confidence score for each search listing thereof,

wherein the sponsored first set of search listings are associated with at least one feature different than the relevance of each search listing when compared to the listings of the second set of search listings, and the sponsored first set of search listings are further ordered in accordance with the at least one feature, the at least one feature comprising any of a number of clicks, a click-through rate, and a conversion rate derived from historical click-through and conversion data from user activity on the sponsored first set of search listings;

(g) computing a plurality of demotion terms related to a plurality of the top-ranked sponsored first set of search listings, wherein the demotion terms capture non-ideal characteristics thereof;

(h) updating the confidence score of each of the top-ranked sponsored first set of search listings based on the plurality of demotion terms; and

(i) re-ranking the top-ranked sponsored first set of search listings according to the updated confidence scores.

17. The processor-readable medium of claim 16 , wherein the identified search listings are further ordered in accordance with a list of trademark keywords.

18. The processor-readable medium of claim 16 , wherein the at least one feature is selected from the group consisting of whether a match occurred in an abstract, whether a match occurred in a display host, whether a match occurred in an algorithmically generated keyword, and whether a match occurred in an algorithmically generated summary.

19. The processor-readable medium of claim 16 , wherein each search listing may be associated with one or more search terms.

20. The method of claim 1 , further comprising:

optimizing placement of the search listings on a location of a search results page based on the confidence score, wherein the location comprises a top, a side, or a bottom of the search results page.

21. The method of claim 1 , wherein the at least one feature further comprises a rank among a sorted set of top search listings of the sponsored first set of search listings from a combination of the sponsored first set of search listings and the second set of search listings.

22. The server of claim 10 , wherein the first manner comprises giving query terms of the search query different weights for different search providers.

23. The server of claim 9 , wherein the at least one feature further comprises a rank among a sorted set of top search listings of the sponsored first set of search listings from a combination of the identified search listings and the second set of search listings.

24. The method of claim 1 , wherein the demotion terms comprise demotion metrics computed for: (i) a document section consisting of an abstract, a bidded term, or a list of key topics, or (ii) for whether or not the listing has been editorially reviewed.

25. The method of claim 1 , wherein the at least one feature further comprises whether the search query appears in any of: a display host, an algorithmically generated keyword or summary, or a combination thereof.

26. The method of claim 9 , wherein the at least one feature further comprises whether the search query appears in at least one of: a display host, an algorithmically generated keyword or summary, or a combination thereof.

Assignments (10)
CORRECTIVE ASSIGNMENT TO CORRECT THE THE ASSIGNOR NAME PREVIOUSLY RECORDED AT REEL: 052853 FRAME: 0153. ASSIGNOR(S) HEREBY CONFIRMS THE ASSIGNMENT. Recorded Mar 29, 2021
From: R2 SOLUTIONS LLC
To: STARBOARD VALUE INTERMEDIATE FUND LP, AS COLLATERAL AGENT
Reel/Frame 056832/0001 →
CORRECTIVE ASSIGNMENT TO CORRECT THE ASSIGNEE NAME PREVIOUSLY RECORDED ON REEL 053654 FRAME 0254. ASSIGNOR(S) HEREBY CONFIRMS THE RELEASE OF SECURITY INTEREST GRANTED PURSUANT TO THE PATENT SECURITY AGREEMENT PREVIOUSLY RECORDED. Recorded Dec 30, 2020
From: STARBOARD VALUE INTERMEDIATE FUND LP
To: R2 SOLUTIONS LLC
Reel/Frame 054981/0377 →
RELEASE OF SECURITY INTEREST IN PATENTS Recorded Jul 8, 2020
From: STARBOARD VALUE INTERMEDIATE FUND LP
To: ACACIA RESEARCH GROUP LLC; AMERICAN VEHICULAR SCIENCES LLC; BONUTTI SKELETAL INNOVATIONS LLC; CELLULAR COMMUNICATIONS EQUIPMENT LLC; INNOVATIVE DISPLAY TECHNOLOGIES LLC; LIFEPORT SCIENCES LLC; LIMESTONE MEMORY SYSTEMS LLC; MOBILE ENHANCEMENT SOLUTIONS LLC; MONARCH NETWORKING SOLUTIONS LLC; NEXUS DISPLAY TECHNOLOGIES LLC; PARTHENON UNIFIED MEMORY ARCHITECTURE LLC; R2 SOLUTIONS LLC; SAINT LAWRENCE COMMUNICATIONS LLC; STINGRAY IP SOLUTIONS LLC; SUPER INTERCONNECT TECHNOLOGIES LLC; TELECONFERENCE SYSTEMS LLC; UNIFICATION TECHNOLOGIES LLC
Reel/Frame 053654/0254 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 25, 2020
From: EXCALIBUR IP, LLC
To: R2 SOLUTIONS LLC
Reel/Frame 053459/0059 →
PATENT SECURITY AGREEMENT Recorded Jun 5, 2020
From: ACACIA RESEARCH GROUP LLC; AMERICAN VEHICULAR SCIENCES LLC; BONUTTI SKELETAL INNOVATIONS LLC; CELLULAR COMMUNICATIONS EQUIPMENT LLC; INNOVATIVE DISPLAY TECHNOLOGIES LLC; LIFEPORT SCIENCES LLC; LIMESTONE MEMORY SYSTEMS LLC; MERTON ACQUISITION HOLDCO LLC; MOBILE ENHANCEMENT SOLUTIONS LLC; MONARCH NETWORKING SOLUTIONS LLC; NEXUS DISPLAY TECHNOLOGIES LLC; PARTHENON UNIFIED MEMORY ARCHITECTURE LLC; R2 SOLUTIONS LLC; SAINT LAWRENCE COMMUNICATIONS LLC; STINGRAY IP SOLUTIONS LLC; SUPER INTERCONNECT TECHNOLOGIES LLC; TELECONFERENCE SYSTEMS LLC; UNIFICATION TECHNOLOGIES LLC
To: STARBOARD VALUE INTERMEDIATE FUND LP, AS COLLATERAL AGENT
Reel/Frame 052853/0153 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 3, 2016
From: YAHOO! INC.
To: EXCALIBUR IP, LLC
Reel/Frame 038950/0592 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 1, 2016
From: EXCALIBUR IP, LLC
To: YAHOO! INC.
Reel/Frame 038951/0295 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 18, 2016
From: YAHOO! INC.
To: EXCALIBUR IP, LLC
Reel/Frame 038383/0466 →
CORRECTIVE ASSIGNMENT TO CORRECT THE NAME OF ASSIGNOR MARVEY NEMENMAN ON THE RECORDATION COVER SHEET, WHICH SHOULD BE MATVEY NEMENMAN, PREVIOUSLY RECORDED ON REEL 017484 FRAME 0479. ASSIGNOR(S) HEREBY CONFIRMS THE ASSIGNMENT OF U.S. APPLICATION NO. 11/334,096 TO YAHOO! INC.. Recorded Jun 4, 2009
From: CARSON, CHARLES C., JR.; CHAWLA, DEVIKA; HARVEY, JAMES B.; NEMENMAN, MATVEY; SABHARWAL, MOHIT; ZAGHA, MARCO J.
To: YAHOO! INC.
Reel/Frame 022780/0169 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 18, 2006
From: CARSON JR., CHARLES C.; CHAWLA, DEVIKA; HARVEY, JAMES B.; NEMENMAN, MARVEY; SABHARWAL, MOHIT; ZAGHA, MARCO J.
To: YAHOO! INC.
Reel/Frame 017484/0479 →
Continuity (2)
Provisional Application 6064505400 · Jan 18, 2005
Related Publication 20060161534A1 · Jul 20, 2006