Systems and methods for improved web searching
Systems and methods are provided for improved web searching. In one implementation, suggested search queries are provided based on previous search queries and click data. A weighted bi-partite graph or index may be used to identify related search queries based on overlapping clicked URLs. According to a method, query-click log data of a search engine is processed to generate sets of suggested search queries, data corresponding to each suggested search query, and a set of clicked URLs related to each suggested search query. Additionally, or independently, methods may be provided for contextually correcting spelling errors within sets of suggested search queries using e contextual algorithm, and/or identifying and discarding sets of suggested search queries and URLs that lead to restricted material, such as restricted content and related URLs.
1. A computer-implemented method for filtering restricted content, the method comprising the following operations performed by one or more processors:
retrieving an in-string black list and an in-string white list of search queries;
receiving a user search query string;
comparing a character substring of the received user search query string against the in-string black list to determine if the character substring of the received user search query string matches at least one listing in the in-string black list;
marking the received user search query string as potentially blocked if the character substring is determined to match the at least one listing in the in-string black list;
matching the character substring of the potentially blocked received user search query string against each entry of the in-string white list;
determining that the character substring of the potentially blocked received user search query string does not exactly match a listing in the in-string white list; and
as a result of determining that the character substring of the potentially blocked received user search query string does not exactly match a listing in the in-string white list, adding the received user search query string to the in-string black list.
2. The method of claim 1 , further comprising:
unblocking the received user search query string if the character substring exactly matches a listing in the in-string white list.
3. The method of claim 1 , further comprising:
blocking the received user search query string if the character substring does not exactly match a listing in the in-string white list.
4. The method of claim 1 , further comprising:
determining whether additional user search query strings are to be processed when the character substring does not exactly match a listing in the in-string white list.
5. The method of claim 1 , further comprising:
comparing a substring of the received user search query string against an editorial list or automatically generated lists of adult URLs and search queries; and
marking the received user search query string as potentially blocked if the substring is determined to match the at least one listing in the editorial list or automatically generated lists of adult URLs and search queries.
6. The method of claim 1 , further comprising:
determining a threshold value of URLs clicked in response to the search query string; and
labeling the search query string within the in-string black list that points to a restricted content URL as a restricted content query if more than the threshold value of URLs are clicked in response to the search query string.
7. The method of claim 1 , further comprising:
overriding the in-string black list to allow a character substring included within the in-string black list to be included in the in-string white list.
8. The method of claim 1 , further comprising:
expanding the in-string white list to maintain records for search queries and clicked URLs related to at least one of finance or banking.
9. The method of claim 1 , wherein the in-string black list includes entries associated with a parental control set by a user, a user authorization level, a fee or subscription based access level, a geographic area or time zone restriction, or a client device and connection status restriction.
10. A system for filtering restricted content, comprising:
a storage medium that stores instructions; and
one or more processors configured to execute the instructions to:
retrieve an in-string black list and an in-string white list of search queries;
receive a user search query string;
compare a character substring of the received user search query string against the in-string black list to determine if the character substring of the received user search query string matches at least one listing in the in-string black list;
mark the received user search query string as potentially blocked if the character substring is determined to match the at least one listing in the in-string black list;
match the character substring of the potentially blocked received user search query string against each entry of the in-string white list;
determine that the character substring of the potentially blocked received user search query string does not exactly match a listing in the in-string white list; and
as a result of determining that the character substring of the potentially blocked received user search query string does not exactly match a listing in the in-string white list, add the received user search query string to the in-string black list.
11. The system of claim 10 , wherein the one or more processors are further operative with the instructions to:
unblock the received user search query string if the character substring exactly matches a listing in the in-string white list.
12. The system of claim 10 , wherein the one or more processors are further operative with the instructions to:
block the received user search query string if the character substring does not exactly match a listing in the in-string white list.
13. The system of claim 10 , wherein the one or more processors are further operative with the instructions to:
determine whether additional user search query strings are to be processed when the character substring does not exactly match a listing in the in-string white list.
14. The system of claim 10 , wherein the one or more processors are further operative with the instructions to:
compare a substring of the received user search query string against an editorial list or automatically generated lists of adult URLs and search queries; and
mark the received user search query string as potentially blocked if the substring is determined to match the at least one listing in the editorial list or automatically generated lists of adult URLs and search queries.
15. The system of claim 10 , wherein the one or more processors are further operative with the instructions to:
determine a threshold value of URLs clicked in response to the search query string; and
label the search query string within the in-string black list that points to a restricted content URL as a restricted content query if more than the threshold value of URLs are clicked in response to the search query string.
16. The system of claim 10 , wherein the one or more processors are further operative with the instructions to:
override the in-string black list to allow a character substring included within the in-string black list to be included in the in-string white list.
17. The system of claim 10 , wherein the one or more processors are further operative with the instructions to:
expand the in-string white list to maintain records for search queries and clicked URLs related to at least one of finance or banking.
18. A tangible, non-transitory computer-readable medium that stores instructions that, when executed by one or more processors, cause the one or more processors to perform operations comprising:
retrieving an in-string black list and an in-string white list of search queries;
receiving a user search query string;
comparing a character substring of the received user search query string against the in-string black list to determine if the character substring of the received user search query string matches at least one listing in the in-string black list;
marking the received user search query string as potentially blocked if the character substring is determined to match the at least one listing in the in-string black list;
matching the character substring of the potentially blocked received user search query string against each entry of the in-string white list;
determining that the character substring of the potentially blocked received user search query string does not exactly match a listing in the in-string white list; and
as a result of determining that the character substring of the potentially blocked received user search query string does not exactly match a listing in the in-string white list, adding the received user search query string to the in-string black list.