GENERATE AN INDEX FOR ENHANCED SEARCH BASED ON USER INTERESTS
Techniques for generating an index for enhanced search based on user interests are disclosed. In some embodiments, a system/process/computer program product for generating an index for enhanced search based on user interests includes aggregating a plurality of web documents associated with one or more entities, wherein the web documents are retrieved from a plurality of online content sources including websites; determining relationships between each of the plurality of web documents, wherein the relationships include online relationships; and generating an index that includes the plurality of web documents and the relationships between each of the plurality of web documents.
1 . A system, comprising:
a processor configured to:
aggregate a plurality of web documents associated with one or more entities, wherein the web documents are retrieved from a plurality of online content sources including one or more websites;
determine relationships between each of the plurality of web documents, wherein the relationships include online relationships; and
generate an index that includes the plurality of web documents and the relationships between each of the plurality of web documents; and
a memory coupled with the processor, wherein the memory is configured to provide the processor with instructions.
2 . The system of claim 1 , wherein the index includes one or more web documents related to one or more topics.
3 . The system of claim 1 , wherein the index is inverted for search and retrieval of the plurality of web documents relevant to a user's query and/or a user's interest.
4 . The system of claim 1 , wherein the index is inverted to generate an inverted index for search and retrieval of the plurality of web documents relevant to a user's query and/or a user's interest, and wherein the inverted index provides a mapping of topics to the plurality of web documents.
5 . The system of claim 1 , wherein the online content includes text-based information, and wherein the processor is further configured to analyze the text-based information to determine a document score associated with each of the one or more entities.
6 . The system of claim 1 , wherein the index is updated in near real-time, and wherein the index includes a vector model for each document in the index.
7 . The system of claim 1 , wherein the processor is further configured to determine a topicality signal for one or more of the plurality of web documents for each of the one or more entities.
8 . The system of claim 1 , wherein the processor is further configured to generate a plurality of signals for each of the plurality of web documents.
9 . The system of claim 1 , wherein the processor is further configured to determine a topic associated with each of the plurality of web documents based on one or more document signals.
10 . The system of claim 1 , wherein the processor is further configured to:
generate a trending signal for a first web document of the plurality of web documents; and
determine whether to reindex the first web document based on the trending signal.
11 . The system of claim 1 , wherein the processor is further configured to:
identify online comments associated with a first web document of the plurality of web documents; and
generate an entropy-based popularity signal for the first web document based on a diversity of the online comments associated with the first web document.
12 . The system of claim 1 , wherein the processor is further configured to receive a user query, wherein the user query corresponds to a new interest that is provided as input for a not now search for the user.
13 . The system of claim 1 , wherein the processor is further configured to:
receive a user query, wherein the user query corresponds to a new interest that is provided as input for a not now search for the user; and
return one or more web documents in response to the user query using the index.
14 . The system of claim 1 , wherein the processor is further configured to:
receive a user query, wherein the user query corresponds to a new interest that is provided as input for a not now search for the user; and
generate an update to a content feed that includes one or more web documents in response to the new interest using the index.
15 . A method, comprising:
aggregating a plurality of web documents associated with one or more entities, wherein the web documents are retrieved from a plurality of online content sources including one or more websites;
determining relationships between each of the plurality of web documents, wherein the relationships include online relationships; and
generating an index that includes the plurality of web documents and the relationships between each of the plurality of web documents.
16 . The method of claim 15 , wherein the index includes one or more web documents related to one or more topics.
17 . The method of claim 15 , wherein the index is inverted for search and retrieval of the plurality of web documents relevant to a user's query and/or a user's interest.
18 . The method of claim 15 , further comprising:
generating a plurality of signals for each of the plurality of web documents.
19 . The method of claim 15 , further comprising:
determining a topic associated with each of the plurality of web documents based on one or more document signals.
20 . A computer program product, the computer program product being embodied in a tangible computer readable storage medium and comprising computer instructions for:
aggregating a plurality of web documents associated with one or more entities, wherein the web documents are retrieved from a plurality of online content sources including one or more websites;
determining relationships between each of the plurality of web documents, wherein the relationships include online relationships; and
generating an index that includes the plurality of web documents and the relationships between each of the plurality of web documents.