Re-indexing query-independent document features for processing search queries
An online system stores documents for access by users. The online system also stores query independent information about the documents. Query independent features include data that can be used to score or rank a document independent of any terms entered as a search query. The online system periodically determines whether the values of query independent features have changed, such as by checking activity logs. The online system updates records of query independent features accordingly, and sends information about the updated records to an enterprise search platform for re-indexing. When a user sends a search query to the online system, the enterprise search platform determines whether documents are relevant to the query based on the document contents and the query independent features associated with the documents.
1. A computer-implemented method comprising:
storing, by a multi-tenant system, a database table comprising records associated with a first tenant of the multi-tenant system, the multi-tenant system configured to store documents for a plurality of tenants, the multi-tenant system configured to allow users associated with a tenant to edit documents associated with the tenant, each record associated with a document and storing query-independent features describing the document, the query-independent features comprising an edit date of the document;
for a document associated with records in the database table:
detecting a change in information associated with the document, the change associated with a last edit date of the document;
updating in the database table, a record associated with the document to store query-independent features based on the changed information wherein the query independent features include the last edit date of the document, the last edit date corresponding to the change;
transmitting query-independent features of the document to an enterprise search platform associated with the multi-tenant system, causing the enterprise search platform to re-index a record associated with the document associated with the first tenant; and
receiving, from a client device, a search request;
transmitting the search request to the enterprise search platform;
receiving, from the enterprise search platform, search results matching the search request, each search result associated with a relevancy score for a document from the documents associated with records in the database table, the relevancy score based on a weighted combination of updated query-independent features including at least an edit date of the document and a term frequency-inverse document frequency score associated with the document; and
transmitting, to the client device, the search results ranked based on the relevancy scores.
2. The computer-implemented method of claim 1 , wherein a task scheduler periodically triggers the process of:
detecting a change in information associated with a document,
updating the database table, and
transmitting query-independent features of the document to the enterprise search platform for re-indexing.
3. The computer-implemented method of claim 1 , wherein the query-independent features associated with documents include at least one of: a document popularity score, a number of times the document is viewed, or a number of times the document is linked to from other documents.
4. The computer-implemented method of claim 1 , wherein the query independent features associated with documents include a creation date.
5. The computer-implemented method of claim 1 , wherein the enterprise search platform performs a partial re-indexing of only the updated features in a record associated with the document.
6. The computer-implemented method of claim 1 , wherein detecting a change in information associated with the document further comprises reviewing an activity log file and determining that activities indicated in the activity log file should change the value of a query-independent feature associated with the document.
7. A computer system comprising:
at least once processor for executing computer program instructions; and
a non-transitory computer-readable storage medium comprising stored instructions executable by the processor that when executed cause the processor to:
store, by a multi-tenant system, a database table comprising records associated with a first tenant of the multi-tenant system, the multi-tenant system configured to store documents for a plurality of tenants, the multi-tenant system configured to allow users associated with a tenant to edit documents associated with the tenant, each record associated with a document and storing query-independent features describing the document, the query-independent features comprising an edit date of the document;
for a document associated with records in the database table:
detect a change in information associated with the document, the change associated with a last edit date of the document;
update in the database table, a record associated with the document to store query-independent features based on the changed information wherein the query independent features include the last edit date of the document, the last edit date corresponding to the change;
transmit query-independent features of the document to an enterprise search platform associated with the multi-tenant system, causing the enterprise search platform to re-index a record associated with the document associated with the first tenant; and
receive, from a client device, a search request;
transmit the search request to the enterprise search platform;
receive, from the enterprise search platform, search results matching the search request, each search result associated with a relevancy score for a document from the documents associated with records in the database table, the relevancy score based on a weighted combination of updated query-independent features including at least an edit date of the document and a term frequency-inverse document frequency score associated with the document; and
transmit, to the client device, the search results ranked based on the relevancy scores.
8. The computer system of claim 7 , wherein a task scheduler periodically triggers the process of:
detecting a change in information associated with a document,
updating the database table, and
transmitting query-independent features of the document to the enterprise search platform for re-indexing.
9. The computer system of claim 7 , wherein the query-independent features associated with documents include at least one of: a document popularity score, a number of times the document is viewed, or a number of times the document is linked to from other documents.
10. The computer system of claim 7 , wherein the query independent features associated with documents include a creation date.
11. The computer system of claim 7 , wherein the enterprise search platform performs a partial re-indexing of only the updated features in a record associated with the document.
12. The computer system of claim 7 , wherein detecting a change in information associated with the document further comprises reviewing an activity log file and determining that activities indicated in the activity log file should change the value of a query-independent feature associated with the document.
13. A non-transitory computer readable storage medium comprising computer executable code that when executed by one or more processors causes the one or more processors to perform operations comprising:
storing, by a multi-tenant system, a database table comprising records associated with a first tenant of the multi-tenant system, the multi-tenant system configured to store documents for a plurality of tenants, the multi-tenant system configured to allow users associated with a tenant to edit documents associated with the tenant, each record associated with a document and storing query-independent features describing the document, the query-independent features comprising an edit date of the document;
for a document associated with records in the database table:
detecting a change in information associated with the document, the change associated with a last edit date of the document;
updating in the database table, a record associated with the document to store query-independent features based on the changed information wherein the query independent features include the last edit date of the document, the last edit date corresponding to the change;
transmitting query-independent features of the document to an enterprise search platform associated with the multi-tenant system, causing the enterprise search platform to re-index a record associated with the document associated with the first tenant; and
receiving, from a client device, a search request;
transmitting the search request to the enterprise search platform;
receiving, from the enterprise search platform, search results matching the search request, each search result associated with a relevancy score for a document from the documents associated with records in the database table, the relevancy score based on a weighted combination of updated query-independent features including at least an edit date of the document and a term frequency-inverse document frequency score associated with the document; and
transmitting, to the client device, the search results ranked based on the relevancy scores.
14. The non-transitory computer-readable storage medium of claim 13 , wherein a task scheduler periodically triggers the process of:
detecting a change in information associated with a document,
updating the database table, and
transmitting query-independent features of the document to the enterprise search platform for re-indexing.
15. The non-transitory computer-readable storage medium of claim 13 , wherein the query-independent features associated with documents include at least one of: a document popularity score, a number of times the document is viewed, or a number of times the document is linked to from other documents.
16. The non-transitory computer-readable storage medium of claim 13 , wherein the query independent features associated with documents include a creation date.
17. The non-transitory computer-readable storage medium of claim 13 , wherein the enterprise search platform performs a partial re-indexing of only the updated features in a record associated with the document.
18. The non-transitory computer-readable storage medium of claim 13 , wherein detecting a change in information associated with the document further comprises reviewing an activity log file and determining that activities indicated in the activity log file should change the value of a query-independent feature associated with the document.