System and method for updating a search index
Methods, systems, and programming for updating a search index are described herein. In a non-limiting embodiment, event data representing actions performed on a plurality of content items managed via the search index may be obtained. The event data may be filtered based on pre-determined criteria to generate updated event data, where the updated event data represents relevant actions performed on at least one of the plurality of content items and are associated with the search index. An updated search index based on the updated event data may then be generated.
1. A method implemented on at least one machine comprising at least one processor, memory, and a communication platform connected to a network for updating a search index, the method comprising:
obtaining content item data representing content items;
obtaining event data representing actions associated with one or more of the content items;
filtering the event data based on pre-determined criteria to generate updated event data, wherein the pre-determined criteria comprise (i) a list of content items represented within the search index including at least one of the content items, and (ii) an action associated with the at least one of the content items corresponding to a relevant action; and
causing the search index to be updated based on the updated event data.
2. The method of claim 1 , wherein the relevant action impacts representation of the at least one of the content items in the search index.
3. The method of claim 1 , wherein the updated search index reflects the action associated with the at least one of the content items.
4. The method of claim 1 , wherein the updated event data represents the relevant action.
5. The method of claim 1 , further comprising:
retrieving the list of content items represented within the search index; and
determining that the list of content items comprises the at least one of the content items.
6. The method of claim 1 , wherein the event data is stored within an event log located on a content grid, and the search index is located on a remote system, the method further comprising:
sending the updated search index to the remote system to perform an update to the search index.
7. The method of claim 6 , wherein the event log, a content log, and an extraction log are located on the content grid, the content log stores information associated with the content items, and the extraction log stores entities extracted from at least some of the content items.
8. A non-transitory, computer-readable medium having information recorded thereon for text processing, when read by at least one processor, effectuate operations comprising:
obtaining content item data representing content items;
obtaining event data representing actions associated with one or more of the content items;
filtering the event data based on pre-determined criteria to generate updated event data, wherein the pre-determined criteria comprise (i) a list of content items represented within the search index including at least one of the content items, and (ii) an action associated with the at least one of the content items corresponding to a relevant action; and
causing the search index to be updated based on the updated event data.
9. The medium of claim 8 , wherein the relevant action impacts representation of the at least one of the content items in the search index.
10. The medium of claim 8 , wherein the updated search index reflects the action associated with the at least one of the content items.
11. The medium of claim 8 , wherein the updated event data represents the relevant action.
12. The medium of claim 8 , wherein the operations further comprise:
retrieving the list of content items represented within the search index; and
determining that the list of content items comprises the at least one of the content items.
13. The medium of claim 8 , wherein the event data is stored within an event log located on a content grid, and the search index is located on a remote system, and wherein the operations further comprise:
sending the updated search index to the remote system to perform an update to the search index.
14. The medium of claim 13 , wherein the event log, a content log, and an extraction log are located on the content grid, the content log stores information associated with the content items, and the extraction log stores entities extracted from at least some of the content items.
15. A system for text processing, the system comprising:
memory storing computer program instructions; and
one or more processors that, in response to executing the computer program instructions, effectuate operations comprising:
obtaining content item data representing content items;
obtaining event data representing actions associated with one or more of the content items;
filtering the event data based on pre-determined criteria to generate updated event data, wherein the pre-determined criteria comprise (i) a list of content items represented within the search index including at least one of the content items, and (ii) an action associated with the at least one of the content items corresponding to a relevant action; and
causing the search index to be updated based on the updated event data.
16. The system of claim 15 , wherein the relevant action impacts representation of the at least one of the content items in the search index.
17. The system of claim 15 , wherein the updated search index reflects the action associated with the at least one of the content items.
18. The system of claim 15 , wherein the updated event data represents the relevant action.
19. The system of claim 15 , wherein the operations further comprise:
retrieving the list of content items represented within the search index; and
determining that the list of content items comprises the at least one of the content items.
20. The system of claim 19 , wherein the event data is stored within an event log located on a content grid, and the search index is located on a remote system, and wherein the operations further comprise:
sending the updated search index to the remote system to perform an update to the search index.