System and method for updating a search engine index based on which files are identified in a file change log
View Patent ↗Various methods and systems for updating a search engine index based on a file change log are disclosed. One method involves accessing a file, which stores a file change log maintained by a file system. The file change log identifies one or more recently modified files. The method also involves updating an index, based on a recently-modified file identified in the file change log. The index is used to search files maintained by the file system. An application external to the file system accesses the file storing the file change log and updates the index.
1. A method comprising:
accessing a file, wherein
the file stores a file change log maintained by a file system,
the file change log identifies one or more recently modified files; and
updating an index, based on a recently modified file identified in the file change log, wherein
the index is used to search files maintained by the file system,
the updating comprises accessing a recently modified portion of the recently modified file, not accessing an unmodified portion of the recently modified file, and updating a portion of the index that corresponds to the recently modified portion of the recently modified file, and
the accessing and the updating are performed by an application external to the file system.
2. The method of claim 1 , wherein
an updated portion of the index includes indexing information associated with a keyword, and
the keyword is included in the file.
3. The method of claim 1 , wherein
the file change log identifies a recently modified portion of a recently modified file by a file identifier, length and offset.
4. The method of claim 1 , wherein the accessing the recently modified portion of the recently modified file comprises accessing an in-core copy of the recently modified portion of the recently modified file, without opening the recently modified file.
5. The method of claim 4 , wherein the in-core copy of the recently modified portion of the recently modified file is stored in the file change log.
6. The method of claim 1 , wherein
the application executes on a different computing node than the file system.
7. The method of claim 1 , wherein
the accessing the recently modified file comprises scanning information stored in the file change log in reverse order,
the updating the portion of the index comprises updating the portion of the index a single time, and
the file change log identifies that the recently modified file has been modified two or more times.
8. A system comprising:
a processor; and
a memory coupled to the processor, wherein the memory stores computer readable instructions executable to implement:
a file system configured to maintain a file, wherein
the file stores a file change log, and
the file change log identifies one or more recently modified files; and
an indexing module coupled to the file system, wherein
the indexing module is configured to access the file and to update an index, based on a recently modified file identified in the file change log,
the indexing module is configured to update the index by accessing a recently modified portion of the recently modified file, not accessing an unmodified portion of the recently modified file, and updating a portion of the index that corresponds to the recently modified portion of the recently modified file, and
the index is used to search files maintained by the file system.
9. The system of claim 8 , wherein
the file change log identifies a recently modified portion of a file by a file identifier, length and offset.
10. The system of claim 8 , wherein
the indexing module is configured to access the recently modified portion of the recently modified file by accessing an in-core copy of the recently modified portion of the recently modified file, and
the in-core copy of the recently modified portion of the recently modified file is stored in the file change log.
11. The system of claim 8 , wherein
the indexing module is implemented on a different computing node than the file system.
12. The system of claim 8 , wherein
the indexing module is configured to access the recently modified file by scanning information stored in the file change log in reverse order,
the indexing module is configured to update the portion of the index by updating the portion of the index a single time, and
the file change log identifies that the recently modified file has been modified two or more times.
13. A system comprising:
interface means for accessing a file, wherein
the file stores a file change log maintained by a file system,
the file change log identifies one or more recently modified files; and
means for updating an index, based on a recently modified file identified in the file change log, wherein
the index is used to search files maintained by the file system,
updating the index comprises accessing a recently modified portion of the recently modified file, not accessing an unmodified portion of the recently modified file, and updating a portion of the index that corresponds to the recently modified portion of the recently modified file, and
the means for accessing and the means for updating are included in an application external to the file system.
14. The system of claim 13 , wherein
an updated portion of the index includes indexing information associated with a keyword, and
the keyword is included in the file.
15. The system of claim 13 , wherein
the file change log identifies a recently modified portion of a recently modified file by a file identifier, length and offset.
16. The system of claim 13 , wherein
the accessing the recently modified portion of the recently modified file comprises accessing an in-core copy of the recently modified portion of the recently modified file, and
the in-core copy of the recently modified portion of the recently modified file is stored in the file change log.
17. The system of claim 13 , wherein
accessing the recently modified file comprises scanning information stored in the file change log in reverse order,
updating the portion of the index comprises updating the portion of the index a single time, and
the file change log identifies that the recently modified file has been modified two or more times.
18. A computer readable storage medium comprising program instructions executable to:
access a file, wherein
the file stores a file change log maintained by a file system,
the file change log identifies one or more recently modified files; and
update an index, based on a recently modified file identified in the file change log, wherein
the program instructions are executable to update the index by accessing a recently modified portion of the recently modified file, not accessing an unmodified portion of the recently modified file, and updating a portion of the index that corresponds to the recently modified portion of the recently modified file, and
the index is used to search files maintained by the file system.
19. The computer readable storage medium of claim 18 , wherein
an updated portion of the index includes indexing information associated with a keyword, and
the keyword is included in the file.
20. The computer readable storage medium of claim 18 , wherein
the file change log identifies a recently modified portion of a recently modified file by a file identifier, length and offset.
21. The computer readable storage medium of claim 18 , wherein
the program instructions are executable to access the recently modified portion of the recently modified file by accessing an in-core copy of the recently modified portion of the recently modified file, and
the in-core copy of the recently modified portion of the recently modified file is stored in the file change log.
22. The computer readable storage medium of claim 18 , wherein
the program instructions are executable to access the recently modified file by scanning information stored in the file change log in reverse order,
the program instructions are executable to update the portion of the index by updating the portion of the index a single time, and
the file change log identifies that the recently modified file has been modified two or more times.