Structured searching of dynamic structured document corpuses
View Patent ↗A system includes a document corpus containing structured documents, which contain both text and annotations of the text. The system also includes a search engine which is adapted to perform structured searches of the structured documents. As new types of annotations are added to the system, the search engine is updated automatically to become capable of performing structured searches for the new types of annotations. For example, if a new natural language processing (NLP) component, adapted to generate annotations of a new type, is added to the system, then the system automatically updates a query language to include a definition of the new type of annotation. The search engine may then immediately be capable of processing structured queries which refer to the new type of annotation.
1. A method performed by at least one computer processor executing computer program instructions tangibly stored on at least one non-transitory computer-readable medium, wherein the method is for use with a system, wherein the system comprises:
a first natural language processing component adapted to parse text within a document corpus to generate annotations of a first type within the document corpus; and
a search component adapted to perform structured searching of annotations of the first type but not of annotations of a second type; and
wherein the method comprises:
(A) identifying a first annotation of the second type within the document corpus;
(B) modifying the search component to enable the search component to perform structured searching of annotations of the second type, thereby producing a modified search component;
(C) receiving a query, the query including a term referring to the second type of annotation;
(D) using the modified search component to perform a search on a document corpus using the query; and
(E) before (A), using a second natural language processing component to parse first text within the document corpus to generate the first annotation of the second type and to add the first annotation of the second type to the document corpus, comprising using the second natural language processing component to recognize text within the document corpus that represents a concept corresponding to the second type of annotation, to generate the annotation of the second type within the document corpus, and to associate the first annotation of the second type with the recognized text.
2. The method of claim 1 , wherein (A) comprises detecting addition of the first annotation to the document corpus.
3. The method of claim 2 :
wherein, prior to (A), the document corpus does not include any annotations of the second type; and
wherein (B) comprises modifying the search component in response to detection of the addition of the first annotation of the second type to the document corpus.
4. The method of claim 1 , further comprising:
(F) before (E), adding, to the system, the second natural language processing component adapted to parse text to generate annotations of the second type; and
wherein (B) comprises modifying the search component in response to the addition of the second natural language processing component to the system.
5. The method of claim 1 , wherein (B) is performed automatically by the at least one computer processor.
6. The method of claim 1 , wherein (B) is performed manually by a human user.
7. The method of claim 1 , wherein the search component is adapted to perform structured searching of annotations of the first type, unstructured searching of text, and mixed searching of text and annotations of the first type.
8. The method of claim 1 , wherein (B) comprises modifying a query language definition, which includes a definition of the first type of annotation, to include a definition of the second type of annotation.
9. The method of claim 1 , wherein the system further includes a query formulation user interface adapted to assist a user in formulating the query, and wherein the method further comprises:
(F) automatically modifying the query formulation user interface to enable the query formulation user interface to assist the user in formulating the query to include the term referring to the second type of annotation.
10. The method of claim 9 , wherein (B) comprises modifying a query language definition, which includes a definition of the first type of annotation, to include a definition of the second type of annotation.
11. The method of claim 1 , wherein the document corpus includes annotations of the second type, and wherein (D) comprises:
(D) (1) using the search component to perform selection on the annotations of the second type in the document corpus using the term of the query which refers the second type of annotation.
12. A non-transitory computer-readable medium having computer program instructions tangibly stored thereon, wherein the computer program instructions are executable by at least one computer processor to perform a method for use with a system, wherein the system comprises:
a first natural language processing component adapted to parse text within a document corpus to generate annotations of a first type within the document corpus; and
a search component adapted to perform structured searching of annotations of the first type but not of annotations of a second type; and
wherein the method comprises:
(A) identifying a first annotation of the second type within the document corpus;
(B) modifying the search component to enable the search component to perform structured searching of annotations of the second type, thereby producing a modified search component;
(C) receiving a query, the query including a term referring to the second type of annotation; and
(D) using the modified search component to perform a search on a document corpus using the query;
(E) before (A), using a second natural language processing component to parse first text within the document corpus to generate the first annotation of the second type and to add the first annotation of the second type to the document corpus, comprising using the second natural language processing component to recognize text within the document corpus that represents a concept corresponding to the second type of annotation, to generate the annotation of the second type within the document corpus, and to associate the first annotation of the second type with the recognized text.
13. The computer-readable medium of claim 12 , wherein (A) comprises detecting addition of the first annotation to the document corpus.
14. The computer-readable medium of claim 13 :
wherein, prior to (A), the document corpus does not include any annotations of the second type; and
wherein (B) comprises modifying the search component in response to detection of the addition of the first annotation of the second type to the document corpus.
15. The computer-readable medium of claim 12 , wherein the method further comprises:
(F) before (E), adding, to the system, the second natural language processing component adapted to parse text to generate annotations of the second type; and
wherein (B) comprises modifying the search component in response to the addition of the second natural language processing component to the system.
16. The computer-readable medium of claim 12 , wherein (B) is performed automatically by the at least one computer processor.
17. The computer-readable medium of claim 12 , wherein (B) is performed manually by a human user.
18. The computer-readable medium of claim 12 , wherein the search component is adapted to perform structured searching of annotations of the first type, unstructured searching of text, and mixed searching of text and annotations of the first type.
19. The computer-readable medium of claim 12 , wherein (B) comprises modifying a query language definition, which includes a definition of the first type of annotation, to include a definition of the second type of annotation.
20. The computer-readable medium of claim 12 , wherein the system further includes a query formulation user interface adapted to assist a user in formulating the query, and wherein the method further comprises:
(F) automatically modifying the query formulation user interface to enable the query formulation user interface to assist the user in formulating the query to include the term referring to the second type of annotation.
21. The computer-readable medium of claim 20 , wherein (B) comprises modifying a query language definition, which includes a definition of the first type of annotation, to include a definition of the second type of annotation.
22. The computer-readable medium of claim 12 , wherein the document corpus includes annotations of the second type, and wherein (D) comprises:
(D) (1) using the search component to perform selection on the annotations of the second type in the document corpus using the term of the query which refers the second type of annotation.