Method for gathering and summarizing internet information
A computer method of gathering and summarizing large amounts of information comprises collecting information from a plurality of information sources ( 14, 51 ) according to respective maps ( 52 ) of the information sources ( 14 ), converting the collected information from a storage format to XML-language documents ( 26, 53 ) and storing the XML-language documents in a storage medium, searching for documents ( 55 ) according to a search query ( 13 ) having at least one term and identifying the documents ( 26 ) found in the search, and displaying the documents as nodes ( 33 ) of a tree structure ( 32 ) having links ( 34 ) and nodes ( 33 ) so as to indicate similarity of the documents to each other.
1. A computer method of gathering and summarizing information, the method comprising:
collecting documents from a plurality of information sources and storing the documents in a storage format;
wherein the documents comprise metadata and text that are to be retrieved;
converting the documents from the storage format to XML-language documents and storing the XML-language documents in a storage medium;
searching for documents according to a search query having at least one term and identifying the documents found in the search;
displaying the documents so as to indicate similarity of the documents to each other according to a clustering algorithm;
further comprising comparing a similarity of a plurality of documents by calculating a similarity function for the plurality of documents; and
wherein the similarity of an additional document added to the plurality of documents is calculated by comparing the additional document to a portion of a similarity matrix for the plurality of documents and without recalculating the entire similarity matrix for the plurality of documents.
2. The method of claim 1 , wherein said documents are collected and stored according to a search ontology providing a map of each respective information source and a time interval between search updates from the plurality of information sources.
3. The method of claim 2 , wherein the method is carried out by a software agent computer program.
4. The method of claim 3 , wherein the software agent computer program is originated in the JAVA computer language.
5. The method of claim 3 , wherein said software agent computer program resides in a computer also operating an agent hosting program; and wherein the software agent computer program is a client program in relation to the agent hosting program.
6. The method of claim 5 , wherein the method is carried out by a plurality of software agent programs residing on a corresponding plurality of computers having agent-hosting programs, said software agent programs communicating with each other through the agent hosting programs.
7. The method of claim 2 , wherein the information sources are a plurality of Internet web sites.
8. The method of claim 1 , wherein the documents are displayed as nodes of a tree structure having links and nodes in which similarity of documents is indicated by proximity of nodes to each other and by a length of links connecting the nodes to a common vertex.
9. The method of claim 1 , wherein the documents are displayed in a hierarchical folder organization.
10. The method of claim 1 , wherein the storage medium is a computer memory.