Systems and methods for key phrase characterization of documents
Systems and methods are disclosed for key phrase characterization of documents. In accordance with one implementation, a method is provided for key phrase characterization of documents. The method includes obtaining a first plurality of documents based at least on a user input, obtaining a statistical model based at least on the user input, and obtaining, from content of the first plurality of documents, a plurality of segments. The method also includes determining statistical significance of the plurality of segments based at least on the statistical model and the content, and providing for display a representative segment from the plurality of segments, the representative segment being determined based at least on the statistical significance.
1. An electronic device comprising:
one or more computer-readable storage media configured to store instructions; and
one or more processors configured to execute the instructions to cause the electronic device to:
identify, in each of a plurality of documents, segments of the document each including a word or multiple words of the document;
determine, for each identified segment, a statistical significance of the segment, the statistical significance indicative of a frequency of the segment in the corresponding document compared to a frequency of the segment in a plurality of other documents each matching a user-provided filter criteria;
determine, for each of the documents, representative segments of the document as those segments having statistical significances above a threshold;
identify at least one set of the documents having at least a predetermined threshold quantity of documents that each include similar representative segments; and
provide for display at least a portion of at least one of the identified at least one set of documents.
2. The electronic device of claim 1 , wherein the user-provided filter criteria indicates a particular entity.
3. The electronic device of claim 1 , wherein the user-provided filter criteria indicates a particular time period.
4. The electronic device of claim 3 , wherein the particular time period is selected based on user interaction with a chart displayed on a user device.
5. The electronic device of claim 1 , wherein statistical significance of segments is further based on relationships between words of segments.
6. The electronic device of claim 1 , wherein the plurality of other documents is associated with a particular entity and the statistical significance of segments is based on a significance model associated with the particular entity.
7. The electronic device of claim 6 , wherein the particular entity is identified based on input from a user of the electronic device.
8. The electronic device of claim 1 , wherein the at least a portion of at least one of the identified set of documents includes, with reference to each of the portions of the at least one of the identified set of documents, a selectable link configured to automatically retrieved additional portions of the corresponding document in response to user selection of the selectable link.
9. The electronic device of claim 1 , wherein the predetermined threshold quantity of documents is provided by a user of the electronic device or is automatically determined by the electronic device.
10. A computerized method comprising:
executing, by a computing device having one or more computer processors, software instructions causing the computing device to:
identify, in each of a plurality of documents, segments of the document each including a word or multiple words of the document;
determine, for each identified segment, a statistical significance of the segment, the statistical significance indicative of a frequency of the segment in the corresponding document compared to a frequency of the segment in a plurality of other documents each matching a user-provided filter criteria;
determine, for each of the documents, representative segments of the document as those segments having statistical significances above a threshold;
identify at least one set of the documents having at least a predetermined threshold quantity of documents that each include similar representative segments; and
provide for display at least a portion of at least one of the identified at least one set of documents.
11. The method of claim 10 , wherein the user-provided filter criteria indicates a particular entity.
12. The method of claim 10 , wherein the user-provided filter criteria indicates a particular time period.
13. The method of claim 12 , wherein the particular time period is selected based on user interaction with a chart displayed on a user device.
14. The method of claim 10 , wherein statistical significance of segments is further based on relationships between words of segments.
15. The method of claim 10 , wherein the plurality of other documents is associated with a particular entity and the statistical significance of segments is based on a significance model associated with the particular entity.
16. The method of claim 15 , wherein the particular entity is identified based on input from a user of the electronic device.
17. The method of claim 10 , wherein the at least a portion of at least one of the identified set of documents includes, with reference to each of the portions of the at least one of the identified set of documents, a selectable link configured to automatically retrieved additional portions of the corresponding document in response to user selection of the selectable link.
18. The method of claim 10 , wherein the predetermined threshold quantity of documents is provided by a user of the electronic device or is automatically determined by the electronic device.