Reducing a large amount of data to a size available for interactive analysis
A request for data is processed by identifying data within a data store satisfying the request, where an amount of the identified data exceeds a threshold, analyzing the identified data to produce an initial result set with a reduced amount of data including information summarizing the identified data, and generating one or more succeeding result sets each from a corresponding prior result set until a succeeding result set includes an amount of data satisfying the threshold. Each succeeding result set includes a reduced amount of data relative to the corresponding prior result set, and generating each succeeding result set includes filtering the corresponding prior result set and generating the succeeding result set including information summarizing the filtered result set.
1. A computer-implemented method of processing a request for data comprising:
identifying data within a data store satisfying the request, wherein a quantity of the identified data is greater than a threshold;
analyzing the identified data to produce an initial result set with a reduced quantity of data including information summarizing the identified data, the analyzing the identified data further comprising:
analyzing two or more instances of data to determine whether the instances of data represent a same entity, wherein entities are individuals; and
when the two or more instances of data are determined as representing the same entity, consolidating the two or more instances of data as a single entity for the information summarizing the identified data; and
generating one or more succeeding result sets each from a corresponding prior result set until a succeeding result set includes a quantity of data that is at or below the threshold, wherein each succeeding result set includes a reduced quantity of data relative to the corresponding prior result set, and generating each succeeding result set includes:
filtering the corresponding prior result set and generating the succeeding result set including information summarizing the filtered result set.
2. The computer-implemented method of claim 1 , further comprising:
providing the identified data associated with the information from the succeeding result set, wherein the quantity of the identified data is at or below the threshold.
3. The computer-implemented method of claim 1 , wherein the filtering of the corresponding prior result set includes:
filtering the prior result set based on one or more criteria from a user.
4. The computer-implemented method of claim 1 , wherein the threshold indicates an amount of data enabling visual analysis of the identified data.
5. The computer-implemented method of claim 1 , wherein the data store includes structured and unstructured data.
6. The computer-implemented method of claim 1 , wherein the data store includes unstructured data, and the identifying data within the data store satisfying the request includes:
extracting entity and relationship data from the unstructured data, wherein the information summarizing one or more from a group of the identified data and the filtered result set is based on the extracted entity and relationship data.
7. The computer-implemented method of claim 1 , further comprising:
displaying each result set within a user interface accessible by a user, wherein the user interface facilitates depiction of one or more result sets in a plurality of different formats.