Systems and methods for grouping and enriching data items accessed from one or more databases for presentation in a user interface
Embodiments of the present disclosure relate to a data analysis system for grouping and enriching data items for presentation to an analyst through a user interface. Data items from one or more data sources are combined into memory-efficient clustered data structures, which may be stored as one or more data tables in a database. Analysis and scoring of those clustered data structures can be performed by utilizing various criteria or rules to generate scores, reports, alerts, or conclusions that may aid an analyst in evaluating the clustered data structures. The analysis and scoring may also be added to the clustered data structures which are stored as one or more data tables in a database. The analyst may be prompted to create a dossier format or specification and to additional enrichments to be performed on the raw data items in the clustered data structures. The system can also perform versioning on the raw data items in the one or more data tables, wherein the versioning is performed at least by aggregating a subset of raw data items from the one or more data tables. The system may then search, group, or filter the raw data items based on the analyst-defined dossier format, as well as add enrichments to the data. Some examples of enrichments include changing the way the data is displayed, inserting data located in a separate reference table, or ordering data to help construct timelines, histograms, and/or other visualizations based upon the various attributes of the raw data items. The enriched data may be presented to the analyst through a user interface, in the user-defined format or specification in order to allow the analyst to efficiently evaluate the data clusters in the context of, for example, a risky trading investigation.
1. A computer system comprising:
one or more computer readable storage devices configured to store a plurality of computer executable instructions; and
one or more hardware computer processors in communication with the one or more computer readable storage devices and configured to execute the plurality of computer executable instructions to cause the computer system to:
generate a first interactive user interface that includes one or more input areas configured to receive user input for indicating one or more key values and one or more data tables;
receive a first request that includes a first key value and a plurality of data tables, wherein the plurality of data tables includes data items that are related based at least partly on respective one or more key values;
perform versioning on the data items in the plurality of data tables, wherein the versioning is performed at least by aggregating first data items that area subset of data items from the plurality of data tables that correspond with the first key value; and
generate a second interactive user interface to display information associated with the versioning such that different versions of the first data items corresponding to the first key value are displayed in a timeline or storyline indicating how the first data items change or progress over time.
2. The computer system of claim 1 , wherein the first request includes a second key value, and wherein the plurality of computer executable instructions further cause the computer system to:
in response to performing the versioning, sub-group or map the aggregated subset of data items based at least in part on the second key value.
3. The computer system of claim 2 , wherein the second interactive user interface displays information associated with the sub-grouping or mapping.
4. The computer system of claim 1 , wherein the plurality of data tables includes a first data table and a second data table, and wherein the plurality of computer executable instructions further cause the computer system to:
prior to performing the versioning, automatically enrich the first data table by joining the first data table with the second data table.
5. The computer system of claim 4 , wherein the automatic enrichment of the first data table includes one of:
adding at least one column of data that includes names from the second data table to the first data table, wherein the names correspond to associated identifiers in the first data table; or
adding at least one column of data that includes identifiers from the second data table to the first data table, wherein the identifiers correspond to associated names in the first data table.
6. The computer system of claim 4 , wherein the automatic enrichment of the first data table includes formatting data items included within the first data table.
7. The computer system of claim 6 , wherein the formatting includes preconfigured customizations.
8. The computer system of claim 1 , wherein the second interactive user interface includes formatted tables of the data items based at least in part on the versioning and first key value.
9. The computer system of claim 1 , wherein the plurality of computer executable instructions further cause the computer system to:
determine distributions or relationships of the data items in the plurality of data tables; and
generate a histogram that is based at least in part on the determined distributions or relationships of the data items, wherein the second interactive user interface includes the histogram.
10. The computer system of claim 1 , wherein the timeline or storyline correspond to changes to the data items over time, wherein the changes are determined based at least in part on the performed versioning.
11. The computer system of claim 1 , wherein the performed versioning further comprises mapping or organizing the aggregated subset of data items chronologically.
12. A computer-implemented method comprising:
generating a first interactive user interface that includes one or more input areas configured to receive user input for indicating one or more key values and one or more data tables;
receiving a first request that includes a first key value and a plurality of data tables, wherein the plurality of data tables includes data items that are related based at least partly on respective one or more key values;
performing versioning on the data items in the plurality of data tables, wherein the versioning is performed at least by aggregating first data items that are a subset of data items from the plurality of data tables that correspond with the first key value; and
generating a second interactive user interface to display information associated with the versioning such that different versions of the first data items corresponding to the first key value are displayed in a timeline or storyline indicating how the first data items change or progress over time.
13. The computer-implemented method of claim 12 , wherein the first request includes a second key value, and further comprising:
in response to performing the versioning, sub-grouping or mapping the aggregated subset of data items based at least in part on the second key value.
14. The computer-implemented method of claim 12 , wherein the plurality of data tables includes a first data table and a second data table, and further comprising:
prior to performing the versioning, automatically enriching the first data table by joining the first data table with the second data table.
15. The computer-implemented method of claim 12 , wherein the second interactive user interface includes formatted tables of the data items based at least in part on the versioning and first key value.
16. The computer-implemented method of claim 12 , further comprising:
determining distributions or relationships of the data items in the plurality of data tables; and
generating a histogram that is based at least in part on the determined distributions or relationships of the data items, wherein the second interactive user interface includes the histogram.
17. A non-transitory computer-readable medium storing a set of instructions that are executable by one or more processors to cause the one or more processors to:
generate a first interactive user interface that includes one or more input areas configured to receive user input for indicating one or more key values and one or more data tables;
receive a first request that includes a first key value and a plurality of data tables, wherein the plurality of data tables includes data items that are related based at least partly on respective one or more key values;
perform versioning on the data items in the plurality of data tables, wherein the versioning is performed at least by aggregating first data items that are a subset of data items from the plurality of data tables that correspond with the first key value; and
generate a second interactive user interface to display information associated with the versioning such that different versions of the first data items corresponding to the first key value are displayed in a timeline or storyline indicating how the first data items change or progress over time.
18. The non-transitory computer-readable medium of claim 17 , wherein the first request includes a second key value, and further comprising:
in response to performing the versioning, sub-group or map the aggregated subset of data items based at least in part on the second key value.
19. The non-transitory computer-readable medium of claim 17 , wherein the plurality of data tables includes a first data table and a second data table, and further comprising:
prior to performing the versioning, automatically enrich the first data table by joining the first data table with the second data table.
20. The non-transitory computer-readable medium of claim 17 , further comprising:
determine distributions or relationships of the data items in the plurality of data tables; and
generate a histogram that is based at least in part on the determined distributions or relationships of the data items, wherein the second interactive user interface includes the histogram.