Systems and methods for intelligent database report generation
Systems, devices, computer-implemented methods, and tangible non-transitory computer-readable media for generating reports from one or more databases that store disparate datasets are provided. Specifically, the proposed systems enable the intelligent generation of reports from multiple datasets by automatically determining a proposed set of join configurations for combination of the multiple datasets. The proposed set of join configurations can be executed as proposed and/or can be edited or customized by the user to generate reports from the multiple datasets. Thus, the proposed systems and methods can provide intuitive and user-friendly tools for generating data reports that accurately synthesize and summarize data contained in multiple different datasets.
1. A computing system for intelligent generation of data reports, the computing system comprising:
one or more processors;
one or more databases that store a set of organizational data, wherein the set of organizational data comprises a plurality of different datasets, and wherein each of the plurality of different datasets comprises a number of respective data elements; and
one or more non-transitory computer-readable media that collectively store instructions that, when executed by the one or more processors cause the computing system to perform operations, the operations comprising:
receiving a request for generation of a report, wherein the report comprises a plurality of requested data elements;
identifying two or more of the plurality of different datasets that collectively contain the plurality of requested data elements;
automatically generating one or more proposed join configurations for combination of the two or more of the plurality of different datasets;
sampling the two or more of the plurality of different data sets to obtain a set of preview data;
providing a user interface that displays at least a portion of the set of preview data, wherein providing the user interface that displays at least the portion of the set of preview data comprises selecting for display a subgroup of the set of preview data that has a reduced sparsity relative to the set of preview data as a whole;
determining one or more final join configurations for combination of the two or more of the plurality of different datasets in response to receiving a user interaction from the user interface;
executing the one or more final join configurations to generate a combined dataset from the two or more of the plurality of different datasets; and
generating the report based on the combined dataset.
2. The computing system of claim 1 , wherein at least one of the two or more of the plurality of different datasets comprises third party application data acquired from a third party application that is separate from the computing system.
3. The computing system of claim 1 , wherein at least one of the two or more of the plurality of different datasets comprises a plurality of employee data elements that correspond to a plurality of employees of an organization.
4. The computing system of claim 1 , wherein automatically generating the one or more proposed join configurations comprises:
automatically inferring, using a machine learning model, a data type for each data element contained in each of the two or more of the plurality of different datasets; and
identifying pairs of data elements in the two or more of the plurality of different datasets that have matching data types.
5. The computing system of claim 1 , wherein automatically generating the one or more proposed join configurations comprises determining a default join configuration that has been previously specified for the two or more of the plurality of different datasets.
6. The computing system of claim 1 , wherein:
at least one of the two or more of the plurality of different datasets comprises a plurality of employee data elements that correspond to a plurality of employees of an organization;
automatically generating the one or more proposed join configurations comprises determining a default join configuration that has been previously specified for the two or more of the plurality of different datasets; and
the default join configuration comprises a join key that uses the plurality of employee data elements as a joining point for the two or more of the plurality of different datasets.
7. The computing system of claim 1 , wherein the operations further comprise:
providing a graphical user interface that displays the one or more proposed join configurations.
8. The computing system of claim 7 , wherein the graphical user interface enables a user to edit the one or more proposed join configurations.
9. The computing system of claim 7 , wherein the graphical user interface enables a user to add an additional join configuration.
10. The computing system of claim 1 , wherein the operations further comprise:
providing a graphical user interface that displays a graphical representation of a schema generated by the combination of the two or more of the plurality of different datasets.
11. The computing system of claim 1 , wherein each of the one or more join configurations comprises a join key that comprises one or more specified data elements used as one or more joining points for the two or more of the plurality of different datasets.
12. The computing system of claim 11 , wherein at least one of the one or more join configurations is a join configuration for joining a given set of datasets, and the operations further comprise:
providing a graphical user interface that displays the one or more join configurations and the join key for each join configuration, wherein the graphical user interface enables a user to edit the join key for the at least one join configuration for joining the given set of datasets.
13. The computing system of claim 1 , wherein the report comprises a custom report and the plurality of requested data elements are specified by a user.
14. The computing system of claim 1 , wherein the report comprises a pre-defined template report and the plurality of requested data elements are pre-defined but modifiable by a user.
15. The computing system of claim 1 , wherein at least one of the plurality of requested data elements comprises a custom field that provides a value calculated according to query expression written in a query language.
16. A computer-implemented method for intelligent generation of data reports, the computer-implemented method comprising:
receiving, by a computing system comprising one or more computing devices, a request for generation of a report, wherein the report comprises a plurality of requested data elements;
identifying, by the computing system, two or more of a plurality of different datasets that collectively contain the plurality of requested data elements;
automatically generating, by the computing system, one or more proposed join configurations for combination of the two or more of the plurality of different datasets;
sampling, by the computing system, the two or more of the plurality of different data sets to obtain a set of preview data;
providing, by the computing system, a user interface that displays at least a portion of the set of preview data, wherein providing the user interface that displays at least the portion of the set of preview data comprises selecting for display a subgroup of the set of preview data that has a reduced sparsity relative to the set of preview data as a whole;
determining, by the computing system, one or more final join configurations for combination of the two or more of the plurality of different datasets in response to receiving a user interaction from the user interface;
executing, by the computing system, the one or more join configurations to generate a combined dataset from the two or more of the plurality of different datasets; and
generating, by the computing system, the report based on the combined dataset.
17. The computer-implemented method of claim 16 , wherein the two or more of the plurality of different datasets comprises:
third party application data acquired from a third party application that is separate from the computing system; and
a plurality of employee data elements that correspond to a plurality of employees of an organization.
18. The computer-implemented method of claim 16 , wherein automatically generating the one or more proposed join configurations comprises:
automatically inferring, using a machine learning model, a data type for each data element contained in each of the two or more of the plurality of different datasets; and
identifying pairs of data elements in the two or more of the plurality of different datasets that have matching data types.
19. The computing system of claim 11 , wherein automatically generating one or more proposed join configurations comprises determining, based at least in part on a number of matching entries between a first data element of a first dataset of the two or more of the plurality of different datasets and a second data element of a second dataset of the two or more of the plurality of different datasets, the join key of at least one of the one or more proposed join configurations.
20. The computing system of claim 11 , wherein automatically generating one or more proposed join configurations comprises determining, based at least in part on a sparsity of a data element of the two or more of the plurality of different datasets, the join key of at least one of the one or more proposed join configurations.
21. The computing system of claim 11 , wherein automatically generating one or more proposed join configurations comprises determining, based at least in part on a scoring function, the join key of at least one of the one or more proposed join configurations.
22. The computing system of claim 11 , wherein the scoring function is based at least in part on at least one of:
a sparsity of a data element of the two or more of the plurality of different datasets;
a degree of matching between a first data element of a first dataset of the two or more of the plurality of different datasets and a second data element of a second dataset of the two or more of the plurality of different datasets; and
a pre-defined prioritization associated with one or more data elements of the two or more of the plurality of different datasets.
23. The computing system of claim 11 , wherein the operations further comprise:
providing a graphical user interface that displays the one or more join configurations and the join key for each join configuration, wherein:
the graphical user interface enables a user to edit the join key for each join configuration; and
the graphical user interface displays at least one of:
a sparsity associated with the join key; and
a matching score associated with the join key.