Systems and methods for intelligent database report generation
Systems, devices, computer-implemented methods, and tangible non-transitory computer-readable media for generating reports from one or more databases that store disparate datasets are provided. Specifically, the proposed systems enable the intelligent generation of reports from multiple datasets by automatically determining a proposed set of join configurations for combination of the multiple datasets. The proposed set of join configurations can be executed as proposed and/or can be edited or customized by the user to generate reports from the multiple datasets. Thus, the proposed systems and methods can provide intuitive and user-friendly tools for generating data reports that accurately synthesize and summarize data contained in multiple different datasets.
1. A computing system for intelligent generation of data reports, the computing system comprising:
one or more processors;
one or more databases that store a set of organizational data, wherein the set of organizational data comprises a plurality of different datasets, and wherein each of the plurality of different datasets comprises a number of respective data elements; and
one or more non-transitory computer-readable media that collectively store instructions that, when executed by the one or more processors cause the computing system to perform operations, the operations comprising:
receiving a request for generation of a report, wherein the report comprises a plurality of requested data elements;
identifying two or more of the plurality of different datasets that collectively contain the plurality of requested data elements;
automatically generating one or more join configurations for combination of the two or more of the plurality of different datasets, wherein each of the one or more join configurations comprises a join key that comprises one or more specified data elements used as one or more joining points for the two or more of the plurality of different datasets, and automatically generating the one or more join configurations comprises:
determining, based at least in part on a number of matching entries between a first data element of a first dataset of the two or more of the plurality of different datasets and a second data element of a second dataset of the two or more of the plurality of different datasets, the join key of at least one of the one or more join configurations;
executing the one or more join configurations to generate a combined dataset from the two or more of the plurality of different datasets; and
generating the report based on the combined dataset.
2. The computing system of claim 1 , wherein at least one of the two or more of the plurality of different datasets comprises third party application data acquired from a third party application that is separate from the computing system.
3. The computing system of claim 1 , wherein at least one of the two or more of the plurality of different datasets comprises a plurality of employee data elements that correspond to a plurality of employees of an organization.
4. The computing system of claim 1 , wherein automatically generating the one or more join configurations comprises:
automatically inferring, using a machine-learned model, a data type for each data element contained in each of the two or more of the plurality of different datasets; and
identifying pairs of data elements in the two or more of the plurality of different datasets that have matching data types.
5. The computing system of claim 1 , wherein automatically generating the one or more join configurations comprises determining a default join configuration that has been previously specified for the two or more of the plurality of different datasets.
6. The computing system of claim 1 , wherein the join key is determined based at least in part on a sparsity of a data element of the two or more of the plurality of different datasets.
7. The computing system of claim 1 , wherein the join key is determined based at least in part on a scoring function.
8. The computing system of claim 7 , wherein the scoring function is based at least in part on at least one of:
a sparsity of a data element of the two or more of the plurality of different datasets;
a degree of matching between a first data element of a first dataset of the two or more of the plurality of different datasets and a second data element of a second dataset of the two or more of the plurality of different datasets; and
a pre-defined prioritization associated with one or more data elements of the two or more of the plurality of different datasets.
9. The computing system of claim 1 , wherein the operations further comprise:
providing a graphical user interface that displays the one or more join configurations.
10. The computing system of claim 9 , wherein the graphical user interface enables a user to edit the one or more join configurations.
11. The computing system of claim 10 , wherein:
the graphical user interface enables a user to edit the join key for each of the one or more join configurations; and
the graphical user interface displays at least one of:
a sparsity associated with the join key; and
a matching score associated with the join key.
12. The computing system of claim 9 , wherein the graphical user interface enables a user to add an additional join configuration.
13. The computing system of claim 1 , wherein the operations further comprise, prior to executing the one or more join configurations to generate the combined dataset:
sampling a subset of entries from each of the two or more of the plurality of different datasets;
combining sampled subsets of entries according to the one or more join configurations to generate a set of preview data; and
providing a graphical user interface that displays at least a portion of the set of preview data.
14. The computing system of claim 13 , wherein providing the graphical user interface that displays at least the portion of the set of preview data comprises selecting for display a subgroup of the set of preview data that has a reduced sparsity relative to the set of preview data as a whole.
15. The computing system of claim 1 , wherein the report comprises a custom report and the plurality of requested data elements are specified by a user.
16. The computing system of claim 1 , wherein the report comprises a pre-defined template report and the plurality of requested data elements are pre-defined but modifiable by a user.
17. The computing system of claim 1 , wherein at least one of the plurality of requested data elements comprises a custom field that provides a value calculated according to query expression written in a query language.
18. A computer-implemented method for intelligent generation of data reports, the method comprising:
receiving, by a computing system comprising one or more computing devices, a request for generation of a report, wherein the report comprises a plurality of requested data elements;
identifying, by the computing system, two or more of a plurality of different datasets that collectively contain the plurality of requested data elements;
automatically generating, by the computing system, one or more join configurations for combination of the two or more of the plurality of different datasets wherein each of the one or more join configurations comprises a join key that comprises one or more specified data elements used as one or more joining points for the two or more of the plurality of different datasets, and automatically generating the one or more join configurations comprises:
determining, based at least in part on a number of matching entries between a first data element of a first dataset of the two or more of the plurality of different datasets and a second data element of a second dataset of the two or more of the plurality of different datasets, the join key of at least one of the one or more join configurations;
executing, by the computing system, the one or more join configurations to generate a combined dataset from the two or more of the plurality of different datasets; and
generating, by the computing system, the report based on the combined dataset.
19. The computer-implemented method of claim 18 , wherein the join key is determined based at least in part on a sparsity of a data element of the two or more of the plurality of different datasets.
20. The computer-implemented method of claim 18 , wherein automatically generating the one or more join configurations comprises:
automatically inferring, using a machine-learned model, a data type for each data element contained in each of the two or more of the plurality of different datasets; and
identifying pairs of data elements in the two or more of the plurality of different datasets that have matching data types.