Automatically transforming data into a compacted electronic data structure
One example described herein can involve a system that receives, from a user, a structured document that describes one or more conditions selected by the user to customize one or more electronic data structures. The system can also query a database to retrieve data from the database. The system can then execute an interpreter program, which can ingest the structured document and the data, identify a subset of the data that satisfies the condition(s), and generate the one or more electronic data structures based on the subset of the data. The electronic data structure(s) can include the identified subset of the data and exclude a remainder of the data. The system can compact the electronic data structure(s) by removing empty fields therein. The system can then provide the compacted data structure(s) to the user.
1. A method comprising:
receiving, by one or more processors, a predefined structured document drafted by a user in a human-readable declarative language, wherein the predefined structured document is a transferrable file, wherein the structured document describes one or more conditions selected by the user to customize one or more electronic data structures, wherein the one or more conditions are defined in the structured document using the human-readable declarative language, and wherein the one or more conditions specify variable values selected by the user for inclusion in the one or more electronic data structures;
querying, by the one or more processors, a database to retrieve data from the database, wherein the querying is performed independently of the one or more conditions expressed in the predefined structured document;
ingesting, by an interpreter program executing on the one or more processors, the structured document and the data;
filtering, by the interpreter program, the data retrieved from the database based on the one or more conditions specified in the structured document to identify a subset of the data that satisfies the one or more conditions;
generating, by the interpreter program executing on the one or more processors, the one or more electronic data structures based on the subset of the data, wherein the one or more electronic data structures include the identified subset of the data and exclude a remainder of the data;
after generating the one or more electronic data structures, compacting, by the one or more processors, the one or more electronic data structures by removing empty fields from the one or more electronic data structures, to thereby generate one or more compacted data structures; and
providing, by the one or more processors, the one or more compacted data structures to the user.
2. The method of claim 1 , further comprising:
determining a first format of the data;
determining, based on the structured document, a second format in which the data is to be organized in the one or more electronic data structures; and
selecting the interpreter program from among a plurality of interpreter programs based on the first format of the data and the second format for the one or more electronic data structures, wherein each interpreter program of the plurality of interpreter programs is configured to process input data in a respective input format and output corresponding data structures in a respective output format.
3. The method of claim 1 , wherein the one or more conditions include a particular value for a particular variable being present in the data.
4. The method of claim 1 , wherein the one or more conditions include a particular type of variable being present in the data.
5. The method of claim 1 , wherein the one or more conditions include a particular data range used for splitting the data into at least two electronic data structures.
6. The method of claim 1 , wherein providing the one or more compacted data structures to the user involves exporting the one or more compacted data structures to a file as one or more spreadsheets.
7. The method of claim 1 , wherein providing the one or more compacted data structures to the user involves outputting the one or more compacted data structures as one or more tables in a graphical user interface that is presented to the user.
8. The method of claim 1 , wherein the one or more electronic data structures include at least two electronic spreadsheets.
9. The method of claim 1 , wherein the human-readable declarative language is eXtensible Markup Language (XML) or JavaScript Object Notation (JSON).
10. The method of claim 1 , wherein the data is organized in the one or more electronic data structures in a second format that is different from a first format of the data.
11. A non-transitory computer-readable medium comprising program code that is executable by one or more processors for causing the one or more processors to perform operations including:
receiving a predefined structured document drafted by a user in a human-readable declarative language, wherein the predefined structured document is a transferrable file, wherein the structured document describes one or more conditions selected by the user to customize one or more electronic data structures, wherein the one or more conditions are defined in the structured document using the human-readable declarative language, and wherein the one or more conditions specify variable values selected by the user for inclusion in the one or more electronic data structures;
querying a database to retrieve data from the database, wherein the querying is performed independently of the one or more conditions expressed in the predefined structured document;
ingesting, by an interpreter program, the structured document and the data;
filtering, by the interpreter program, the data retrieved from the database based on the one or more conditions specified in the structured document to identify a subset of the data that satisfies the one or more conditions;
generating, by the interpreter program, the one or more electronic data structures based on the subset of the data, wherein the one or more electronic data structures include the identified subset of the data and exclude a remainder of the data;
after generating the one or more electronic data structures, compacting the one or more electronic data structures by removing empty fields from the one or more electronic data structures, to thereby generate one or more compacted data structures; and
providing the one or more compacted data structures to the user.
12. The non-transitory computer-readable medium of claim 11 , wherein the operations further comprise:
determining a first format of the data;
determining, based on the structured document, a second format in which the data is to be organized in the one or more electronic data structures; and
selecting the interpreter program from among a plurality of interpreter programs based on the first format of the data and the second format for the one or more electronic data structures, wherein each interpreter program of the plurality of interpreter programs is configured to process input data in a respective input format and output corresponding data structures in a respective output format.
13. The non-transitory computer-readable medium of claim 11 , wherein the one or more conditions include a particular value for a particular variable being present in the data.
14. The non-transitory computer-readable medium of claim 11 , wherein the one or more conditions include a particular type of variable being present in the data.
15. The non-transitory computer-readable medium of claim 11 , wherein the one or more conditions include a particular data range used for splitting the data into at least two electronic data structures.
16. The non-transitory computer-readable medium of claim 11 , wherein providing the one or more compacted data structures to the user involves exporting the one or more compacted data structures to a file as one or more spreadsheets.
17. The non-transitory computer-readable medium of claim 11 , wherein providing the one or more compacted data structures to the user involves outputting the one or more compacted data structures as one or more tables in a graphical user interface that is presented to the user.
18. The non-transitory computer-readable medium of claim 11 , wherein the one or more electronic data structures include at least two electronic spreadsheets, and wherein the empty fields include empty rows or empty columns of the at least two electronic spreadsheets.
19. The non-transitory computer-readable medium of claim 11 , wherein the human-readable declarative language is eXtensible Markup Language (XML) or JavaScript Object Notation (JSON).
20. The non-transitory computer-readable medium of claim 11 , wherein the data is organized in the one or more electronic data structures in a second format that is different from a first format of the data.
21. A system comprising:
one or more processors; and
one or more memories comprising program code that is executable by the one or more processors for causing the one or more processors to perform operations including:
receiving a predefined structured document drafted by a user in a human-readable declarative language, wherein the predefined structured document is a transferrable file, wherein the structured document describes one or more conditions selected by the user to customize one or more electronic data structures, wherein the one or more conditions are defined in the structured document using the human-readable declarative language, and wherein the one or more conditions specify variable values selected by the user for inclusion in the one or more electronic data structures;
querying a database to retrieve data from the database, wherein the querying is performed independently of the one or more conditions expressed in the predefined structured document;
ingesting, by an interpreter program, the structured document and the data;
filtering, by the interpreter program, the data retrieved from the database based on the one or more conditions specified in the structured document to identify a subset of the data that satisfies the one or more conditions;
generating, by the interpreter program, the one or more electronic data structures based on the subset of the data, wherein the one or more electronic data structures include the identified subset of the data and exclude a remainder of the data;
after generating the one or more electronic data structures, compacting the one or more electronic data structures by removing empty fields from the one or more electronic data structures, to thereby generate one or more compacted data structures; and
providing the one or more compacted data structures to the user.
22. The system of claim 21 , wherein the operations further comprise:
determining a first format of the data;
determining, based on the structured document, a second format in which the data is to be organized in the one or more electronic data structures; and
selecting the interpreter program from among a plurality of interpreter programs based on the first format of the data and the second format for the one or more electronic data structures, wherein each interpreter program of the plurality of interpreter programs is configured to process input data in a respective input format and output corresponding data structures in a respective output format.
23. The system of claim 21 , wherein the one or more conditions include a particular value for a particular variable being present in the data.
24. The system of claim 21 , wherein the one or more conditions include a particular type of variable being present in the data.
25. The system of claim 21 , wherein the one or more conditions include a particular data range used for splitting the data into at least two electronic data structures.
26. The system of claim 21 , wherein providing the one or more compacted data structures to the user involves exporting the one or more compacted data structures to a file as one or more spreadsheets.
27. The system of claim 21 , wherein providing the one or more compacted data structures to the user involves outputting the one or more compacted data structures as one or more tables in a graphical user interface that is presented to the user.
28. The system of claim 21 , wherein the one or more electronic data structures include at least two electronic spreadsheets.
29. The system of claim 21 , wherein the human-readable declarative language is eXtensible Markup Language (XML) or JavaScript Object Notation (JSON).
30. The system of claim 21 , wherein the data is organized in the one or more electronic data structures in a second format that is different from a first format of the data.