User interface data sample transformer
An approach for transforming a large dataset using user interface-based transformations applied to a sample of the dataset is disclosed. The sample of the large dataset has the same or similar format as the large dataset. A user can quickly apply transformations to the sample dataset using UI-based instructions. The UI-based instructions can be used to create a transformation job that can be configured to run on a backed database, such as a distributed database, to apply the transformations to the large dataset.
1. A system comprising:
one or more computer processors; and
one or more computer-readable mediums storing instructions that, when executed by the one or more computer processors, cause the system to perform operations comprising:
receiving a request to apply a set of data transformations to convert an input data set into a validated format that can be parsed by a data visualization application;
executing the set of data transformations on a sample dataset that is a subset of the input data set, wherein executing the set of data transformations yields one or more errors;
causing presentation of data identifying the one or more errors;
receiving one or more additional data transformations to convert the dataset into the validated format;
executing an updated set of data transformations to the sample data set, the updated set of data transformations being based on the set of data transformations and the one or more additional data transformations, wherein execution of the updated set of data transformations completes without error; and
executing the updated set of data transformations on the input dataset to convert the input dataset into the validated format.
2. The system of claim 1 , the operations further comprising:
receiving the input data set in a non-validated format that cannot be parsed by the data visualization application.
3. The system of claim 1 , the operations further comprising:
generating database-executable code defining the updated set of data transformations based on browser-executable code defining the data transformations, the browser-executable code having been used to execute the updated set of data transformations to the sample data set.
4. The system of claim 1 , wherein the data visualization application is configured to parse the input data in the validated format to cause a visualization of the input data, the visualization including at least one of: a point plot, a network graph, or a histogram.
5. The system of claim 1 , the operations further comprising:
receiving an additional input dataset in the non-validated format; and
in response to receiving the additional input dataset, automatically executing the updated set of data transformations to convert the additional input dataset into the validated format.
6. The system of claim 5 , the operations further comprising:
receiving a request to filter a portion of the input dataset that is in the validated format;
in response to receiving the request, generating a first filtered dataset extracted from the input dataset that is in the validated format;
receiving a refresh request for the first filtered dataset; and
in response to receiving the refresh request, generating a second filtered dataset that includes validated data from the additional input dataset in the validated format.
7. The system of claim 1 , wherein the set of data transformations and the one or more additional data transformations are received via a graphical user interface (GUI) comprising one or more display objects that are configured to initiate pre-configured transformations to datasets using a browser-executable code type upon the one or more display objects being selected through the GUI.
8. A method comprising:
receiving a request to apply a set of data transformations to convert an input data set into a validated format that can be parsed by a data visualization application;
executing the set of data transformations on a sample dataset that is a subset of the input data set, wherein executing the set of data transformations yields one or more errors;
causing presentation of data identifying the one or more errors;
receiving one or more additional data transformations to convert the dataset into the validated format;
executing an updated set of data transformations to the sample data set, the updated set of data transformations being based on the set of data transformations and the one or more additional data transformations, wherein execution of the updated set of data transformations completes without error; and
executing the updated set of data transformations on the input dataset to convert the input dataset into the validated format.
9. The method of claim 8 , further comprising:
receiving the input data set in a non-validated format that cannot be parsed by the data visualization application.
10. The method of claim 8 , further comprising:
generating database-executable code defining the updated set of data transformations based on browser-executable code defining the data transformations, the browser-executable code having been used to execute the updated set of data transformations to the sample data set.
11. The method of claim 8 , wherein the data visualization application is configured to parse the input data in the validated format to cause a visualization of the input data, the visualization including at least one of: a point plot, a network graph, or a histogram.
12. The method of claim 8 , further comprising:
receiving an additional input dataset in the non-validated format; and
in response to receiving the additional input dataset, automatically executing the updated set of data transformations to convert the additional input dataset into the validated format.
13. The method of claim 12 , further comprising:
receiving a request to filter a portion of the input dataset that is in the validated format;
in response to receiving the request, generating a first filtered dataset extracted from the input dataset that is in the validated format;
receiving a refresh request for the first filtered dataset; and
in response to receiving the refresh request, generating a second filtered dataset that includes validated data from the additional input dataset in the validated format.
14. The method of claim 8 , wherein the set of data transformations and the one or more additional data transformations are received via a graphical user interface (GUI) comprising one or more display objects that are configured to initiate pre-configured transformations to datasets using a browser-executable code type upon the one or more display objects being selected through the GUI.
15. A non-transitory computer-readable medium storing instructions that, when executed by one or more computer processors of one or more computing devices, cause the one or more computing devices to perform operations comprising:
receiving a request to apply a set of data transformations to convert an input data set into a validated format that can be parsed by a data visualization application;
executing the set of data transformations on a sample dataset that is a subset of the input data set, wherein executing the set of data transformations yields one or more errors;
causing presentation of data identifying the one or more errors;
receiving one or more additional data transformations to convert the dataset into the validated format;
executing an updated set of data transformations to the sample data set, the updated set of data transformations being based on the set of data transformations and the one or more additional data transformations, wherein execution of the updated set of data transformations completes without error; and
executing the updated set of data transformations on the input dataset to convert the input dataset into the validated format.
16. The non-transitory computer-readable medium of claim 15 , the operations further comprising:
receiving the input data set in a non-validated format that cannot be parsed by the data visualization application.
17. The non-transitory computer-readable medium of claim 15 , the operations further comprising:
generating database-executable code defining the updated set of data transformations based on browser-executable code defining the data transformations, the browser-executable code having been used to execute the updated set of data transformations to the sample data set.
18. The non-transitory computer-readable medium of claim 15 , wherein the data visualization application is configured to parse the input data in the validated format to cause a visualization of the input data, the visualization including at least one of: a point plot, a network graph, or a histogram.
19. The non-transitory computer-readable medium of claim 15 , the operations further comprising:
receiving an additional input dataset in the non-validated format; and
in response to receiving the additional input dataset, automatically executing the updated set of data transformations to convert the additional input dataset into the validated format.
20. The non-transitory computer-readable medium of claim 19 , the operations further comprising:
receiving a request to filter a portion of the input dataset that is in the validated format;
in response to receiving the request, generating a first filtered dataset extracted from the input dataset that is in the validated format;
receiving a refresh request for the first filtered dataset; and
in response to receiving the refresh request, generating a second filtered dataset that includes validated data from the additional input dataset in the validated format.