Detecting analysis model compatibilities with complex experiment designs to generate experiment design and analysis model compatibility graphical user interfaces
The present disclosure relates to systems, non-transitory computer-readable media, and methods for generating and displaying compatibility metrics between experiment designs and data analysis models. For example, the disclosed systems can display an experiment design user interface that enables user selections of a modular experiment design and data analysis models for the experiment design. Furthermore, the disclosed systems can extract (or identify) one or more analysis code validation components from data analysis models that detect design errors (e.g., incompatibilities) between selected data analysis models and the experiment design. Additionally, the disclosed systems can compare the one or more analysis code validation components to the experiment design to detect compatibilities between the selected data analysis models with the experiment design. Moreover, the disclosed systems can also display, within graphical user interfaces, the detected compatibilities between selected data analysis models and the experiment design during scheduling of the modular experiment design.
1 . A computer-implemented method comprising:
providing, for display via an experiment design user interface, one or more experiment design selection elements and one or more data analysis model selection elements;
in response to a user interaction with the one or more experiment design selection elements and the one or more data analysis model selection elements, identifying an experiment design comprising one or more experiment process components and a data analysis model;
generating an analysis code validation graph by:
extracting one or more analysis tasks from the data analysis model;
extracting one or more analysis code validation components from the data analysis model; and
combining the one or more analysis tasks and the one or more analysis code validation components to generate the analysis code validation graph;
generating an experiment pre-runtime compatibility metric by comparing the one or more experiment process components and the analysis code validation graph; and
providing, for display within a compatibility graphical user interface, a compatibility element indicating the experiment pre-runtime compatibility metric of the data analysis model relative to the experiment design representing whether the one or more experiment process components of the experiment design satisfy one or more conditions of the one or more analysis code validation components of the data analysis model.
2 . The computer-implemented method of claim 1 , further comprising generating the analysis code validation graph by generating a directed acyclic graph for the data analysis model comprising at least one analysis model task node, at least one analysis code validation component node from the one or more analysis code validation components, and at least one dependent analysis model task node with an edge from the at least one analysis model task node.
3 . The computer-implemented method of claim 2 , further comprising comparing the one or more experiment process components and the analysis code validation graph by comparing the at least one analysis code validation component node, of the at least one analysis model task node, to the one or more experiment process components to generate the experiment pre-runtime compatibility metric.
4 . The computer-implemented method of claim 3 , further comprising, upon determining the one or more experiment process components do not satisfy one or more conditions of the at least one analysis code validation component node, generating a negative experiment pre-runtime compatibility metric for the at least one analysis model task node.
5 . The computer-implemented method of claim 4 , further comprising disabling the at least one analysis model task node based on the negative experiment pre-runtime compatibility metric.
6 . The computer-implemented method of claim 5 , further comprising executing the experiment design with the at least one analysis model task node disabled and an additional analysis model task node from the analysis code validation graph enabled.
7 . The computer-implemented method of claim 4 , further comprising providing, for display within the compatibility graphical user interface, the compatibility element indicating an analysis task corresponding to the at least one analysis model task node as incompatible relative to the experiment design with a description representing the one or more conditions of the at least one analysis code validation component node.
8 . The computer-implemented method of claim 1 , further comprising generating the experiment pre-runtime compatibility metric by generating a positive experiment pre-runtime compatibility metric based on determining the one or more experiment process components satisfy the one or more analysis code validation components from the analysis code validation graph.
9 . The computer-implemented method of claim 1 , further comprising:
in response to a negative experiment pre-runtime compatibility metric, identifying a modified experiment design comprising one or more modified experiment process components based on additional user interactions with one or more additional experiment design elements; and
providing, for display within the compatibility graphical user interface, an additional compatibility element indicating an additional experiment pre-runtime compatibility metric of the data analysis model relative to the modified experiment design.
10 . A system comprising:
at least one processor; and
at least one non-transitory computer-readable storage medium storing instructions that, when executed by the at least one processor, cause the system to:
provide, for display via an experiment design user interface, one or more experiment design selection elements and one or more data analysis model selection elements;
in response to a user interaction with the one or more experiment design selection elements and the one or more data analysis model selection elements, identify an experiment design comprising one or more experiment process components and a data analysis model;
generate an analysis code validation graph by:
extracting one or more analysis tasks from the data analysis model;
extracting one or more analysis code validation components from the data analysis model; and
combining the one or more analysis tasks and the one or more analysis code validation components to generate the analysis code validation graph;
generate an experiment pre-runtime compatibility metric by comparing the one or more experiment process components and the analysis code validation graph; and
provide, for display within a compatibility graphical user interface, a compatibility element indicating the experiment pre-runtime compatibility metric of the data analysis model relative to the experiment design representing whether the one or more experiment process components of the experiment design satisfy one or more conditions of the one or more analysis code validation components of the data analysis model.
11 . The system of claim 10 , wherein the instructions cause the system to generate the analysis code validation graph by generating a directed acyclic graph for the data analysis model comprising at least one analysis model task node, at least one analysis code validation component node from the one or more analysis code validation components, and at least one dependent analysis model task node with an edge from the at least one analysis model task node.
12 . The system of claim 11 , wherein the instructions cause the system to:
compare the one or more experiment process components and the analysis code validation graph by comparing the at least one analysis code validation component node, of the at least one analysis model task node, to the one or more experiment process components to generate the experiment pre-runtime compatibility metric; and
upon determining the one or more experiment process components do not satisfy one or more conditions of the at least one analysis code validation component node, generate a negative experiment pre-runtime compatibility metric for the at least one analysis model task node.
13 . The system of claim 12 , wherein the instructions cause the system to provide, for display within the compatibility graphical user interface, the compatibility element indicating an analysis task corresponding to the at least one analysis model task node as incompatible relative to the experiment design with a description representing the one or more conditions of the at least one analysis code validation component node.
14 . The system of claim 10 , wherein the instructions cause the system to generate the experiment pre-runtime compatibility metric by generating a positive experiment pre-runtime compatibility metric based on determining the one or more experiment process components satisfy the one or more analysis code validation components from the analysis code validation graph.
15 . The system of claim 10 , wherein the instructions cause the system to:
in response to a negative experiment pre-runtime compatibility metric, identifying a modified experiment design comprising one or more modified experiment process components based on additional user interactions with one or more additional experiment design elements; and
provide, for display within the compatibility graphical user interface, an additional compatibility element indicating an additional experiment pre-runtime compatibility metric of the data analysis model relative to the modified experiment design.
16 . A non-transitory computer-readable medium storing instructions that, when executed by at least one processor, cause a computing device to:
provide, for display via an experiment design user interface, one or more experiment design selection elements and one or more data analysis model selection elements;
in response to a user interaction with the one or more experiment design selection elements and the one or more data analysis model selection elements, identify an experiment design comprising one or more experiment process components and a data analysis model;
generate an analysis code validation graph by:
extracting one or more analysis tasks from the data analysis model;
extracting one or more analysis code validation components from the data analysis model; and
combining the one or more analysis tasks and the one or more analysis code validation components to generate the analysis code validation graph;
generate an experiment pre-runtime compatibility metric by comparing the one or more experiment process components and the analysis code validation graph; and
provide, for display within a compatibility graphical user interface, a compatibility element indicating the experiment pre-runtime compatibility metric of the data analysis model relative to the experiment design representing whether the one or more experiment process components of the experiment design satisfy one or more conditions of the one or more analysis code validation components of the data analysis model.
17 . The non-transitory computer-readable medium of claim 16 , wherein the instructions cause the computing device to generate the analysis code validation graph by generating a directed acyclic graph for the data analysis model comprising at least one analysis model task node, at least one analysis code validation component node from the one or more analysis code validation components, and at least one dependent analysis model task node with an edge from the at least one analysis model task node.
18 . The non-transitory computer-readable medium of claim 16 , wherein the instructions cause the computing device to generate the experiment pre-runtime compatibility metric by generating a negative experiment pre-runtime compatibility metric based on determining the one or more experiment process components do not satisfy the one or more analysis code validation components from the analysis code validation graph.
19 . The non-transitory computer-readable medium of claim 18 , wherein the instructions cause the computing device to:
in response to a negative experiment pre-runtime compatibility metric, identifying a modified experiment design comprising one or more modified experiment process components based on additional user interactions with one or more additional experiment design elements; and
providing, for display within the compatibility graphical user interface, an additional compatibility element indicating an additional experiment pre-runtime compatibility metric of the data analysis model relative to the modified experiment design.
20 . The non-transitory computer-readable medium of claim 16 , wherein the instructions cause the computing device to generate the experiment pre-runtime compatibility metric by generating a positive experiment pre-runtime compatibility metric based on determining the one or more experiment process components satisfy the one or more analysis code validation components from the analysis code validation graph.