Systems and methods for smart tools in sequence pipelines
The invention relates to bioinformatics pipelines and wrapper scripts that call executables in those pipelines and that also identify beneficial changes to the pipelines. A tool in a pipeline has a smart wrapper that can cause the tool to analyze the sequence data it receives but that can also select a change to the pipeline when circumstances warrant. In certain aspects, the invention provides a system for genomic analysis. The system includes a processor coupled to a non-transitory memory. The system is operable to present to a user a plurality of genomic tools organized into a pipeline. At least a first one of the tools comprises an executable and a wrapper script. The system can receive instructions from the user and sequence data—instructions that call for the sequence data to be analyzed by the pipeline—and select, using the wrapper script, a change to the pipeline.
1. A method for processing a bioinformatics pipeline, the method comprising:
receiving, from a user, instructions to process a bioinformatics pipeline, the bioinformatics pipeline comprising a plurality of genomic tools, wherein at least a first one of the genomic tools comprises an executable and wrapper metadata;
creating a first job for execution, the first job comprising the executable of the first one of the genomic tools and input data, wherein the first job further comprises a cloud instance;
modifying the bioinformatics pipeline to avoid an error relating to the executable of the first genomic tool, the modification comprising replacing the executable of the first job with an executable of an alternative genomic tool according to the wrapper metadata of the first one of the genomic tools;
and
initiating execution of the first job on the cloud instance, wherein the modification of the first job avoids the error.
2. The method of claim 1 , further comprising modifying the bioinformatics pipeline to avoid an error that relates to an insufficient resource condition.
3. The method of claim 2 , wherein modifying the bioinformatics pipeline to avoid an error related to an insufficient resource condition comprises determining a need for additional resources from the wrapper metadata, and requesting the additional resources for execution of the alternative genomic tool.
4. The method of claim 3 , wherein the requested additional resources include sufficient computing power to avoid the insufficient resource condition.
5. The method of claim 4 , wherein the requested additional resources include sufficient computer processors to avoid the insufficient resource condition.
6. The method of claim 3 , wherein the requested additional resources include sufficient storage space to avoid the insufficient resource condition.
7. The method of claim 1 , wherein creating the first job for execution further comprises:
initiating execution, on a first cloud instance, of the first job; and
receiving, from the first cloud instance, the error from the executable of the first genomic tool;
wherein modifying the bioinformatics pipeline is performed in response to receiving the error.
8. The method of claim 1 , wherein the executable includes a sequence alignment program and the alternative genomic tool includes an alternative sequence alignment program.
9. The method of claim 1 , wherein replacing the executable of the first genomic tool further comprises replacing the first job with a set of jobs.
10. The method of claim 9 , wherein replacing the first job with a set of jobs comprises calling for a second one of the tools in the bioinformatics pipeline to generate ancillary data from the input data, the ancillary data to be used as input data by the executable of the alternative genomic tool.
11. The method of claim 3 , wherein the requested additional resources include a data file not provided by the user and not included in the input data.
12. The method of claim 1 , wherein modifying the bioinformatics pipeline to avoid an error further comprises adding a flag to instructions that send a parameter to the executable of the alternative genomic tool, wherein the parameter controls how the executable of the alternative genomic tool analyzes the input data.
13. The method of claim 1 , wherein the wrapper metadata comprises a script that detects an inconsistency.
14. The method of claim 13 , wherein the script detects an inconsistency between the executable and input data of the first job.
15. The method of claim 13 , wherein the script modifies the bioinformatics pipeline to avoid the error.
16. The method of claim 1 , further comprising prompting the user to allow the modification.
17. The method of claim 1 , wherein the cloud instance is selected based on the wrapper metadata.
18. A system for processing a bioinformatics pipeline, the system comprising:
at least one computer hardware processor; and
at least one non-transitory computer-readable storage medium storing processor-executable instructions that, when executed by the at least one computer hardware processor, cause the at least one computer hardware processor to perform:
receiving, from a user, instructions to process a bioinformatics pipeline, the bioinformatics pipeline comprising a plurality of genomic tools, wherein at least a first one of the genomic tools comprises an executable and wrapper metadata;
creating a first job for execution, the first job comprising the executable of the first one of the genomic tools and input data, wherein the first job further comprises a cloud instance;
modifying the bioinformatics pipeline to avoid an error relating to the executable of the first genomic tool, the modification comprising replacing the executable of the first job with an executable of an alternative genomic tool according to the wrapper metadata of the first one of the genomic tools;
and
initiating execution of the first job on the cloud instance, wherein the modification of the first job avoids the error.
19. The system of claim 18 , wherein modifying the bioinformatics pipeline to avoid an error related to an insufficient resource condition comprises determining a need for additional resources from the wrapper metadata, and requesting the additional resources for execution of the alternative genomic tool.
20. The method of claim 17 , wherein the cloud instance is selected based on resource requirements specified in the wrapper metadata.