Automation of workflow creation and failure recovery

1. A computer-implemented method comprising:

receiving a first job in a workflow of jobs to execute;

executing the first job;

determining, via a processor, a plurality of data associated with the first job, wherein the plurality of data comprises data associated with (i) a second job executed immediately prior to the first job, (ii) a third job executed immediately after the first job, (iii) a determination of whether the first job failed or executed successfully and (iv) a type of data associated with the first job;

storing the determined plurality of data;

receiving an analytic job to execute immediately after the third job;

determining two or more related jobs to be executed in the workflow instead of the analytic job based on determining that the analytic job had previously failed and determining that the two or more related jobs, in combination, can be substituted for the analytic job by determining that (i) the two more related jobs perform a same function, while the two or more related jobs are performed in combination, as the analytic job and (ii) the two or more related jobs have not previously failed based on previous analytic job results;

substituting the two or more related jobs for the analytic job in the workflow;

executing the two or more related jobs; and

in a case that the two or more related jobs to be performed in combination cannot be determined, exiting the workflow prior to running any remaining jobs associated with the workflow.

2. The method of claim 1 , wherein the plurality of data further comprises job inputs and job outputs associated with the first job, the second job and the third job.

3. The method of claim 1 , wherein the first job, the second job and the third job are associated with a workflow of analytic jobs.

4. The method of claim 1 , further comprising:

determining that the analytic job executed successfully, and related jobs that have also executed successfully.

5. A non-transitory computer-readable medium comprising instructions executable by a processor of a computing device to cause the computing device to perform a method, the method comprising:

receiving a first job in a workflow of jobs to execute;

executing the first job;

determining, via a processor, a plurality of data associated with the first job, wherein the plurality of data comprises data associated with (i) a second job executed immediately prior to the first job, (ii) a third job executed immediately after the first job, (iii) a determination of whether the first job failed or executed successfully and (iv) a type of data associated with the first job;

storing the determined plurality of data;

receiving an analytic job to execute immediately after the third job;

determining two or more related jobs to be executed in the workflow instead of the analytic job based on determining that the analytic job had previously failed and determining that (i) the two more related jobs perform a same function, while the two or more related jobs are performed in combination, as the analytic job and (ii) the two or more related jobs, in combination, can be substituted for the analytic job by determining that the two or more related jobs have not previously failed based on previous analytic job results;

substituting the two or more related jobs for the analytic job in the workflow;

executing the two or more related jobs; and

in a case that the two or more related jobs to be performed in combination cannot be determined, exiting the workflow prior to running any remaining jobs associated with the workflow.

6. The medium of claim 5 , wherein the plurality of data further comprises job inputs and job outputs associated with the first job, the second job and the third job.

7. The medium of claim 5 , wherein the first job, the second job and the third job are associated with a workflow of analytic jobs.

8. The medium of claim 5 , wherein the method further comprises:

determining that the analytic job executed successfully, and related jobs that have also executed successfully.

9. A system comprising:

a processor;

a non-transitory computer-readable medium comprising instructions executable by the processor to cause the system to perform a method, the method comprising:

receiving a first job in a workflow of jobs to execute;

executing the first job;

determining, via a processor, a plurality of data associated with the first job, wherein the plurality of data comprises data associated with (i) a second job executed immediately prior to the first job, (ii) a third job executed immediately after the first job, (iii) a determination of whether the first job failed or executed successfully and (iv) a type of data associated with the first job;

storing the determined plurality of data;

receiving an analytic job to execute immediately after the third job;

determining two or more related jobs to be executed in the workflow instead of the analytic job based on determining that the analytic job had previously failed and determining that (i) the two more related jobs perform a same function, while the two or more related jobs are performed in combination, as the analytic job and (ii) the two or more related jobs, in combination, can be substituted for the analytic job by determining that the two or more related jobs have not previously failed based on previous analytic job results;

substituting the two or more related jobs for the analytic job in the workflow;

executing the two or more related jobs; and

in a case that the two or more related jobs to be performed in combination cannot be determined, exiting the workflow prior to running any remaining jobs associated with the workflow.

10. The system of claim 9 , wherein the plurality of data further comprises job inputs and job outputs associated with the first job, the second job and the third job.

11. The system of claim 9 , wherein the first job, the second job and the third job are associated with a workflow of analytic jobs.

12. The system of claim 9 , wherein the method further comprises:

determining that the analytic job executed successfully, and related jobs that have also executed successfully.

13. The system of claim 9 , wherein the system comprises a Hadoop system.