Generating and implementing data integration job execution design recommendations
The method of managing performance of data integration are described. A performance analyzer may receive data about a data integration job execution. The performance analyzer may determine whether there is a performance issue of the data integration job execution. The performance analyzer analyzes the data about the data integration job execution when there is a performance issue. The performance analyzer generates a job execution design recommendation based on the analysis of the data and a set of predefined recommendation rules. The performance analyzer then displays the data about the data integration job execution and when there is a generated job execution design recommendation, displaying the job execution design recommendation.
1. A computer-implemented method of managing performance of data integration comprising:
receiving data about the data integration job execution, wherein the data integration job is for an extract, transform, and load (ETL) job;
determining whether there is a performance issue of the data integration job execution;
analyzing the data about the data integration job execution when there is a performance issue;
generating and implementing a job execution design recommendation based on analyzing the data and a set of predefined recommendation rules, wherein the set of predefined recommendation rules comprises an operator combining recommendation, wherein the operator combining recommendation specifies that the processes of two or more operators are to be carried out by a single operator; and
displaying the data about the data integration job execution and when there is a generated job execution design recommendation, displaying the job execution design recommendation, wherein the displaying the data of the data integration job includes displaying an execution plan of a designed job execution and a process view of one or more processes of an actual job execution.
2. The computer-implemented method of claim 1 , wherein the data received is performance data of the data integration job execution and resource utilization data of an environment in which the data integration job execution is occurring.
3. The computer-implemented method of claim 1 , wherein the receiving the data about the data integration job is performed in real-time.
4. The computer-implemented method of claim 1 , wherein the receiving the data about the data integration job is retrieved from a memory.
5. A performance analyzer, comprising:
a processor; and
a memory communicatively coupled to the processor, wherein the memory is encoded with instructions and wherein the instructions when executed by the processor include:
receive data about the data integration job execution, wherein the data integration job is for an extract, transform, and load (ETL) job;
determine whether there is a performance issue of the data integration job execution;
analyze the data about the data integration job execution when there is a performance issue;
generate and implement a job execution design recommendation based on analyzing the data and a set of predefined recommendation rules, wherein the set of predefined recommendation rules comprises an operator combining recommendation, wherein the operator combining recommendation specifies that the processes of two or more operators are to be carried out by a single operator; and
display the data about the data integration job execution and when there is a generated job execution design recommendation, displaying the job execution design recommendation, wherein the displaying the data of the data integration job includes displaying an execution plan of a designed job execution and a process view of one or more processes of an actual job execution.
6. The performance analyzer of claim 5 , wherein the data received is performance data of the data integration job execution and resource utilization data of an environment in which the data integration job execution is occurring.
7. The performance analyzer of claim 5 , wherein the receiving the data about the data integration job is performed in real-time.
8. The performance analyzer of claim 5 , wherein receiving data about the data integration job is retrieved from a memory.
9. A computer program product of managing performance of data integration, the computer program product comprising a computer readable storage medium having program code embodied therewith, the program code executable by a computer system to:
receive data about the data integration job execution, wherein the data integration job is for an extract, transform, and load (ETL) job;
determine whether there is a performance issue of the data integration job execution;
analyze the data about the data integration job execution when there is a performance issue;
generate and implement a job execution design recommendation based on analyzing the data and a set of predefined recommendation rules, wherein the set of predefined recommendation rules comprises an operator combining recommendation, wherein the operator combining recommendation specifies that the processes of two or more operators are to be carried out by a single operator; and
display the data about the data integration job execution and when there is a generated job execution design recommendation, displaying the job execution design recommendation, wherein the displaying the data of the data integration job includes displaying an execution plan of a designed job execution and a process view of one or more processes of an actual job execution.
10. The computer program product of claim 9 , wherein the data received is performance data of the data integration job execution and resource utilization data of an environment in which the data integration job execution is occurring.
11. The computer program product of claim 9 , wherein the receiving the data about the data integration job is performed in real-time.
12. The computer program product of claim 9 , wherein receiving data about the data integration job is retrieved from a memory.