System and method for identifying external connections in a streaming application
A method, computer program product, and computing device for monitoring network activity associated with streaming a data load through a stream application including a plurality of stream operators deployed on a plurality of computing devices. One or more stream operators with one or more external connections may be identified from the plurality of stream operators. The identified one or more stream operators may be deployed based upon, at least in part, the one or more external connections.
1. A computer-implemented method comprising:
monitoring, at a computing device, network activity associated with streaming a data load through a stream application including a plurality of stream operators deployed on a plurality of computing devices;
identifying one or more stream operators with one or more external connections from the plurality of stream operators; and
deploying the identified one or more stream operators based upon, at least in part, the one or more external connections.
2. The computer-implemented method of claim 1 , wherein monitoring the network activity associated with streaming the data load includes:
profiling at least one stream operator of the plurality of stream operators with expected connection information during development of the stream application; and
associating the expected connection information with the at least one stream operator.
3. The computer-implemented method of claim 1 , wherein identifying the one or more stream operators includes:
identifying one or more internal connections between the plurality of stream operators from the monitored network activity associated with streaming the data load; and
filtering the one or more stream operators with external connections from the plurality of stream operators based upon, at least in part, identifying the one or more internal connections between the plurality of stream operators.
4. The computer-implemented method of claim 1 , wherein deploying the identified one or more stream operators with the one or more external connections includes:
deploying at least one of the identified one or more stream operators on one or more computing devices designated for external connections.
5. The computer-implemented method of claim 1 , wherein deploying the identified one or more stream operators with the one or more external connections includes:
fusing at least one of the identified one or more stream operators to one or more other stream operators of the plurality of stream operators.
6. The computer-implemented method of claim 1 , wherein deploying the identified one or more stream operators with the one or more external connections includes:
wrapping at least one of the identified one or more stream operators with additional exception handling.
7. The computer-implemented method of claim 1 , wherein deploying the identified one or more stream operators with the one or more external connections includes:
deploying at least one of the identified one or more stream operators in a consistent region.
8. The computer-implemented method of claim 1 , further comprising:
displaying external connection information associated with the one or more external connections from the plurality of stream operators in a user interface.
9. The computer-implemented method of claim 8 , wherein deploying the identified one or more stream operators includes deploying the identified one or more stream operators via the user interface.
10. A computer program product comprising a non-transitory computer readable storage medium having a plurality of instructions stored thereon, which, when executed by a processor, cause the processor to perform operations comprising:
monitoring, at a computing device, network activity associated with streaming a data load through a stream application including a plurality of stream operators deployed on a plurality of computing devices;
identifying one or more stream operators with one or more external connections from the plurality of stream operators; and
deploying the identified one or more stream operators based upon, at least in part, the one or more external connections.
11. The computer program product of claim 10 , wherein monitoring the network activity associated with streaming the data load includes:
profiling at least one stream operator of the plurality of stream operators with expected connection information during development of the stream application; and
associating the expected connection information with the at least one stream operator.
12. The computer program product of claim 10 , wherein identifying the one or more stream operators includes:
identifying one or more internal connections between the plurality of stream operators from the monitored network activity associated with streaming the data load; and
filtering the one or more stream operators with external connections from the plurality of stream operators based upon, at least in part, identifying the one or more internal connections between the plurality of stream operators.
13. The computer program product of claim 10 , wherein deploying the identified one or more stream operators with the one or more external connections includes:
deploying at least one of the identified one or more stream operators on one or more computing devices designated for external connections.
14. The computer program product of claim 10 , wherein deploying the identified one or more stream operators with the one or more external connections includes:
fusing at least one of the identified one or more stream operators to one or more other stream operators of the plurality of stream operators.
15. The computer program product of claim 10 , wherein deploying the identified one or more stream operators with the one or more external connections includes:
wrapping at least one of the identified one or more stream operators with additional exception handling.
16. The computer program product of claim 10 , wherein deploying the identified one or more stream operators with the one or more external connections includes:
deploying at least one of the identified one or more stream operators in a consistent region.
17. The computer program product of claim 10 , further comprising:
displaying external connection information associated with the one or more external connections from the plurality of stream operators in a user interface.
18. The computer program product of claim 17 , wherein deploying the identified one or more stream operators includes deploying the identified one or more stream operators via the user interface.
19. A computing system including one or more processors and one or more memories configured to perform operations comprising:
monitoring, at a computing device, network activity associated with streaming a data load through a stream application including a plurality of stream operators deployed on a plurality of computing devices;
identifying one or more stream operators with one or more external connections from the plurality of stream operators; and
deploying the identified one or more stream operators based upon, at least in part, the one or more external connections.
20. The computing system of claim 19 , wherein monitoring the network activity associated with streaming the data load includes:
profiling at least one stream operator of the plurality of stream operators with expected connection information during development of the stream application; and
associating the expected connection information with the at least one stream operator.