Stream processing of telemetry for a network topology
Systems and methods include receiving messages from local security agents each on a host in a network, wherein the messages include network topology of the network in terms of addresses and sockets; incrementally creating a network topology of the network based on the messages; determining security policies for one or more microsegments in the network based on flow data and the network topology; and providing the security policies to respective hosts for local implementation of the one or more microsegments.
1. A method comprising steps of:
receiving messages from local security agents each on a host in a network, wherein the messages include network topology of the network in terms of addresses and sockets;
incrementally creating a network topology of the network based on the messages;
determining security policies for one or more microsegments in the network based on flow data and the network topology;
providing the security policies to respective hosts for local implementation of the one or more microsegments; and
in a local security agent,
processing raw network address events;
processing raw socket events; and
combining the raw network address events and the raw socket events.
2. The method of claim 1 , wherein the steps further include
receiving updated messages which change the network topology; and
redetermining the security policies for the one or more microsegments.
3. The method of claim 1 , wherein the raw network address events are processed by dividing addresses into groups based on any of remote system identifier, address family, and namespace.
4. The method of claim 1 , wherein the combining includes any of wildcard sockets create one resolved socket for each network address in a matching group,
single IP sockets create one resolved socket if and only if there is a network address with a matching IP address, and
changes to either network addresses or sockets triggers a new comparison.
5. The method of claim 1 , wherein the method is implemented by a cloud-based system.
6. The method of claim 5 , wherein the local implementation of the one or more microsegments is via the local security agents.
7. An apparatus comprising at least one processor and memory storing instructions that, when executed, cause the at least one processor to implement steps of:
receiving messages from local security agents each on a host in a network, wherein the messages include network topology of the network in terms of addresses and sockets;
incrementally creating a network topology of the network based on the messages;
determining security policies for one or more microsegments in the network based on flow data and the network topology;
providing the security policies to respective hosts for local implementation of the one or more microsegments; and
in a local security agent,
processing raw network address events;
processing raw socket events; and
combining the raw network address events and the raw socket events.
8. The apparatus of claim 7 , wherein the steps further include
receiving updated messages which change the network topology; and
redetermining the security policies for the one or more microsegments.
9. The apparatus of claim 7 , wherein the raw network address events are processed by dividing addresses into groups based on any of remote system identifier, address family, and namespace.
10. The apparatus of claim 7 , wherein the combining includes any of wildcard sockets create one resolved socket for each network address in a matching group,
single IP sockets create one resolved socket if and only if there is a network address with a matching IP address, and
changes to either network addresses or sockets triggers a new comparison.
11. The apparatus of claim 7 , wherein the steps are implemented by a cloud-based system.
12. The apparatus of claim 11 , wherein the local implementation of the one or more microsegments is via the local security agents.
13. A non-transitory computer-readable medium comprising instructions that, when executed, cause at least one processor to perform steps of:
receiving messages from local security agents each on a host in a network, wherein the messages include network topology of the network in terms of addresses and sockets;
incrementally creating a network topology of the network based on the messages;
determining security policies for one or more microsegments in the network based on flow data and the network topology; and
providing the security policies to respective hosts for local implementation of the one or more microsegments; and
in a local security agent,
processing raw network address events;
processing raw socket events; and
combining the raw network address events and the raw socket events.
14. The non-transitory computer-readable medium of claim 13 , wherein the steps further include
receiving updated messages which change the network topology; and
redetermining the security policies for the one or more microsegments.
15. The non-transitory computer-readable medium of claim 13 , wherein the raw network address events are processed by dividing addresses into groups based on any of remote system identifier, address family, and namespace.
16. The non-transitory computer-readable medium of claim 13 , wherein the combining includes any of
wildcard sockets create one resolved socket for each network address in a matching group,
single IP sockets create one resolved socket if and only if there is a network address with a matching IP address, and
changes to either network addresses or sockets triggers a new comparison.
17. The non-transitory computer-readable medium of claim 13 , wherein the steps are implemented by a cloud-based system.