Network packet de-duplication
Embodiments are directed to monitoring network traffic over a network. A monitoring engine may monitor flows of network packets in the network. The monitoring engine may determine an observation port that provided the network packets. The monitoring engine may determine primary network packets provided by an authoritative observation port based on which observation port provided the network packets and provide them to an analysis engine. The monitoring engine may discard a remainder of the network packets that may be associated with non-authoritative observation ports. The analysis engine may analyze the one or more primary network packets.
1. A method for monitoring network traffic over a network, wherein one or more processors in one or more network monitoring computers (NMCs) execute instructions to perform actions, comprising:
employing a plurality of observation ports to monitor one or more flows of network packets based on one or more of a characteristic of an observation port or a characteristic of a network packet monitored by the observation port;
employing the plurality of observation ports to determine one or more authoritative observation ports, wherein one or more of the monitored network packets associated with the one or more authoritative observation ports is identified as one or more primary network packets;
changing identification of an observation port as authoritative to a different observation port based on one or more observed changes in the one or more characteristics of the one or more flows of network packets; and
providing information for the one or more flows based on the one or more primary network packets.
2. The method of claim 1 , wherein determining the one or more authoritative observation ports further comprises employing one or more of static configuration information, dynamic configuration information, heuristics, or rules.
3. The method of claim 1 , further comprising one or more of:
discarding the one or more monitored network packets unassociated with the one or more authoritative observation ports; or
identifying as duplicative the one or more monitored network packets unassociated with the one or more authoritative observation ports.
4. The method of claim 1 , wherein the provided information is employed to perform one or more further actions including:
applying one or more policies to reduce double counting of duplicative monitored network packets for the one or more flows; or
providing metrics for the one or more flows based on non-duplicative monitored network packets.
5. The method of claim 1 , further comprising:
employing the monitored network packets to identify one or more devices on a network that operate as a router or provide a router interface.
6. The method of claim 1 , wherein employing the plurality of observation ports to monitor the one or more flows of network packets further comprises:
determining one or more of the plurality of observation ports based on an association of the observation port with a flow based on a path used by one or more of the monitored network packets.
7. A system for monitoring network traffic over a network between one or more computers comprising:
one or more network monitoring computers (NMCs), comprising:
a memory that stores at least instructions; and
one or more processors that execute instructions that perform actions, including:
employing a plurality of observation ports to monitor one or more flows of network packets based on one or more of a characteristic of an observation port or a characteristic of a network packet monitored by the observation port;
employing the plurality of observation ports to determine one or more authoritative observation ports, wherein one or more of the monitored network packets associated with the one or more authoritative observation ports is identified as one or more primary network packets;
changing identification of an observation port as authoritative to a different observation port based on one or more observed changes in the one or more characteristics of the one or more flows of network packets; and
providing information for the one or more flows based on the one or more primary network packets.
8. The system of claim 7 , wherein determining the one or more authoritative observation ports further comprises employing one or more of static configuration information, dynamic configuration information, heuristics, or rules.
9. The system of claim 7 , further comprising one or more of:
discarding the one or more monitored network packets unassociated with the one or more authoritative observation ports; or
identifying as duplicative the one or more monitored network packets unassociated with the one or more authoritative observation ports.
10. The system of claim 7 wherein the provided information is employed to perform one or more further actions including:
applying one or more policies to reduce double counting of duplicative monitored network packets for the one or more flows; or
providing metrics for the one or more flows based on non-duplicative monitored network packets.
11. The system of claim 7 , further comprising:
employing the monitored network packets to identify one or more devices on a network that operate as a router or provide a router interface.
12. The system of claim 7 , wherein employing the plurality of observation ports to monitor the one or more flows of network packets further comprises:
determining one or more of the plurality of observation ports based on an association of the observation port with a flow based on a path used by one or more of the monitored network packets.
13. A processor readable non-transitory storage media that includes instructions for monitoring network traffic over a network between one or more computers, wherein execution of the instructions by one or more processors on one or more network monitoring computers (NMCs) performs actions, comprising:
employing a plurality of observation ports to monitor one or more flows of network packets based on one or more of a characteristic of an observation port or a characteristic of a network packet monitored by the observation port;
employing the plurality of observation ports to determine one or more authoritative observation ports, wherein one or more of the monitored network packets associated with the one or more authoritative observation ports is identified as one or more primary network packets;
changing identification of an observation port as authoritative to a different observation port based on one or more observed changes in the one or more characteristics of the one or more flows of network packets; and
providing information for the one or more flows based on the one or more primary network packets.
14. The processor readable non-transitory storage media of claim 13 , wherein determining the one or more authoritative observation ports further comprises employing one or more of static configuration information, dynamic configuration information, heuristics, or rules.
15. The processor readable non-transitory storage media of claim 13 , further comprising one or more of:
discarding the one or more monitored network packets unassociated with the one or more authoritative observation ports; or
identifying as duplicative the one or more monitored network packets unassociated with the one or more authoritative observation ports.
16. The processor readable non-transitory storage media of claim 13 , wherein the provided information is employed to perform one or more further actions including:
applying one or more policies to reduce double counting of duplicative monitored network packets for the one or more flows; or
providing metrics for the one or more flows based on non-duplicative monitored network packets.
17. The processor readable non-transitory storage media of claim 13 , further comprising:
employing the monitored network packets to identify one or more devices on a network that operate as a router or provide a router interface.