Virtualization and replay-based system for network debugging
A method and system of analyzing a network to identify a network defect allows user selection of traffic subset to be recorded. After recording the selected traffic subset of the network traffic during network operation, the recorded traffic is then replayed at least in part to the network to replicate, and thus assist in identifying, the network defect.
1. A method of analyzing a network by replaying network traffic flows, the method comprising:
providing, by a computing system, options to a user regarding which network traffic subset from a group of network traffic subsets is to be recorded for a network device;
receiving, by the computing system, a user selection of a network traffic subset that is to be recorded for the network device;
recording, by a recording subsystem of the computing system, the network traffic subset for the network device during operation of the network; and
replaying, by a replaying subsystem of the computing system, at least a portion of the network traffic subset relative to the network device at a user-selected pace so as to facilitate debugging of one or more network defects, wherein the replaying includes reproducing network traffic flows between network devices, including the network device, from the operation of the network.
2. The method of claim 1 , wherein the one or more network defects includes switch central processing unit (CPU) inflation, recurrent broadcast storms, anomalous forwarding, and invalid controller actions.
3. The method of claim 1 , wherein the network is not operating during the replaying.
4. The method of claim 1 , wherein the network is operating during the replaying.
5. The method of claim 1 , wherein the replaying utilizes synthetic network traffic so as to simulate network traffic without recording contents of the network traffic.
6. The method of claim 5 , wherein the network traffic includes packets, each packet having a header portion and a content portion, and wherein the synthetic network traffic includes packets having header portions matching respective header portions in the packets of the network traffic and having content portions that do not match respective content portions in the packets of the network traffic.
7. The method of claim 6 , wherein the content portions of the packets in the synthetic network traffic are randomly generated.
8. The method of claim 1 , wherein the user-selected pace for the replaying is the same as the pace at which the recording was performed.
9. The method of claim 1 , wherein the user-selected pace for the replaying is different from the pace at which the recording was performed.
10. The method of claim 1 , further comprising:
receiving a user selection of a replay mode;
wherein the replaying is based on the selected replay mode.
11. The method of claim 10 , wherein the network device includes a controller, and the replaying comprises replaying recorded control messages sent from the controller.
12. The method of claim 10 , wherein the network device includes a switch, and the replaying comprises replaying recorded control messages sent to the switch.
13. The method of claim 1 , wherein the options provided to the user further comprise options to select a level of detail from a group of levels of detail corresponding to recording the network traffic subset for the network device, the group of levels of detail comprising: packet level, flow level, and application message level.
14. A non-transitory computer readable medium having stored thereon computer executable instructions for analyzing a network by replaying network traffic flows, the computer executable instructions comprising instructions for:
providing options to a user regarding which network traffic subset from a group of network traffic subsets is to be recorded for a network device;
receiving a user selection of a network traffic subset is to be recorded corresponding to the network device;
recording the network traffic subset for the network device during network operation; and
replaying at least a portion of the network traffic subset relative to the network device at a user-selected pace so as to facilitate debugging of one or more network defects, wherein the replaying includes reproducing network traffic flows between network devices, including the network device, from the operation of the network.
15. The non-transitory computer readable medium according to claim 14 , wherein the recording includes recording at least one of control messages and packet headers.
16. The non-transitory computer readable medium according to claim 14 , wherein the replaying utilizes synthetic network traffic so as to simulate the network traffic without recording contents of the network traffic.
17. The non-transitory computer readable medium according to claim 16 , wherein the synthetic network traffic includes packets having header portions and content portions, and wherein the content portions randomly generated.
18. A replay system for analyzing a network by replaying network traffic flows, the replay system comprising:
a recording server, configured to:
provide options to a user regarding which network traffic subset from a group of network traffic subsets is to be recorded for a network device; and
record a network traffic subset, corresponding to a user selection, for the network device during network operation;
at least one database for storing the network traffic subset; and
a replay server, configured replay at least a portion of the network traffic subset relative to the network device at a user-selected pace so as to facilitate debugging of one or more network defects, wherein the replaying includes reproducing network traffic flows between network devices, including the network device, from the operation of the network.