System and method for observing and controlling a programmable network using cross network learning
A system and method for observing and controlling a programmable network via higher layer attributes is disclosed. According to one embodiment, the system includes one or more collectors and a remote network manager. The one or more collectors are configured to receive network traffic data from a plurality of network elements in the network. The remote network manager is configured to connect to the one or more collectors over the Internet via a network interface. The one or more collectors extract metadata from the network traffic data and send the metadata to the network manager.
1. A system for monitoring a network comprising:
a plurality of network systems; and
a computer, comprising a non-transitory machine-readable medium and at least one processor, for executing a remote network manager, the remote network manager comprising a network interface for communicating through the network with the plurality of network systems and configured (i) to collect through the network interface and the network data from the plurality of network systems, (ii) to analyze the collected data to learn a network pattern from a first network system of the plurality of network systems, (iii) to predict a network behavior of a second network system of the plurality of network systems, (iv) to formulate a control policy to send through the network to a set of one or more programmable network elements of the second network system, and (v) to observe the application of the control policy at the set of one or more programmable network elements of the second network system.
2. The system of claim 1 , wherein the remote network manager is further configured to predict performance of an application, a user, or a device based on observed characteristics of the network using network protocol level metrics and metadata.
3. The system of claim 1 , wherein the network pattern is a protocol level metric of the network and metadata of network traffic data.
4. The system of claim 1 further comprising a programmable controller that controls at least some of the set of programmable network elements, wherein the remote network manager controls the set of programmable network elements via the programmable controller.
5. The system of claim 1 further comprising one or more collectors that are disposed in a network system of the plurality of network systems and configured to receive network traffic data from a plurality of network elements in the network system.
6. The system of claim 5 , wherein the collected data comprises metadata that the network manager analyzes to learn the network pattern.
7. The system of claim 6 , wherein the remote network manager or the one or more collectors are further configured to index the network enabling efficient search and retrieval of the metadata and learned network patterns.
8. The system of claim 6 , wherein the one or more collectors are further configured to receive statistics about the network, topology information about the network, input from one or more enterprise systems, or combinations thereof.
9. The system of claim 6 , wherein metadata is time-aligned with data received from one or more enterprise systems.
10. The system of claim 5 , wherein the remote network manager is disposed in a cloud and connected to the one or more collectors over the Internet.
11. The system of claim 5 further comprising a programmable network element disposed in the first network system, wherein the remote network manager programs the programmable network element to configure the programmable network element to send filtered network traffic data to the one or more collectors.
12. The system of claim 5 further comprising a programmable network element disposed in the first network system, wherein the one or more collectors program the programmable network element to configure the programmable network element to send filtered network traffic data to the one or more collectors.
13. The system of claim 5 , wherein the remote network manager applies a control loop to determine whether a network control objective is met after programming a programmable network element.
14. The system of claim 5 , wherein the remote network manager affects the control policy by programming a programmable network element or a programmable controller with a control primitive.
15. The system of claim 14 , wherein the control primitive includes an access control list (ACL), quality of service (QoS), rate limit settings, or combinations thereof.
16. The system of claim 14 , wherein the remote network manager maintains a relationship between the control policy and the control primitive in a database.
17. The system of claim 5 , wherein the one or more collectors are programmable, and wherein the remote network manager programs the one or more collectors to collect different type of metadata.
18. The system of claim 17 , wherein the remote network manager de-duplicates the metadata received from the one or more collectors.
19. The system of claim 18 , wherein the remote network manager calculates a quality of experience of a user, an application, or a device, based on the metadata received from the one or more collectors.