Methods and apparatus for application aware hub clustering techniques for a hyper scale SD-WAN
Some embodiments provide a method for a software-defined wide area network (SD-WAN) connecting first and second sites, with the first site including an edge node and the second site including multiple forwarding hub nodes. At the edge node of the first site, the method receives a packet of a particular flow including a flow attribute. The method uses the flow attribute to identify a hub-selection rule from multiple hub-selection rules, each hub-selection rule identifying at least one forwarding hub node at the second site for receiving one or more flows from the first site, and at least one hub-selection rule identifying at least one forwarding hub node that is not identified by another hub-selection rule. The method uses the identified hub-selection rule to identify a forwarding hub node for the particular flow. The method then sends the packet from the edge node at the first site to the identified forwarding hub node at the second site.
1. For a software-defined wide area network (SD-WAN), a method for providing resources of a datacenter to a plurality of branch sites, the method comprising:
at a controller of the SD-WAN,
receiving a set of network traffic statistics from a plurality of forwarding hub nodes of the datacenter;
based on the received set of network traffic statistics, determining that additional forwarding hub nodes are needed for processing a particular category of flows;
directing a server at the datacenter to generate additional forwarding hub nodes; and
providing, to edge nodes of the plurality of branch sites, an updated list of forwarding hub nodes available for processing flows belonging to the particular category of flow.
2. The method of claim 1 , wherein the updated list of forwarding hub nodes is provided as an updated hub selection rule.
3. The method of claim 2 , wherein the controller provides a plurality of hub selection rules to the plurality of branch sites, each hub selection rule specifying one or more forwarding hub nodes for receiving traffic of a particular category.
4. The method of claim 3 , wherein each hub selection rule comprises a match criteria defined in terms of flow attributes, wherein edge nodes at the plurality of branch networks compare flow attributes of packets to the match criteria of the plurality of hub selection rules to identify matching hub selection rules.
5. The method of claim 1 , wherein the updated list of forwarding hub nodes is provided as an updated definition of a forwarding hub node group used by at least one hub selection rule.
6. The method of claim 1 , wherein the forwarding hub node groups are identified by the hub selection rules using forwarding hub node group identifiers.
7. The method of claim 1 , wherein prior to determining that additional forwarding hub nodes are needed for processing a particular category of flows, the method further comprising:
aggregating the received set of network traffic statistics by flow categories;
analyzing the aggregated set of network traffic statistics; and
determining whether a volume of traffic for any particular category of flows exceeds a specified threshold value.
8. The method of claim 7 , wherein a determination that a volume of traffic for a particular category of flows exceeds the threshold value comprises a determination that additional forwarding hub nodes are needed for processing the particular category of flows.
9. The method of claim 7 , wherein the threshold value is a maximum threshold value, the method further comprising when the volume of traffic for a particular category of flows does not exceed the maximum threshold value, determining whether the volume of traffic is below a minimum threshold value.
10. The method of claim 9 , wherein a determination that the volume of traffic for the particular category of flows is below the minimum threshold value comprises a determination that a number of forwarding hub nodes for processing the particular category of flows is to be decreased.
11. The method of claim 10 , wherein based on the determination that the number of forwarding hub nodes for processing the particular category of flows is to be decreased the method further comprises determining that one or more forwarding hub nodes are to be placed in standby mode.
12. The method of claim 10 , wherein based on the determination that the number of forwarding hub nodes for processing the particular category of flows is to be decreased the method further comprises determining that one or more forwarding hub nodes are to be shut down.
13. The method of claim 1 , wherein each forwarding hub node in the plurality of forwarding hub nodes comprises a unique network address for receiving and forwarding network traffic.
14. The method of claim 1 , wherein the plurality of branch sites are arranged around the datacenter in a hub and spoke topology.
15. The method of claim 1 , wherein directing a server at the datacenter to generate additional forwarding hub nodes further comprises any one of adding an already active forwarding hub node, booting up a new forwarding hub node, and waking up a forwarding hub node that has been in a standby state.
16. A non-transitory machine readable medium storing a program for execution by at least one processing unit, the program for providing resources of a datacenter to a plurality of branch sites, the datacenter and plurality of branch sites comprising a software-defined wide area network (SD-WAN), the program comprising sets of instructions for:
at a controller of the SD-WAN,
receiving a set of network traffic statistics from a plurality of forwarding hub nodes of the datacenter;
based on the received set of network traffic statistics, determining that additional forwarding hub nodes are needed for processing a particular category of flows;
directing a server at the datacenter to generate additional forwarding hub nodes; and
providing, to edge nodes of the plurality of branch sites, an updated list of forwarding hub nodes available for processing flows belonging to the particular category of flow.
17. The non-transitory machine readable medium of claim 16 , wherein the controller provides a plurality of hub selection rules to the plurality of branch sites, each hub selection rule (i) specifying one or more forwarding hub nodes for receiving traffic of a particular category, and (ii) comprising a match criteria defined in terms of flow attributes, wherein edge nodes at the plurality of branch networks compare flow attributes of packets to the match criteria of the plurality of hub selection rules to identify matching hub selection rules.
18. The non-transitory machine readable medium of claim 16 , wherein
the updated list of forwarding hub nodes is provided as an updated definition of a forwarding hub node group used by at least one hub selection rule, and
the forwarding hub node groups are identified by the hub selection rules using forwarding hub node group identifiers.
19. The non-transitory machine readable medium of claim 16 , wherein prior to determining that additional forwarding hub nodes are needed for processing a particular category of flows, the program further comprising sets of instructions for:
aggregating the received set of network traffic statistics by flow categories;
analyzing the aggregated set of network traffic statistics; and
determining whether a volume of traffic for any particular category of flows exceeds a specified threshold value, wherein a determination that a volume of traffic for a particular category of flows exceeds the threshold value comprises a determination that additional forwarding hub nodes are needed for processing the particular category of flows.
20. The non-transitory machine readable medium of claim 19 ,
wherein the threshold value is a maximum threshold value, the program further comprising a set of instructions for determining whether the volume of traffic is below a minimum threshold value when the volume of traffic for a particular category of flows does not exceed the maximum threshold value,
wherein a determination that the volume of traffic for the particular category of flows is below the minimum threshold value comprises a determination that a number of forwarding hub nodes for processing the particular category of flows is to be decreased.