Distributed gateways for multi-regional large scale deployments
Some embodiments of the invention provide a method for implementing an SD-WAN connecting multiple sites at multiple physical locations. The method is performed at a first hub router of the SD-WAN. The method establishes, with a first edge router of a first site in a first region, a new connection for the first hub router to use to connect the first edge router to a second edge router of a second site in the first region. The method determines that a peer-connection notification regarding the newly connected first edge router has to be sent to a first route reflector (RR) that does not connect directly with the first edge router but connects to routers in a second region. The method sends the peer-connection notification to the first RR to analyze and determine whether to obtain routes associated with the first edge router for advertising to routers in the second region.
1 . A method for implementing an SD-WAN (software-defined wide area network) connecting a plurality of sites at a plurality of physical locations, the method comprising:
at a first hub router of the SD-WAN that comprises (i) a plurality of edge routers at the plurality of sites, (ii) a plurality of route reflectors for a plurality of regions, each region comprising one or more sites, and (iii) a plurality of hub routers for the plurality of regions, each particular hub router of each particular region forwarding packets between the edge routers of the sites of the particular region and between the regions:
establishing, with a first edge router located at a first site in a first region, a new connection for the first hub router to use to connect the first edge router to a second edge router of a second site in the first region;
determining that a peer-connection notification regarding the newly connected first edge router has to be sent to a first route reflector that does not connect directly with the first edge router but connects to one or more routers in a second region;
sending the peer-connection notification to the first route reflector for the first route reflector to analyze in order to determine whether the first route reflector needs to obtain routes associated with the first edge router for advertising to the one or more routers in the second region.
2 . The method of claim 1 , wherein the one or more routers comprise a third edge router at a third site in the second region.
3 . The method of claim 1 , wherein the peer-connection notification comprises at least an identifier associated with the first edge router, wherein the first route reflector analyzes the peer-connection notification to determine whether the first route reflector needs to obtain routes associated with the first edge router by using the identifier associated with the first edge router to perform a lookup in a routing table maintained by the first route reflector to determine whether the first route reflector has already obtained routes associated with the first edge router.
4 . The method of claim 3 , wherein when the first route reflector determines that the first route reflector has not already obtained routes associated with the first edge router, the first route reflector sends a request to the first hub router for routes of the first edge router and after receiving the routes of the first edge router from the first hub router, the first route reflector (i) updates the routing table with the routes and (ii) advertises the routes to the one or more routers in the second region.
5 . The method of claim 4 , wherein the first route reflector also connects directly with a second hub router in a third region, and advertises the routes to the second hub router, wherein the second hub router advertises the routes to a second route reflector of the third region.
6 . The method of claim 1 , wherein the peer-connection notification comprises at least an identifier associated with the first edge router, a metric value that indicates the first hub router has a direct connection to the first edge router, and one or more of PMTU (path maximum transmission unit) associated with the first edge router, a current connection status of the first edge router, a profile associated with the first edge router, a set of configuration parameters defined for the first edge router, and endpoint information associated with the first edge router.
7 . The method of claim 6 , wherein the endpoint information comprises (i) a number of private links of the first edge router, (ii) network addresses for each private link of the first edge router, (iii) a number of public links of the first edge router, and (iv) network addresses for each public link of the first edge router.
8 . The method of claim 6 , wherein the identifier comprises a logical identifier assigned to the first edge router.
9 . The method of claim 6 , wherein the metric value is a metric value of 1 for direct connections and incremented for each additional hop.
10 . The method of claim 6 , wherein the peer-connection notification further comprises a flag that indicates the direct connection between the first hub router and the first edge router.
11 . The method of claim 1 , wherein the first route reflector belongs to a set of route reflectors to which the first hub router has direct connections, wherein determining that the peer-connection notification regarding the newly connected first edge router has to be sent to the first route reflector further comprises determining that the peer-connection notification regarding the newly connected first edge router has to be sent to the set of route reflectors to which the first hub router has a direct connection.
12 . The method of claim 11 , wherein sending the peer-connection notification to the first route reflector further comprises sending the peer-connection notification to each route reflector in the identified set of route reflectors.
13 . The method of claim 11 , wherein the set of route reflectors comprises at least the first route reflector and a second route reflector, wherein the second route reflector has a direct connection to the first edge router but does not have direct connections to the one or more routers in the second region.
14 . A method for implementing an SD-WAN (software-defined wide area network) connecting a plurality of sites at a plurality of physical locations, the method comprising:
at a first hub router of a first region of the SD-WAN that comprises (i) a plurality of edge routers at the plurality of sites, (ii) a plurality of route reflectors for a plurality of regions, each region comprising one or more sites, and (iii) a plurality of hub routers for the plurality of regions, each particular hub router of each particular region forwarding packets between the edge routers of the sites of the particular region and between the regions:
establishing, with a first edge router located at a first site in the first region, a new connection for the first hub router to use to connect the first edge router to a second edge router of a second site in the first region;
determining that a peer-connection notification regarding the newly connected first edge router has to be sent to a second hub router of a second region that does not directly connect with the first edge router but connects to (i) one or more routers in a second region and (ii) a third hub router of a third region; and
sending the peer-connection notification to the second hub router for the second hub router to distribute the peer-connection notification to the one or more routers in the second region and the third hub router of the third region.
15 . The method of claim 14 , wherein:
the peer-connection notification sent to the second hub router identifies the newly connected first edge router as being one hop away from the first hub router; and
the peer-connection notification distributed by the second hub router to the one or more other routers in the second region and the third hub router of the third region identifies the newly connected first edge router as being two hops away from the second hub router.
16 . The method of claim 14 , wherein the peer-connection notification comprises at least an identifier associated with the first edge router, a metric value that indicates the first hub router has a direct connection to the first edge router, and one or more of PMTU (path maximum transmission unit) associated with the first edge router, a current connection status of the first edge router, a profile associated with the first edge router, a set of configuration parameters defined for the first edge router, and endpoint information associated with the first edge router.
17 . The method of claim 16 , wherein the endpoint information comprises (i) a number of private links of the first edge router (ii) network addresses for each private link of the first edge router, (iii) a number of public links of the first edge router, and (iv) network addresses for each public link of the first edge router.
18 . The method of claim 16 , wherein the metric value is a metric value of 1 to indicate the direct connection between the first hub router and the first edge router, wherein before the second hub router distributes the peer-connection notification to the one or more routers in the second region and the third hub router of the third region, the second hub router increments the metric value by one to reflect the first hub router as an additional hop between the second hub router and the first edge router.
19 . The method of claim 18 , wherein the peer-connection notification further comprises a direct connection flag that indicates the first hub router has the direct connection to the first edge router, wherein in addition to incrementing the metric value by one before distributing the peer-connection notification, the second hub router removes the direct connection flag and sets a relayed connection flag to indicate the second hub router has a relayed connection to the first edge router.
20 . The method of claim 18 , wherein the third hub router distributes the peer-connection notification to at least one router in the third region after incrementing the metric value by one to reflect the second hub router as another additional hop between the third hub router and the first edge router.
21 . The method of claim 14 further comprising:
receiving, from the first edge router, a set of routes of the first edge router; and
distributing the set of routes of the first edge router to a first route reflector and not to the second hub router.
22 . The method of claim 21 , wherein the first and second hub routers have direct connections to the first route reflector, wherein the second hub router receives the set of routes of the first edge router from the first route reflector.
23 . The method of claim 22 , wherein the first route reflector has direct connections to the one or more routers in the second region, wherein the one or more routers in the second region receive the set of routes of the first edge router from the first route reflector and not from the second hub router.
24 . The method of claim 22 , wherein:
the second hub router and the third hub router are directly connected to a second route reflector;
after the second hub router receives the set of routes of the first edge router from the first route reflector, the second hub router distributes the routes to the second route reflector; and
the third hub router receives the set of routes of the first edge router from the second route reflector and does not receive the set of routes of the first edge router from the second hub router.
25 . The method of claim 24 , wherein the first route reflector does not have a direct connection to the second route reflector.