Dynamic edge-to-edge across multiple hops in multi-regional large scale deployments with distributed gateways
Some embodiments of the invention provide a method for providing dynamic edge-to-edge support across multi-hops in an SD-WAN connecting multiple regions. The method is performed at a first route reflector for a first of the multiple regions. The method receives, from a first edge router at a first site of the first region, a first request for endpoint information associated with a second edge router at a second site of a second region. After determining that the first route reflector does not have a direct connection to the second edge router, the method identifies a next-hop hub router for reaching the second edge router. The method sends a second request to the identified next-hop hub router to request the identified next-hop hub router to forward endpoint information for the second edge router to the first edge router for use in establishing a dynamic edge-to-edge connection with the second edge router.
1 . A method of providing dynamic edge-to-edge support across multi-hops in an SD-WAN (software-defined wide area network), the method comprising:
at a first route reflector for a first region of a plurality of regions connected by the SD-WAN, each region in the plurality of regions comprising one or more edge routers located at one or more sites in the region, the plurality of regions connected by a plurality of hub routers located in the plurality of regions:
receiving, from a first edge router located at a first site of the first region, a first endpoint information request for endpoint information associated with a second edge router located at a second site of a second region;
after determining that the first route reflector does not have a direct connection to the second edge router, identifying a next-hop hub router for reaching the second edge router; and
sending a second endpoint information request to the identified next-hop hub router to request the identified next-hop hub router to forward endpoint information for the second edge router to the first edge router for the first edge router to use to establish a dynamic edge-to-edge connection with the second edge router.
2 . The method of claim 1 , wherein:
the first edge router is directly connected to a first hub router;
the identified next-hop hub router comprises a second hub router;
the second hub router is directly connected to (i) the second edge router and (ii) the first hub router; and
the dynamic edge-to-edge connection flows (i) from the first edge router to the first hub router, (ii) from the first hub router to the second hub router, and (iii) from the second hub router to the second edge router.
3 . The method of claim 2 , wherein:
a connection between the first edge router and the first hub router and a connection between the second edge router and the second hub router each comprise overlay connections; and
a connection between the first and second hub routers comprises an underlay connection.
4 . The method of claim 1 , wherein:
the first edge router is directly connected to a first hub router;
the identified next-hop hub router comprises a second hub router that is directly connected to the second edge router;
each of the first and second hub routers have direct connections to a third hub router that is an intermediate hub router between the first and second hub routers; and
the dynamic edge-to-edge connection flows (i) from the first edge router to the first hub router, (ii) from the first hub router to the third hub router, (iii) from the third hub router to the second hub router, and (iv) from the second hub router to the second edge router.
5 . The method of claim 4 , wherein:
a connection between the first edge router and the first hub router and a connection between the second edge router and the second hub router each comprise overlay connections; and
a connection between the first hub router and the third hub router and a connection between the third hub router and the second hub router comprise underlay connections.
6 . The method of claim 1 , wherein the second endpoint request comprises an edge-to-edge information request control message, wherein sending the edge-to-edge information request control message to the identified next-hop hub router comprises generating the edge-to-edge information request control message and embedding endpoint information of the first edge router in the edge-to-edge information request control message.
7 . The method of claim 6 , wherein the identified next-hop hub router also extracts from the edge-to-edge information request control message the endpoint information of the first edge router and forwards the endpoint information of the first edge router to the second edge router.
8 . The method of claim 1 , wherein the endpoint information comprises a number of links of the second edge router and network addresses of each link of the second edge router.
9 . The method of claim 8 , wherein the number of links comprises (i) a number of private links and (ii) a number of public links.
10 . The method of claim 1 , wherein receiving the first endpoint information request comprises receiving the first endpoint information request via a direct connection between the first route reflector and the first edge router.
11 . The method of claim 1 , wherein when the first route reflector determines that the second edge router is directly connected to the first route reflector, the method comprises providing (i) endpoint information for the second edge router to the requesting first edge router and (ii) endpoint information for the first edge router to the second edge router.
12 . The method of claim 1 , wherein the next-hop hub router is a first hub router, wherein when the first hub router does not have a direct connection to the second edge router, the first hub router (i) performs a look-up in a routing table maintained by the first hub router to identify a next-hop second hub router for reaching the second edge router and (ii) sends a third endpoint information request to the identified next-hop second hub router.
13 . The method of claim 1 , wherein identifying the next-hop hub router comprises performing a look-up in a routing table maintained by the first route reflector, the routing table comprising (i) a plurality of identifiers associated with a plurality of destinations and (ii) identifiers associated with one or more next-hops for reaching each destination in the plurality of destinations.
14 . The method of claim 13 , wherein the routing table comprises a source of reachability (SoR) table.
15 . The method of claim 1 , wherein before sending the second endpoint information request, the method further comprises generated a new dynamic edge-to-edge hash table that includes a list of subscribers for the second edge router, wherein the list of subscribers includes at least the first edge router.
16 . The method of claim 15 , wherein the identified next-hop router sends endpoint information of the second edge router to each subscriber in the list of subscribers for the second edge router.
17 . A non-transitory machine readable medium storing a program for execution by a set of processing units, the program for providing dynamic edge-to-edge support across multi-hops in an SD-WAN (software-defined wide area network), the program comprising sets of instructions for:
at a first route reflector for a first region of a plurality of regions connected by the SD-WAN, each region in the plurality of regions comprising one or more edge routers located at one or more sites in the region, the plurality of regions connected by a plurality of hub routers located in the plurality of regions:
receiving, from a first edge router located at a first site of the first region, a first endpoint information request for endpoint information associated with a second edge router located at a second site of a second region;
after determining that the first route reflector does not have a direct connection to the second edge router, identifying a next-hop hub router for reaching the second edge router; and
sending a second endpoint information request to the identified next-hop hub router to request the identified next-hop hub router to forward endpoint information for the second edge router to the first edge router for the first edge router to use to establish a dynamic edge-to-edge connection with the second edge router.
18 . The non-transitory machine readable medium of claim 17 , wherein:
the first edge router is directly connected to a first hub router;
the identified next-hop hub router comprises a second hub router;
the second hub router is directly connected to (i) the second edge router and (ii) the first hub router; and
the dynamic edge-to-edge connection flows (i) from the first edge router to the first hub router, (ii) from the first hub router to the second hub router, and (iii) from the second hub router to the second edge router.
19 . The non-transitory machine readable medium of claim 18 , wherein:
a connection between the first edge router and the first hub router and a connection between the second edge router and the second hub router each comprise overlay connections; and
a connection between the first and second hub routers comprises an underlay connection.
20 . The non-transitory machine readable medium of claim 17 , wherein:
the second endpoint request comprises an edge-to-edge information request control message;
the set of instructions for sending the edge-to-edge information request control message to the identified next-hop hub router comprises a set of instructions for generating the edge-to-edge information request control message and embedding endpoint information of the first edge router in the edge-to-edge information request control message; and
the identified next-hop hub router also extracts from the edge-to-edge information request control message the endpoint information of the first edge router and forwards the endpoint information of the first edge router to the second edge router.