Distributed gateways for multi-regional large scale deployments
Some embodiments of the invention provide a method for implementing an SD-WAN connecting multiple sites at multiple physical locations. The method is performed at a first route reflector for a first region of the SD-WAN. The method receives, from a hub router of the first region, a peer-connection notification regarding a newly connected first edge router located at a first site in a second region. The method determines that a routing table maintained by the first route reflector does not include routes of the first edge router and that the first route reflector does not have a direct connection to the first edge router. Based on said determining, the method requests routes of the first edge router from the hub router. After receiving from the hub router the requested routes of the first edge router, the method updates the routing table to include the routes of the first edge router.
1 . A method for implementing an SD-WAN (software-defined wide area network) connecting a plurality of sites at a plurality of physical locations, the method comprising:
at a first route reflector of a first region of the SD-WAN that comprises (i) a plurality of edge routers at the plurality of sites, (ii) a plurality of route reflectors for a plurality of regions, each region comprising one or more sites, and (iii) a plurality of hub routers for the plurality of regions, each particular hub router of each particular region forwarding packets between the edge routers of the sites of the particular region and between the regions:
receiving, from a first hub router of the first region, a peer-connection notification regarding a newly connected first edge router located at a first site in a second region;
determining (i) that a routing table maintained by the first route reflector does not include routes of the first edge router and (ii) that the first route reflector does not have a direct connection to the first edge router;
based on said determining, requesting routes of the first edge router from the first hub router; and
after receiving from the first hub router the requested routes of the first edge router, updating the routing table to include the routes of the first edge router.
2 . The method of claim 1 further comprising advertising the routes of the first edge router to at least a second edge router located at a second site in the first region.
3 . The method of claim 1 , wherein the routing table comprises a source of reachability (SoR) table comprising a hash map of all routers of which the first route reflector has been notified, wherein each entry for each particular router included in the SoR table comprises an indication of whether the first route reflector has a direct connection with the particular router and a list of other routers through which the particular router is reachable.
4 . The method of claim 3 , wherein each entry further comprises at least (i) a first set of data associated with the particular router, and (ii) for each other router in the list of other routers through which the particular router is reachable, a second set of data associated the other router.
5 . The method of claim 4 , wherein the first set of data comprises an identifier associated with the particular router and the second set of data comprises an identifier associated with the other router.
6 . The method of claim 5 , wherein:
the first set of data comprises at least two of (i) endpoint information associated with the particular router, (ii) PMTU (path maximum transmission unit) associated with the particular router, (iii) a current connection status of the particular router, (iv) a profile associated with the particular router, and (v) a set of configuration parameters associated with the particular router; and
the second set of data comprises at least two of (i) endpoint information associated with the other router, (ii) PMTU associated with the other router, (iii) a current connection status of the other router, (iv) a profile associated with the other router, and (v) a set of configuration parameters associated with the other router.
7 . The method of claim 6 , wherein the endpoint information comprises (i) a number of private links of the first edge router (ii) network addresses for each private link of the first edge router, (iii) a number of public links of the first edge router, and (iv) network addresses for each public link of the first edge router.
8 . The method of claim 3 , wherein determining (i) that the SoR table does not include routes of the first edge router and (ii) that the first route reflector does not have a direct connection to the first edge router comprises determining that the SoR table does not include an entry for the first edge router.
9 . The method of claim 8 further comprising updating the SoR table to include an entry for the first edge router.
10 . The method of claim 9 , wherein updating the SoR table to include the routes of the first edge router comprising updating the entry for the first edge router in the SoR table to include the routes of the first edge router.
11 . The method of claim 10 further comprising iterating through each entry in the SoR table to identify one or more other routers to which the routes of the first edge router need to be advertised.
12 . The method of claim 1 , wherein requesting routes of the first edge router from the first hub router comprises sending a route subscription notification for routes of the first edge router to the first hub router in order to receive routes of the first edge router.
13 . The method of claim 12 , wherein the first hub router adds the first route reflector to a list of subscribers for the first edge router, wherein the first hub router sends routes of the first edge router to each subscriber in the list of subscribers including the first route reflector.
14 . The method of claim 13 , wherein when the first hub router receives updated routes of the first edge router, the method further comprises receiving the updated routes of the first edge router from the first hub router as a subscriber of the first edge router; and updating the routing table with the updated routes.
15 . A non-transitory machine readable medium storing a program for execution by a set of processing units, the program for implementing an SD-WAN (software-defined wide area network) connecting a plurality of sites at a plurality of physical locations, the program comprising sets of instructions for:
at a first route reflector of a first region of the SD-WAN that comprises (i) a plurality of edge routers at the plurality of sites, (ii) a plurality of route reflectors for a plurality of regions, each region comprising one or more sites, and (iii) a plurality of hub routers for the plurality of regions, each particular hub router of each particular region forwarding packets between the edge routers of the sites of the particular region and between the regions:
receiving, from a first hub router of the first region, a peer-connection notification regarding a newly connected first edge router located at a first site in a second region;
determining (i) that a routing table maintained by the first route reflector does not include routes of the first edge router and (ii) that the first route reflector does not have a direct connection to the first edge router;
based on said determining, requesting routes of the first edge router from the first hub router; and
after receiving from the first hub router the requested routes of the first edge router, updating the routing table to include the routes of the first edge router.
16 . The non-transitory machine readable medium of claim 15 , the program further comprising a set of instructions for advertising the routes of the first edge router to at least a second edge router located at a second site in the first region.
17 . The non-transitory machine readable medium of claim 15 , wherein the routing table comprises a source of reachability (SoR) table comprising a hash map of all routers of which the first route reflector has been notified, wherein each entry for each particular router included in the SoR table comprises an indication of whether the first route reflector has a direct connection with the particular router and a list of other routers through which the particular router is reachable.
18 . The non-transitory machine readable medium of claim 17 , wherein each entry further comprises at least (i) a first set of data associated with the particular router and comprising an identifier associated with the particular router, and (ii) for each other router in the list of other routers through which the particular router is reachable, a second set of data associated the other router and comprising an identifier associated with the other router.
19 . The non-transitory machine readable medium of claim 18 , wherein:
the first set of data comprises at least two of (i) endpoint information associated with the particular router, (ii) PMTU (path maximum transmission unit) associated with the particular router, (iii) a current connection status of the particular router, (iv) a profile associated with the particular router, and (v) a set of configuration parameters associated with the particular router; and
the second set of data comprises at least two of (i) endpoint information associated with the other router, (ii) PMTU associated with the other router, (iii) a current connection status of the other router, (iv) a profile associated with the other router, and (v) a set of configuration parameters associated with the other router.
20 . The non-transitory machine readable medium of claim 17 , wherein the set of instructions for determining (i) that the SoR table does not include routes of the first edge router and (ii) that the first route reflector does not have a direct connection to the first edge router comprises sets of instructions for:
determining that the SoR table does not include an entry for the first edge router; and updating the SoR table to include an entry for the first edge router by updating the entry for the first edge router in the SoR table to include the routes of the first edge router.