Edge node cluster network redundancy and fast convergence using an underlay anycast VTEP IP
Some embodiments provide a method for providing redundancy and fast convergence for modules operating in a network. The method configures modules to use a same anycast inner IP address, anycast MAC address, and to associate with a same anycast VTEP IP address. In some embodiments, the modules are operating in an active-active mode and all nodes running modules advertise the anycast VTEP IP addresses with equal local preference. In some embodiments, modules are operating in active-standby mode and the node running the active module advertises the anycast VTEP IP address with higher local preference.
1. A method for providing redundancy in a virtualized environment comprising:
configuring a plurality of service routers executing on a plurality of edge nodes to use a same anycast inner internet protocol (IP) address, wherein a first service router of the plurality of service routers is configured as an active service router;
configuring the plurality of edge nodes to use a same anycast virtual extensible local area network tunnel end point (VTEP) IP address,
wherein a first edge node in the plurality of edge nodes on which the first service router executes advertises the anycast VTEP IP address with higher preference than other edge nodes on which service routers in the plurality of service routers execute,
wherein upon failure of the connection to the first service router, the anycast VTEP IP address is advertised as unavailable at the first edge node and traffic to the anycast VTEP IP address is directed to a second, standby service router acting as a current, active service router in the plurality of service routers, wherein a second edge node on which the second service router executes advertises the anycast VTEP IP address with higher preference,
wherein upon recovery of the first service router, the anycast VTEP IP address is advertised as available at the first edge node with higher preference than the second edge node; and
configuring managed forwarding elements executing on host machines and implementing a distributed router to use the anycast inner IP address of the plurality of service routers as a default gateway.
2. The method of claim 1 , wherein the failure of the first service router is detected by a fault detection protocol along a path from the first edge node to a hardware switch.
3. The method of claim 2 wherein the fault detection protocol is a bidirectional forwarding detection protocol.
4. A method for providing redundancy in a virtualized environment comprising:
configuring a plurality of service routers executing on a plurality of edge nodes to use a same anycast inner internet protocol (IP) address, wherein a first service router of the plurality of service routers is configured as an active service router;
configuring the plurality of edge nodes to use a same anycast virtual extensible local area network tunnel end point (VTEP) IP address,
wherein a particular edge node in the plurality of edge nodes on which the active service router executes advertises the anycast VTEP IP address with higher preference than other edge nodes on which service routers in the plurality of service routers execute,
wherein the first service router executes on a first edge node,
wherein, upon detection of a failure of the connection to the first service router by a fault detection protocol along a path from the first edge node to a leaf hardware switch in a leaf spine network topology, traffic to the anycast VTEP IP address is directed to a second, standby service router acting as a current, active service router in the plurality of service routers; and
configuring a distributed router to use the anycast inner IP address of the plurality of service routers as a default gateway.
5. The method of claim 4 , wherein, upon failure of the connection to the first service router, the anycast VTEP IP address is advertised as unavailable at the first edge node.
6. The method of claim 4 , wherein configuring the distributed router to use the anycast inner IP address of the plurality of service routers as the default gateway comprises configuring the distributed router to associate the inner anycast IP address of the plurality of service routers with the anycast VTEP IP address.
7. A method for providing redundancy in a virtualized environment comprising:
configuring a plurality of service routers executing on a plurality of edge nodes to use a same anycast inner internet protocol (IP) address, wherein a first service router of the plurality of service routers is configured as an active service router;
configuring the plurality of edge nodes to use a same anycast virtual extensible local area network tunnel end point (VTEP) IP address,
wherein a particular edge node in the plurality of edge nodes on which the active service router executes advertises the anycast VTEP IP address with higher preference than other edge nodes on which service routers in the plurality of service routers execute,
wherein upon failure of the connection to the first service router, traffic to the anycast VTEP IP address is directed to a second, standby service router acting as a current, active service router in the plurality of service routers, and
wherein upon failure of the connection to the first service router, the anycast VTEP IP address is advertised as unavailable at the particular edge node when the first service router was the only service router using the anycast inner IP executing on the particular edge node; and
configuring a distributed router to use the anycast inner IP address of the plurality of service routers as a default gateway.
8. The method of claim 7 , wherein, upon recovery of the first service router, the anycast VTEP IP address is advertised as available at the first edge node.
9. The method of claim 8 wherein the first edge node advertises the availability with higher preference than a second edge node on which the second, standby service router acting as the current, active service router executes.
10. The method of claim 7 , wherein configuring the distributed router to use the anycast inner IP address of the plurality of service routers as the default gateway comprises:
configuring the distributed router to associate the inner anycast IP address of the plurality of service routers with the anycast VTEP IP address.
11. A non-transitory machine readable medium storing a program which when executed by at least one processing unit provides redundancy in a virtualized environment, the program comprising sets of instructions for:
configuring a plurality of service routers executing on a plurality of edge nodes to use a same anycast inner internet protocol (IP) address, wherein a first service router of the plurality of service routers is configured as an active service router;
configuring the plurality of edge nodes to use a same anycast virtual extensible local area network tunnel end point (VTEP) IP address,
wherein a first edge node in the plurality of edge nodes on which the first service router executes advertises the anycast VTEP IP address with higher preference than other edge nodes on which service routers in the plurality of service routers execute,
wherein upon failure of the connection to the first service router, the anycast VTEP IP address is advertised as unavailable at the first edge node and traffic to the anycast VTEP IP address is directed to a second, standby service router acting as a current, active service router in the plurality of service routers, wherein a second edge node on which the second service router executes advertises the anycast VTEP IP address with higher preference,
wherein upon recovery of the first service router, the anycast VTEP IP address is advertised as available at the first edge node with higher preference than the second edge node; and
configuring managed forwarding elements executing on host machines and implementing a distributed router to use the anycast inner IP address of the plurality of service routers as a default route.
12. The machine readable medium of claim 11 wherein the failure of the first service router is detected by a fault detection protocol along a path from the first edge node to a hardware switch.
13. The machine readable medium of claim 12 wherein the fault detection protocol is a bidirectional forwarding detection protocol.
14. A non-transitory machine readable medium storing a program which when executed by at least one processing unit provides redundancy in a virtualized environment, the program comprising sets of instructions for:
configuring a plurality of service routers executing on a plurality of edge nodes to use a same anycast inner internet protocol (IP) address, wherein a first service router of the plurality of service routers is configured as an active service router;
configuring the plurality of edge nodes to use a same anycast virtual extensible local area network tunnel end point (VTEP) IP address,
wherein a particular edge node in the plurality of edge nodes on which the active service router executes advertises the anycast VTEP IP address with higher preference than other edge nodes on which service routers in the plurality of service routers execute,
wherein the first service router executes on a first edge node,
wherein upon detection of a failure of the connection to the first service router by a fault detection protocol along a path from the first edge node to a leaf hardware switch in a leaf spine network topology, traffic to the anycast VTEP IP address is directed to a second, standby service router acting as a current, active service router in the plurality of service routers; and
configuring a distributed router to use the anycast inner IP address of the plurality of service routers as a default gateway.
15. The machine readable medium of claim 14 , wherein the set of instructions for configuring the distributed router to use the anycast inner IP address of the plurality of service routers as the default gateway comprises a set of instructions for configuring the distributed router to associate the inner anycast IP address of the plurality of service routers with the anycast VTEP IP address.
16. The machine readable medium of claim 14 , wherein the fault detection protocol is a bidirectional forwarding detection protocol.
17. A non-transitory machine readable medium storing a program which when executed by at least one processing unit provides redundancy in a virtualized environment, the program comprising sets of instructions for:
configuring a plurality of service routers executing on a plurality of edge nodes to use a same anycast inner internet protocol (IP) address, wherein a first service router of the plurality of service routers is configured as an active service router;
configuring the plurality of edge nodes to use a same anycast virtual extensible local area network tunnel end point (VTEP) IP address,
wherein a particular edge node in the plurality of edge nodes on which the active service router executes advertises the anycast VTEP IP address with higher preference than other edge nodes on which service routers in the plurality of service routers execute,
wherein upon failure of the connection to the first service router, traffic to the anycast VTEP IP address is directed to a second, standby service router acting as a current, active service router in the plurality of service routers, and
wherein upon failure of the connection to the first service router, the anycast VTEP IP address is advertised as unavailable at the particular edge node when the first service router was the only service router using the anycast inner IP executing on the particular edge node; and
configuring a distributed router to use the anycast inner IP address of the plurality of service routers as a default gateway.
18. The machine readable medium of claim 17 wherein, upon recovery of the first service router, the anycast VTEP IP address is advertised as available at the first edge node.
19. The machine readable medium of claim 18 wherein the first edge node advertises the availability with higher preference than a second edge node on which the second, standby service router acting as the current, active service router executes.
20. The machine readable medium of claim 17 , wherein the set of instructions for configuring the distributed router to use the inner anycast IP address of the plurality of service routers as the default gateway further comprises a set of instructions for configuring the distributed router to associate the anycast inner IP address of the plurality of service routers with the anycast VTEP IP address.