Content request routing and load balancing for content distribution networks
View Patent ↗A content distribution mechanism that distributes content of a content provider at various sites across a network and selects the site that is nearest a content requestor using an anycast address that resides at each of the sites. The sites are configured as nodes (or clusters) and each node includes a content server and a DNS server. The DNS servers are so associated with the content servers at their respective nodes as to resolve the name of the content provider to the IP address of the content servers at the nodes. The DNS servers each are assigned the anycast address in addition to a unique address, and the anycast address is advertised to the network (in particular, the network routing infrastructure) using Border Gateway Protocol (BGP). Node selection occurs when the network routing infrastructure selects a shortest path to the anycast address during DNS name resolution.
1. A method of content delivery in a network, comprising:
assigning a common address to a first Domain Name System (DNS) device and a second DNS device, the first DNS device associated with a first cache server system having a first unique address, the second DNS device associated with a second cache server system having a second unique address different from the first unique address;
advertising, by the first DNS device and the second DNS device, the common address to a plurality of routers within the network, wherein the common address is transmitted to the plurality of routers within the network in association with Border Gateway Patrol (BGP) messages;
monitoring one or more load characteristics of the first cache server system in the network, the one or more load characteristics including a utilization or a latency of the first cache server system, wherein the first cache server system and the second cache server system are geographically distributed across the network;
determining if the one or more load characteristics of the first cache server system exceed a predefined overload metric; and
discontinuing, by the first DNS device, advertising of the common address to the plurality of routers, in response to determining that the one or more load characteristics of the first cache server system exceed the predefined overload metric.
2. The method as recited in claim 1 , wherein the common address is an anycast address.
3. The method as recited in claim 1 , wherein the first cache server system and the second cache server system are located in different Internet Service Provider Point of Presences.
4. The method as recited in claim 1 , wherein the first cache server system and the second cache server system are located at or near entry points of the network.
5. The method as recited in claim 1 , wherein the first cache server system or the second cache server system comprises at least two cache servers connected in a cluster, and wherein the at least two cache servers are coupled to a switch usable to select from among the at least two cache servers based on a selection policy.
6. The method as recited in claim 1 , further comprising restarting, by the first DNS device, advertising of the common address to the plurality of routers after the one or more load characteristics satisfy the predefined overload metric.
7. The method as recited in claim 1 , further comprising storing, by each of the plurality of routers, multiple routes in association with the common address in a routing table.
8. The method as recited in claim 7 , further comprising:
receiving a DNS resolution request at one of the plurality of routers, wherein the DNS resolution request specifies the common address and requests resolution of a DNS name;
determining that the first DNS device has a shorter network distance than the second DNS device; and
resolving the DNS name to the first unique address of the first cache server system associated with the, first DNS device, in response to determining that the first DNS device has the shorter network distance than the second DNS device.
9. The method as recited in claim 1 , wherein the advertising, by the first DNS device and the second DNS device, comprises indicating that content is available for retrieval by an end user system.
10. The method as recited in claim 9 , wherein the second cache server system associated with the second DNS device is configured to provide the content to the end user system, while the first DNS device discontinues advertising the common address to the plurality of routers, the end user system configured to recognize the first DNS device and the second DNS device as a single DNS device.
11. The method as recited in claim 1 , wherein the first cache server system comprises a single cache server.
12. A computerized device comprising:
a processor;
a memory unit that stores instructions associated with an application executed by the processor; and
an interconnect coupling the processor and the memory unit, enabling the computerized device to execute the application and perform operations of:
advertising, by a first Domain Name System (DNS) device, a common address to a plurality of routers within a network, the common address assigned to the first DNS device and a second DNS device, the first DNS device associated with a first cache server system having a first unique address, the second DNS device associated with a second cache server system having a second unique address, wherein the common address is transmitted to the plurality of routers within the network in association with Border Gateway Patrol messages;
monitoring one or more load characteristics of the first cache server system in the network, wherein the first cache server system and the second cache server system are geographically distributed across the network;
determining if the one or more load characteristics of the first cache server system exceed a predefined overload metric;
discontinuing, by the first DNS device, advertising of the common address to the plurality of routers, in response to determining that the one or more load characteristics of the first cache server system exceed the predefined overload metric;
determining, after the discontinuing the advertising of the common address to the plurality of routers, whether the one or more load characteristics satisfy the predefined overload metric; and
restarting, by the first DNS, advertising of the common address to the plurality of routers in the network, in response to determining that the one or more of the load characteristics satisfy the predefined overload metric.
13. The computerized device as recited in claim 12 , wherein the common address is an anycast address.
14. The computerized device as recited in claim 12 , wherein the second cache server system associated with the second DNS device is configured to provide content to an end user system, while the first DNS device discontinues advertising the common address to the plurality of routers, the end user system configured to recognize the first DNS device and the second DNS device as a single DNS device.
15. A system for content delivery in a network comprising:
a plurality of nodes;
wherein each node comprises a Domain Name System (DNS) device, each DNS device associated with a corresponding cache server system having a unique address;
wherein the DNS devices are assigned a common address, and wherein each DNS device is operable to advertise the common address to a plurality of routers within the network, the common address being transmitted to the plurality of routers within the network in association with Border Gateway Patrol (BGP) messages;
wherein each node is operable to monitor one or more load characteristics of the associated cache server system in the node, each associated cache server system being geographically distributed across the network;
wherein each DNS device is operable to discontinue advertising of the common address to the plurality of routers within the network, if the associated cache server system has a load characteristic that exceeds a predefined overload metric; and
wherein a DNS device associated with a cache server system determined to have the load characteristic that exceeds the predefined overload metric is operable to restart advertising of the common address to the plurality of routers within the network in response to the load characteristic satisfying the predefined overload metric.
16. The system as recited in claim 15 , wherein the common address is an anycast address.
17. The system as recited in claim 15 , wherein the common address is advertised by the DNS devices to the plurality of routers within the network to indicate that content is available for retrieval by an end user system.
18. The system as recited in claim 17 , wherein another cache server system associated with another DNS device of the DNS devices is configured to provide the content to the end user system, while the DNS device discontinues advertising the common address to the plurality of routers, the end user system configured to recognize the DNS devices as a single DNS device.
19. The system as recited in claim 15 , wherein the cache server system comprises a single cache server.
20. The system as recited in claim 15 , wherein the cache server system comprises a plurality of cache servers.