Connection digest for accelerating web traffic
View Patent ↗In various aspects, provided herein are systems, methods and computer-program products for delivering content objects over the Internet from a content delivery network to end-user systems. The systems, methods and products described herein optionally utilize one or more techniques for reducing the delay associated with obtaining non-cached content objects from their respective origin servers, including by re-using existing open connections, by making use of a TCP hand-off technique and by transmitting updates to system digests simultaneous with the exchange of keepalive signals between servers.
1. A system for delivering content objects over the Internet from a content delivery network to end-user systems, comprising:
a first server, wherein the first server is configured to:
receive a request for a content object, wherein:
the request is to deliver a content object to an end-user system;
the request is from an end-user system;
the first server is one of a first plurality of servers in a first content delivery network having a first plurality of points of presence (POPs); and
the first content delivery network delivers content over the Internet to end-user systems;
determine that the content object is not cached by the first server;
determine that the content object is to be requested from an origin server; and
determine that the first server either has no open connection with the origin server or that the first server has an open connection with the origin server with limited performance; and
a cache for storing a connection digest, wherein:
the connection digest tracks connection information of a second server with the origin server;
the second server is one of a second plurality of servers in a second content delivery network having a second plurality of POPs; and
the second content delivery network delivers content over the Internet to end-user systems;
the first server being further configured to:
query the connection digest; and
receive from the query a result identifying that the second server has an open connection with the origin server.
2. The system of claim 1 , wherein the first server is further configured to:
transfer the request for the content object to the second server based on the result from the connection digest.
3. The system of claim 1 , wherein the first server is further configured to:
retrieve the content object from the origin server using the open connection of the second server with the origin server.
4. The system of claim 1 , wherein the second server is configured to:
retrieve the content object from the origin server using the open connection of the second server with the origin server.
5. The system of claim 1 , wherein the connection digest comprises a database including entries indicating open connections between the origin server and each of the first plurality of servers and/or the second plurality of servers, entries indicating a quality of open connections between the origin server and each of the plurality of servers, entries indicating a TCP window size for open connections between the origin server and each of the plurality of servers or any combination of these.
6. The system of claim 1 , wherein the first content delivery network and the second content delivery network are the same or wherein the first plurality of POPs and the second plurality of POPs are the same or wherein the first plurality of servers and the second plurality of servers are the same.
7. The system of claim 1 , wherein the first content delivery network and the second content delivery network are federated content delivery networks.
8. A method for delivering content objects over the Internet from a content delivery network to end-user systems, the method comprising:
receiving a request to deliver a content object to an end-user system, wherein:
the request is received at a first server;
the request is received from an end-user system;
the first server is one of a first plurality of servers in a first content delivery network having a first plurality of points of presence (POPs); and
the first content delivery network delivers content over the Internet to end-user systems;
determining that the first server does not have the content object cached;
determining that the content object is to be requested from an origin server;
determining that the first server either has no open connection with the origin server or that the first server has an open connection with the origin server with limited performance;
querying a connection digest, wherein:
the connection digest tracks connection information of a second server with the origin server;
the second server is one of a second plurality of servers in a second content delivery network having a second plurality of POPs; and
the second content delivery network delivers content over the Internet to end-user systems; and
receiving a result from the query that identifies the second server as having an open connection with the origin server.
9. The method of claim 8 , further comprising:
transferring the request for the content object to the second server based on the result from the query.
10. The method of claim 8 , further comprising:
retrieving the content object from the origin server using the open connection of the second server with the origin server; and
serving the content object to the end-user system.
11. The method of claim 10 , further comprising:
caching the content object on the first server or the second server.
12. The method of claim 10 , wherein the retrieving the content object is performed in a shorter time than a time required for retrieving the content object from the origin server by opening new connection between the origin server and the first server or by using the open connection of the first server with the origin server with limited performance.
13. The method of claim 8 , wherein the connection digest comprises a database including entries indicating open connections between the origin server and each of the first plurality of servers and/or the second plurality of servers, entries indicating a quality of open connections between the origin server and each of the plurality of servers, entries indicating a TCP window size between each of the plurality of servers and the origin or any combination of these.
14. The method of claim 8 , wherein the first content delivery network and the second content delivery network are the same or wherein the first plurality of POPs and the second plurality of POPs are the same or wherein the first plurality of servers and the second plurality of servers are the same.
15. The method of claim 8 , wherein the first content delivery network and the second content delivery network are federated content delivery networks.
16. A computer-program product tangibly embodied in a non-transitory machine-readable storage medium, comprising instructions, that when executed by one or more processors in a computing device, cause the computing device to:
receive a request to deliver a content object to an end-user system
determine that the computing device does not have the content object cached;
determine that the content object is to be requested from an origin server;
determine that the computing device either has no open connection with the origin server or that the computing device has an open connection with the origin server with limited performance;
query a connection digest, wherein:
the connection digest tracks connection information of a second computing device with the origin server;
receive a result from the query that identifies the second computing device as having an open connection with the origin server;
transfer the request for the content object to the second server, wherein: the request to deliver a content object is from an end-user system;
the computing device is one of a first plurality of servers in a first content delivery network having a first plurality of points of presence (POPs);
the first plurality of servers deliver content over the Internet to end users;
the second computing device is one of a second plurality of servers in a second content delivery network having a second plurality of POPs; and
the second plurality of servers delivers content over the Internet to end-user systems.
17. The computer-program product of claim 16 , wherein:
the first content delivery network and the second content delivery network are the same or wherein the first plurality of POPs and the second plurality of POPs are the same or wherein the first plurality of servers and the second plurality of servers are the same.
18. The computer-program product of claim 16 , wherein:
the first content delivery network and the second content delivery network are federated content delivery networks.
19. The computer-program product of claim 16 , wherein the instructions further comprise instructions configured to cause the computing device to:
retrieve the content object from the origin serve using the open connection of the second computing device with the origin server.