End-to-end acceleration of dynamic content
View Patent ↗A method of accelerating dynamic content between Points of Presence (POPs) and front-loading latency bottlenecks in a Content Delivery Network (CDN) may include receiving, at a first POP, a content request from a user device, where content responsive to the content request includes a first content portion that is not stored in the first POP. The method may also include determining that the first content portion is available through a second POP. The method may additionally include transmitting the first content portion through a persistent connection mesh from the second POP to the first POP, wherein the persistent connection mesh is maintained between the first POP and the second POP prior to the request for content being received by the first POP. The method may further include delivering the content responsive to the content request to the user device.
1. A system for accelerating content between Points of Presence (POPs) in a Content Delivery Network (CDN), comprising:
a first POP in the CDN, the first POP comprising a first plurality of edge servers that store and distribute content in response to user requests;
a second POP in the CDN, the second POP comprising a second plurality of edge servers that store and distribute content in response to user requests and; and
a persistent connection mesh between the first POP and the second POP, wherein:
content responsive to a content request received at the first POP comprises a first content portion that is not stored in the first POP;
the first content portion is available through the second POP; and
the persistent connection mesh is maintained between the first POP and the second POP prior to the content request being received by the first POP.
2. The system of claim 1 , wherein the first content portion is transmitted through the persistent connection mesh from the second POP to the first POP.
3. The system of claim 2 , wherein the content portion is retrieved from an origin server through the second POP.
4. The system of claim 1 , wherein the persistent connection mesh comprises a first connection that is refreshed or renewed in response to the first connection becoming stale or unreliable.
5. The system of claim 1 , wherein the content portion responsive to the content request comprises static content stored in the first POP.
6. The system of claim 1 , wherein the first POP comprises a concentration server to maintain the persistent connection mesh.
7. The system of claim 6 , wherein the concentration server of the first POP aggregates the requests of the edge servers of the first POP and transmits them to the second POP.
8. A system for accelerating uncached content between Points of Presence (POPs) in a Content Delivery Network (CDN), the system comprising:
a first POP comprising a first plurality of edge servers in the CDN;
a second POP comprising a second plurality of edge servers in the CDN; and
a connection between the first POP and the second POP, wherein:
the first POP receives a content request from a user device;
the connection is available between the first POP and the second POP prior to the content request being received by the first POP; and
the connection is pre-warmed to increase the congestion window.
9. The system of claim 8 , wherein a content portion is transmitted through the connection from the second POP to the first POP in response to the content request.
10. The system of claim 9 , wherein the content portion is retrieved from an origin server through the second POP.
11. The system of claim 8 , wherein the connection comprises a first connection, and wherein the first connection is refreshed or renewed in response to the first connection becoming stale or unreliable.
12. The system of claim 8 , wherein the content portion responsive to the content request comprises static content stored in the first POP.
13. The system of claim 8 , wherein the first POP comprises a concentration server to maintain the connection.
14. The system of claim 13 , wherein the concentration server aggregates the requests of the first plurality of edge servers and transmits them to the second POP.
15. A Content Delivery Network (CDN) for accelerating content, comprising:
an origin server communicating with a plurality of origin addresses; and
a Point of Presence (POP) maintaining a connection with the origin server, the POP comprising a plurality of edge servers;
wherein the connection is pre-warmed to maximize a throughput of the connection, and
wherein the POP is configured to receive a content request from a user device while the connection is maintained with at least a portion of the content request resulting in a cache miss.
16. The system of claim 15 , wherein the POP is configured to request the portion of the content request resulting in the cache miss from the origin server using the connection.
17. The system of claim 15 , wherein the content portion is retrieved from an origin server through a second POP comprising a plurality of edge servers.