End-to-end acceleration of dynamic content
A method of accelerating dynamic content between Points of Presence (POPs) and front-loading latency bottlenecks in a Content Delivery Network (CDN) may include receiving, at a first POP, a content request from a user device, where content responsive to the content request includes a first content portion that is not stored in the first POP. The method may also include determining that the first content portion is available through a second POP. The method may additionally include transmitting the first content portion through a persistent connection mesh from the second POP to the first POP, wherein the persistent connection mesh is maintained between the first POP and the second POP prior to the request for content being received by the first POP. The method may further include delivering the content responsive to the content request to the user device.
1. A system for accelerating dynamic content between Points of Presence (POPs) and front-loading latency bottlenecks in a Content Delivery Network (CDN), the system comprising:
a first POP in the CDN configured to receive a first content request from a first user device, wherein the first POP comprises a first plurality of edge servers that store and distribute content in response to user requests, each of the first plurality of edge servers located at an edge of a network; and
a second POP in the CDN configured to receive a second content request from a second user device, wherein the second POP comprises a second plurality of edge servers that store and distribute content in response to user requests, each of the second plurality of edge servers located at an edge of the network.
2. The system of claim 1 , wherein at least one of the first POP and the second POP is configured to establish a connection between the first POP and the second POP and pre-warm the connection.
3. The system of claim 1 , the system configured to establish a persistent connection mesh between the first POP and the second POP.
4. The system of claim 3 , wherein the persistent connection mesh is maintained without requiring a user request.
5. The system of claim 3 , further comprising a first content portion, not stored in the first POP, the first content portion available through the second POP, wherein the first content portion is transmitted through the persistent connection mesh from the second POP to the first POP.
6. The system of claim 3 , wherein the persistent connection mesh comprises a first connection that is refreshed or renewed in response to the first connection becoming stale or unreliable.
7. The system of claim 3 , wherein the first POP comprises a concentration server maintain the persistent connection mesh.
8. The system of claim 1 , wherein at least one of the first content request or the second content request are received while a connection is maintained with at least a portion of the at least one of the first content request or the second content request resulting in a cache miss.
9. The system of claim 8 , wherein at least one of the first POP or the second POP is configured to request the portion of the first content request or the second content request resulting in the cache miss from an origin server using the connection.
10. A method of accelerating dynamic content between Points of Presence (POPs) and front-loading latency bottlenecks in a Content Delivery Network (CDN), the method comprising:
receiving, at a first POP, a content request from a user device for a content portion, wherein: the first POP comprises a first plurality of edge servers that store and distribute content in response to user requests, each of the first plurality of edge servers located at an edge of a network;
determining that the content portion is available through a second POP, wherein the second POP comprises a second plurality of edge servers that store and distribute content in response to user requests, each of the second plurality of edge servers located at an edge of the network;
transmitting the content portion from the second POP to the first POP; and
delivering the content portion responsive to the content request to the user device.
11. The method of claim 10 , further comprising:
establishing a connection between the first POP and the second POP; and
pre-warming the connection.
12. The method of claim 10 , further comprising establishing a persistent connection mesh between the first POP and the second POP.
13. The method of claim 12 , wherein the persistent connection mesh is maintained without requiring a user request.
14. The method of claim 12 , further comprising transmitting a first content portion, not stored in the first POP, the first content portion available through the second POP, through the persistent connection mesh from the second POP to the first POP.
15. The method of claim 12 , further comprising refreshing or renewing a first connection of the persistent connection mesh in response to the first connection becoming stale or unreliable.
16. The method of claim 12 , wherein the first POP comprises a concentration server maintain the persistent connection mesh.
17. The method of claim 10 , further comprising receiving the content request while a connection is maintained with at least a portion of the content request resulting in a cache miss.
18. The method of claim 17 , further comprising requesting the portion of the content request resulting in the cache miss from an origin server using the connection for at least one of the first POP or the second POP.
19. A Points of Presence (POPs) system comprising:
A first POP comprising a first plurality of edge servers that store and distribute content in response to user requests, each of the first plurality of edge servers located at an edge of a network;
at least one processor; and
a memory, the memory including instructions causing the at least one processor to:
receive a content request from a user device for a content portion,
determine that the content portion is available through a second POP, wherein the second POP comprises a second plurality of edge servers that store and distribute content in response to user requests, each of the second plurality of edge servers located at an edge of the network,
receive the content portion transmitted from the second POP to the first POP, and
deliver the content portion responsive to the content request to the user device.
20. The POP system of claim 19 , the instructions further causing the at least one processor to:
establish a connection between the first POP and the second POP; and
pre-warm the connection.