System for detection of content servers and caching popular content therein
An apparatus including a network interface to a first portion of a network and a second portion of a network. A deep-packet-inspection (DPI) unit identifies a content source, inspects one or more packets provided from the identified source over the first network portion, each packet having a source address and a destination address. A storage stores at least a portion of the content. A content delivery unit receives a request from the second network portion for requested content from the identified source and responsive thereto provides the requested content, or portions of the requested content, from the storage to the second network portion if the requested content, or a portion of the requested content, is stored in the storage, or otherwise sends the request over the first network portion to the identified source for the requested content, or missing portions of the requested content.
1. An apparatus comprising:
a first network interface to at least a first network and a second interface to at least a second network, the first network communicatively connecting between the apparatus and a plurality of content sources and the second network communicatively connecting between the apparatus and a plurality of user nodes;
a deep-packet-inspection (DPI) unit that identifies at least a source of content containing content eligible for storing by the apparatus, the DPI unit further inspecting one or more packets provided from the identified at least a source of content over the first network, each packet having at least a specific source address and a specific destination address; wherein the identifies at least a source of content comprises inspection of one out of a predefined number of packets of packet flows from the traffic on the second network; wherein the predefined number is determined respective of a symmetric hash function that uses source addresses and destination addresses of packet flows;
a storage for storing at least a portion of the content from the identified at least a source of content; and
a content delivery unit that receives a request over the second network for requested content from the identified at least a source of content and responsive thereto provides the requested content, or portions of the requested content, from the storage to the second network if the requested content, or portions of the requested content, is stored in the storage, or otherwise sending the request over the first network to the identified at least a source of content for the requested content, or missing portions of the requested content.
2. The apparatus of claim 1 , wherein the hash function further uses source ports and the destination ports of packet flows.
3. The apparatus of claim 1 , wherein a source of content is considered to be identified when an identification count counted by a counter exceeds a predetermined threshold.
4. The apparatus of claim 3 , wherein the identification count ages if the count did not increase during a predefined period of time.
5. The apparatus of claim 1 , wherein the content is video.
6. The apparatus of claim 1 , wherein storing at least some of the content occurs after inspection of the content of a received data packet provided over the second network by the DPI unit and determination that the content is eligible for storage.
7. The apparatus of claim 1 , where the first network and the second network are logical partitions of a unified network.
8. A system of a service provider comprising:
a first network;
a second network for the delivery of data packets to a user node from the plurality of user nodes;
a first network interface to at least the first network and a second interface to at least the second network, the first network communicatively connecting between the apparatus and a plurality of content sources and the second network communicatively connecting between the apparatus and a plurality of user nodes;
a deep-packet-inspection (DPI) unit that identifies at least a source of content containing content eligible for storing by the apparatus, the DPI unit further inspecting one or more packets provided from the identified at least a source of content over the first network, each packet having at least a specific source address and a specific destination address; wherein the identifies at least a source of content comprises inspection of one out of a predefined number of packets of packet flows from the traffic on the second network; wherein the predefined number is determined respective of a symmetric hash function that uses source addresses and destination addresses of packet flows;
a storage for storing at least a portion of the content from the identified at least a source of content:
a content delivery unit that receives a request over the second network for requested content from the identified at least a source of content and responsive thereto provides the requested content, or portions of the requested content, from the storage to the second network if the requested content, or portions of the requested content is stored in the storage or otherwise sending the request over the first network to the identified at least a source of content for the requested content or missing portions of the requested content;
the content delivery unit receiving requests over the second network from the user node for content, the content delivery unit providing the content from the storage if the content or portions thereof are found in the storage or otherwise generating a request over the first network to a content source coupled to the first network.