Managed exit nodes and third party proxy providers in a proxy infrastructure
Systems and methods herein provide for a proxy infrastructure. In the proxy infrastructure, a network element (e.g., a supernode) is connected with a plurality of exit nodes. At one of a plurality of messenger units of the proxy infrastructure, a proxy protocol request is received directly from a client computing device. The proxy protocol request specifies a request and a target. In response the proxy protocol request, a selection is made between one between one of the plurality of exit nodes. A message with the request is sent from the messenger to the supernode connected with the selected exit node. Finally, the message is sent from the supernode to the selected exit node to forward the request to the target.
1. A method of operating a proxy infrastructure, comprising:
connecting to a plurality of third party proxy providers external to the proxy infrastructure;
connecting to a plurality of exit nodes internal to the proxy infrastructure, wherein connecting to the plurality of exit nodes comprises:
contacting one or more external supernodes;
establishing a connection to each of the one or more external supernodes;
loading, by each of the one or more external supernodes, a pre-declared list of third party proxy providers;
transmitting, by each of the one or more external supernodes, quality check requests to the third party proxy providers from the pre-declared list; and
storing results about the third party proxy providers in a database from the quality check requests;
receiving, at one of a plurality of messenger units of the proxy infrastructure, a proxy protocol request directly from a client computing device, the proxy protocol request specifying a target and a desired geographical region;
selecting one of the plurality of third party proxy providers or one of the plurality of exit nodes based on the desired geographical region;
establishing a communication session with the target through the selected one of the plurality of third party proxy providers or one of the plurality of exit nodes;
before the communication session with the target is established, providing a positive connection response to the client computing device; and
forwarding data requests from the client computing device to the target via the communication session.
2. The method of claim 1 , wherein each of the plurality of exit nodes is connected to one of a plurality of supernodes in the proxy infrastructure.
3. The method of claim 1 , wherein the positive connection response comprises an OK response.
4. The method of claim 1 , further comprising:
before the communication session with the target is established, receiving the data requests from the client computing device;
buffering the data requests until the communication session with the target is established;
bundling the buffered data requests into a single data request; and
transferring the single data request to a network element when the communication session with the target is established.
5. The method of claim 4 , further comprising:
initiating a timer after receiving content fulfilling the single data request from the target; and
terminating the communication session with the target based on a determination that no other data requests are pending when the timer expires.
6. The method of claim 1 , wherein selecting one of the plurality of third party proxy providers or one of the plurality of exit nodes based on the desired geographical region further comprises:
determining that the proxy infrastructure operates in the desired geographical region by identifying one or more exit nodes in the desired geographic region from the plurality of exit nodes; and
in response to determining that the proxy infrastructure operates in the desired geographical region, selecting an exit node from the one or more exit nodes based on statistics collected for each of the one or more exit nodes, wherein the statistics comprise at least one of: bandwidth, latency, or availability status.
7. The method of claim 6 , further comprising:
in response to determining that the proxy infrastructure does not operate in the desired geographical region or that the one or more exit nodes have experienced an outage, identifying one or more third party proxy providers in the desired geographical region from the plurality of third party proxy providers; and
selecting a third party proxy provider from the one or more third party proxy providers based on statistics collected for each of the one or more third party proxy providers, wherein the statistics comprise at least one of: bandwidth, latency, or availability status.
8. The method of claim 1 , wherein the plurality of messenger units of the proxy infrastructure share a common domain name.
9. The method of claim 8 , wherein the one of the plurality of messenger units is selected by a DNS server during a DNS lookup by the client computing device using a load balancing algorithm.
10. The method of claim 1 , wherein a quality check request of the quality check requests comprises:
transmitting a ping message to a third party proxy provider from the pre-declared list;
receiving a pong message from the third party proxy provider; and
determining an amount of time between transmitting the ping message and receiving the pong message.
11. A non-transitory computer-readable device having instructions stored thereon that, when executed by at least one computing device, cause the at least one computing device to perform operations, the operations comprising:
connecting to a plurality of third party proxy providers external to a proxy infrastructure;
connecting to a plurality of exit nodes internal to the proxy infrastructure;
receiving, at one of a plurality of messenger units of the proxy infrastructure, a proxy protocol request directly from a client computing device, the proxy protocol request specifying a target and a desired geographical region;
selecting one of the plurality of third party proxy providers or one of the plurality of exit nodes based on the desired geographical region;
establishing a communication session with the target through the selected one of the plurality of third party proxy providers or one of the plurality of exit nodes;
before the communication session with the target is established:
providing a positive connection response to the client computing device;
receiving data requests from the client computing device;
buffering the data requests until the communication session with the target is established; and
bundling the buffered data requests into a single data request; and
forwarding the single data request to the target via the communication session when the communication session with the target is established.
12. The non-transitory computer-readable device of claim 11 , wherein connecting to the plurality of third party proxy providers further comprises:
contacting one or more external supernodes;
establishing a connection to each of the one or more external supernodes;
loading, by each of the one or more external supernodes, a pre-declared list of third party proxy providers;
transmitting, by each of the one or more external supernodes, quality check requests to the third party proxy providers from the pre-declared list; and
storing results about the third party proxy providers in a database from the quality check requests.
13. The non-transitory computer-readable device of claim 11 , wherein each of the plurality of exit nodes is connected to one of a plurality of supernodes in the proxy infrastructure.
14. The non-transitory computer-readable device of claim 11 , wherein the positive connection response comprises an OK response.
15. The non-transitory computer-readable device of claim 11 , further comprising:
initiating a timer after receiving content fulfilling the single data request from the target; and
terminating the communication session with the target based on a determination that no other data requests are pending when the timer expires.
16. The non-transitory computer-readable device of claim 11 , wherein selecting one of the plurality of third party proxy providers or one of the plurality of exit nodes based on the desired geographical region further comprises:
determining that the proxy infrastructure operates in the desired geographical region by identifying one or more exit nodes in the desired geographical region from the plurality of exit nodes; and
in response to determining that the proxy infrastructure operates in the desired geographical region, selecting an exit node from the one or more exit nodes based on statistics collected for each of the one or more exit nodes, wherein the statistics comprise at least one of: bandwidth, latency, or availability status.
17. The non-transitory computer-readable device of claim 16 , further comprising:
in response to determining that the proxy infrastructure does not operate in the desired geographical region or that the one or more exit nodes have experienced an outage, identifying one or more third party proxy providers in the desired geographical region from the plurality of third party proxy providers; and
selecting a third party proxy provider from the one or more third party proxy providers based on statistics collected for each of the one or more third party proxy providers, wherein the statistics comprise at least one of: bandwidth, latency, or availability status.
18. The non-transitory computer-readable device of claim 11 , wherein the plurality of messenger units of the proxy infrastructure share a common domain name.
19. The non-transitory computer-readable device of claim 18 , wherein the one of the plurality of messenger units is selected by a DNS server during a DNS lookup by the client computing device using a load balancing algorithm.
20. The non-transitory computer-readable device of claim 11 , wherein the positive connection response is provided to the client computing device simultaneously with selecting one of the plurality of third party proxy providers or one of the plurality of exit nodes.