Methods and systems for implementing a regionally contiguous proxy service
System and method for efficiently implementing scalable, highly efficient decentralized proxy services through proxy infrastructures situated in different geo-locations. In one aspect, the systems and methods enable users from any geographical location to send requests to the geographically closest proxy infrastructure. One exemplary method described allows proxy infrastructures to gather, classify, and store metadata of exit nodes in its internal database. In another aspect, systems and methods described herein enable proxy infrastructures to select metadata of exit nodes from its internal database and forward requests from a user device to respective proxy servers or proxy supernodes to which the selected exit nodes are connected.
1. A computer-readable storage medium for data extraction and gathering from a web server using a nearest available proxy server comprising instructions which, when executed by a computer device, causes the computer device to:
receive a user request by a proxy gateway at a proxy infrastructure geographically closest to a user device;
forward the user request to a proxy messenger;
check the user request for geolocation of an exit node;
request, from a repository unit, metadata of the exit node to implement the user request;
select the exit node to implement the user request from a pool database;
send the user request and an Internet Protocol (IP) address of the exit node selected to a proxy supernode;
instruct the exit node selected to establish a connection with a target;
send the user request to the exit node selected;
forward the user request to the target.
2. The computer-readable storage medium of claim 1 , wherein content for the user request is returned to the user device from the target by:
receiving the response for the user request from the target;
forwarding the response received from the target to the proxy supernode, the proxy messenger, the proxy gateway, and to the user device.
3. The computer-readable storage medium of claim 1 , wherein the repository unit at the proxy infrastructure gathers from a central management unit the metadata of multiple exit nodes irrespective of their locations.
4. The computer-readable storage medium of claim 1 , wherein exit nodes in the pool database are classified into categories based on exit node attributes, comprising: geo-location, ability to reach specific targets, or latency/response time.
5. The computer-readable storage medium of claim 1 , wherein the proxy supernode maintains connection with multiple exit nodes in geographical proximity.
6. The computer-readable storage medium of claim 5 wherein the exit node connects to the proxy supernode by making a Domain Name System (DNS) query to a regional DNS server.
7. The computer-readable storage medium of claim 1 wherein, before accepting the user request, the proxy messenger at the proxy infrastructure, performs user validation actions including checking data about a user in a user database.
8. The computer-readable storage medium of claim 7 wherein the request from the user device contains authentication credentials necessary for user validation.
9. The computer-readable storage medium of claim 1 wherein the user device connects to the geographically closest proxy infrastructure by requesting from the DNS provider the IP address of the geographically closest proxy infrastructure.
10. The computer-readable storage medium of claim 1 wherein the user request contains user-defined preferences comprising: geographical location of the exit node, ability to reach specific target, operating system platform or system configuration settings.
11. A system for data extraction and gathering from a web server using a nearest available proxy server comprising:
at least one processor;
a memory coupled to the at least one processor;
a proxy infrastructure geographically closest to a user device configured to:
receive a user request by a proxy gateway at a proxy infrastructure geographically closest to a user device;
forward the user request to a proxy messenger;
check the user request for geolocation of an exit node;
request, from a repository unit, metadata of the exit node to implement the user request;
select the exit node to implement the user request from a pool database;
send the user request and an Internet Protocol (IP) address of the exit node selected to a proxy supernode;
instruct the exit node selected to establish a connection with a target;
send the user request to the exit node selected;
forward the user request to the target.
12. The system of claim 11 , wherein content for the user request is returned to a user device from the target by:
receiving the response for the user request from the target;
forwarding the response received from the target to the proxy supernode, the proxy messenger, the proxy gateway, and to the user device.
13. The system of claim 11 , wherein the repository unit at the proxy infrastructure gathers from a central management unit the metadata of multiple exit nodes irrespective of their locations.
14. The system of claim 11 , wherein exit nodes in the pool database are classified into categories based on exit node attributes, comprising: geo-location, ability to reach specific targets, or latency/response time.
15. The system of claim 11 , wherein the proxy supernode maintains connection with multiple exit nodes in geographical proximity.
16. The system of claim 15 wherein the exit node connects to the proxy supernode by making a Domain Name System (DNS) query to a regional DNS server.
17. The system of claim 16 wherein the exit node, upon connecting to the proxy supernode, sends a platform message to the proxy supernode.
18. The system of claim 17 wherein the proxy supernode upon receiving the platform message from the exit node, forwards the platform message to a central management unit.
19. The system of claim 17 wherein the platform message comprises at least one, or a combination, of: operating system configuration details, hardware IDs, serial numbers, computer hardware IDs (CHID), universally unique identifiers, or information regarding battery level.
20. The system of claim 11 wherein, before accepting the user request, the proxy messenger at the proxy infrastructure, performs user validation actions including checking data about a user in a user database.
21. The system of claim 20 wherein the request from the user device contains authentication credentials necessary for user validation.
22. The system of claim 11 wherein the user device connects to the geographically closest proxy infrastructure by requesting from the DNS provider the IP address of the geographically closest proxy infrastructure.
23. The system of claim 11 wherein the user request contains user-defined preferences comprising: geographical location of the exit node, ability to reach specific target, operating system platform or system configuration settings.