Selecting proxy device based on hardware resource utilization
A method for fetching a content from a web server to a client device is disclosed, using tunnel devices serving as intermediate devices. The tunnel device is selected based on an attribute, such as IP Geolocation. A tunnel bank server stores a list of available tunnels that may be used, associated with values of various attribute types. The tunnel devices initiate communication with the tunnel bank server, and stays connected to it, for allowing a communication session initiated by the tunnel bank server. Upon receiving a request from a client to a content and for specific attribute types and values, a tunnel is selected by the tunnel bank server, and is used as a tunnel for retrieving the required content from the web server, using standard protocol such as SOCKS, WebSocket or HTTP Proxy. The client only communicates with a super proxy server that manages the content fetching scheme.
1 . A method for obtaining, a content that is stored in a web server and that is identified by a content identifier, by a first device that is configured to be in one of an idle state and a non-idle state, the method comprising:
connecting, by the first device, over the Internet, with a first server that is selected from a plurality of servers that includes the first server;
establishing, by the first device with the first server over the Internet, a Transmission Control Protocol (TCP) connection that uses an ‘Active OPEN’, ‘Passive OPEN’, or TCP keepalive mechanism;
metering, by the first device in the non-idle state, a utilization of a hardware resource in the first device;
comparing, by the first device in the non-idle state, the metered utilization of the hardware resource to a threshold;
shifting, by the first device, to the idle state, in response to determining that the metered utilization is below the threshold;
sending, by the first device to the first server over the TCP connection, a first status message indicative of the metered utilization of the hardware resource, in response to the shifting to the idle state;
receiving, by the first device from the first server over the established connection, in response to the sent first status message, a first request that comprises the content identifier;
sending, by the first device to the web server over the Internet, a second request that comprises the received content identifier;
receiving, by the first device from the web server, the content, in response to the sending of the second request;
sending, by the first device to the first server over the Internet, the received content;
metering, by the first device in the idle state, the utilization of the hardware resource;
comparing, by the first device in the idle state, the metered utilization to the threshold;
shifting, by the first device, to the non-idle state, in response to determining that the metered utilization is above the threshold; and
sending, by the first device to the first server over the TCP connection, a second status message indicative of the metered utilization, in response to the shifting to the non-idle state,
wherein the metering of the utilization of the resource further comprises metering of a battery charging level of a battery in the first device using a Battery Management System (BMS),
wherein the metering of the utilization of the resource further comprises metering the utilization of a processor, sensing an output of a sensor, sensing an input from a human user by an input device, metering a communication activity over the Internet, in the first device.
2 . The method according to claim 1 , wherein the metering of the utilization of the resource further comprises metering the utilization of a processor in the first device.
3 . The method according to claim 1 , wherein the metering of the utilization of the resource further comprises sensing an input from a human user by an input device in the first device.
4 . The method according to claim 1 , wherein the metering of the utilization of the resource further comprises sensing an output of a sensor in the first device.
5 . The method according to claim 1 , wherein the metering of the utilization of the resource further comprises metering a communication activity over the Internet with the first device.
6 . The method according to claim 1 , wherein the first device comprises a motion sensor, wherein the metering of the utilization of the resource further comprises sensing, using the motion sensor, the first device motion, acceleration, vibration, or location change.
7 . The method according to claim 1 , wherein the first device comprises a network interface or a network transceiver for communication over a network, wherein the metering of the utilization of the resource further comprises metering of an amount of data transmitted to, or received from, the network during a time interval.
8 . The method according to claim 1 , wherein the threshold is above 40%, 50%, 60%, 70%, 80%, or 90% of a defined battery full charge capacity.
9 . The method according to claim 1 , further comprising shifting, when in the idle state, to the non-idle state in response to determining, by the first device, that the resource utilization being above the threshold; and shifting, when in the non-idle state, to the idle state in response to determining, by the first device, that the resource utilization being below the threshold.
10 . The method according to claim 1 , wherein the TCP connection uses, or is based on, a Virtual Private Network (VPN).
11 . The method according to claim 1 , wherein the communication by the first device over the Internet with the first server uses, or is compatible with, a Transmission Control Protocol over Internet Protocol (TCP/IP) protocol or connection.
12 . The method according to claim 1 , wherein the communication over the Internet with the first or second server uses, or is compatible with, a Hypertext Transfer Protocol (HTTP) or HTTP Secure (HTTPS) protocol or connection.
13 . The method according to claim 1 , wherein the second request comprises a HTTP or HTTPS request.
14 . The method according to claim 1 , wherein the communication over the Internet with the first server uses, or is compatible with, a HTTP Proxy protocol or connection.
15 . The method according to claim 1 , wherein the first device is further operating in multiple states that include the idle state and the non-idle states.
16 . The method according to claim 1 , wherein the content identifier comprises a domain name, the method further comprising performing, by the first device using a Domain Name System (DNS) server, a DNS resolution for obtaining a numerical IP address, and wherein the first request or the second request comprises the obtained numerical IP address.
17 . The method according to claim 1 , wherein the content comprises a web-page or a web-site, and wherein the content identifier is Uniform Resource Identifier (URI) or Uniform Resource Locator (URL).
18 . The method according to claim 1 , further comprising storing or operating a web browser.
19 . The method according to claim 1 , wherein at least part of steps of claim 1 are included in a Software Development Kit (SDK) that is provided as a non-transitory computer readable medium containing computer instructions, and wherein the method further comprising installing the SDK.
20 . The method according to claim 1 , further comprising operating, by the first device, an operating system or a program process or thread, wherein the metering of the utilization of the resource further comprises detecting of activating or executing of the respective process or thread by the respective operating system or the program.
21 . The method according to claim 20 , wherein the process or thread comprises a low-priority or background task, an idle process, or a screensaver.
22 . The method according to claim 20 , wherein the process or thread comprises using an entire screen for displaying.
23 . The method according to claim 1 , wherein the first device comprises an input device for obtaining an input from a human user or operator, wherein the metering of the utilization of the resource further comprises receiving an input from the input device during a pre-set time interval.
24 . The method according to claim 23 , wherein the input device comprises a pointing device, a keyboard, a touchscreen, or a microphone.
25 . The method according to claim 1 , wherein the first device is addressable in the Internet using a first IP address, the method further comprising sending, by the first device to the first server over the TCP connection, a third status message indicative of at least one value of at least one attribute type.
26 . The method according to claim 25 , wherein the initiating of the communication is based on a Network Address Translator (NAT) traversal scheme.
27 . The method according to claim 26 , wherein the NAT traversal scheme is according to Internet Engineering Task Force (IETF) Request for Comments (RFC) 2663, IETF RFC 3715, IETF RFC 3947, IETF RFC 5128, IETF RFC 5245, IETF RFC 5389, or IETF RFC 7350.
28 . The method according to claim 26 , wherein the NAT traversal scheme is according to Traversal Using Relays around NAT (TURN), Socket Secure (SOCKS), NAT ‘hole punching’, Session Traversal Utilities for NAT (STUN), Interactive Connectivity Establishment, (ICE), UPnP Internet Gateway Device Protocol (IGDP), or Application-Level Gateway (ALG).
29 . The method according to claim 1 , wherein the first request further comprises an Internet Protocol (IP) address of a second server.
30 . The method according to claim 29 , further comprising, in response to the receiving of the first request, initiating, by the first device, a communication with the second server over the Internet.
31 . The method according to claim 29 , wherein the sending by the first device of the received content comprises sending to the second server using the received IP address.
32 . The method according to claim 1 , wherein the communication over the Internet with the first server uses, or is compatible with, Socket Secure (SOCKS) protocol or connection.
33 . The method according to claim 32 , wherein the SOCKS protocol or connection uses, or is compatible with, SOCKS4, SOCKS4a, or SOCKS5.
34 . The method according to claim 32 , wherein the SOCKS protocol or connection uses, or is compatible with, IETF RFC 1928, IETF RFC 1929, IETF RFC 1961, or IETF RFC 3089.
35 . The method according to claim 1 , wherein each one of the servers in the plurality of servers is connectable to the Internet and is addressable in the Internet using a respective IP address, the method further comprising selecting, by the first device, the first server from the plurality of servers.
36 . The method according to claim 35 , wherein the first server is selected randomly or according to a criterion, from the plurality of servers.
37 . The method according to claim 36 , wherein the first server is randomly selected using one or more random numbers generated by a random number generator.
38 . The method according to claim 37 , wherein the random number generator is hardware based.
39 . The method according to claim 38 , wherein the random number generator is using thermal noise, shot noise, nuclear decaying radiation, photoelectric effect, or quantum phenomena.
40 . The method according to claim 37 , wherein the random number generator is software based.
41 . The method according to claim 40 , wherein the random number generator is based on executing an algorithm for generating pseudo-random numbers.
42 . The method according to claim 1 , wherein the first device is associated with multiple IP addresses.
43 . The method according to claim 42 , wherein the first device is associated with a list that includes more than 1,000, 2,000, 5,000, 10,000, 20,000, 50,000 or 100,000 distinct IP addresses stored in a database.
44 . The method according to claim 1 , further comprising integrating the first device in part, or entirely, in a household appliance.
45 . The method according to claim 44 , further comprising controlling, by the first device, an air temperature, wherein a primary function of the appliance is associated with temperature control, and wherein the appliance is an air conditioner or a heater.
46 . The method according to claim 44 , wherein the appliance is configured for cleaning clothes.
47 . The method according to claim 44 , wherein the appliance is configured for heating water.
48 . The method according to claim 1 , wherein the first device is enclosed in a single enclosure that is a hand-held enclosure or a portable enclosure.
49 . The method according to claim 48 , further comprising integrating of the first device with a notebook computer, a laptop computer, a media player, a Digital Still Camera (DSC), a Digital video Camera (DVC or digital camcorder), a Personal Digital Assistant (PDA), a cellular telephone, a digital camera, a video recorder, or a smartphone.
50 . The method according to claim 1 , further comprising storing or operating, by the first device, an operating system.
51 . The method according to claim 50 , wherein the operating system comprises a client operating system.
52 . The method according to claim 50 , wherein the operating system comprises a mobile operating system.
53 . The method according to claim 1 , wherein the connecting to the Internet, comprises connecting to the Internet via a wireless network.
54 . The method according to claim 53 , wherein the wireless network comprises a Wireless Personal Area Network (WPAN).
55 . The method according to claim 53 , wherein the wireless network comprises a Wireless Wide Area Network (WWAN).
56 . The method according to claim 55 , wherein the WWAN is a wireless broadband network.
57 . The method according to claim 56 , further comprising using, by the wireless network a WiMAX network that is based on IEEE 802.16-2009.
58 . The method according to claim 53 , wherein the wireless network comprises a cellular telephone network.
59 . The method according to claim 58 , further comprising using, by the cellular telephone network, a Third Generation (3G) network that uses a protocol selected from the group consisting of UMTS W-CDMA, UMTS HSPA, UMTS TDD, CDMA2000 1×RTT, CDMA2000 EV-DO, and GSM EDGE-Evolution, or wherein the method further comprising using, by the cellular telephone network, a Fourth Generation (4G) network that uses HSPA+, Mobile WiMAX, LTE, LTE-Advanced, MBWA, or is based on IEEE 802.20-2008.
60 . The method according to claim 53 , wherein the wireless network comprises a Wireless Local Area Network (WLAN).
61 . The method according to claim 60 , wherein the WLAN is based on IEEE 802.11-2012, IEEE 802.11a, IEEE 802.11b, IEEE 802.11g, IEEE 802.11n, or IEEE 802.11ac standard.