System and method for implementing a robot proof web site
View Patent ↗The invention prevents robots from browsing a Web site beyond a welcome page. When an initial request from an undefined originator is received, the Web site responds to it with a welcome page including a challenge. Then, on receiving a further request from the undefined originator, the Web site can check whether the challenge is fulfilled or not. If fulfilled, the undefined originator is assumed to be a human being and authorized to go on. If the challenge is not fulfilled, the undefined originator is assumed to be a robot, in which case site access is further denied. The invention prevents Web site contents from being investigated by robots while not requiring users to have to log on.
1. A system for preventing robots from browsing a Web site beyond a welcome page, comprising:
a computer having at least one processor and a memory, the computer comprising program code that when executed by the at least one processor causes the computer to:
receive an initial request, directed to the Web site, from an undefined originator;
respond to the initial request with a challenge that prompts a response to the challenge from the undefined originator; and
receive the response to the challenge from the undefined originator, wherein
the challenge includes:
a plurality of graphical forms, and
an accompanying textual expression describing one of the plurality of graphical forms, and
the response to the challenge includes an identification of a location of the described one of the plurality of graphical forms.
2. The system of claim 1 , wherein the computer further comprises program code that when executed by the at least one processor causes the computer to modify the challenge in response to a second initial request.
3. The system of claim 2 , the program code to modify the challenge in response to the second initial request comprises program code to vary a coordinate location of the described one of the plurality of graphical forms.
4. The system of claim 2 , wherein the program code to modify the challenge in response to the second initial request comprises program code to vary which one of the plurality of graphical forms that is described by the accompanying textual expression.
5. The system of claim 1 , wherein the computer further comprises program code that when executed by the at least one processor causes the computer to process further requests from the undefined originator after the challenge has been successfully fulfilled.
6. The system of claim 1 , wherein the computer further comprises program code that when executed by the at least one processor causes the computer to stop processing further requests from the undefined originator after the challenge has not been successfully fulfilled.
7. The system of claim 6 , wherein the program code to stop processing further requests from the undefined originator after the challenge has not been successfully fulfilled comprises program code to drop or redirect a TCP connection established with the undefined originator.
8. The system of claim 1 , wherein the computer further comprises program code that when executed by the at least one processor causes the computer to log a source IP address of the undefined originator, and to start a timer.
9. The system of claim 1 , wherein the computer further comprises program code that when executed by the at least one processor causes the computer to:
receive a new request;
determine whether a source IP address of the new request matches the logged source IP address of the undefined originator;
determine whether said timer is expired; and
upon the source IP address of the new request matching the logged source IP address of the undefined originator and the timer being expired, respond to the new request with a second challenge that prompts a response to the second challenge.
10. The system of claim 1 , wherein the location of the described one of the plurality of graphical forms is X and Y coordinates of the undefined originator's click associated with the challenge.