System and method for implementing a robot proof Web site
View Patent ↗The invention prevents robots from browsing a Web site beyond a welcome page. When an initial request from an undefined originator is received, the Web site responds to it with a welcome page including a challenge. Then, on receiving a further request from the undefined originator, the Web site can check whether the challenge is fulfilled or not. If fulfilled, the undefined originator is assumed to be a human being and authorized to go on. If the challenge is not fulfilled, the undefined originator is assumed to be a robot, in which case site access is further denied. The invention prevents Web site contents from being investigated by robots while not requiring users to have to log on.
1. A method for preventing robots from browsing a Web site beyond a welcome page, said method in said Web site comprising the steps of:
receiving an initial request from an undefined originator and responding to said initial request with a challenge that prompts a response from said undefined originator; and
receiving a response from said undefined originator and checking said response to determine whether said challenge is fulfilled; and
if said challenge is fulfilled:
processing any further requests; and
if said challenge is not fulfilled:
stopping processing of any further requests, wherein said step of stopping processing of said further requests includes the further step of:
dropping or redirecting a TCP connection established with said undefined originator
logging a source IP address of said undefined originator and starting a timer,
further including steps upon receiving a new request of:
checking whether a source IP address of said new request matches said logged source IP address; and
if said source IP address matches said logged source IP address:
checking whether said timer has expired and, if said timer is expired, resetting said logged IP address; and
proceeding normally with said new request; and
if said timer is not expired, dropping or redirecting said TCP connection;
if said source IP address does not match said logged source IP address, proceeding normally with said new request and executing all the above steps with each newly received request.
2. The method according to claim 1 wherein:
said challenge includes prompting said undefined originator to perform a specific action.
3. The method according to claim 2 wherein:
said prompting is different at each subsequent access of said web site.
4. The method according to claim 3 wherein:
said response includes making a choice among a plurality of prompted response options.
5. The method according to claim 4 , wherein said response includes an answer to a quiz.
6. The method according to claim 3 , wherein said response includes an answer to a quiz.
7. The method according to claim 2 , wherein said response includes an answer to a quiz.
8. The method according to claim 2 , wherein said response is suggested by textual meaning.
9. The method according to claim 1 wherein:
said prompting is different at each subsequent access of said web site.
10. The method according to claim 9 wherein:
said response includes making a choice among a plurality of prompted response options.
11. The method according to claim 10 , wherein said response includes an answer to a quiz.
12. The method according to claim 9 , wherein said response includes an answer to a quiz.
13. The method according to claim 1 wherein:
said response includes making a choice among a plurality of prompted response options.
14. The method according to claim 13 , wherein said response includes an answer to a quiz.
15. The method according to claim 13 , wherein said response is suggested by textual meaning.
16. The method according to claim 9 , wherein said response is suggested by textual meaning.
17. The method according to claim 1 , wherein said response includes an answer to a quiz.
18. The method according to claim 17 , wherein said response is suggested by textual meaning.
19. The method according to claim 1 , wherein said response is suggested by textual meaning.
20. A computer process for preventing robots from browsing a web site beyond a welcome page, comprising computer-executable steps of:
receiving an initial request from an undefined originator and responding to said initial request with a challenge that prompts a response from said undefined originator; and
receiving a response from said undefined originator and checking said response to determine whether said challenge is fulfilled; and
if said challenge is fulfilled:
processing any further requests; and
if said challenge is not fulfilled:
stopping processing of any further requests, wherein said step of stopping processing of said further requests includes the further step of:
dropping or redirecting a TCP connection established with said undefined originator
logging a source IP address of said undefined originator and starting a timer,
further including computer-executable steps for:
checking whether a source IP address of said new request matches said logged source IP address; and
if said source IP address matches said logged source IP address:
checking whether said timer has expired and, if said timer is expired, resetting said logged IP address; and
proceeding normally with said new request; and
if said timer is not expired, dropping or redirecting said TCP connection;
if said source IP address does not match said logged source IP address, proceeding normally with said new request and executing all the above steps with each newly received request.
21. A computer process according to claim 20 , further including computer-executable steps for:
prompting said undefined originator to perform a specific action.
22. A computer process according to claim 21 , further including computer-executable steps for:
prompting said undefined originator to make a response chosen from among a plurality of prompted response options.
23. A computer process according to claim 20 , further including computer-executable steps for:
changing said prompting at each access of said website.
24. A computer process according to claim 23 , further including computer-executable steps for:
prompting said undefined originator to make a response chosen from among a plurality of prompted response options.
25. A computer process according to claim 20 , further including computer-executable steps for:
prompting said undefined originator to make a response chosen from among a plurality of prompted response options.
26. A computer process according to claim 20 , further including computer-executable steps for:
prompting said undefined originator to make a response chosen from among a plurality of prompted response options.
27. A computer process according to claim 20 , further including computer-executable steps for:
prompting said undefined originator to make a response that is an answer to a quiz.
28. A computer process according to claim 20 , further including computer-executable steps for:
prompting said undefined originator to make a response based upon the knowledge content of said prompt.
29. The method according to claim 2 wherein:
said response includes making a choice among a plurality of prompted response options.
30. The method according to claim 29 , wherein said response includes an answer to a quiz.