Method and system for detecting bot behavior
A bot detection engine to determine whether hosts in an organization's network are performing bot-related activities is disclosed. A bot detection engine can receive network traffic between hosts in a network, and/or between hosts across several networks. The bot engine may parse the network traffic into session datasets and discard the session datasets that were not initiated by hosts in a given network. The session datasets may be analyzed and state data may be accumulated. The state data may correspond to actions performed by the hosts, such as requesting a website or clicking ads, or requesting content within the website (e.g. clicking on a image which forms a HTTP request/response transaction for the image file).
1. A method for detecting bot behavior on networks, comprising:
generating one or more session datasets, the session datasets corresponding to received network traffic from one or more hosts in a network;
discarding session datasets that correspond to network traffic not initiated by one or more hosts in the network; and
determining whether one or more of the hosts in the network is performing network attacks on targets outside of the network by:
accumulating a number of actions performed by the one or more hosts into a database by continually tracking a number of events per time interval, the actions corresponding to one or more potential bot actions performed by the one or more hosts contacting one or more external hosts per the time interval as indicated by data in the network traffic, wherein the one or more potential bot actions correspond to: clicking on a website advertisement, sending one or more emails, selecting a particular item from a prior executed search, creating a new friend or follower in a social network, or attempting to access multiple IP addresses external to the network on a same protocol and port;
discarding actions older than a pre-selected time interval limit; and
determining whether the number of actions per the time interval surpasses a threshold corresponding to the one or more potential bot actions per the time interval, and if the number of actions per the time interval surpasses the threshold then generating host score data, wherein the host score data corresponds to an indication of whether one or more of the hosts is a bot or whether one or more of the hosts is partaking in bot activity corresponding to network attacks and a most recent time an individual potential bot action was reported.
2. The method of claim 1 , wherein the host score data corresponds to threat score data and certainty score data, the threat score data and certainty score data corresponding to an individual potential bot action.
3. The method of claim 2 , wherein a value of the host score data attenuates with time.
4. The method of claim 3 , wherein an attenuation is dictated by a decay rate.
5. The method of claim 1 , wherein the host scores for the one or more hosts are periodically updated.
6. The method of claim 1 , wherein the action corresponds to multiple hosts repeatedly accessing a same IP address external to the network.
7. The method of claim 1 , wherein the network traffic is received passively through a network switch.
8. A computer program product embodied on a non-transitory computer readable medium, the non-transitory computer readable medium having stored thereon a sequence of instructions which, when executed by a processor causes the processor to execute a method for accessing data corresponding to detecting bot behavior on networks, comprising:
generating one or more session datasets, the session datasets corresponding to received network traffic from one or more hosts in a network;
discarding session datasets that correspond to network traffic not initiated by one or more hosts in the network; and
determining whether one or more of the hosts in the network is performing network attacks on targets outside of the network by:
accumulating a number of actions performed by the one or more hosts into a database by continually tracking a number of events per time interval, the actions corresponding to one or more potential bot actions performed by the one or more hosts contacting one or more external hosts per the time interval as indicated by data in the network traffic, wherein the one or more potential bot actions correspond to: clicking on a website advertisement, sending one or more emails, selecting a particular item from a prior executed search, creating a new friend or follower in a social network, or attempting to access multiple IP addresses external to the network on a same protocol and port;
discarding actions older than a pre-selected time interval limit; and
determining whether the number of actions per the time interval surpasses a threshold corresponding to the one or more potential bot actions per the time interval, and if the number of actions per the time interval surpasses the threshold then generating host score data, wherein the host score data corresponds to an indication of whether one or more of the hosts is a bot or whether one or more of the hosts is partaking in bot activity corresponding to network attacks and a most recent time an individual potential bot action was reported.
9. The computer program product of claim 8 , wherein the host score data corresponds to threat score data and certainty score data, the threat score data and certainty score data corresponding to an individual potential bot action.
10. The computer program product of claim 9 , wherein a value of the host score data attenuates with time.
11. The computer program product of claim 10 , wherein an attenuation is dictated by a decay rate.
12. The computer program product of claim 8 , wherein the host scores for the one or more hosts are periodically updated.
13. The computer program product of claim 8 , wherein the action corresponds to multiple hosts repeatedly accessing a same IP address external to the network.
14. The computer program product of claim 8 , wherein the network traffic is received passively through a network switch.
15. A system for detecting bot behavior on networks, comprising:
a computer processor to execute a set of program code instructions;
a memory to hold the program code instructions, in which the program code instructions comprises program code to perform:
generating one or more session datasets, the session datasets corresponding to received network traffic from one or more hosts in a network;
discarding session datasets that correspond to network traffic not initiated by one or more hosts in the network; and
determining whether one or more of the hosts in the network is performing network attacks on targets outside of the network by:
accumulating a number of actions performed by the one or more hosts into a database by continually tracking a number of events per time interval, the actions corresponding to one or more potential bot actions performed by the one or more hosts contacting one or more external hosts per the time interval as indicated by data in the network traffic, wherein the one or more potential bot actions correspond to: clicking on a website advertisement, sending one or more emails, selecting a particular item from a prior executed search, creating a new friend or follower in a social network, or attempting to access multiple IP addresses external to the network on a same protocol and port;
discarding actions older than a pre-selected time interval limit; and
determining whether the number of actions per the time interval surpasses a threshold corresponding to the one or more potential bot actions per the time interval, and if the number of actions per the time interval surpasses the threshold then generating host score data, wherein the host score data corresponds to an indication of whether one or more of the hosts is a bot or whether one or more of the hosts is partaking in bot activity corresponding to network attacks and a most recent time an individual potential bot action was reported.
16. The system of claim 15 , wherein the host score data corresponds to threat score data and certainty score data, the threat score data and certainty score data corresponding to an individual potential bot action.
17. The system of claim 16 , wherein a value of the host score data attenuates with time.
18. The system of claim 17 , wherein an attenuation is dictated by a decay rate.
19. The system of claim 15 , wherein the host scores for the one or more hosts are periodically updated.
20. The system of claim 15 , wherein the action corresponds to multiple hosts repeatedly accessing a same IP address external to the network.
21. The system of claim 15 , wherein the network traffic is received passively through a network switch.