Automated collection of branded training data for security awareness training
A method of collecting training data related to a branded phishing URL may comprise retrieving a phishing URL impersonating a brand; fetching a final webpage referenced thereby; determining the main language of the textual content thereof; rendering graphical representation(s) of the final webpage; extracting, from the source of URLs, information including the retrieved phishing URL, a brand, a type and a date associated therewith and storing the extracted information together with the final webpage and the rendered graphical representation(s). A message that contains a URL matching the phishing URL may then be retrieved. The main language of the textual content of the message may be determined and graphical representations thereof rendered. A record may be updated with the message, the main language and the rendered graphical representations, which may be made accessible as training data to train users to recognize phishing websites and messages.
1. A computer-implemented method of collecting training data, comprising:
retrieving, over a computer network, a phishing Uniform Resource Locator (URL) impersonating a brand from a source of URLs;
fetching a webpage referenced by the retrieved phishing URL;
rendering at least one graphical representation of the fetched webpage,
extracting, from the source of URLs, information associated with the retrieved phishing URL, and storing the extracted information in a database over the computer network, together with the fetched webpage, and the rendered at least one graphical representation of the fetched webpage;
retrieving, from a source of messages, a message that contains a URL matching the retrieved phishing URL;
rendering at least one graphical representation of the retrieved message;
updating a record in a database with the message, and the at least one rendered graphical representation of the message; and
making the stored extracted information and the updated record accessible over the computer network as training data to train end users to recognize phishing websites and phishing messages.
2. The computer-implemented method of claim 1 , wherein fetching comprises following at least one redirection leading to a final webpage.
3. The computer-implemented method of claim 1 , further comprising determining a main language of a textual content of the fetched webpage and wherein storing the extracted information further includes storing the determined main language of the fetched webpage.
4. The computer-implemented method of claim 1 , wherein the extracted information comprises at least one of a brand, a type and a date associated with the retrieved phishing URL.
5. The computer-implemented method of claim 1 , wherein the graphical representations of the fetched webpage comprise metadata associated with the fetched webpage.
6. The computer-implemented method of claim 5 , wherein the metadata comprises a phishing URL.
7. The computer-implemented method of claim 1 , wherein the graphical representations of the fetched webpage comprise at least some of a graphical representation of the fetched webpage configured for a mobile device, a tablet computer, a laptop computer and a desktop computer.
8. The computer-implemented method of claim 1 , further comprising determining a main language of the retrieved message and wherein updating further comprises updating the record in the database with the determined main language of the retrieved message.
9. The computer-implemented method of claim 1 , wherein the retrieved message comprises one of an email, a text message and an instant message.
10. The computer-implemented method of claim 1 , further comprising at least one of prior parsing, decoding, decompressing and decrypting a content of the retrieved message.
11. The computer-implemented method of claim 1 , wherein the matching of the URL retrieved from the source of messages with the retrieved phishing URL requires fewer than all URL elements to match.
12. The computer-implemented method of claim 11 , wherein the URL elements comprise at least one of a label of the domain name, an element of the path, an element of the query string and the fragment.
13. The computer-implemented method of claim 1 , wherein the graphical representations of the retrieved message comprise metadata associated with the retrieved message.
14. The computer-implemented method of claim 13 , wherein the metadata of the retrieved message comprises at least one of a sender of the message, a date when the message was sent and a subject of the retrieved message.
15. The computer-implemented method of claim 1 , wherein the graphical representations of the retrieved message comprise at least some of a graphical representation of the retrieved message configured for a mobile device, a tablet computer, a laptop computer and a desktop computer.
16. A computing device configured to collect training data related to a branded phishing Uniform Resource Locator (URL), comprising:
at least one processor;
at least one data storage device coupled to the at least one processor;
a network interface coupled to the at least one processor and to a computer network;
a plurality of processes spawned by the at least one processor, the processes including processing logic for:
retrieving, over a computer network, a phishing Uniform Resource Locator (URL) impersonating a brand from a source of URLs;
fetching a webpage referenced by the retrieved phishing URL;
rendering at least one graphical representation of the fetched webpage, extracting, from the source of URLs, information associated with the retrieved phishing URL, and storing the extracted information in a database over the computer network, together with the fetched webpage, and the rendered at least one graphical representation of the fetched webpage;
retrieving, from a source of messages, a message that contains a URL matching the retrieved phishing URL;
rendering at least one graphical representation of the retrieved message;
updating a record in a database with the message, and the at least one rendered graphical representation of the message; and
making the stored extracted information and the updated record accessible over the computer network as training data to train end users to recognize phishing websites and phishing messages.
17. The computing device of claim 16 , wherein the processing logic for fetching the webpage comprises processing logic to follow at least one redirection leading to a final webpage.
18. The computing device of claim 16 , further comprising processing logic for determining a main language of a textual content of the fetched webpage and wherein the processing logic for storing the extracted information further includes processing logic for storing the determined main language of the fetched webpage.
19. The computing device of claim 16 , wherein the extracted information comprises at least one of a brand, a type and a date associated with the retrieved phishing URL.
20. The computing device of claim 16 , wherein at least one of the graphical representations of the fetched webpage comprises metadata associated with the fetched webpage.
21. The computing device of claim 20 , wherein the metadata comprises a phishing URL.
22. The computing device of claim 16 , wherein the graphical representations of the fetched webpage comprise at least some of a graphical representation of the fetched webpage configured for a mobile device, a tablet computer, a laptop computer and a desktop computer.
23. The computing device of claim 16 , further comprising processing logic for determining a main language of the retrieved message and wherein the processing logic for updating further comprises processing logic for updating the record in the database with the determined main language of the retrieved message.
24. The computing device of claim 16 , wherein the retrieved message comprises one of an email, a text message and an instant message.
25. The computing device of claim 16 , further comprising processing logic to at least one of parse, decode, decompress and decrypt a content of the retrieved message.
26. The computing device of claim 16 , wherein the processing logic for matching the URL retrieved from the source of messages with the retrieved phishing URL allows for fewer than all URL elements to match.
27. The computing device of claim 26 , wherein the URL elements comprise at least one of a label of the domain name, an element of the path, an element of the query string and the fragment.
28. The computing device of claim 16 , wherein the graphical representations of the retrieved message comprise metadata associated with the retrieved message.
29. The computing device of claim 28 , wherein the metadata of the retrieved message comprises at least one of a sender of the message, a date when the message was sent and a subject of the retrieved message.
30. The computing device of claim 16 , wherein the graphical representations of the retrieved message comprise at least some of a graphical representation of the retrieved message configured for a mobile device, a tablet computer, a laptop computer and a desktop computer.