IP Library Granted Patent US 10,958,684
Granted Patent B2
US 10,958,684 · App. 16/239,605 · Granted Mar 23, 2021

Method and computer device for identifying malicious web resources

Inventor: Pavel Vladimirovich Slipenchuk (Moscow, RU)
Assignee: GROUP IB, LTD
H04L63/1483G06F16/24578G06F16/9566G06N20/00H04L63/1416H04L63/1425H04L63/168
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,958,684
App. No.
16/239,605
Granted
Mar 23, 2021
Kind
B2
Abstract

The disclosed non-limiting embodiments of the present technology are directed to methods and systems for warning in regard to cyber threats, especially methods to detect malicious web resources, in particular phishing websites, and mirrors of blocked and/or prohibited websites. The disclosed method comprises receiving, by the computer device, pointers for a plurality of web resources; extracting, by the computer device, at least some of the content elements of each web resource of the plurality of web resources. Iteratively combining, by the computer device, at least two content elements into subgroups and then iteratively combining subgroups into groups in response to a number of web resources including the at least two content elements exceeding a predefined minimum threshold of web resources for the at least one first subgroup and/or group.

Claims (37)

1. A method for identifying malicious web resources, the method executable on a computer device, the method comprising:

receiving, by the computer device, pointers for a plurality of web resources;

extracting, by the computer device, at least some of the content elements of each web resource of the plurality of web resources;

combining, by the computer device, at least two content elements into at least one first subgroup in response to a number of web resources including said at least two content elements exceeding a predefined minimum threshold of web resources for the at least one first subgroup;

combining, by the computer device, at least two content elements into at least one second subgroup in response to number of web resources including said at least two content elements exceeds a predefined minimum threshold of web resources for the at least one second subgroup;

combining, by the computer device, the at least one first subgroup and the at least one second subgroup into a group of content elements in response to the number of web resources including the content elements of the at least one first subgroup and the at least one second subgroup exceeding a predefined threshold of web resources for the group;

storing, by the computer device in a database, the content element group and the pointers for the web resources associated with the relevant content element group.

2. The method of claim 1 , wherein the plurality of web resources comprises at least two web resources.

3. The method of claim 1 , wherein the method further comprises: performing a preliminary network scan to obtain pointers for the plurality of web resources.

4. The method of claim 1 , wherein the receiving the pointers for the plurality of web resources comprises obtaining at least a portion of the pointers from an external source via a data network.

5. The method of claim 1 , wherein the receiving the pointers for the plurality of web resources comprises obtaining the pointers from a previously composed database of web resources.

6. The method of claim 1 , wherein the receiving the pointers for the plurality of web resources comprises obtaining at least some pointers from a list of previously extracted pointers for content elements of the plurality of web resources.

7. The method of claim 1 , wherein the content elements are one of: (i) files of content elements and (ii) hash sums of files of content elements.

8. The method of claim 1 , wherein the method further comprises, after extracting at least some of the content elements, performing a filtering, the filtering including deleting previously defined standard content elements, and wherein combining is executed without the deleted content elements.

9. The method of claim 1 , wherein the method further comprises, prior to saving the group of content elements, determining a weight for a group, the determining being based on a ratio of a number of content elements in the group and a number of web resources associated with the group of content elements, and wherein the first and second subgroups of content elements are combined into the group in response to the weight of the obtained group exceeding the predefined threshold.

10. The method of claim 1 , wherein the method further comprises, after saving the group of content elements and pointers for web resources associated with said group of content elements, identifying malicious web resources associated with the group of content elements.

11. The method of claim 1 , wherein the identifying of malicious web resources comprises receiving an indication thereof from a human assessor.

12. A computer device for identifying malicious web resources, the computer device communicatively coupled to a data network and at least one database, the computer device comprising a computer processor, the computer processor being configured to:

receive pointers for a plurality of web resources;

extract at least some of the content elements of each web resource of the plurality of web resources;

combine at least two content elements into at least one first subgroup in response to a number of web resources including said at least two content elements exceeding a predefined minimum threshold of web resources for the at least one first subgroup;

combine at least two content elements into at least one second subgroup in response to number of web resources including said at least two content elements exceeds a predefined minimum threshold of web resources for the at least one second subgroup;

combine the at least one first subgroup and the at least one second subgroup into a group of content elements in response to the number of web resources including the content elements of the at least one first subgroup and the at least one second subgroup exceeding a predefined threshold of web resources for the group;

store in the at least one database, the content element group and the pointers for the web resources associated with the relevant content element group.

13. The device of claim 12 , wherein the processor is further configured to perform a network scan to obtain the pointers for a plurality of web resources.

14. The device of claim 12 , wherein the processor is further configured to obtain pointers for the plurality of web resources at least partially from an external source via a data network.

15. The device of claim 12 , wherein the processor is further configured to obtain pointers for the plurality of web resources from a previously composed database of web resources.

16. The device of claim 12 , wherein to receive the pointers for the plurality of web resources, the processor is configured to obtain at least some of the pointers from previously extracted pointers for content elements of the plurality of web resources.

17. The device of claim 12 , wherein the content elements are files of content elements or hash sums of files of content elements.

18. The device of claim 12 , wherein, after extracting at least some of the content elements, the processor is further configured to perform a filtration by deleting previously defined standard content elements, and to combine at least two elements into a group without the deleted content elements.

19. A method for identifying malicious web resources, the method executable on a computer device, the method comprising:

receiving, by the computer device, pointers for a plurality of web resources;

extracting, by the computer device, at least some of the content elements of each web resource of the plurality of web resources;

iteratively combining, by the computer device, a given combination of at least two content elements into at least one subgroup in response to a number of web resources including the given combination exceeding a predefined minimum threshold of web resources for the at least one first subgroup;

iteratively combining, by the computer device, the at least one subgroup into a group of content elements in response to the number of web resources including the content elements of the at least one subgroup exceeding a predefined threshold of web resources for the group;

storing, by the computer device in a database, the content element group and the pointers for the web resources associated with the relevant content element group;

using, by the computer device, a machine learning algorithm to analyze the content element group to flag malicious web resources.

Assignments (4)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 17, 2025
From: F.A.C.C.T. ANTIFRAUD LLC
To: GROUP-IB GLOBAL PRIVATE LIMITED
Reel/Frame 071438/0815 →
CHANGE OF NAME Recorded Jul 19, 2024
From: GROUP IB, LTD
To: F.A.C.C.T. ANTIFRAUD LLC
Reel/Frame 068462/0907 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Oct 11, 2019
From: GROUP IB TDS, LTD
To: GROUP IB, LTD
Reel/Frame 050690/0987 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 4, 2019
From: SLIPENCHUK, PAVEL VLADIMIROVICH
To: GROUP IB TDS, LTD
Reel/Frame 047897/0754 →
Priority Claims (1)
RU RU2018101760 · Jan 17, 2018 · national
Continuity (1)
Related Publication 20190222609A1 · Jul 18, 2019