System and method for dynamic and real-time categorization of webpages
View Patent ↗A system and method for categorizing content on a webpage is disclosed. The method comprises receiving a request for a webpage from a user's computer. Next, the system determines whether there is dynamic content on the webpage by analyzing the address, links, reputation, type, style and other indicators of being able to easily change the webpage. If the webpage contains content that can be changed, then the webpage is analyzed to determine a current categorization thereof. If the webpage does not have dynamic content then the categorization of the webpage will remain the same thereby freeing system resources by only analyzing dynamic webpages.
1. A method for categorizing dynamic content on a webpage using a dynamic categorization computer system, the method comprising:
in response to a gateway hardware computer receiving a request for a webpage from a user over a computer network,
determining, via an electronic processor, whether the webpage is categorized;
in response to determining, via the electronic processor, the webpage is categorized, determining whether the webpage contains dynamic content, and
in response to determining the webpage contains dynamic content,
re-categorizing content of the webpage with the dynamic categorization computer system; and
in response to determining, via the electronic processor, the webpage is uncategorized:
receiving, by the electronic processor, a suggested category for the webpage from the user, wherein the user is untrusted and does not have authority to change a category of the webpage, and
receiving, in response to the suggested category, via the electronic processor, a categorization of the webpage from an administrator, wherein the categorization from the administrator is the suggested category;
receiving, via the electronic processor, a policy associated with the user;
blocking or allowing the request for the webpage via the gateway hardware computer based on the categorization and the user policy.
2. The method of claim 1 , wherein determining if the webpage contains dynamic content comprises analyzing one or more of an address of the webpage, one or more links included in the webpage, and a reputation of the webpage.
3. The method of claim 1 , wherein the webpage includes multiple sections and the content of each section is analyzed and categorized.
4. The method of claim 1 , further comprising allowing access to the webpage for the user's computer in response to the categorization of the webpage.
5. The method of claim 4 , wherein allowing access further comprises blocking access if the content is malicious.
6. A system for categorizing content on a webpage with a computer system, the system comprising:
one or more hardware processors configured to:
receive a request for a webpage from a user over a computer network,
determine whether the webpage is categorized;
in response to determining the webpage is categorized, determine whether the webpage includes dynamic content;
in response to determining the webpage includes dynamic content, re-categorizing the webpage, and
in response to determining the webpage is not categorized, receive a suggested category for the webpage from the user, wherein the user is untrusted and does not have authority to change a category of the webpage,
receive, in response to the suggested category, a categorization of the webpage from an administrator, wherein the categorization from the administrator is the suggested category,
receive a policy associated with the user; and
block or allow the request for the webpage based on the categorization of the webpage from the administrator and the policy.
7. The system of claim 6 , wherein the one or more hardware processors are further configured to determine if the webpage contains dynamic content by analyzing an address of the webpage.
8. The system of claim 6 , wherein the one or more hardware processors are further configured to determine if the webpage contains dynamic content by analyzing one or more of an address of the webpage, one or more links included in the webpage, and a reputation of the webpage.
9. The system of claim 6 , wherein the webpage contains multiple sections and the content of each section is analyzed.
10. The system of claim 6 , wherein the one or more hardware processors are further configured to implement a real time categorization server module configured to categorize the dynamic content of the webpage.
11. The system of claim 10 , wherein the one or more hardware processors are configured to categorize each section of the webpage if the content is dynamic.
12. A system for determining dynamic content on a webpage-requested by a user over a network, the system comprising:
a hardware computer configured to:
determine whether the webpage is categorized and in response to the webpage being categorized, determine whether the webpage includes dynamic content,
re-categorize a content of the webpage in response to the webpage being categorized and containing content that is dynamic,
in response to determining the webpage is uncategorized, receive a suggested category for the webpage from the user, wherein the user is untrusted and does not have authority to change a category of the uncategorized webpage,
receive, in response to the suggested category, a categorization of the uncategorized webpage from an administrator, wherein the categorization from the administrator is the suggested category,
receive policy information for the user, and
allow or block the webpage based on the categorization from the administrator and the policy information.
13. The system of claim 12 , wherein the one or more hardware processors are configured to analyze addresses of the webpage content in order to determine if the content is dynamic.
14. The system of claim 13 , wherein the one or more hardware processors are configured to categorize the content of the webpage.