WEB PAGE METADATA CLASSIFIER
Among other things, embodiments of the present disclosure discussed herein may be used to identify and classify new web page content based on metadata in the content. The embodiments of the present disclosure help provide a classification solution for web content that is scalable to large numbers of content attributes, has the flexibility to predict values for a wide range of diverse attributes, and provides consistent and highly accurate results.
1 . A method comprising:
receiving, over the Internet by a server computer system, a request for web page content from a client computing device of a user;
in response to the request for web page content, causing, by the server computer system, the web page content to render on a display screen coupled to the client computing device;
analyzing, by the server computer system, metadata in the web page content to determine:
a unique identifier associated with the web page content; and
a classifier attribute associated with the unique identifier for classifying the web page content, wherein determining the classifier attribute for the unique identifier is based on a classifier attribute associated with a previously-classified unique identifier for other web page content; and
storing the unique identifier and the determined classifier attribute for the web page content in a database in communication with the server computer system.
2 . The method of claim 1 , wherein the server computer system determines a plurality of classifier attributes associated with the unique identifier based on the metadata in the web page content.
3 . The method of claim 2 , wherein the plurality of classifier attributes include one or more of: a product identifier, a portal identifier, a platform identifier, a mobile application identifier, and an organizational identifier.
4 . The method of claim 1 , further comprising:
receiving a second request, by the server computer system over the Internet, for the web page content;
in response to the second request, retrieving the unique identifier and the determined classifier attribute for the web page content from the database by the server computer system; and
validating classification of the retrieved unique identifier, based on the determined classifier attribute, by the server computer system.
5 . The method of claim 1 , further comprising generating, by the server computer system, an analytical dataset based on a plurality of unique identifiers stored in the database.
6 . The method of claim 5 , wherein the analytical dataset comprises:
a set of classified unique identifiers and associated classified classifier attributes; and
a set of unclassified unique identifiers and associated unclassified classifier attributes.
7 . The method of claim 6 , further comprising processing the analytical dataset using a random forest model to predict a respective value for each respective unclassified classifier attribute associated with the set of unclassified unique identifiers.
8 . The method of claim 7 , wherein the respective value for each respective unclassified classifier attribute is based on classified classifier attribute values in the analytical dataset.
9 . The method of claim 7 , wherein a separate random forest model is run for each respective unclassified classifier attribute.
10 . The method of claim 1 , further comprising:
generating, by the server computer system, a report including the unique identifier and the classifier attribute; and
causing, by the server computer system, the report to display on the display screen coupled to the client computing device.
11 . A system comprising:
a processor; and
memory coupled to the processor and storing instructions that, when executed by the processor, cause the system to perform operations comprising:
receiving, over the Internet, a request for web page content from a client computing device of a user;
in response to the request for web page content, causing, by the system, the web page content to render on a display screen coupled to the client computing device;
analyzing metadata in the web page content to determine:
a unique identifier associated with the web page content; and
a classifier attribute associated with the unique identifier for classifying the web page content, wherein determining the classifier attribute for the unique identifier is based on a classifier attribute associated with a previously-classified unique identifier for other web page content; and
storing the unique identifier and the determined classifier attribute for the web page content in a database in communication with the system.
12 . The system of claim 11 , wherein the system determines a plurality of classifier attributes associated with the unique identifier based on the metadata in the web page content.
13 . The system of claim 12 , wherein the plurality of classifier attributes include one or more of: a product identifier, a portal identifier, a platform identifier, a mobile application identifier, and an organizational identifier.
14 . The system of claim 11 , wherein the memory further comprises instructions for causing the system to perform operations comprising:
receiving a second request, over the Internet, for the web page content;
in response to the second request, retrieving the unique identifier and the determined classifier attribute for the web page content from the; and
validating classification of the retrieved unique identifier, based on the determined classifier attribute.
15 . The system of claim 11 , wherein the memory further comprises instructions for causing the system to perform operations comprising: generating an analytical dataset based on a plurality of unique identifiers stored in the database.
16 . The system of claim 15 , wherein the analytical dataset comprises:
a set of classified unique identifiers and associated classified classifier attributes; and
a set of unclassified unique identifiers and associated unclassified classifier attributes.
17 . The system of claim 16 , wherein the memory further comprises instructions for causing the system to perform operations comprising: processing the analytical dataset using a random forest model to predict a respective value for each respective unclassified classifier attribute associated with the set of unclassified unique identifiers.
18 . The system of claim 17 , wherein the respective value for each respective unclassified classifier attribute is based on classified classifier attribute values in the analytical dataset.
19 . The system of claim 17 , wherein a separate random forest model is run for each respective unclassified classifier attribute.
20 . The system of claim 11 , wherein the memory further comprises instructions for causing the system to perform operations comprising:
generating a report including the unique identifier and the classifier attribute; and
causing, by the system, the report to display on the display screen coupled to the client computing device.
21 . A tangible, non-transitory computer-readable medium storing instructions that, when executed by a computer system, cause the computer system to perform operations comprising:
receiving, over the Internet, a request for web page content from a client computing device of a user;
in response to the request for web page content, causing, by the computer system, the web page content to render on a display screen coupled to the client computing device;
analyzing, by the server computer system, metadata in the web page content to determine:
a unique identifier associated with the web page content; and
a classifier attribute associated with the unique identifier for classifying the web page content, wherein determining the classifier attribute for the unique identifier is based on a classifier attribute associated with a previously-classified unique identifier for other web page content; and
storing the unique identifier and the determined classifier attribute for the web page content in a database in communication with the computer system.