System and method to measure effectiveness and consumption of editorial content
A system for analyzing user consumption of content on web pages or determining user engagement with content comprising a data collection script and an content-engagement-inference engine. The data collection script determines one or more content elements to be measured from a web page and collects description data associated with the one or more content elements. The description data describes information about the one or more content elements. The content-engagement-inference engine creates an inference or analytics result based on the description data. The inference or analytics result describes how the one or more content elements have been consumed by users and then provides the inference or analytics result for users to designated entities.
1. A computer-implemented method comprising:
creating a data collection script for a publisher of a webpage;
embedding the data collection script on a client device of a user;
receiving, by the data collection script, a signal indicating that the webpage is rendered by a web browser on the client device of the user;
determining specific configuration of the web page associated with the publisher;
retrieving, by the data collection script, a set of rules specific to the specific configuration of the web page associated with the publisher, wherein the set of rules indicates how to detect a certain type of content on web pages;
detecting one or more content elements of the web page based on the retrieved set of rules;
determining, by the data collection script, that the one or more content elements are rendered on the web page by the web browser on the client device of the user;
collecting, by the data collection script, description data associated with the web page and the detected one or more content elements, wherein the description data includes interaction data that indicates interactions of the user with the one or more content elements and the web page, wherein the description data further includes metadata that provides information associated with the web page and the one or more content elements, and wherein the collecting comprises:
obtaining the interaction data that describes interactions of the user with the web page;
determining one or more attributes associated with the one or more content elements, wherein the one or more attributes comprise a presentation, a design, or a type of the one or more content elements, and wherein the type of the one or more content elements indicates a video, a picture, or a text;
retrieving, for each of the one or more content elements, user interaction data from the obtained interaction data that is specific to interactions of the user with the one or more attributes of the content element;
determining one or more locations within the web page at which the one or more content elements are presented when rendered;
identifying, in response to determining that each of the one or more content elements are rendered on the web page, a subset of the user interaction data based on the one or more locations and a time at which it was determined that the one or more content elements are rendered, the subset of the user interaction data being specific to interactions of the user with the one or more content elements that are rendered; and
retrieving the metadata associated with the web page and the one or more content elements;
transmitting the description data including the user interaction data and the metadata to an analytics engine configured to generate indications of a level of engagement of the user with the one or more content elements based on the description data; and
generating inferences on a behavior of the user from the indications of the level of engagement of the user with the one or more content elements based on the set of rules specific to the publisher.
2. The method of claim 1 , wherein the set of rules comprises at least a div tag, a content type, a content boundary, a frame definition, or a headline identifier for the one or more content elements.
3. The method of claim 1 , wherein the interactions of the user with the one or more attributes of the one or more content elements comprises cursor movement that includes scrolling behavior, scrolling velocity, scrolling direction, clicking on a comment link, clicking on a sharing link, or clicking on a navigational link.
4. The method of claim 1 , wherein the metadata comprises article titles, a page name, video titles, or content thumbnails.
5. The method of claim 1 , wherein the interactions of the user with the web page comprises an operation for content sharing.
6. The method of claim 1 , wherein the data collection script is created based on the set of rules and the data collection script is configured to collect the description data relative to the one or more content elements while the web page is rendered by a web browser on a client device of the user.
7. The method of claim 1 , wherein the set of rules determines the level of engagement of the user with the one or more content elements based on the description data.
8. The method of claim 1 , wherein the subset of the interaction data is identified in response to determining that each of the content elements are fully rendered on the web page.
9. The method of claim 1 , further comprising:
generating, by the analytics engine, a predicted level of engagement of the user with the one or more content elements based on the description data, wherein the predicted level of engagement indicates an extent to which each of the one or more content elements was consumed by the user.
10. The method of claim 9 , wherein the one or more content elements includes a video, and the predicted level of engagement indicates an extent to which the user viewed the video.
11. The method of claim 9 , wherein the one or more content elements includes text, and the predicted level of engagement indicates an extent to which the user read the text.
12. A system comprising:
one or more data processors; and
a non-transitory computer readable storage medium containing instructions which, when executed on the one or more data processors, cause the one or more data processors to perform actions including:
creating a data collection script for a publisher of a webpage;
embedding the data collection script on a client device of a user;
receiving, by the data collection script, a signal indicating that the webpage is rendered by a web browser on the client device of the user;
determining specific configuration of the web page associated with the publisher;
retrieving, by the data collection script, a set of rules specific to the specific configuration of the web page associated with the publisher, wherein the set of rules indicates how to detect a certain type of content on web pages;
detecting one or more content elements of the web page based on the retrieved set of rules;
determining, by the data collection script, that the one or more content elements are rendered on the web page by the web browser on the client device of the user;
collecting, by the data collection script, description data associated with the web page and the detected one or more content elements, wherein the description data includes interaction data that indicates interactions of the user with the one or more content elements and the web page, wherein the description data further includes metadata that provides information associated with the web page and the one or more content elements, and wherein the collecting comprises:
obtaining the interaction data that describes interactions of the user with the web page;
determining one or more attributes associated with the one or more content elements, wherein the one or more attributes comprise a presentation, a design, or a type of the one or more content elements, and wherein the type of the one or more content elements indicates a video, a picture, or a text;
retrieving, for each of the one or more content elements, user interaction data from the obtained interaction data that is specific to interactions of the user with the one or more attributes of the content element;
determining one or more locations within the web page at which the one or more content elements are presented when rendered;
identifying, in response to determining that each of the one or more content elements are rendered on the web page, a subset of the user interaction data based on the one or more locations and a time at which it was determined that the one or more content elements are rendered, the subset of the user interaction data being specific to interactions of the user with the one or more content elements that are rendered; and
retrieving the metadata associated with the web page and the one or more content elements;
transmitting the description data including the user interaction data and the metadata to an analytics engine configured to generate indications of a level of engagement of the user with the one or more content elements based on the description data; and
generating inferences on a behavior of the user from the indications of the level of engagement of the user with the one or more content elements based on the set of rules specific to the publisher.
13. The system of claim 12 , wherein the set of rules comprises at least a div tag, a content type, a content boundary, a frame definition, or a headline identifier for the one or more content elements.
14. The system of claim 12 , wherein the interactions of the user with the one or more attributes of the one or more content elements comprises cursor movement that includes scrolling behavior, scrolling velocity, scrolling direction, clicking on a comment link, clicking on a sharing link, or clicking on a navigational link.
15. The system of claim 12 , wherein the metadata comprises article titles, a page name, video titles, or content thumbnails.
16. The system of claim 12 , wherein the interactions of the user with the web page comprises an operation for content sharing.
17. The system of claim 12 , wherein the data collection script is created based on the set of rules and the data collection script is configured to collect the description data relative to the one or more content elements while the web page is rendered by a web browser on a client device of the user.
18. The system of claim 12 , wherein the set of rules determines the level of engagement of the user with the one or more content elements based on the description data.
19. A non-transitory machine-readable storage medium comprising a computer-program product that includes instructions configured to cause one or more data processors to perform actions including:
creating a data collection script for a publisher of a webpage;
embedding the data collection script on a client device of a user;
receiving, by the data collection script, a signal indicating that the webpage is rendered by a web browser on the client device of the user;
determining specific configuration of the web page associated with the publisher;
retrieving, by the data collection script, a set of rules specific to the specific configuration of the web page associated with the publisher, wherein the set of rules indicates how to detect a certain type of content on web pages;
detecting one or more content elements of the web page based on the retrieved set of rules;
determining, by the data collection script, that the one or more content elements are rendered on the web page by the web browser on the client device of the user;
collecting, by the data collection script, description data associated with the web page and the detected one or more content elements, wherein the description data includes interaction data that indicates interactions of the user with the one or more content elements and the web page, wherein the description data further includes metadata that provides information associated with the web page and the one or more content elements, and wherein the collecting comprises:
obtaining the interaction data that describes interactions of the user with the web page;
determining one or more attributes associated with the one or more content elements, wherein the one or more attributes comprise a presentation, a design, or a type of the one or more content elements, and wherein the type of the one or more content elements indicates a video, a picture, or a text;
retrieving, for each of the one or more content elements, user interaction data from the obtained interaction data that is specific to interactions of the user with the one or more attributes of the content element;
determining one or more locations within the web page at which the one or more content elements are presented when rendered;
identifying, in response to determining that each of the one or more content elements are rendered on the web page, a subset of the user interaction data based on the one or more locations and a time at which it was determined that the one or more content elements are rendered, the subset of the user interaction data being specific to interactions of the user with the one or more content elements that are rendered; and
retrieving the metadata associated with the web page and the one or more content elements;
transmitting the description data including the user interaction data and the metadata to an analytics engine configured to generate indications of a level of engagement of the user with the one or more content elements based on the description data; and
generating inferences on a behavior of the user from the indications of the level of engagement of the user with the one or more content elements based on the set of rules specific to the publisher.
20. The non-transitory machine-readable storage medium of claim 19 , wherein the set of rules determines the level of engagement of the user with the one or more content elements based on the description data, and the set of rules comprises at least a div tag, a content type, a content boundary, a frame definition, or a headline identifier for the one or more content elements.
21. The non-transitory machine-readable storage medium of claim 19 , wherein the interactions of the user with the one or more attributes of the one or more content elements comprises cursor movement that includes scrolling behavior, scrolling velocity, scrolling direction, clicking on a comment link, clicking on a sharing link, or clicking on a navigational link.
22. The non-transitory machine-readable storage medium of claim 19 , wherein the metadata comprises article titles, a page name, video titles, or content thumbnails.
23. The non-transitory machine-readable storage medium of claim 19 , wherein the interactions of the user with the web page comprises an operation for content sharing.
24. The non-transitory machine-readable storage medium of claim 19 , wherein the data collection script is created based on the set of rules and the data collection script is configured to collect the description data relative to the one or more content elements while the web page is rendered by a web browser on a client device of the user.