System and method for detecting and reporting online activity using real-time content-based network monitoring
A computerized system and method for tracking and reporting online activity across a plurality of clients and servers is disclosed that intercepts and logs secure and non-secure HTTP request and response pages, analyzes each of the received page records, associates each page record to an event type based on user-defined parameters, identifies and extracts user-defined attributes of each page record based on its event type, and reports on the occurrence of the event along with its associated attributes.
1. A computer programmed digital electrical tracking system apparatus connected to a user browser and a Web server on the Internet, the apparatus adapted to:
provide the user browser with a Web page containing a URL specifying both an address of the tracking system and information that specifies a URL on the Web server;
upon receipt by the tracking system of a Web page request from the user browser, determine a Web server URL from the Web page request;
identify and extract captured information indicating that the user browser has requested the Web server URL, the captured information stored within one or more databases;
form parameter data based upon pre-determined selection parameters from the one or more databases;
encode an original URL as part of the tracking system's URL path to construct at least one rewritten URL;
embed the rewritten URLs in a response such that a browser request to each of the rewritten embedded URLs is sent to the tracking system; and
cause the Web page specified by the Web server URL to be returned to the user browser; and
provide profiling and analysis of at least one session.
2. The apparatus of claim 1 , wherein the apparatus causes the profiling by operations comprising identifying a site, associating of a logging page record with the sites, and associating at least one site page with event triggers, event pre-triggers and parse methods.
3. The apparatus of claim 1 , wherein the apparatus causes the analysis by operations comprising reporting at least one of the following:
a session detail;
an event detail;
a purchase detail; and
a purchase summary.
4. The apparatus of claim 3 , wherein the apparatus causes the generation of the session detail by operations comprising reporting at least one of the following:
activity start and end dates, by a site name;
a session identifier, a time at which the session was created;
a number of page views in the session;
a number of purchase events detected in the session;
a number of events detected in the session; and
the session's duration and a user identifier.
5. The apparatus of claim 3 , wherein the apparatus causes the generation of the event detail by operations comprising reporting at least one of the following:
activity start and end dates, by a site name,
a per event record that matches at least one of the parameters,
the session in which the event was detected;
a time of the event;
a site of the event;
an event type; and
a user identifier.
6. The apparatus of claim 3 , wherein the apparatus causes the generation of the purchase detail by operations comprising reporting at least one of the following:
activity start and end dates, by a site name;
a per purchase item record that matches at least one of the parameters;
a purchase date;
a time at which the purchase occurred;
the site of the purchase;
a name of the purchased item;
a unit price of the item;
a quantity;
a price;
a user identifier; and
a credit-card type.
7. The apparatus of claim 6 , wherein the apparatus returns the per purchase item record that matches a query containing the activity start and the end dates, by the site name.
8. The apparatus of claim 3 , wherein the apparatus causes the generation of the purchase summary by operations comprising reporting at least one of the following:
activity start and end dates, by site;
a site record that matches at least one of the parameters;
the site name;
a number of purchases on the site;
a number of items purchased on the site;
a value of purchases on the site;
a number of page views on the site; and
a duration of all the sessions within the site.
9. The apparatus of claim 3 , wherein the apparatus causes the generation of the purchase summary by operations that return a category code and a source code referral parameter for the sessions recorded by the rewritten embedded URLs.
10. The apparatus of claim 1 , where the apparatus causes the Web page specified by the Web server URL to be returned to the user browser by operations comprising:
requesting the Web page from the Web server based on the Web server URL;
receiving the response from Web server; and
forwarding the response to the user browser.
11. The apparatus of claim 1 , where the apparatus causes the Web page specified by the Web server URL to be returned to the user by operations comprising redirecting the user browser to the Web page on the Web browser.
12. The apparatus of claim 11 , where the apparatus causes the redirection operation to be performed using an HTTP redirect.
13. The apparatus of claim 1 , the apparatus is further adapted to:
dynamically maintaining the pre-determined selection parameters based upon revisable, operator-defined instructions on how to select and extract information from a text page; and
predicting future user activity by analyzing the parameter data.
14. The apparatus of claim 13 , wherein the apparatus provides the predicting based on live traffic.
15. The apparatus of claim 13 , wherein the apparatus provides the predicting based on based on stored client-server information.
16. The apparatus of claim 1 , wherein the apparatus returns a purchase item record that matches a query containing activity start and end dates and site name.
17. A method of capturing on a computer programmed digital electrical tracking system information about activity of a user browser accessing a Web server, the method comprising:
providing a user browser with a Web page containing a URL specifying both an address of a tracking system and information that specifies a URL on a Web server;
upon receipt by the tracking system of a Web page request from the user browser, determining a Web server URL from the Web page request;
identifying and extracting captured information indicating that the user browser has requested the Web server URL, the captured information stored within a database;
forming parameter data based upon pre-determined selection parameters from the database;
encoding an original URL as part of the tracking system's URL path to construct at least one rewritten URL;
embedding at least one of the rewritten URLs in a response such that a browser request to each of the rewritten embedded URLs is sent to the tracking system; and
providing site profiling and analysis of at least one session.
18. The method of claim 17 , wherein the providing profiling comprises identifying a site, associating a logging page record with the site, and associating at least one site page with event triggers, event pre-triggers, and parse methods.
19. The method of claim 17 , wherein the analysis comprises reporting at least one of the following:
a session detail of the session;
an event detail of an event;
a purchase detail of a purchase; and
a purchase summary of a purchase.
20. The method of claim 19 , wherein the analysis includes the session detail, and generation of the session detail comprises reporting at least one of the following:
activity start and end dates, by a site name;
a session identifier;
a time at which the session was created;
a number of page views in the session;
a number of purchase events detected in the session;
a number of events detected in the session; and
the session's duration and a user identifier.
21. The method of claim 19 , wherein the analysis includes the event detail, and generation of the event detail comprises reporting at least one of the following:
activity start and end dates, by a site name;
a per event record that matches at least one of the parameters;
the session in which the event was detected;
a time of the event;
a site of the event;
an event type; and
a user identifier.
22. The method of claim 19 , wherein the analysis includes the purchase detail, and generation of the purchase detail comprises reporting at least one of the following:
an activity start and end dates, by a site name;
a per purchase item that matches at least one of the parameters;
a purchase date;
a time at which the purchase occurred;
a site of the purchase;
a name of the purchased item;
a unit price of the item;
a quantity;
a price;
a user identifier; and
a credit-card type.
23. The method of claim 19 , wherein the analysis includes the purchase summary, and generation of the purchase summary comprises reporting at least one of the following:
activity start and end dates, by a site,
a site record that matches at least one of the parameters;
at least one of the site name;
a number of purchases on the site;
a number of items purchased on the site;
a value of purchases on the site;
a number of page views on the site; and
a duration of all the sessions within the site.
24. The method of claim 19 , wherein the analysis includes the purchase summary, and generation of the purchase summary returns a category code and a source code referral parameter for the sessions recorded by the rewritten embedded URLs.
25. The method of claim 17 , wherein the Web page specified by the Web server URL is returned to the user browser by operations comprising:
requesting the Web page from the Web server based on the Web server URL;
receiving the response from Web server; and
forwarding the response to the user browser.
26. The method of claim 17 , wherein the Web page specified by the Web server URL is returned to the user by operations comprising redirecting the user browser to the Web page on the Web browser.
27. The method of claim 26 , wherein the redirecting is performed using an HTTP redirect.
28. The method of claim 17 , further comprising:
dynamically maintaining the pre-determined selection parameters based upon revisable, operator-defined instructions on how to select and extract information from a text page; and
predicting future user activity by analyzing the parameter data.
29. The method of claim 17 , wherein the analysis includes analysis performed on live traffic.
30. The method of claim 17 , wherein the analysis includes analysis performed on stored client-server information.
31. The method of claim 17 , further including returning a purchase item record that matches a query containing activity start and end dates and site name.