System and method for detecting and reporting online activity using real-time content-based network monitoring
A computerized system and method for tracking and reporting online activity across a plurality of clients and servers is disclosed that intercepts and logs secure and non-secure HTTP request and response pages, analyzes each of the received page records, associates each page record to an event type based on user-defined parameters, identifies and extracts user-defined attributes of each page record based on its event type, and reports on the occurrence of the event along with its associated attributes.
1. A method of capturing on a computer programmed digital electrical tracking system information about activity of a user browser accessing a Web server, the method comprising:
providing the user browser with a Web page containing a URL specifying both an address of the tracking system and information that specifies a URL on the Web server;
upon receipt by the tracking system of a Web page request from the user browser, determining a Web server URL from the Web page request;
identifying and extracting captured information indicating that the user browser has requested the Web server URL, the captured information stored within a database;
forming parameter data based upon pre-determined selection parameters from the database;
encoding an original URL as part of the tracking system URL path to construct at least one rewritten URL;
embedding the rewritten URLs in the response such that a browser request to each of the rewritten embedded URLs is sent to the tracking system; and
causing the Web page specified by the Web server URL to be returned to the user browser.
2. The method of claim 1 , where the causing the Web page specified by the Web server URL to be returned to the user browser comprises:
requesting the Web page from the Web server based on the Web server URL;
receiving a response from Web server; and
forwarding the response to the user browser.
3. The method of claim 1 , where the causing the Web page specified by the Web server URL to be returned to the user comprises redirecting the user browser to the Web page on the Web browser.
4. The method of claim 3 , where the redirection is performed using an HTTP redirect.
5. The method of claim 1 , further comprising:
dynamically maintaining the pre-determined selection parameters based upon revisable, operator-defined instructions on how to select and extract information from a text page; and analyzing the parameter data sets to predict future user activity.
6. A computer programmed digital electrical tracking system apparatus connected to a user browser and a Web server on the Internet, the apparatus adapted to:
provide the user browser with a Web page containing a URL specifying both an address of the tracking system and information that specifies a URL on the Web server;
upon receipt by the tracking system of a Web page request from the user browser, determine a Web server URL from the Web page request;
identifying and extracting captured information indicating that the user browser has requested the Web server URL, the captured information stored within a database;
forming parameter data based upon pre-determined selection parameters from the database;
encoding an original URL as part of the tracking system URL path to construct at least one rewritten URL;
embedding the rewritten URLs in the response such that a browser request to each of the rewritten embedded URLs is sent to the tracking system; and
cause the Web page specified by the Web server URL to be returned to the user browser.
7. The apparatus of claim 6 , wherein the apparatus causes the Web page specified by the Web server URL to be returned to the user browser by operations comprising:
requesting the Web page from the Web server based on the Web server URL;
receiving a response from Web server; and
forwarding the response to the user browser.
8. The apparatus of claim 6 , where the apparatus causes the Web page specified by the Web server URL to be returned to the user by redirecting the user browser to the Web page on the Web browser.
9. The apparatus of claim 8 , where the redirection is performed using an HTTP redirect.
10. The apparatus of claim 6 , is further adapted to:
dynamically maintain the pre-determined selection parameters based upon revisable, operator-defined instructions on how to select and extract information from a text page; and
analyze the parameter data sets to predict future user activity.