Web page download time analysis
View Patent ↗Systems and methods for determining web page download times are described. HTTP transactions data is collected from flow records or PDUs. A subscriber IP address, HTTP URI, and referrer are extracted from the flow records. A subscriber record is identified using the subscriber IP address, and a configured web page is identified using the HTTP URI. A processing path is then determined for the HTTP transaction The processing path is selected from one of: a new page download path for a configured page, a collision path for HTTP transactions that collide with an existing page download, and a page object path for artifacts pages that are already being tracked.
1. A method, comprising:
performing, by one or more computer systems,
receiving HTTP transaction data;
extracting a host and URI from the HTTP transaction data;
retrieving a subscriber record using at least one of an IP address and link identifier in the HTTP transaction data;
evaluating whether at least one of the host and URI correspond to a web page that is configured;
if the web page is configured, evaluating whether the subscriber record is already tracking web page data;
creating a new entry for the web page in the subscriber record, if the subscriber record is not already tracking web page data;
inserting a new page data object into the subscriber record using a primary page URI as the key;
extracting transaction timing information and at least one of byte and packet counts from the HTTP transaction data to populate in the page data object; and
starting a lifetime timer for the page data object.
2. The method of claim 1 , further comprising:
if the subscriber record is already tracking web page data, evaluating whether the HTTP transaction data corresponds to an existing web page entry; and
creating a new entry for the web page in the subscriber record, if the HTTP transaction data does not correspond to an existing web page entry in the subscriber record.
3. The method of claim 1 , wherein a value of the lifetime timer is selected to make sure that all artifacts related to the web page are received before the page data object is closed.
4. The method of claim 1 , further comprising:
if a redirect or failure response code is present in the HTTP transaction data, then reporting the web page data to other applications.
5. The method of claim 1 , further comprising:
if an HTTP response code indicates success, inserting a secondary URI key into a URI map; and
associating the secondary URI key with the page data object.
6. The method of claim 1 , further comprising:
extracting subscriber and equipment data from a subscriber GTP session context; and populating the subscriber and equipment data in the page data object.
7. The method of claim 1 , further comprising:
if the subscriber record is already tracking web page data, evaluating whether the HTTP transaction data corresponds to an existing web page entry; and
updating a new entry for the web page in the subscriber record, if the HTTP transaction data corresponds to an existing web page entry in the subscriber record.
8. The method of claim 7 , further comprising:
checking a time difference between a last artifact download time for a first web page and a time of a second HTTP request;
if the time exceeds a threshold, reporting the first page a properly completed; and
if the time does not exceed the threshold, closing a first page download and removing the first pages from key performance indicator (KPI) calculations.
9. The method of claim 7 , further comprising:
examining a referrer field in the HTTP transaction data; and
if the referrer field is the same as a primary URL of the web page, continue tracking the web page and adding data to the page data object.
10. The method of claim 1 , further comprising:
if the web page is not configured, evaluating whether the subscriber record is already tracking web page data; and
if the subscriber record is already tracking web page data, processing page object data from the HTTP transaction data.
11. The method of claim 10 , further comprising:
identifying that a web page has completed downloading, and
reporting the page data object as complete.
12. The method of claim 11 , wherein the web page has completed downloading if the HTTP URI matches a configured web page's stop markers, if an object request exceeds a silence period, or if a content type indicates an off-page request.
13. The method of claim 10 , further comprising:
identifying embedded audio or video content in the HTTP transaction data; and
excluding data associated with the audio or video content from the page data object.
14. A method, comprising:
performing, by one or more computer systems,
receiving HTTP transaction data;
extracting a host and URI from the HTTP transaction data;
retrieving a subscriber record using at least one of an IP address and link identifier in the HTTP transaction data;
evaluating whether at least one of the host and URI correspond to a web page that is configured;
if the web page is configured, evaluating whether the subscriber record is already tracking web page data; and
creating a new entry for the web page in the subscriber record, if the subscriber record is not already tracking web page data;
if the subscriber record is already tracking web page data, evaluating whether the HTTP transaction data corresponds to an existing web page entry;
updating a new entry for the web page in the subscriber record, if the HTTP transaction data corresponds to an existing web page entry in the subscriber record;
checking a time difference between a last artifact download time for a first web page and a time of a second HTTP request;
if the time exceeds a threshold, reporting the first page as properly completed; and
if the time does not exceed the threshold, closing a first page download and removing the first page from key performance indicator (KPI) calculations.