IP Library Granted Patent US 9,785,722
Granted Patent B2
US 9,785,722 · App. 13/075,636 · Granted Oct 10, 2017

Systems and methods for remote replay of user interaction with a webpage

View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,785,722
App. No.
13/075,636
Granted
Oct 10, 2017
Kind
B2
Abstract

A system and method for replaying a user's interaction with a webpage by requesting playback of user interaction data from a replay server, receiving a media asset from the replay server to allow playback the requested user interaction data, the media asset being pre-fetched for use by a proxy application, periodically requesting and receiving the user interaction data from the replay server, recreating an interaction visualization from the user interaction data, and playing back said interaction visualization based on data received from the replay server.

Claims (30)

1. A system for facilitating remote replay of a user interaction with a webpage, the user interaction occurring from a user computer being connected over a network to a server hosting the webpage, the user computer comprising a web browser and input/output devices, the webpage being an HTML document including dynamic elements being configured to execute operations that write modifications to the HTML document, and with a tracking script providing instructions to the web browser to record a tracking record and with the tracking record including information regarding the input/output devices, the system comprising:

a tracking server communicating over the network with at least one of the user computer and the server and being configured to fetch, from at least one of the user computer and the server, the tracking record comprising the user interaction with the webpage and including the dynamic elements of the webpage; and

an analysis computer communicating with the tracking server over the network;

wherein the tracking server is configured to normalize the tracking record by removing modifications written to the HTML document by operations executed with the dynamic elements; and

wherein the analysis computer requests the normalized tracking record from the tracking server to create an interaction visualization based on the normalized tracking record to replay the user interaction with the webpage.

2. The system of claim 1 , wherein the input/output devices are at least one of a keyboard, a mouse, a touch screen, a monitor, and a printer.

3. The system of claim 2 , wherein the tracking record includes at least one of mouse movements, mouse scrolling, mouse clicks and keyboard entries.

4. The system of claim 1 , wherein the server comprises:

a webpage storage module storing the webpage; and

a tracking tag code module instructing the server to include a tracking script to the stored webpage before serving to the user computer,

wherein the tracking script records the tracking record.

5. The system of claim 1 , wherein the tracking server is configured to further provide playback environment data to the analysis computer, wherein the playback environment data is at least one of a brand of a web browser used to record the tracking record, a time and a date of the tracking record, a length of time of the tracking record, the webpage visited, a time spent on the webpage, an account ID of the user, and any physical inputs made at the user computer.

6. The system of claim 1 wherein the dynamic elements comprise at least one of scripts and commands.

7. The system of claim 1 wherein the dynamic elements comprise JavaScript.

8. The system of claim 1 wherein the operations that write modifications to the HTML document further comprise AJAX requests and wherein the tracking server is further configured to normalize the tracking record by removing the AJAX requests.

9. The system of claim 1 wherein the tracking server comprises a tracking replay module comprising routines being configured to normalize different data formats to enable accurate or consistent replay of the user interaction.

10. A computer-implemented method for utilizing a tracking server to facilitate remote replay of a user interaction with a webpage, the user interaction occurring from a user computer being connected over a network to a server hosting the webpage, the user computer comprising a web browser and input/output devices, the webpage being an HTML document including dynamic elements for executing operations that write modifications to the HTML document, and with a tracking script providing instructions to the web browser to record a tracking record and with the tracking record including information regarding the input/output devices, the computer-implemented method comprising:

fetching, with the tracking server, the tracking record from at least one of the user computer and the server and with the tracking record comprising the user interaction with the webpage and including the dynamic elements of the webpage;

normalizing, with the tracking server, the tracking record by removing modifications written to the HTML document by operations executed with the dynamic elements; and

providing, with the tracking server, the normalized tracking record to an analysis computer to create an interaction visualization based on the normalized tracking record to replay the user interaction with the webpage.

11. The computer-implemented method of claim 10 , wherein the tracking record includes at least one of mouse movements, mouse scrolling, mouse clicks and keyboard entries.

12. The computer-implemented method of claim 10 , wherein the tracking server further provides playback environment data to the analysis computer, wherein the playback environment data is at least one of a brand of a web browser used to record the tracking record, a time and a date of the tracking record, a length of time of the tracking record, the webpage visited, a time spent on the webpage, an account ID of the user, and any physical inputs made at the user computer.

13. The computer-implemented method of claim 10 wherein the dynamic elements comprise at least one of scripts and commands.

14. The computer-implemented method of claim 10 wherein the dynamic elements comprise JavaScript.

15. The computer-implemented method of claim 10 wherein the operations that write modifications to the HTML document further comprise AJAX requests and wherein the tracking server further normalizes the tracking record by removing the AJAX requests.

16. The computer-implemented method of claim 10 wherein the tracking server comprises a tracking replay module comprising routines for normalizing different data formats to enable accurate or consistent replay of the user interaction.

17. A non-transitory computer-readable medium having stored thereon computer-executable instructions to facilitate remote replay of a user interaction with a webpage, the user interaction occurring from a user computer being connected over a network to a server hosting the webpage, the user computer comprising a web browser and input/output devices, the webpage being an HTML document including dynamic elements for executing operations that write modifications to the HTML document, and with a tracking script providing instructions to the web browser to record a tracking record and with the tracking record including information regarding the input/output devices, the computer-executable instructions, when executed by one or more processors, are configured to:

fetch the tracking record from at least one of the user computer and the server and with the tracking record comprising the user interaction with the webpage and including the dynamic elements of the webpage;

normalize the tracking record by removing modifications written to the HTML document by operations executed with the dynamic elements; and

provide the normalized tracking record to an analysis computer to create an interaction visualization based on the normalized tracking record to replay the user interaction with the webpage.

Assignments (18)
SECURITY INTEREST Recorded Dec 23, 2025
From: VERINT AMERICAS INC.
To: ALTER DOMUS (US) LLC, AS COLLATERAL AGENT
Reel/Frame 074034/0292 →
SECURITY INTEREST Recorded Apr 23, 2019
From: VERINT AMERICAS INC.
To: JP MORGAN CHASE BANK, N.A. (AS COLLATERAL AGENT)
Reel/Frame 048964/0411 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 30, 2019
From: FORESEE RESULTS, INC.
To: VERINT AMERICAS INC.
Reel/Frame 048192/0481 →
RELEASE OF AMENDED AND RESTATED INTELLECTUAL PROPERTY SECURITY AGREEMENT RECORDED AT REEL 042280/FRAME 0880 AND REEL 046390/FRAME 0264 Recorded Dec 20, 2018
From: CREDIT SUISSE AG, CAYMAN ISLANDS BRANCH
To: ANSWERS FINANCE, LLC; ANSWERS HOLDINGS, INC.; ANSWERS CORPORATION; FORESEE RESULTS, INC.; FORESEE SESSION REPLAY, INC.; RSR ACQUISITION LLC; MULTIPLY MEDIA, LLC; DURHAM ACQUISITION LLC
Reel/Frame 048636/0584 →
SECURITY INTEREST Recorded Jul 18, 2018
From: ANSWERS CORPORATION; FORESEE RESULTS, INC.; RSR ACQUISITION, LLC; MULTIPLY MEDIA, LLC; DURHAM ACQUISITION LLC
To: CREDIT SUISSE AG, CAYMAN ISLANDS BRANCH
Reel/Frame 046390/0264 →
RELEASE OF FIRST LIEN INTELLECTUAL PROPERTY SECURITY AGREEMENT RECORDED AT REEL 042280/FRAME 0497 Recorded May 21, 2018
From: CREDIT SUISSE AG, CAYMAN ISLANDS BRANCH
To: ANSWERS FINANCE, LLC; ANSWERS HOLDINGS, INC.; ANSWERS CORPORATION; FORESEE RESULTS, INC.; FORESEE SESSION REPLAY, INC.; RSR ACQUISITION LLC; MULTIPLY MEDIA, LLC
Reel/Frame 046201/0418 →
RELEASE OF SECURITY INTEREST Recorded May 23, 2017
From: WILMINGTON TRUST, NATIONAL ASSOCIATION, AS COLLATERAL AGENT
To: FORESEE RESULTS, INC.
Reel/Frame 042470/0320 →
RELEASE OF FIRST LIEN SHORT FORM INTELLECTUAL PROPERTY SECURITY AGREEMENT RECORDED AT REEL 033882/FRAME 0415 Recorded Apr 19, 2017
From: CREDIT SUISSE AG, CAYMAN ISLANDS BRANCH
To: FORESEE RESULTS, INC.
Reel/Frame 042285/0453 →
SECOND LIEN INTELLECTUAL PROPERTY SECURITY AGREEMENT Recorded Apr 18, 2017
From: ANSWERS HOLDINGS, INC.; ANSWERS FINANCE, LLC; ANSWERS CORPORATION; EASY2 TECHNOLOGIES, INC.; FORESEE RESULTS, INC.; FORESEE SESSION REPLAY, INC.; RSR ACQUISITION LLC; WEBCOLLAGE INC.; MULTIPLY MEDIA, LLC
To: CREDIT SUISSE AG, CAYMAN ISLANDS BRANCH
Reel/Frame 042280/0880 →
FIRST LIEN INTELLECTUAL PROPERTY SECURITY AGREEMENT Recorded Apr 18, 2017
From: ANSWERS FINANCE, LLC; ANSWERS HOLDINGS, INC.; ANSWERS CORPORATION; EASY2 TECHNOLOGIES, INC.; FORESEE RESULTS, INC.; RSR ACQUISITION LLC; WEBCOLLAGE INC.; MULTIPLY MEDIA, LLC; FORESEE SESSION REPLAY, INC.
To: CREDIT SUISSE AG, CAYMAN ISLANDS BRANCH
Reel/Frame 042280/0497 →
SECURITY INTEREST Recorded Sep 9, 2016
From: CREDIT SUISSE AG, CAYMAN ISLANDS BRANCH
To: WILMINGTON TRUST, NATIONAL ASSOCIATION
Reel/Frame 039684/0237 →
RELEASE OF SECURITY INTEREST Recorded Oct 6, 2014
From: SUNTRUST BANK, AS COLLATERAL AGENT
To: FORESEE RESULTS, INC.
Reel/Frame 033890/0483 →
RELEASE OF SECURITY INTEREST Recorded Oct 6, 2014
From: SUNTRUST BANK, AS COLLATERAL AGENT
To: FORESEE RESULTS, INC.
Reel/Frame 033890/0596 →
SECURITY INTEREST Recorded Oct 3, 2014
From: FORESEE RESULTS, INC.
To: CREDIT SUISSE AG, CAYMAN ISLANDS BRANCH
Reel/Frame 033882/0415 →
SECURITY INTEREST Recorded Oct 3, 2014
From: FORESEE RESULTS, INC.
To: CREDIT SUISSE AG, CAYMAN ISLANDS BRANCH
Reel/Frame 033882/0569 →
SECURITY AGREEMENT Recorded Dec 20, 2013
From: FORESEE RESULTS, INC.
To: SUNTRUST BANK
Reel/Frame 031866/0913 →
SECURITY AGREEMENT Recorded Dec 20, 2013
From: FORESEE RESULTS, INC.
To: SUNTRUST BANK
Reel/Frame 031866/0921 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 30, 2011
From: WHITE, ALEXEI R.; CHARLAND, ANDRE D.; JOHNSON, DAVID C.; COHEN, MITCHELL
To: FORESEE RESULTS, INC.
Reel/Frame 026829/0404 →