IP Library Granted Patent US 10,908,807
Granted Patent B2
US 10,908,807 · App. 16/542,349 · Granted Feb 2, 2021

Method, apparatus, and computer program product for facilitating the playback of interface events

View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,908,807
App. No.
16/542,349
Granted
Feb 2, 2021
Kind
B2
Abstract

Provided herein are method, apparatus, and computer program products for facilitating capture and play back of interface event data. One exemplary method may comprise providing, as a function of at least profile data, environmental data, transaction data, relevance data, and implicit data derived therefrom, a dynamic application environment, displaying the dynamic application environment on an dynamic application interface, capturing interface event data, the interface event data being based on user interaction with the dynamic application interface, and comprising of one or more interface events and a particular time at which each of the one or more interface events occurred, providing data to the play back device configured for initializing a play back environment, such that the play back environment receives the interface event data and performs play back, and outputting the one or more interface events in a relative time to the particular time.

Claims (70)

1. A method for providing a dynamic application environment and capturing interface events, the interface events being indicative of user interaction with the dynamic application environment, subsequently initializing a second environment to recreate the dynamic application environment at a second device such that the interface events can be played back on the second environment, and performing play back of the interface events on the second device, the method comprising:

providing, via a dynamic application environment determination and rendering module, the dynamic application environment;

displaying the dynamic application environment on a dynamic application interface;

capturing, via a recording module, interface event data, the interface event data being representative of a user interaction with the dynamic application interface, the interface event data comprising of one or more interface events, each interface event occurring at a particular time, and the particular time at which each of the one or more interface events occurred;

receiving, via an initialization module, play back device data;

receiving data indicative of the dynamic application environment;

providing data to the play back device configured for initializing a play back environment, such that the play back environment receives the interface event data and performs play back;

identifying an initial state of the dynamic application environment;

providing data configured for implementing a play back state based on the initial state, the play back state configured to recreate a same computing environment on the play back device;

reproducing the dynamic application environment, wherein the reproduction of the dynamic application environment enables the one or more interface events that were captured to be reproduced in the dynamic application environment;

accessing, via a play back module, subsequent to the capturing of the interface event data, the interface event data; and

outputting the one or more interface events in a relative time to the particular time.

2. The method according to claim 1 , further comprising:

storing, via the recording module, the interface event data;

accessing, via the play back module, the interface event data; and

extracting the one or more interface events and the particular time of occurrence.

3. The method according to claim 1 , wherein the time scale at which the one or more interface events are provided to the play back device is real time.

4. The method according to claim 1 , further comprising:

providing, via the initialization module, a portion of the data indicative of the dynamic application environment to the play back device, the portion of information comprising a category, sub-category, price range of a relevant promotion being provided via an impression in the dynamic application environment.

5. The method according to claim 1 , wherein interface events comprise one or more of text input, scrolls, swipes, clicks, presses, selections, and mouseovers.

6. The method according to claim 1 , further comprising:

aiding in performance of debugging by receiving, via the play back module, input from the play back device and performing at least a pause, rewind, fast-forward, speed up, or slow-down in the transmission of the interface event data in response to the input.

7. The method according to claim 1 , further comprising:

aiding in performance of quality assurance or debugging by receiving, via the play back module, input from the play back device and providing a single interface event at a time in response to the input.

8. A computer program product for providing a dynamic application environment and capturing interface events, the interface events being indicative of user interaction with the dynamic application environment, subsequently initializing a second environment to recreate the dynamic application environment at a second device such that the interface events can be played back on the second environment, and performing play back of the interface events on the second device, the computer program product comprising at least one non-transitory computer-readable storage medium having computer-executable program code instructions stored therein, the computer-executable program code instructions comprising program code instructions for:

providing, via a dynamic application environment determination and rendering module, the dynamic application environment;

displaying the dynamic application environment on a dynamic application interface;

capturing, via a recording module, interface event data, the interface event data being representative of a user interaction with the dynamic application interface, the interface event data comprising of one or more interface events, each interface event occurring ata particular time, and the particular time at which each of the one or more interface events occurred;

receiving, via an initialization module, play back device data;

receiving data indicative of the dynamic application environment;

providing data to the play back device configured for initializing a play back environment, such that the play back environment receives the interface event data and performs play back;

identifying an initial state of the dynamic application environment;

providing data configured for implementing a play back state based on the initial state, the play back state configured to recreate a same computing environment on the play back device;

reproducing the dynamic application environment, wherein the reproduction of the dynamic application environment enables the one or more interface events that were captured to be reproduced in the dynamic application environment;

accessing, via a play back module, subsequent to the capturing of the interface event data, the interface event data; and

outputting the one or more interface events in a relative time to the particular time.

9. The computer program product according to claim 8 , wherein the computer-executable program code instructions further comprise program code instructions for:

storing, via the recording module, the interface event data;

accessing, via the play back module, the interface event data; and

extracting the one or more interface events and the particular time of occurrence.

10. The computer program product according to claim 8 , wherein the time scale at which the one or more interface events are provided to the play back device is real time.

11. The computer program product according to claim 8 , wherein the computer-executable program code instructions further comprise program code instructions for:

providing, via the initialization module, a portion of the data indicative of the dynamic application environment to the play back device, the portion of information comprising a category, sub-category, price range of a relevant promotion being provided via an impression in the dynamic application environment.

12. The computer program product according to claim 8 , wherein interface events comprise one or more of text input, scrolls, swipes, clicks, presses, selections, and mouseovers.

13. The computer program product according to claim 8 , wherein the computer-executable program code instructions further comprise program code instructions for:

aiding in performance of debugging by receiving, via the play back module, input from the play back device and performing at least a pause, rewind, fast-forward, speed up, or slow-down in the transmission of the interface event data in response to the input.

14. The computer program product according to claim 8 , wherein the computer-executable program code instructions further comprise program code instructions for:

aiding in performance of quality assurance or debugging by receiving, via the play back module, input from the play back device and providing a single interface event at a time in response to the input.

15. An apparatus for providing a dynamic application environment and capturing interface events, the interface events being indicative of user interaction with the dynamic application environment, subsequently initializing a second environment to recreate the dynamic application environment at a second device such that the interface events can be played back on the second environment, and performing play back of the interface events on the second device, the apparatus comprising at least a processor, and a memory associated with the processor having computer coded instructions therein, the apparatus comprising:

a dynamic application environment determination and rendering module configured for:

providing the dynamic application environment; and

displaying the dynamic application environment on a dynamic application interface;

a recording module, the recording module configured for:

capturing interface event data, the interface event data being representative of a user interaction with the dynamic application interface, the interface event data comprising of one or more interface events, each interface event occurring ata particular time, and the particular time at which each of the one or more interface events occurred;

an initialization module, the initialization module configured for:

receiving play back device data;

receiving data indicative of the dynamic application environment;

providing data to the play back device configured for initializing a play back environment, such that the play back environment receives the interface event data and performs play back;

identifying an initial state of the dynamic application environment; and

providing data configured for implementing a play back state based on the initial state, the play back state configured to recreate a same computing environment on the play back device; and

a play back module, the play back module configured for:

accessing, subsequent to the capturing of the interface event data, the interface event data;

reproducing the dynamic application environment, wherein the reproduction of the dynamic application environment enables the one or more interface events that were captured to be reproduced in the dynamic application environment; and

outputting the one or more interface events in a relative time to the particular time.

16. The apparatus according to claim 15 , wherein the recording module is configured for storing the interface event data; and the play back module is configured for accessing the interface event data; and extracting the one or more interface events and the particular time of occurrence.

17. The apparatus according to claim 15 , wherein the time scale at which the one or more interface events are provided to the play back device is real time.

18. The apparatus according to claim 15 , wherein the initialization module provides a portion of the data indicative of the dynamic application environment to the play back device, the portion of information comprising a category, sub-category, price range of a relevant promotion being provided via an impression in the dynamic application environment.

19. The apparatus according to claim 15 , wherein interface events comprise one or more of text input, scrolls, swipes, clicks, presses, selections, and mouseovers.

20. The apparatus according to claim 15 , wherein the play back module is configured to aid in performance of debugging by receiving input from the play back device and performing at least a pause, rewind, fast-forward, speed up, or slow-down in the transmission of the interface event data in response to the input.

21. The apparatus according to claim 15 , wherein the play back module is configured to aid in performance of quality assurance or debugging by receiving input from the play back device and providing a single interface event at a time in response to the input.

Assignments (5)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 12, 2024
From: GROUPON, INC.
To: BYTEDANCE INC.
Reel/Frame 068833/0811 →
RELEASE OF SECURITY INTEREST Recorded Feb 26, 2024
From: JPMORGAN CHASE BANK, N.A.
To: GROUPON, INC.; LIVINGSOCIAL, LLC (F/K/A LIVINGSOCIAL, INC.)
Reel/Frame 066676/0001 →
TERMINATION AND RELEASE OF SECURITY INTEREST IN INTELLECTUAL PROPERTY RIGHTS Recorded Feb 26, 2024
From: JPMORGAN CHASE BANK, N.A.
To: GROUPON, INC.; LIVINGSOCIAL, LLC (F/K/A LIVINGSOCIAL, INC.)
Reel/Frame 066676/0251 →
SECURITY INTEREST Recorded Jul 23, 2020
From: GROUPON, INC.; LIVINGSOCIAL, LLC
To: JPMORGAN CHASE BANK, N.A.
Reel/Frame 053294/0495 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 16, 2019
From: HYCHE, MARTIN ERIC
To: GROUPON, INC.
Reel/Frame 050069/0630 →