IP Library Granted Patent US 10,416,875
Granted Patent B1
US 10,416,875 · App. 15/197,931 · Granted Sep 17, 2019

Method, apparatus, and computer program product for facilitating the playback of interface events

Inventor: Martin Eric Hyche (Kingsport, TN)
Assignee: GROUPON, INC.
G06F3/0488G06F3/0482G06F3/04817
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,416,875
App. No.
15/197,931
Granted
Sep 17, 2019
Kind
B1
Abstract

Provided herein are method, apparatus, and computer program products for facilitating capture and play back of interface event data. One exemplary method may comprise providing, as a function of at least profile data, environmental data, transaction data, relevance data, and implicit data derived therefrom, a dynamic application environment, displaying the dynamic application environment on an dynamic application interface, capturing interface event data, the interface event data being based on user interaction with the dynamic application interface, and comprising of one or more interface events and a particular time at which each of the one or more interface events occurred, providing data to the play back device configured for initializing a play back environment, such that the play back environment receives the interface event data and performs play back, and outputting the one or more interface events in a relative time to the particular time.

Claims (70)

1. An apparatus for providing a dynamic application environment and capturing interface events, the interface events being indicative of user interaction with the dynamic application environment, subsequently initializing a second environment to recreate the dynamic application environment at a second device such that the interface events can be played back on the second environment, and performing play back of the interface events on the second device, the apparatus comprising at least a processor, and a memory associated with the processor having computer coded instructions therein, the apparatus comprising:

a dynamic application environment determination and rendering module configured for:

providing, as a function of at least profile data, environmental data, transaction data, relevance data, and implicit data derived from a combination of one or more of the profile data, environmental data, transaction data, and relevance data, the dynamic application environment; and

displaying the dynamic application environment on a dynamic application interface;

a recording module, the recording module configured for:

capturing interface event data, the interface event data being based on of user interaction with the dynamic application interface, the interface event data comprising of one or more interface events, each interface event occurring a particular time, and the particular time at which each of the one or more interface events occurred;

an initialization module, the initialization module configured for:

receiving play back device data;

receiving data indicative of the dynamic application environment;

providing data to the play back device configured for initializing a play back environment, such that the play back environment receives the interface event data and performs play back;

identifying an initial state of the dynamic application environment based on the profile data, environmental data, transaction data, relevance data, and implicit data derived from a combination of one or more of the profile data, environmental data, transaction data, and relevance data; and

providing data configured for implementing a play back state based on the initial state, the play back state configured to recreate a same computing environment on the play back device; and

a play back module, the play back module configured for:

accessing, subsequent to the capturing of the interface event data, the interface event data;

reproducing the dynamic application environment, wherein the reproduction of the dynamic application environment enables the one or more interface events that were captured to be reproduced in the dynamic application environment; and

outputting the one or more interface events in a relative time to the particular time.

2. The apparatus of claim 1 , wherein the recording module is configured for storing the interface event data; and the play back module is configured for accessing the interface event data; and extracting the one or more interface events and the particular time of occurrence.

3. The apparatus of claim 1 , wherein the time scale at which the one or more interface events are provided to the play back device is real time.

4. The apparatus of claim 1 , wherein the initialization module provides a portion of the data indicative of the dynamic application environment to the play back device, the portion of information comprising a category, sub-category, price range of a relevant promotion being provided via an impression in the dynamic application environment.

5. The apparatus of claim 1 , wherein interface events comprise one or more of text input, scrolls, swipes, clicks, presses, selections, and mouseovers.

6. The apparatus of claim 1 , wherein interface event data comprises a lack one or more of text input, scrolls, swipes, clicks, presses, selections, and mouseovers; and a time period for the lack of the text input, scrolls, swipes, clicks, presses, selections, and mouseovers.

7. The apparatus of claim 1 , wherein the play back module is configured to aid in performance of debugging by receiving input from the play back device and performing at least a pause, rewind, fast-forward, speed up, or slow-down in the transmission of the interface event data in response to the input.

8. The apparatus of claim 1 , wherein the play back module is configured to aid in performance of quality assurance or debugging by receiving input from the play back device and providing a single interface event at a time in response to the input.

9. A computer program product for providing a dynamic application environment and capturing interface events, the interface events being indicative of user interaction with the dynamic application environment, subsequently initializing a second environment to recreate the dynamic application environment at a second device such that the interface events can be played back on the second environment, and performing play back of the interface events on the second device, the computer program product comprising at least one non-transitory computer-readable storage medium having computer-executable program code instructions stored therein, the computer-executable program code instructions comprising program code instructions for:

providing, via a dynamic application environment determination and rendering module, as a function of at least profile data, environmental data, transaction data, relevance data, and implicit data derived from a combination of one or more of the profile data, environmental data, transaction data, and relevance data, the dynamic application environment;

displaying the dynamic application environment on a dynamic application interface;

capturing, via a recording module, interface event data, the interface event data being based on of user interaction with the dynamic application interface, the interface event data comprising of one or more interface events, each interface event occurring a particular time, and the particular time at which each of the one or more interface events occurred;

receiving, via an initialization module, play back device data;

receiving data indicative of the dynamic application environment;

providing data to the play back device configured for initializing a play back environment, such that the play back environment receives the interface event data and performs play back;

identifying an initial state of the dynamic application environment based on the profile data, environmental data, transaction data, relevance data, and implicit data derived from a combination of one or more of the profile data, environmental data, transaction data, and relevance data; and

providing data configured for implementing a play back state based on the initial state, the play back state configured to recreate a same computing environment on the play back device; and

accessing, via a play back module, subsequent to the capturing of the interface event data, the interface event data;

reproducing the dynamic application environment, wherein the reproduction of the dynamic application environment enables the one or more interface events that were captured to be reproduced in the dynamic application environment; and

outputting the one or more interface events in a relative time to the particular time.

10. The computer program product according to claim 9 , wherein the computer-executable program code instructions further comprise program code instructions for:

storing, via the recording module, the interface event data;

accessing, via the play back module, the interface event data; and

extracting the one or more interface events and the particular time of occurrence.

11. The computer program product according to claim 9 , wherein the time scale at which the one or more interface events are provided to the play back device is real time.

12. The computer program product according to claim 9 , wherein the computer-executable program code instructions further comprise program code instructions for: providing, via the initialization module, a portion of the data indicative of the dynamic application environment to the play back device, the portion of information comprising a category, sub-category, price range of a relevant promotion being provided via an impression in the dynamic application environment.

13. The computer program product according to claim 9 , wherein interface events comprise one or more of text input, scrolls, swipes, clicks, presses, selections, and mouseovers.

14. The computer program product according to claim 9 , wherein interface event data comprises a lack one or more of text input, scrolls, swipes, clicks, presses, selections, and mouseovers; and a time period for the lack of the text input, scrolls, swipes, clicks, presses, selections, and mouseovers.

15. The computer program product according to claim 9 , wherein the computer-executable program code instructions further comprise program code instructions for: aiding in performance of debugging by receiving, via the play back module, input from the play back device and performing at least a pause, rewind, fast-forward, speed up, or slow-down in the transmission of the interface event data in response to the input.

16. The computer program product according to claim 9 , wherein the computer-executable program code instructions further comprise program code instructions for: aiding in performance of quality assurance or debugging by receiving, via the play back module, input from the play back device and providing a single interface event at a time in response to the input.

17. A method for providing a dynamic application environment and capturing interface events, the interface events being indicative of user interaction with the dynamic application environment, subsequently initializing a second environment to recreate the dynamic application environment at a second device such that the interface events can be played back on the second environment, and performing play back of the interface events on the second device, the method comprising:

providing, via a dynamic application environment determination and rendering module, as a function of at least profile data, environmental data, transaction data, relevance data, and implicit data derived from a combination of one or more of the profile data, environmental data, transaction data, and relevance data, the dynamic application environment;

displaying the dynamic application environment on a dynamic application interface;

capturing, via a recording module, interface event data, the interface event data being based on of user interaction with the dynamic application interface, the interface event data comprising of one or more interface events, each interface event occurring a particular time, and the particular time at which each of the one or more interface events occurred;

receiving, via an initialization module, play back device data;

receiving data indicative of the dynamic application environment;

providing data to the play back device configured for initializing a play back environment, such that the play back environment receives the interface event data and performs play back;

identifying an initial state of the dynamic application environment based on the profile data, environmental data, transaction data, relevance data, and implicit data derived from a combination of one or more of the profile data, environmental data, transaction data, and relevance data; and

providing data configured for implementing a play back state based on the initial state, the play back state configured to recreate a same computing environment on the play back device;

reproducing the dynamic application environment, wherein the reproduction of the dynamic application environment enables the one or more interface events that were captured to be reproduced in the dynamic application environment; and

accessing, via a play back module, subsequent to the capturing of the interface event data, the interface event data; and

outputting the one or more interface events in a relative time to the particular time.

18. The method according to claim 17 , further comprising:

storing, via the recording module, the interface event data;

accessing, via the play back module, the interface event data; and

extracting the one or more interface events and the particular time of occurrence.

19. The method according to claim 17 , wherein the time scale at which the one or more interface events are provided to the play back device is real time.

20. The method according to claim 17 , further comprising:

providing, via the initialization module, a portion of the data indicative of the dynamic application environment to the play back device, the portion of information comprising a category, sub-category, price range of a relevant promotion being provided via an impression in the dynamic application environment.

21. The method according to claim 17 , wherein interface events comprise one or more of text input, scrolls, swipes, clicks, presses, selections, and mouseovers.

22. The method according to claim 17 , wherein interface event data comprises a lack one or more of text input, scrolls, swipes, clicks, presses, selections, and mouseovers; and a time period for the lack of the text input, scrolls, swipes, clicks, presses, selections, and mouseovers.

23. The method according to claim 17 , further comprising:

aiding in performance of debugging by receiving, via the play back module, input from the play back device and performing at least a pause, rewind, fast-forward, speed up, or slow-down in the transmission of the interface event data in response to the input.

24. The method according to claim 17 , further comprising:

aiding in performance of quality assurance or debugging by receiving, via the play back module, input from the play back device and providing a single interface event at a time in response to the input.

Assignments (5)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 12, 2024
From: GROUPON, INC.
To: BYTEDANCE INC.
Reel/Frame 068833/0811 →
RELEASE OF SECURITY INTEREST Recorded Feb 26, 2024
From: JPMORGAN CHASE BANK, N.A.
To: GROUPON, INC.; LIVINGSOCIAL, LLC (F/K/A LIVINGSOCIAL, INC.)
Reel/Frame 066676/0001 →
TERMINATION AND RELEASE OF SECURITY INTEREST IN INTELLECTUAL PROPERTY RIGHTS Recorded Feb 26, 2024
From: JPMORGAN CHASE BANK, N.A.
To: GROUPON, INC.; LIVINGSOCIAL, LLC (F/K/A LIVINGSOCIAL, INC.)
Reel/Frame 066676/0251 →
SECURITY INTEREST Recorded Jul 23, 2020
From: GROUPON, INC.; LIVINGSOCIAL, LLC
To: JPMORGAN CHASE BANK, N.A.
Reel/Frame 053294/0495 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 14, 2016
From: HYCHE, MARTIN ERIC
To: GROUPON, INC.
Reel/Frame 039742/0279 →
Continuity (1)
Provisional Application 62186826 · Jun 30, 2015